IP Library › Granted Patent US 12,341,738
Granted Patent B2
US 12,341,738 · App. 18/205,319 · Granted Jun 24, 2025

Contextual reply augmentation system

Inventors: Christie Marie Heikkinen (Sherman Oaks, CA); David Phillip Taitz (Los Angeles, CA); Jeremy Baker Voss (Los Angeles, CA)
Assignee: Snap Inc.
H04L51/18G06F3/04817G06F3/0482
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,341,738
App. No.
18/205,319
Filed
Jun 2, 2023
Granted
Jun 24, 2025
Kind
B2
Art Unit
2171
USPC
715/753
Abstract

Methods and systems are disclosed that access relationship data of a first user of an interaction system to identify a second user of the interaction system associated with the first user, cause presentation of identification information for the second user within an interaction interface and, responsive to identifying an event pertaining to the second user, cause presentation of a call-to-action graphical element associated with identification information of the second user within the interaction interface. Responsive to detecting user selection of the call-to-action graphical element, the methods and systems invoke an interaction function to facilitate an interaction between the first user and the second user. The interaction function includes at least one of a communication function enabling the first user to communicate digital content to the second user using the interaction system, and an augmentation function enabling the first user to augment the digital content using an augmentation graphical feature.

Claims (64)

1. A method using at least one processor, the method comprising:

accessing relationship data related to a first user of an interaction system to identify a second user of the interaction system associated with the first user;

causing presentation, within an interaction interface, of identification information for the second user of the interaction system;

identifying an event pertaining to the second user of the interaction system, the identifying of the event comprising:

accessing a first set of events, each event of the first set of events being associated with event logic and a priority value;

determining a second set of events corresponding to a subset of the first set of events, the event logic for each event in the second set of events matching user data of the second user; and

selecting the event from the second set of events based on its associated priority value; and

responsive to identifying the event pertaining to the second user of the interaction system:

causing presentation of a call-to-action graphical element in association with identification information of the second user within the interaction interface;

detecting user selection of the call-to-action graphical element within the interaction interface; and

responsive to detecting the user selection of the call-to-action graphical element, invoking an interaction function to facilitate an interaction between the first user and the second user, the interaction function comprising at least one of:

a communication function to enable the first user to communicate digital content to the second user, using the interaction system, and

an augmentation function to enable the first user to augment the digital content using an augmentation graphical feature.

2. The method of claim 1 , wherein the augmentation graphical feature corresponds to an event type of the event pertaining to the second user.

3. The method of claim 2 , wherein the event type of the event pertaining to the second user is a birthday event type, and the augmentation graphical feature is a birthday celebration graphical element.

4. The method of claim 1 , wherein:

the second user is one of a set of users of the interaction system, each user in the set of users of the interaction system being associated with the first user based on at least one of a recorded bidirectional relationship or a recorded unidirectional relationship; and

the method further comprises causing presentation of identification information for each user of the set of users of the interaction system, the presentation of the identification information being within the interaction interface.

5. The method of claim 1 , wherein the identification information for the second user comprises a user name and an avatar.

6. The method of claim 1 , wherein the event pertaining to the second user comprises creation of a recorded relationship between the first user and the second user.

7. The method of claim 1 , wherein the user data of the second user of the interaction system is at least one of user profile data or user message data.

8. The method of claim 1 , further comprising applying a machine learning model to the user data of the second user to determine one or more characteristics of the user data, and wherein determining the second set of events further comprises applying the event logic for each event in the first set of events to the one or more characteristics of the user data.

9. The method of claim 1 , wherein the communication function is a reply camera function to enable the first user to capture at least one of a digital image or a digital video for communication to the second user, using the interaction system.

10. A computing apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed by the at least one processor, configure the computing apparatus to perform operations comprising:

accessing relationship data related to a first user of an interaction system to identify a second user of the interaction system associated with the first user;

causing presentation, within an interaction interface, of identification information for the second user of the interaction system;

identifying an event pertaining to the second user of the interaction system, the identifying of the event comprising:

accessing a first set of events, each event of the first set of events being associated with event logic and a priority value;

determining a second set of events corresponding to a subset of the first set of events, the event logic for each event in the second set of events matching user data of the second user; and

selecting the event from the second set of events based on its associated priority value; and

responsive to identifying the event pertaining to the second user of the interaction system:

causing presentation of a call-to-action graphical element in association with identification information of the second user within the interaction interface;

detecting user selection of the call-to-action graphical element within the interaction interface; and

responsive to detecting the user selection of the call-to-action graphical element, invoking an interaction function to facilitate an interaction between the first user and the second user, the interaction function comprising at least one of:

a communication function to enable the first user to communicate digital content to the second user, using the interaction system, and

an augmentation function to enable the first user to augment the digital content using an augmentation graphical feature.

11. The computing apparatus of claim 10 , wherein the augmentation graphical feature corresponds to an event type of the event pertaining to the second user.

12. The computing apparatus of claim 11 , wherein the event type of the event pertaining to the second user is a birthday event type, and the augmentation graphical feature is a birthday celebration graphical element.

13. The computing apparatus of claim 10 , wherein

the second user is one of a set of users of the interaction system, each user in the set of users of the interaction system being associated with the first user based on at least one of a recorded bidirectional relationship or a recorded unidirectional relationship; and

the operations further comprise causing presentation of identification information for each user of the set of users of the interaction system, the presentation of the identification information being within the interaction interface.

14. The computing apparatus of claim 10 , wherein the identification information for the second user comprises a user name and an avatar.

15. The computing apparatus of claim 10 , wherein the event pertaining to the second user comprises creation of a recorded relationship between the first user and the second user.

16. The computing apparatus of claim 10 , wherein the user data of the second user is at least one of user profile data or user message data.

17. The computing apparatus of claim 10 , wherein the operations further comprise:

applying a machine learning model to the user data to determine one or more characteristics of the user data of the second user, and wherein determining the second set of events further comprises applying the event logic for each event in the first set of events to the one or more characteristics of the user data.

18. The computing apparatus of claim 10 , wherein the communication function is a reply camera function to enable the first user to capture at least one of a digital image or a digital video for communication to the second user, using the interaction system.

19. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

accessing relationship data related to a first user of an interaction system to identify a second user of the interaction system associated with the first user;

causing presentation, within an interaction interface, of identification information for the second user of the interaction system;

identifying an event pertaining to the second user of the interaction system, the identifying of the event comprising:

accessing a first set of events, each event of the first set of events being associated with event logic and a priority value;

determining a second set of events corresponding to a subset of the first set of events, the event logic for each event in the second set of events matching user data of the second user; and

selecting the event from the second set of events based on its associated priority value; and

responsive to identifying the event pertaining to the second user of the interaction system:

causing presentation of a call-to-action graphical element in association with identification information of the second user within the interaction interface;

detecting user selection of the call-to-action graphical element within the interaction interface; and

responsive to detecting the user selection of the call-to-action graphical element,

invoking an interaction function to facilitate an interaction between the first user and the second user, the interaction function comprising at least one of:

a communication function to enable the first user to communicate digital content to the second user, using the interaction system, and

an augmentation function to enable the first user to augment the digital content using an augmentation graphical feature.

20. The method of claim 1 , wherein selecting the event from the second set of events further comprises determining a maximum priority value of a set of priority values associated with the second set of events, and selecting the respective event of the second set of events associated with the maximum priority value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2024
From: HEIKKINEN, CHRISTIE MARIE; TAITZ, DAVID PHILLIP; VOSS, JEREMY BAKER
To: SNAP INC.
Reel/Frame 066119/0947 →
Continuity (2)
Provisional Application 63348305 · Jun 2, 2022
Related Publication 20230396572A1 · Dec 7, 2023
References Cited (97)
US 6871006B1 · Oguz et al. · 2005 [cited by applicant]
US 7362946B1 · Kowald · 2008 [cited by applicant]
US 9396354B1 · Murphy et al. · 2016 [cited by applicant]
US 9482882B1 · Hanover et al. · 2016 [cited by applicant]
US 9482883B1 · Meisenholder · 2016 [cited by applicant]
US 9838730B1 · Matias · 2017 [cited by applicant]
US 10178365B1 · Singh et al. · 2019 [cited by applicant]
US 10348662B2 · Baldwin et al. · 2019 [cited by applicant]
US 10348960B1 · Sehn · 2019 [cited by applicant]
US 10354425B2 · Yan et al. · 2019 [cited by applicant]
US 10380394B1 · Boyd et al. · 2019 [cited by applicant]
US 10540575B1 · Brody · 2020 [cited by applicant]
US 10580458B2 · Sehn · 2020 [cited by applicant]
US 10623891B2 · Sehn et al. · 2020 [cited by applicant]
US 10638256B1 · Suiter · 2020 [cited by applicant]
US 10691967B2 · Zak et al. · 2020 [cited by applicant]
US 10754525B1 · Al Majid et al. · 2020 [cited by applicant]
US 10783927B1 · Davis · 2020 [cited by applicant]
US 10805696B1 · Suiter et al. · 2020 [cited by applicant]
US 10839219B1 · Suiter et al. · 2020 [cited by applicant]
US 10893055B2 · Allen et al. · 2021 [cited by applicant]
US 10956793B1 · Wang et al. · 2021 [cited by applicant]
US 10984547B2 · Ezra et al. · 2021 [cited by applicant]
US 10990697B2 · Murphy et al. · 2021 [cited by applicant]
US 10997758B1 · Yan et al. · 2021 [cited by applicant]
US 11044393B1 · Suiter et al. · 2021 [cited by applicant]
US 11099643B1 · Miller et al. · 2021 [cited by applicant]
US 11128715B1 · Al Majid et al. · 2021 [cited by applicant]
US 11153665B2 · Beck et al. · 2021 [cited by applicant]
US 11157558B2 · Beck et al. · 2021 [cited by applicant]
US 11201981B1 · Suiter et al. · 2021 [cited by applicant]
US 11216869B2 · Allen et al. · 2022 [cited by applicant]
US 11227637B1 · Collins et al. · 2022 [cited by applicant]
US 11297399B1 · Tang · 2022 [cited by applicant]
US 11301960B2 · Chang et al. · 2022 [cited by applicant]
US 11308653B2 · Yoon et al. · 2022 [cited by applicant]
US 11349796B2 · Tang · 2022 [cited by applicant]
US 11372608B2 · Sehn · 2022 [cited by applicant]
US 11388226B1 · Anderton et al. · 2022 [cited by applicant]
US 11496544B2 · Pavlovskaia et al. · 2022 [cited by applicant]
US 11563886B2 · Bartow et al. · 2023 [cited by applicant]
US 20030160944A1 · Foote et al. · 2003 [cited by applicant]
US 20050187912A1 · Matsa et al. · 2005 [cited by applicant]
US 20050286519A1 · Ravikumar et al. · 2005 [cited by applicant]
US 20060271696A1 · Chen et al. · 2006 [cited by applicant]
US 20070280452A1 · Bernard · 2007 [cited by applicant]
US 20080016114A1 · Beauregard et al. · 2008 [cited by applicant]
US 20080045176A1 · Ho et al. · 2008 [cited by applicant]
US 20080092168A1 · Logan et al. · 2008 [cited by applicant]
US 20100183280A1 · Beauregard et al. · 2010 [cited by applicant]
US 20120278710A1 · Berger et al. · 2012 [cited by applicant]
US 20130042169A1 · Reedy · 2013 [cited by applicant]
US 20130077937A1 · Kennedy et al. · 2013 [cited by applicant]
US 20150160916A1 · Lothian · 2015 [cited by applicant]
US 20150279427A1 · Godfrey et al. · 2015 [cited by applicant]
US 20160196052A1 · Franklin et al. · 2016 [cited by applicant]
US 20170357382A1 · Miura et al. · 2017 [cited by applicant]
US 20180026925A1 · Kennedy · 2018 [cited by applicant]
US 20180089904A1 · Jurgenson et al. · 2018 [cited by applicant]
US 20180188899A1 · Nigam · 2018 [cited by examiner]
US 20180191797A1 · Javier et al. · 2018 [cited by applicant]
US 20180348966A1 · Scoville · 2018 [cited by examiner]
US 20180357634A1 · Shin · 2018 [cited by examiner]
US 20190012765A1 · Egri et al. · 2019 [cited by applicant]
US 20190140990A1 · Rabbat et al. · 2019 [cited by applicant]
US 20190392866A1 · Yoon et al. · 2019 [cited by applicant]
US 20200004829A1 · Denton · 2020 [cited by examiner]
US 20200201969A1 · Jo et al. · 2020 [cited by applicant]
US 20200320767A1 · Al Majid et al. · 2020 [cited by applicant]
US 20200353366A1 · Titus · 2020 [cited by applicant]
US 20200366395A1 · Brenner et al. · 2020 [cited by applicant]
US 20200409729A1 · Al Majid · 2020 [cited by applicant]
US 20200412864A1 · Al Majid et al. · 2020 [cited by applicant]
US 20210014238A1 · Allen et al. · 2021 [cited by applicant]
US 20210136521A1 · Al Majid et al. · 2021 [cited by applicant]
US 20210144422A1 · Wagner et al. · 2021 [cited by applicant]
US 20210304469A1 · Heikkinen et al. · 2021 [cited by applicant]
US 20210336916A1 · Boyd et al. · 2021 [cited by applicant]
US 20220086340A1 · Ebsen et al. · 2022 [cited by applicant]
US 20220319552A1 · Collins et al. · 2022 [cited by applicant]
US 20220375137A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220406008A1 · Jurgenson et al. · 2022 [cited by applicant]
US 20230004278A1 · Anvaripour et al. · 2023 [cited by applicant]
US 20230344953A1 · Anvaripour et al. · 2023 [cited by applicant]
US 20240397156A1 · Belosludtcev et al. · 2024 [cited by applicant]
AU 2017100670A4 · 2017 [cited by applicant]
CN 101808152B · 2012 [cited by applicant]
CN 119301554A · 2025 [cited by applicant]
EP 1587111A1 · 2005 [cited by applicant]
JP 2003141038A · 2003 [cited by applicant]
WO WO2022072689A1 · 2022 [cited by applicant]
WO WO2022212127A1 · 2022 [cited by applicant]
WO WO2023235584A1 · 2023 [cited by applicant]
“International Application Serial No. PCT/US2023/024315, International Search Report mailed Sep. 19, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/024315, Written Opinion mailed Sep. 19, 2023”, 4 pgs. [cited by applicant]
“U.S. Appl. No. 18/322,397, Notice of Allowance mailed Jan. 13, 2025”, 11 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/024315, International Preliminary Report on Patentability mailed Dec. 12, 2024”, 6 pgs. [cited by applicant]