Granted Patent B2

US 12,218,892 · App. 18/118,912 · Granted Feb 4, 2025

Inventor: Jiayu He (Toronto, CA)

Assignee: Snap Inc.

H04L51/04G06F40/205G06F40/247H04L51/10H04L51/52

Abstract

Claims (65)

1. A method, the method comprising:

receiving, by a first device, a text string inputted by a second user into chat text of a messaging client, the messaging client enabling communication between the second user of a second device and a first user of the first device; and

in response to receiving the text string inputted into the chat text, automatically by the first device:

parsing the text string into one or more text portions;

determining one or more relevant tags of a plurality of tags based on the one or more parsed text portions;

identifying a root word in an individual text portion based on the one or more relevant tags;

identifying associated children words for the identified root word, the children words being in the individual text portion;

assigning scores for the one or more parsed text portions of the text string by:

generating a first score for the identified root word; and

generating a second set of scores for the identified children words associated with the identified root word;

selecting a media overlay of a plurality of media overlays based on the one or more relevant tags and a plurality of scores, the selecting of the media overlay comprising selecting the media overlay that corresponds to the plurality of scores including (1) the first score corresponding to the identified root word, and (2) the second set of scores corresponding to the identified children words; and

displaying the selected media overlay adjacent to the text string within the chat text of the messaging client enabling the first device to send a reply message that includes the selected media overlay to the second device.

2. The method of claim 1 , wherein the selected media overlay corresponds to a predefined overlay for displaying in a predefined order.

3. The method of claim 1 , further comprising:

determining a relevancy score for each of the plurality of media overlays that includes the selected media overlay based on the individual one or more relevant tags and the generated first and second scores for each of the one or more parsed text portions; and

ordering the selected media overlay with other media overlays within the chat text based on the determined relevancy score of each of the plurality of media overlays.

4. The method of claim 3 wherein the method further includes ranking media overlays that includes the selected media overlay based on a number of relevant tags associated with each media overlay of the media overlays.

5. The method of claim 1 , further comprising:

receiving, via the chat text, user selection of the selected media overlay among other media overlays; and

providing, by the first device, for transmission of the selected media overlay to the second device.

6. The method of claim 1 , wherein the first user and the second user correspond to contacts within a messaging application running on each of the first device and the second device.

7. The method of claim 1 , wherein determining the one or more relevant tags based on the one or more parsed text portions comprises iteratively scanning through each text portion of the text string.

8. The method of claim 1 , wherein the first score is based on a specified criterion, the specified criterion is updated at specified intervals.

9. The method of claim 1 , wherein each of the one or more relevant tags have an associated score and selecting the media overlay comprises selecting the media overlay based on the associated score of the one or more relevant tags.

10. The method of claim 1 , wherein the text string comprises one or more of words, phrases, and emoji.

11. The method of claim 1 , wherein the one or more parsed text portions comprise one or more words; and

determining one or both of a synonym and an antonym of at least one of the one or more words, wherein determining the one or more relevant tags comprises determining the one or more relevant tags based on one or both of the synonym and the antonym.

12. The method of claim 1 , wherein the first score for the identified root word and the second set of scores for the identified children words each correspond to an emotion of individual words, the emotion reflecting a mood of the second user, the selected media overlay being selected based on the first score and the second set of scores corresponding to individual emotions.

13. The method of claim 12 , wherein at least one of the first score for the identified root word or the second set of scores for the identified children words correspond to an amount of the emotion of the second user, the selected media overlay being selected based on the amount of the emotion.

14. The method of claim 1 , wherein the operations further comprise:

selecting a set of media overlays by randomly selecting the set of media overlays from the plurality of media overlays, wherein selecting the media overlay of the plurality of media overlays comprises selecting the media overlay of the set of media overlays.

15. A computing apparatus, comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, configure the computing apparatus to perform one or more operations comprising:

receiving a text string inputted by a second user into chat text of a messaging client, the messaging client enabling communication between the second user of a second device and a first user of the computing apparatus; and

in response to receiving the text string inputted into the chat text, automatically:

parsing the text string into one or more text portions;

determining one or more relevant tags of a plurality of tags based on the one or more parsed text portions;

identifying a root word in an individual text portion based on the one or more relevant tags;

identifying associated children words for the identified root word, the children words being in the individual text portion;

assigning scores for the one or more parsed text portions of the text string by:

generating a first score for the identified root word; and

generating a second set of scores for the identified children words associated with the identified root word;

selecting a media overlay of a plurality of media overlays based on the one or more relevant tags and a plurality of scores, the selecting of the media overlay comprising selecting the media overlay that corresponds to the plurality of scores including (1) the first score corresponding to the identified root word, and (2) the second set of scores corresponding to the identified children words; and

displaying the selected media overlay adjacent to the text string within the chat text of the messaging client enabling sending of a reply message that includes the selected media overlay to the second device.

16. The computing apparatus of claim 15 , wherein the selected media overlay corresponds to a predefined overlay for displaying in a predefined order.

17. The computing apparatus of claim 15 , wherein the computing apparatus is further configured to:

determining a relevancy score for each of the plurality of media overlays that includes the selected media overlay based on the individual one or more relevant tags and the generated first and second scores for each of the one or more parsed text portions; and

ordering the selected media overlay with other media overlays within the chat text based on the determined relevancy score of each of the plurality of media overlays.

18. The computing apparatus of claim 17 , wherein the computing apparatus is further configured to ranking media overlays that includes the selected media overlay based on a number of relevant tags associated with each media overlay of the media overlays.

19. The computing apparatus of claim 15 , wherein the computing apparatus is further configured to:

receiving, via the chat text, user selection of the selected media overlay among other media overlays; and

providing the selected media overlay to the second device.

20. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform one or more operations comprising:

receiving a text string inputted by a second user into chat text of a messaging client, the messaging client enabling communication between the second user of a second device and a first user of the computer; and

in response to receiving the text string inputted into the chat text, automatically:

parsing the text string into one or more text portions;

determining one or more relevant tags of a plurality of tags based on the one or more parsed text portions;

identifying a root word in an individual text portion based on the one or more relevant tags;

identifying associated children words for the identified root word, the children words being in the individual text portion;

assigning scores for the one or more parsed text portions of the text string by:

generating a first score for the identified root word; and

generating a second set of scores for the identified children words associated with the identified root word;

selecting a media overlay of a plurality of media overlays based on the one or more relevant tags and a plurality of scores, the selecting of the media overlay comprising selecting the media overlay that corresponds to the plurality of scores including (1) the first score corresponding to the identified root word, and (2) the second set of scores corresponding to the identified children words; and

displaying the selected media overlay adjacent to the text string within the chat text of the messaging client enabling sending of a reply message that includes the selected media overlay to the second device.

Assignments (1)

Continuity (2)

References Cited (18)