Granted Patent B2

US 11,030,789 · App. 16/792,569 · Granted Jun 8, 2021

Inventors: Jesse Chand (Los Angeles, CA); Jeremy Voss (Los Angeles, CA)

Assignee: Snap Inc.

G06T13/40G06K9/00288G06T17/20G06T19/20H04L51/10H04L65/1069H04L65/403G06F3/0482G06T2219/2016G10L15/26H04N7/157

Abstract

Claims (58)

1. A method comprising:

receiving message content associated with a communication session at a client device, the message content including, user profile data that defines a language preference, facial tracking data and audio data;

transcribing the audio data to a first text string;

determining a first language of the message content based on the language preference;

determining a second language associated with the communication session;

translating the first text string to a second text string based on the second language;

generating an avatar based on the facial tracking data; and

causing display of a presentation of the message content at the client device, the presentation of the message content comprising a display of the avatar that includes the second text string.

2. The method of claim 1 , wherein the translating the first text string to the second text string based on the second language includes accessing a user profile associated with the client device, the user profile including an identification of the second language.

3. The method of claim 1 , wherein the display of the avatar that includes the second text string comprises a text bubble, wherein the second text string is presented within the text bubble.

4. The method of claim 1 , wherein the client device is a first client device, the receiving the message content includes receiving the message content from a second client device, and the detecting the first language based on the first text string includes:

accessing a user profile associated with the second client device, the user profile including an identification of the first language.

5. The method of claim 1 , wherein the detecting the first language based on the first text string includes:

performing a comparison of the first text string against a language database; and

identifying the first language based on the comparison.

6. The method of claim 1 , wherein client device is a first client device, the receiving the message content includes receiving the message content from a second client device, and the method further comprises:

capturing image data at the second client device, the image data depicting a set of facial features; and

animating the display of the avatar at the first client device based on the set of facial features depicted by the image data.

7. The method of claim 1 , wherein the message content includes a temporal condition that defines a display period of the message content, and wherein the method further comprises:

causing display of the presentation of the message content at the client device based on the display period.

8. A system comprising:

a memory; and

at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:

receiving message content associated with a communication session at a client device, the message content including, user profile data that defines a language preference, facial tracking data and audio data;

transcribing the audio data to a first text string;

determining a first language of the message content based on the language preference;

translating the first text string to a second text string based on the second language;

generating an avatar based on the facial tracking data; and

causing display of a presentation of the message content at the client device, the presentation of the message content comprising a display of the avatar that includes the second text string.

9. The system of claim 8 , wherein the translating the first text string to the second text string based on the second language includes accessing a user profile associated with the client device, the user profile including an identification of the second language.

10. The system of claim 8 , wherein the display of the avatar that includes the second text string comprises a text bubble, wherein the second text string is presented within the text bubble.

11. The system of claim 8 , wherein the client device is a first client device, the receiving the message content includes receiving the message content from a second client device, and the detecting the first language based on the first text string includes:

accessing a user profile associated with the second client device, the user profile including an identification of the first language.

12. The system of claim 8 , wherein the detecting the first language based on the first text string includes:

performing a comparison of the first text string against a language database; and

identifying the first language based on the comparison.

13. The system of claim 8 , wherein client device is a first client device, the receiving the message content includes receiving the message content from a second client device, and the instructions cause the system to perform operations further comprising:

capturing image data at the second client device, the image data depicting a set of facial features; and

animating the display of the avatar at the first client device based on the set of facial features depicted by the image data.

14. The system of claim 8 , wherein the message content includes a temporal condition that defines a display period of the message content, and wherein the instructions cause the system to perform operations further comprising:

causing display of the presentation of the message content at the client device based on the display period.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

receiving message content associated with a communication session at a client device, the message content including, user profile data that defines a language preference, facial tracking data and audio data;

transcribing the audio data to a first text string;

determining a first language of the message content based on the language preference;

translating the first text string to a second text string based on the second language;

generating an avatar based on the facial tracking data; and

causing display of a presentation of the message content at the client device, the presentation of the message content comprising a display of the avatar that includes the second text string.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the translating the first text string to the second text string based on the second language includes accessing a user profile associated with the client device, the user profile including an identification of the second language.

17. The non-transitory machine-readable storage medium of claim 15 , wherein the display of the avatar that includes the second text string comprises a text bubble, wherein the second text string is presented within the text bubble.

18. The non-transitory machine-readable storage medium of claim 15 , wherein the client device is a first client device, the receiving the message content includes receiving the message content from a second client device, and the detecting the first language based on the first text string includes:

accessing a user profile associated with the second client device, the user profile including an identification of the first language.

19. The non-transitory machine-readable storage medium of claim 15 , wherein the detecting the first language based on the first text string includes:

performing a comparison of the first text string against a language database; and

identifying the first language based on the comparison.

20. The non-transitory machine-readable storage medium of claim 15 , wherein client device is a first client device, the receiving the message content includes receiving the message content from a second client device, and the instructions cause the machine to perform operations further comprising:

capturing image data at the second client device, the image data depicting a set of facial features; and

animating the display of the avatar at the first client device based on the set of facial features depicted by the image data.

Assignments (2)

Continuity (2)

Cited By (74)

US 1,089,291 US 12,198,398 US 12,212,614 US 12,223,672 US 12,229,901 US 12,235,991 US 12,236,512 US 12,254,577 US 12,271,536 US 12,277,632 US 12,284,146 US 12,284,698 US 12,288,273 US 12,293,433 US 12,299,775 US 12,307,564 US 12,315,495 US 12,321,577 US 12,340,453 US 12,361,934 US 12,380,722 US 12,387,444 US 12,394,154 US 12,395,456 US 12,412,347 US 12,417,562 US 12,418,504 US 12,429,953 US 12,436,598 US 12,469,273 US 12,472,435 US 12,475,621 US 12,475,658 US 12,499,483 US 12,499,638 US 12,504,866 US 12,513,098 US 12,517,626 US 12,518,437 US 12,518,738 US 12,530,847 US 12,530,852 US 12,536,751 US 12,541,930 US 12,548,267 US 12,555,274 US 12,555,310 US 12,567,102 US 12,579,204 US 12,580,784 US 12,580,980 US 12,586,562 US 12,602,842 US 12,614,354 US 12,614,359 US 12,620,188 US 12,620,216 US 12,632,890 US 12,633,073 US 12,646,266 US 12,646,268 US 12,651,292 US 12,651,409 US 12,670,674 US 12,682,508 US 12,695,929 US 12,699,802 US 12,700,187 US 12,705,875 US 12,711,538 US 12,725,332 US 12,731,342 US 12,731,343 US 12,737,973