IP Library Granted Patent US 10,938,758
Granted Patent B2
US 10,938,758 · App. 15/369,499 · Granted Mar 2, 2021

Generating and displaying customized avatars in media overlays

Inventors: Nicholas Richard Allen (Venice, CA); Dorian Franklin Baldwin (Toronto, CA); Jacob Edward Blackstock (Toronto, CA); David James Kennedy (Toronto, CA); Shahan Panth (Toronto, CA); Timothy Jordan Garcia (Toronto, CA)
Assignee: Snap Inc.
H04L51/08G06F3/0484G06K9/00751G06T13/80H04L51/063H04L67/18H04W4/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,938,758
App. No.
15/369,499
Granted
Mar 2, 2021
Kind
B2
Abstract

Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by generating and displaying media overlays with avatars of different users. For example, media overlays can be generated by the system and displayed in conjunction with media content (e.g., images and/or video) generated by an image-capturing device (e.g., a digital camera).

Claims (56)

1. A system comprising:

a processor;

a user interface coupled to the processor, the user interface comprising an input device and a display screen; and

memory coupled to the processor and storing instructions that, when executed by the processor, cause the processor to perform operations comprising:

receiving a media content item;

generating a plurality of media overlays that each comprise an avatar of a user, wherein the avatar of the user is a visual representation of the user, wherein an appearance of the avatar of the user is generated to reflect themes of the plurality of media overlays, wherein the appearance of the avatar of the user is different in each of the media overlays;

causing a plurality of selectable items associated with the plurality of media overlays to be displayed on the display screen, wherein the selectable items are included in a gallery or carrousel;

receiving a selection, via the input device, of a first selectable item included in the plurality of selectable items, wherein the first selectable item corresponds to a first media overlay included in the plurality of media overlays;

in response to receiving the selection, generating a modified media content item by incorporating the first media overlay including the avatar of the user with the media content item, wherein incorporating the first media overlay with the media content item comprises overlaying the first media overlay on the media content item; and

causing the modified media content item to be displayed on the display screen.

2. The system of claim 1 , wherein the media content item is an image or a video.

3. The system of claim 1 , wherein the system further comprises:

an image capturing device, and wherein the media content item is received from the image capturing device.

4. The system of claim 1 , wherein the media content item is received from a computing device over a network.

5. The system of claim 1 , wherein generating the plurality of media overlays is further based on at least one of: location information, an event, a time of day, or a date, and wherein the appearance of the avatar of the user in each of the media overlays is modified based on at least one of the location information, the event, the time of day, or the date.

6. The system of claim 5 , wherein generating the plurality of media overlays based on the time of day includes identifying time information or time zone information from a clock operating on the system.

7. The system of claim 5 , wherein generating the plurality of media overlays based on the location information includes identifying a location from a location sensor coupled to the processor.

8. The system of claim 1 , wherein generating the plurality of media overlays includes modifying a setting of the media overlay or modifying the avatar of the user.

9. The system of claim 1 , wherein generating the plurality of media overlays includes providing access to the media overlays by the user for a predetermined time period.

10. The system of claim 1 , wherein the operations further comprise:

retrieving sensor information from a sensor component coupled with the processor, and wherein generating the plurality of media overlays is further based on the sensor information.

11. The system of claim 10 , wherein the sensor component includes at least one of: a temperature sensor, a velocity sensor, an acceleration sensor, and an altitude sensor.

12. The system of claim 1 , wherein the operations further comprise:

receiving a selection of a second media overlay from the plurality of media overlays from the input device, and

wherein generating the modified media content item includes overlaying the first media overlay and the second media overlay on the media content item.

13. The system of claim 1 , wherein the operations further comprise:

in response to the selection of the first selectable item corresponding to the first media overlay, removing a second media overlay from the plurality of media overlays displayed to the user via the display screen of the user interface.

14. The system of claim 1 , wherein the operations further comprise:

storing a history of media content items with applied media overlays in a database in communication with the system.

15. The system of claim 14 , wherein the operations further comprise:

retrieving the history of media content items with applied media overlays from the database; and

causing the history of media content items to be displayed on the display screen of the user interface.

16. The system of claim 15 , wherein the first media content item displayed in the history of media content items has a media content overlay with a previous version of the user's avatar, and wherein displaying the history of media content items includes displaying the first media content item with a current version of the user's avatar.

17. The system of claim 1 , wherein the operations further comprise:

generating text for each of the plurality of media overlays, wherein each of the media overlays includes the generated text.

18. The system of claim 17 , wherein generating the text for each of the media overlays includes:

identifying a location based on information from a location sensor coupled to the processor;

identifying a language associated with the location; and

generating the text in the media overlays in the identified language.

19. The system of claim 1 , wherein generating the media overlay includes:

transmitting, to a server over a network, a request for the plurality of media overlays, the request including avatar characteristics associated with the user; and

receiving, from the server over the network, the plurality of media overlays each comprising the avatar of the user.

20. A computer-implemented method comprising:

receiving, by a processor, a media content item;

generating, by the processor, a plurality of media overlays that each comprises an avatar of the user, wherein the avatar of the user is a visual representation of the user, wherein an appearance of the avatar of the user is generated to reflect themes of the plurality of media overlays, wherein the appearance of the avatar of the user is different in each of the media overlays;

causing, by the processor, a plurality of selectable items associated with the plurality of media overlays to be displayed on the display screen, wherein the selectable items are included in a gallery or carrousel;

receiving a selection, by the processor from the input device, of a first selectable item included in the plurality of selectable items, wherein the first selectable item corresponds to a first media overlay included in the plurality of media overlays;

in response to receiving the selection, generating, by the processor, a modified media content item by incorporating the first media overlay including the avatar of the user with the media content item, wherein incorporating the first media overlay with the media content item comprises overlaying the first media overlay on the media content item; and

causing, by the processor, the modified media content item to be displayed on a display screen of a user interface.

21. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving a media content item;

generating a plurality of media overlays that each comprise an avatar of a user, wherein the avatar of the user is a visual representation of the user, wherein an appearance of the avatar of the user is generated to reflect themes of the plurality of media overlays, wherein the appearance of the avatar of the user is different in each of the media overlays;

causing a plurality of selectable items associated with the plurality of media overlays to be displayed on the display screen, wherein the selectable items are included in a gallery or carrousel;

receiving a selection, via the input device, of a first selectable item included in the plurality of selectable items, wherein the first selectable item corresponds to a first media overlay included in the plurality of media overlays;

in response to receiving the selection, generating a modified media content item by incorporating the first media overlay including the avatar of the user with the media content item, wherein incorporating the first media overlay with the media content item comprises overlaying the first media overlay on the media content item; and

causing the modified media content item to be displayed on a display screen of a user interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2021
From: ALLEN, NICHOLAS RICHARD; BALDWIN, DORIAN FRANKLIN; BLACKSTOCK, JACOB EDWARD; KENNEDY, DAVID JAMES; PANTH, SHAHAN; GARCIA, TIMOTHY JORDAN
To: SNAP INC.
Reel/Frame 055019/0504 →
Continuity (2)
Provisional Application 62412115 · Oct 24, 2016
Related Publication 20180113587A1 · Apr 26, 2018
Cited By (90)
US 1,089,291 US 12,192,617 US 12,198,398 US 12,206,635 US 12,223,156 US 12,223,672 US 12,229,901 US 12,235,991 US 12,236,512 US 12,254,577 US 12,271,536 US 12,277,632 US 12,284,146 US 12,284,698 US 12,288,273 US 12,293,433 US 12,299,775 US 12,307,564 US 12,314,553 US 12,315,495 US 12,316,589 US 12,321,577 US 12,340,064 US 12,340,453 US 12,361,934 US 12,363,056 US 12,387,444 US 12,394,077 US 12,394,154 US 12,395,456 US 12,401,889 US 12,406,416 US 12,412,347 US 12,417,562 US 12,418,504 US 12,429,953 US 12,436,598 US 12,450,854 US 12,469,273 US 12,472,435 US 12,475,621 US 12,475,658 US 12,495,204 US 12,499,483 US 12,499,638 US 12,504,866 US 12,513,098 US 12,517,626 US 12,518,437 US 12,518,738 US 12,520,101 US 12,524,128 US 12,530,847 US 12,530,852 US 12,536,751 US 12,541,930 US 12,548,267 US 12,555,274 US 12,555,310 US 12,567,102 US 12,579,204 US 12,580,784 US 12,580,980 US 12,586,562 US 12,602,842 US 12,614,354 US 12,614,359 US 12,616,903 US 12,620,188 US 12,620,216 US 12,632,890 US 12,633,073 US 12,646,266 US 12,646,268 US 12,647,673 US 12,651,292 US 12,651,409 US 12,659,569 US 12,670,674 US 12,682,508 US 12,695,929 US 12,699,802 US 12,700,187 US 12,701,334 US 12,705,875 US 12,711,538 US 12,725,332 US 12,731,342 US 12,731,343 US 12,737,973