Granted Patent B2

US 12,361,475 · App. 17/488,011 · Granted Jul 15, 2025

Inventors: Serhii Dehtiarov (Kyiv, UA); Yuliia Khoryshko (Kyiv, UA); Jean Luo (Seattle, WA); Bogdan Maksymchuk (Los Angeles, CA); Vincent Sung (Los Angeles, CA); Evelina Yatselenko (Kyiv, UA)

Assignee: SNAP INC.

G06Q30/0643G06F3/0482G06Q30/0633G06T17/20G06T19/006G06V40/16

Abstract

Claims (72)

1. A method, comprising:

receiving, by a messaging application running on a device of a user, a request to present augmented reality content in association with live video captured by a device camera, the live video depicting a face of the user;

accessing, in response to receiving the request, an augmented reality content item configured to generate a plurality of completed looks with respect to applying makeup to the face;

displaying, based on accessing the augmented reality content item, a tile view of the plurality of completed looks, each tile within the tile view depicting an overlay on the face of the user depicted in the live video, each overlay corresponding to real-time application of makeup for a respective completed look of the plurality of completed looks,

wherein the tile view includes a first user-selectable element for generating a media content item which includes the tile view;

receiving user input selecting a first tile within the tile view, the first tile corresponding to a first completed look of the plurality of completed looks; and

switching, in response to receiving the user input, away from display of the tile view and to a single view, the single view including a set of makeup products associated with the first completed look,

wherein the single view includes a second user-selectable element for generating a media content item which includes the single view, and

wherein the tile view includes a third user-selectable element for switching between a rear-facing camera and a front-facing camera with respect to each tile in the tile view, and a fourth user-selectable element for activating or deactivating a flash with respect to each tile in the tile view.

2. The method of claim 1 , wherein each completed look of the plurality of completed looks is associated with applying makeup to plural regions of the face, and

wherein each makeup product within the set of makeup products is user-selectable for applying to one of the plural regions of the face.

3. The method of claim 2 , further comprising:

receiving, via the single view, second user input selecting a makeup product from among the set of makeup products;

receiving, via the single view, third user input corresponding to application of the selected makeup product, for updating display of the face with respect to the completed look for the selected makeup product; and

updating display of the face based on the third user input.

4. The method of claim 3 , wherein the augmented reality content item is configured to generate a mesh for tracking the plural regions of the face.

5. The method of claim 4 , wherein updating display of the face comprises:

determining a region of the plural regions corresponding to the third user input; and

displaying an overlay corresponding to the selected makeup product with respect to the determined region, such that the selected makeup product is depicted as being applied to the determined region of the face.

6. The method of claim 1 , further comprising:

receiving, via the single view, second user input selecting a makeup product from among the set of makeup products;

receiving, via the single view, third user input to add the selected makeup product to a shopping cart associated with a user account of the user; and

providing, in response to receiving the third user input, for updating the shopping cart with the selected makeup product.

7. The method of claim 1 , further comprising:

displaying, by the messaging application, a carousel interface for selecting the augmented reality content item from among plural augmented reality content items; and

receiving, via the carousel interface, user selection of the augmented reality content item from among the plural augmented reality content items,

wherein the request corresponds to the user selection.

8. The method of claim 1 , wherein the single view includes a fifth user-selectable elements for switching between the rear-facing camera and the front-facing camera with respect to the single view, and a sixth user-selectable element for activating or deactivating the flash with respect to the single view.

9. A device comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, configure the at least one processor to perform operations comprising:

receiving, by a messaging application running on the device of a user, a request to present augmented reality content in association with live video captured by a device camera, the live video depicting a face of the user;

accessing, in response to receiving the request, an augmented reality content item configured to generate a plurality of completed looks with respect to applying makeup to the face;

displaying, based on accessing the augmented reality content item, a tile view of the plurality of completed looks, each tile within the tile view depicting an overlay on the face of the user depicted in the live video, each overlay corresponding to real-time application of makeup for a respective completed look of the plurality of completed looks,

wherein the tile view includes a first user-selectable element for generating a media content item which includes the tile view;

receiving user input selecting a first tile within the tile view, the first tile corresponding to a first completed look of the plurality of completed looks; and

switching, in response to receiving the user input, away from display of the tile view and to a single view, the single view including a set of makeup products associated with the first completed look,

wherein the single view includes a second user-selectable element for generating a media content item which includes the single view, and

wherein the tile view includes a third user-selectable element for switching between a rear-facing camera and a front-facing camera with respect to each tile in the tile view, and a fourth user-selectable element for activating or deactivating a flash with respect to each tile in the tile view.

10. The device of claim 9 , wherein each completed look of the plurality of completed looks is associated with applying makeup to plural regions of the face, and

wherein each makeup product within the set of makeup products is user-selectable for applying to one of the plural regions of the face.

11. The device of claim 10 , the operations further comprising:

receiving, via the single view, second user input selecting a makeup product from among the set of makeup products;

receiving, via the single view, third user input corresponding to application of the selected makeup product, for updating display of the face with respect to the completed look for the selected makeup product; and

updating display of the face based on the third user input.

12. The device of claim 11 , wherein the augmented reality content item is configured to generate a mesh for tracking the plural regions of the face.

13. The device of claim 12 , the operations further comprising:

determining a region of the plural regions corresponding to the third user input, and

displaying an overlay corresponding to the selected makeup product with respect to the determined region, such that the selected makeup product is depicted as being applied to the determined region of the face.

14. The device of claim 9 , the operations further comprising:

receiving, via the single view, second user input selecting a makeup product from among the set of makeup products;

receiving, via the single view, third user input to add the selected makeup product to a shopping cart associated with a user account of the user; and

providing, in response to receiving the third user input, for updating the shopping cart with the selected makeup product.

15. The device of claim 9 , the operations further comprising:

displaying, by the messaging application, a carousel interface for selecting the augmented reality content item from among plural augmented reality content items; and

receiving, via the carousel interface, user selection of the augmented reality content item from among the plural augmented reality content items,

wherein the request corresponds to the user selection.

16. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

receiving, by a messaging application running on a device of a user, a request to present augmented reality content in association with live video captured by a device camera, the live video depicting a face of a user;

accessing, in response to receiving the request, an augmented reality content item configured to generate a plurality of completed looks with respect to applying makeup to the face;

displaying, based on accessing the augmented reality content item, a tile view of the plurality of completed looks, each tile within the tile view depicting an overlay on the face of the user depicted in the live video, each overlay corresponding to real-time application of makeup for a respective completed look of the plurality of completed looks,

wherein the tile view includes a first user-selectable element for generating a media content item which includes the tile view;

receiving user input selecting a first tile within the tile view, the first tile corresponding to a first completed look of the plurality of completed looks; and

switching, in response to receiving the user input, away from display of the tile view and to a single view, the single view including a set of makeup products associated with the first completed look,

wherein the single view includes a second user-selectable element for generating a media content item which includes the single view, and

wherein the tile view includes a third user-selectable element for switching between a rear-facing camera and a front-facing camera with respect to each tile in the tile view, and a fourth user-selectable element for activating or deactivating a flash with respect to each tile in the tile view.

17. The computer-readable storage medium of claim 16 , wherein each makeup product within the set of makeup products is user-selectable for applying with respect to the face depicted in the live video.

18. The computer-readable storage medium of claim 17 , wherein the instructions further configure the computer to:

receive, via the single view, second user input selecting a makeup product from among the set of makeup products;

receive, via the single view, third user input corresponding to application of the selected makeup, for updating display of the face with respect to the completed look for the selected makeup product; and

update display of the face based on the third user input.

19. The computer-readable storage medium of claim 18 , wherein the augmented reality content item is configured to generate a mesh for tracking plural regions of the face.

Assignments (1)

Continuity (2)

References Cited (121)

Cited By (1)

US 12,548,069