IP Library › Granted Patent US 11,776,264
Granted Patent B2
US 11,776,264 · App. 17/820,661 · Granted Oct 3, 2023

Adding beauty products to augmented reality tutorials

Inventors: Christine Barron (Los Angeles, CA); Virginia Drummond (Venice, CA); Jean Luo (Seattle, WA); Alek Matthiessen (Marina Del Rey, CA); Celia Nicole Mourkogiannis (Los Angeles, CA); Jonathan Solichin (Arcadia, CA); Olesia Voronova (Santa Monica, CA)
Assignee: Snap Inc.
G06V20/41G06F16/7335G06K7/10118G06Q30/0627G06T19/006G06V20/46A61Q1/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,776,264
App. No.
17/820,661
Filed
Aug 18, 2022
Granted
Oct 3, 2023
Kind
B2
Art Unit
2616
USPC
345/633
Abstract

Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Claims (63)

1. A method, comprising:

accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter;

processing the video data, using at least one processor, to identify changes to the body part of the presenter from an application of the beauty product;

receiving input from the presenter that identifies the beauty product applied to the body part; and

associating the changes to the body part of the presenter with the beauty product.

2. The method of claim 1 further comprising:

storing, within a data store, association data associating the beauty product with the changes to the body part.

3. The method of claim 1 , wherein the changes to the body part of the presenter comprise a color change of the body part or a change of texture of the body part.

4. The method of claim 1 further comprising:

retrieving information regarding the beauty product;

causing presentation of information regarding the beauty product on a display device; and

storing, within a data store, association data associating the beauty product with the tutorial.

5. The method of claim 4 , wherein the information regarding the beauty product comprises one or more of:

a name of the beauty product, the body part associated with the beauty product, a manufacturer of the beauty product, a website associated with the beauty product, an image of the beauty product, a product code of the beauty product, and an indication of ratings of the beauty product.

6. The method of claim 1 wherein the video data is live video data.

7. The method of claim 1 further comprising:

determining effects indicating changes to make to a second video data of a user to simulate applying the beauty product to the body part of the user, wherein the effects are determined based on the changes to the body part of the presenter; and

storing, within the data store, second association data associating the effects with the beauty product and the tutorial.

8. The method of claim 7 , wherein the changes to the body part of the presenter comprise one or more of:

a color, a texture, a transparency, a width, a length, a skin type for the body part, and a hair type of the body part.

9. The method of claim 1 wherein receiving input from the presenter that identifies the beauty product applied to the body part further comprises:

recording the video data using a computing device;

during the recording of the video data, receiving input from the presenter that identifies the beauty product applied to the body part; and

focusing a display, on the computing device, of the video data on images of the beauty product.

10. The method of claim 9 , wherein the beauty product is a first beauty product and wherein the method further comprises:

matching image data of the first beauty product in the images to a stored image data of a second beauty product; and

identifying the first beauty product as the second beauty product.

11. The method of claim 1 further comprising:

identifying a product code from an image of the beauty product;

matching the product code to stored product codes to identify the beauty product; and

retrieving information regarding the beauty product using the product code, wherein the product code is an identifier assigned to the beauty product.

12. The method of claim 11 , wherein the information regarding the beauty product comprises an identity of the beauty product, and wherein the method further comprises:

causing presentation of a user interface item for the presenter to confirm or reject the identity of the beauty product; and

in response to receiving, via an application implemented by at least one processor, input from the presenter that indicates rejection of the identity of the beauty product, recording new images of the presenter creating the tutorial, and identifying the beauty product based on the new images.

13. The method of claim 1 wherein the input from the presenter is the presenter holding the beauty product within the video data.

14. The method of claim 1 , wherein the video data is live video data, and wherein the method further comprising:

in response to determining that the beauty product is within the live video data,

causing an interrogation signal to be transmitted to the beauty product to solicit a radio frequency identification (RFID) identifying the beauty product,

receiving radio signals comprising the RFID from the beauty product, the RFID comprising a product code, and

identifying the beauty product using the product code.

15. The method of claim 1 further comprising:

generating an identifier for the beauty product, the identifier identifying the beauty product to an application recording the tutorial;

causing presentation of information regarding the beauty product on a display device;

receiving, input from the presenter, the input comprising custom information regarding the beauty product; and

storing a generic identifier of the beauty product and the custom information based on the generated identifier.

16. The method of claim 1 , wherein the beauty product is associated with a step of the tutorial, wherein the tutorial comprises a plurality of steps, and wherein the method further comprises:

causing presentation of information regarding each step of the plurality of steps on a display device; and

in response to receiving an indication of a selection of a step of the plurality of steps, associating the beauty product with the step.

17. The method of claim 1 further comprising:

in response to a selection by the presenter, displaying a preview of a plurality of tutorials to the presenter, wherein each of the plurality of tutorials use the beauty product.

18. A system comprising:

at least one processor; and

at least one memory including instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:

accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter;

processing the video data, using at least one processor, to identify changes to the body part of the presenter from an application of the beauty product;

receiving input from the presenter that identifies the beauty product applied to the body part; and

associating the changes to the body part of the presenter with the beauty product.

19. The system of claim 18 , wherein the changes to the body part of the presenter comprise a color change of the body part or a change of texture of the body part.

20. A non-transitory computer-readable medium comprising instructions, which when executed by a computing device comprising one or more processors, cause the one or more processors to:

accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter;

processing the video data, using at least one processor, to identify changes to the body part of the presenter from an application of the beauty product;

receiving input from the presenter that identifies the beauty product applied to the body part; and

associating the changes to the body part of the presenter with the beauty product.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 18, 2023
From: BARRON, CHRISTINE; DRUMMOND, VIRGINIA; LUO, JEAN; MATTHIESSEN, ALEK; MOURKOGIANNIS, CELIA NICOLE; SOLICHIN, JONATHAN; VORONOVA, OLESIA
To: SNAP INC.
Reel/Frame 064297/0061 →
Continuity (3)
Continuation 17155715 · Jan 22, 2021
Provisional Application 62705076 · Jun 10, 2020
Related Publication 20230050788A1 · Feb 16, 2023
Cited By (3)
US 12,226,001 US 12,354,353 US 12,488,551