IP Library › Granted Patent US 11,969,075
Granted Patent B2
US 11,969,075 · App. 17/938,464 · Granted Apr 30, 2024

Augmented reality beauty product tutorials

Inventors: Christine Barron (Los Angeles, CA); Virginia Drummond (Venice, CA); Jean Luo (Seattle, WA); Alek Matthiessen (Marina Del Rey, CA); Celia Nicole Mourkogiannis (Los Angeles, CA); Jonathan Solichin (Arcadia, CA); Olesia Voronova (Santa Monica, CA)
Assignee: Snap Inc.
A45D44/005G06F3/04817G06F3/04842G06Q30/0601G06T11/001G09B19/003G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,969,075
App. No.
17/938,464
Granted
Apr 30, 2024
Kind
B2
Abstract

Systems, methods, and computer readable media for augmented reality beauty product tutorials are disclosed. Methods disclose displaying on a first portion of a screen a beauty product tutorial including pre-recorded images of a presenter applying a beauty product to a body part of the presenter and determining first effects indicating changes to make to live images of a user to simulate applying the beauty product to the body part of the user, where the first effects are determined based on second effects indicating changes to the pre-recorded images from applying the beauty product to the body part of the presenter. Methods further disclose processing the live images of the user to add the first effects and indications of motion of the beauty product and displaying the processed live images of the user on a second portion of the screen.

Claims (49)

1. A method comprising:

determining one or more effects, the one or more effects indicating changes to make to live images of a first person to simulate applying a beauty product to a body part of the first person, the one or more effects being determined based on changes to a pre-recorded video depicting the beauty product being applied in a plurality of steps to the body part of a second person;

determining one or more indications of motion of the beauty product;

processing the live images of the first person to add the one or more effects and the one or more indications of motion of the beauty product; and

displaying on a screen of a computing device the processed live images of the first person.

2. The method of claim 1 wherein the one or more indications of motion of the beauty product are determined based on motion of the beauty product within the pre-recorded video.

3. The method of claim 1 wherein an indication of motion of the one or more indications of motion of the beauty product are determined based on comparing a first effect of the one or more effects with a second effect of the one or more effects.

4. The method of claim 1 wherein the displaying further comprises:

displaying, on a first portion of the screen of a computing device, the pre-recorded video and on a second portion of the screen the processed live images of the first person.

5. The method of claim 4 further comprising:

determining within the live images of the first person a body part of the first person corresponding to the body part of the second person; and

adjusting the second portion of the screen to display the body part of the first person in a size proportional to a size of the body part of the second person displayed in the pre-recorded images.

6. The method of claim 4 wherein the pre-recorded video and the processed live images are displayed so that a first effect of the one or more effects determined based on changes to the pre-recorded video is displayed simultaneously with a second effect added to the first person, the first effect corresponding to the second effect.

7. The method of claim 1 , wherein the method is performed by an apparatus of the computing device.

8. The method of claim 1 further comprising:

receiving the live images from a camera of the computing device.

9. The method of claim 1 further comprising:

displaying an image of the beauty product on the screen; and

in response to a selection of the image of the beauty product, displaying additional information regarding the beauty product, the additional information regarding the beauty product comprising an icon to customize the beauty product; and wherein the method further comprises:

in response to a selection of the icon to customize the beauty product, displaying options to customize the beauty product, and in response to a selection of an option of the options to customize the beauty product, processing the live images of the first person to modify the one or more effects based on the option to customize the beauty product.

10. The method of claim 9 , wherein the options to customize the beauty product comprises one or more of the following: changing a color of the beauty product, changing a brush size of the beauty product, changing an application size of the beauty product, or changing an application thickness of a beauty product.

11. The method of claim 1 further comprising:

capturing a current live image of the processed live images of the first person, the current live image comprising the one or more effects;

displaying the captured current live image on the screen; and

sending the captured current live image as an ephemeral message of a social network.

12. The method of claim 1 further comprising:

in response to an indication to turn off augmented reality,

processing second live images of the first person to add the one or more indications of motion of the beauty product; and

displaying on the screen the processed second live images of the first person.

13. A system comprising:

one or more processors; and

one or memories including instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

determining one or more effects, the one or more effects indicating changes to make to live images of a first person to simulate applying a beauty product to a body part of the first person, the one or more effects being determined based on changes to a pre-recorded video depicting the beauty product being applied in a plurality of steps to the body part of a second person;

determining one or more indications of motion of the beauty product;

processing the live images of the first person to add the one or more effects and the one or more indications of motion of the beauty product; and

displaying on a screen of a computing device the processed live images of the first person.

14. The system of claim 13 wherein the one or more indications of motion of the beauty product are determined based on motion of the beauty product within the pre-recorded video.

15. The system of claim 13 wherein an indication of motion of the one or more indications of motion of the beauty product are determined based on comparing a first effect of the one or more effects with a second effect of the one or more effects.

16. The system of claim 13 wherein the displaying further comprises:

displaying, on a first portion of the screen of a computing device, the pre-recorded video and on a second portion of the screen the processed live images of the first person.

17. A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:

determining one or more effects, the one or more effects indicating changes to make to live images of a first person to simulate applying a beauty product to a body part of the first person, the one or more effects being determined based on changes to a pre-recorded video depicting the beauty product being applied in a plurality of steps to the body part of a second person;

determining one or more indications of motion of the beauty product;

processing the live images of the first person to add the one or more effects and the one or more indications of motion of the beauty product; and

displaying on a screen of a computing device the processed live images of the first person.

18. The non-transitory computer-readable medium of claim 17 wherein the one or more indications of motion of the beauty product are determined based on motion of the beauty product within the pre-recorded video.

19. The non-transitory computer-readable medium of claim 17 wherein an indication of motion of the one or more indications of motion of the beauty product are determined based on comparing a first effect of the one or more effects with a second effect of the one or more effects.

20. The non-transitory computer-readable medium of claim 17 wherein the displaying further comprises:

displaying, on a first portion of the screen of a computing device, the pre-recorded video and on a second portion of the screen the processed live images of the first person.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2023
From: BARRON, CHRISTINE; DRUMMOND, VIRGINIA; LUO, JEAN; MATTHIESSEN, ALEK; MOURKOGIANNIS, CELIA NICOLE; SOLICHIN, JONATHAN; VORONOVA, OLESIA
To: SNAP INC.
Reel/Frame 065750/0698 →
Continuity (3)
Continuation 17301090 · Mar 24, 2021
Provisional Application 63002883 · Mar 31, 2020
Related Publication 20230108804A1 · Apr 6, 2023
Cited By (3)
US 12,226,001 US 12,354,353 US 12,488,551