IP Library › Granted Patent US 12,394,107
Granted Patent B2
US 12,394,107 · App. 18/072,039 · Granted Aug 19, 2025

Methods and systems for virtual try on (VTO) providing an augmented reality experience

Inventors: Xuanyi Hong (Toronto, CA); Jeffrey Houghton (East York, CA)
Assignee: L'Oreal
G06T11/00G06F3/0482G06Q30/0643G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,394,107
App. No.
18/072,039
Granted
Aug 19, 2025
Kind
B2
Abstract

Methods and systems for VTO provide an augmented reality experience. Webpage components define different VTO experiences for different products/services and different instances (e.g., hair, nail or makeup products with different colors). The components can integrate with a webpage, for example, as an advertisement. When executed on a user device, the components provide a VTO for a particular product including a collection of interfaces that provide a model image experience. Pre-rendered “after” model images using an appropriate VTO engine show the product/services. The after model images can be presented prior to a live user image experience enabled by a corresponding user device executed VTO engine rendering a product instance to a user image. The model experience can be presented while the user image experience (e.g. its VTO engine) is readied. The model experience can be presented in a same/overlapping region as the user image experience, for example.

Claims (37)

1. A method comprising:

presenting, by a computing device, a virtual try on (VTO) experience to virtually try on instances of a product or a service, the VTO experience presented in two parts comprising a model image experience and a user image experience providing an augmented reality;

wherein the model image experience comprises displaying after model images pre-rendered with effects associated with the instances of the product or service by a first VTO engine, the after model images received by the computing device as a part of webpage components executed by the computing device to provide the VTO experience;

wherein the user image experience comprises displaying after user images rendered with effects associated with the instances by a corresponding second VTO engine executed by the computing device using one or more user before images of the user received from a camera of the computing device; and

wherein the model image experience is presented by the computing device prior to presenting the user image experience, while the user image experience is being readied by the computing device,

the method further comprising presenting during the model image experience a start control to receive input to start the user image experience; receiving input to start the user image experience; invoking the loading of the user image experience in response; and continuing to present the model image experience while the user image experience is loaded by the computing device.

2. The method of claim 1 , wherein the product or service is one of a hair product, nail product, or makeup product.

3. The method of claim 1 , wherein the webpage comprise a before model image where no effect is applied to the model and a before/after control to selectively display the before model image and a selected after model image to present a before/after virtual try on of the product or service.

4. The method of claim 1 , wherein the webpage components for the user image experience comprise an effects selection interface to select between the plurality of effects to simulate different instances of the product or service in the after user images.

5. The method of claim 1 , wherein the webpage components comprise after model images for a plurality of models and wherein the method presents a model selection interface to select between the plurality of model after images for presenting during the model image experience.

6. The method of claim 1 comprising presenting the VTO experience as an advertisement in a portion of a webpage.

7. The method of claim 6 , wherein the advertisement comprises information to facilitate performance analysis of a digital marketing campaign.

8. The method of claim 1 , wherein the first VTO engine is configured to execute on a server computing device and the corresponding second VTO engine is configured to execute on a user computing device to render same effects as the first VTO engine, and wherein the user computing device comprises fewer or small computing resources compared to the server computing device.

9. A method comprising:

presenting, by a computing device, a virtual try on (VTO) experience to virtually try on instances of a product or a service, the VTO experience presented in two parts comprising a model image experience and a user image experience providing an augmented reality;

wherein the model image experience comprises displaying after model images pre-rendered with effects associated with the instances of the product or service by a first VTO engine, the after model images received by the computing device as a part of webpage components executed by the computing device to provide the VTO experience;

wherein the user image experience comprises displaying after user images rendered with effects associated with the instances by a corresponding second VTO engine executed by the computing device using one or more user before images of the user received from a camera of the computing device; and

wherein the model image experience is presented by the computing device prior to presenting the user image experience, while the user image experience is being readied by the computing device,

wherein the model image experience is presented in an overlapping screen region with the user image experience and the method comprises presenting a control to switch between the user image experience and the model image experience.

10. A computing device comprising at least one processor and a non-transient storage medium storing computer readable instructions that, when executed by a processor of the computing device, cause the computing device to:

present a virtual try on (VTO) experience for a product or service comprising displaying an after model image from a plurality of after model images pre-rendered to show instances of product effects or service effects as a part of a model image experience; and

present a user image VTO experience that presents after user images rendered with the product effects or service effects by a VTO engine executed by the computing device to provide an augmented reality for a user, wherein the model image experience is presented while the user image experience is readied by the computing device,

wherein the instructions cause the computing device to: present during the model image experience a start control to receive input to start the user image experience; receive input to start the user image experience; invoke the loading of the user image experience in response; and continue to present the model image experience while the user image experience is loaded by the computing device.

11. The computing device of claim 10 , wherein the product or service is one of a hair product, nail product, or makeup product.

12. The computing device of claim 10 , wherein the instructions cause the computing device to receive a before model image where no effect is applied to the model and present before/after control to selectively display the before model image and a selected after model image to present a before/after virtual try on of the product or service.

13. The computing device of claim 10 , wherein the instructions cause the computing device to present an effects selection interface to select between the product effects or services to simulate different instances of the product or service in the after user images.

14. The computing device of claim 10 , wherein the instructions cause the computing device to receive after model images for a plurality of models and present a model selection interface to select between the plurality of model after images for presenting during the model image experience.

15. The computing device of claim 10 , wherein the instructions cause the computing device to present the VTO experience as an advertisement in a portion of the webpage.

16. The computing device of claim 10 , wherein the computing device is a user computing device and the VTO engine comprises a user VTO engine, and wherein the instructions cause the user computing device to receive the after model images as pre-rendered images generated by a corresponding VTO engine configured to execute on a separate computing device from the user computing device.

17. A computing device comprising at least one processor and a non-transient storage medium storing computer readable instructions that, when executed by a processor of the computing device, cause the computing device to:

present a virtual try on (VTO) experience for a product or service comprising displaying an after model image from a plurality of after model images pre-rendered to show instances of product effects or service effects as a part of a model image experience; and

present a user image VTO experience that presents after user images rendered with the product effects or service effects by a VTO engine executed by the computing device to provide an augmented reality for a user, wherein the model image experience is presented while the user image experience is readied by the computing device,

wherein the instructions cause the computing device to present the model image experience in an overlapping in a screen region with the user image experience and present a control to switch between the user image experience and the model image experience.

18. A computer program product comprising a non-transitory storage medium storing computer readable instructions that, when executed by a processor of a computing device, cause the computing device to:

present a virtual try on (VTO) experience for a product or service comprising displaying an after model image from a plurality of after model images pre-rendered to show instances of product effects or service effects; and

present a user image VTO experience that presents after user images rendered with the product effects or service effects by a VTO engine executed by the computing device to provide an augmented reality for a user, wherein the model image experience is presented while the user image experience is readied by the computing device,

wherein the instructions cause the computing device to: present during the model image experience a start control to receive input to start the user image experience; receive input to start the user image experience; invoke the loading of the user image experience in response: and continue to present the model image experience while the user image experience is loaded by the computing device.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2024
From: HOUGHTON, JEFFREY
To: MODIFACE INC.
Reel/Frame 069522/0761 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2023
From: MODIFACE INC.
To: L'OREAL
Reel/Frame 063624/0519 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2023
From: HONG, XUANYI
To: MODIFACE INC.
Reel/Frame 063494/0839 →
Continuity (1)
Related Publication 20240177360A1 · May 30, 2024
References Cited (11)
US 11263821B1 · Singh et al. · 2022 [cited by applicant]
US 20060178957A1 · LeClaire · 2006 [cited by examiner]
US 20180075524A1 · Sartori Odizzio et al. · 2018 [cited by applicant]
US 20210407162A1 · Charraud et al. · 2021 [cited by applicant]
US 20220215463A1 · Sartori Odizzio et al. · 2022 [cited by applicant]
US 20220215633A1 · Neulander · 2022 [cited by examiner]
US 20220230401A1 · Singh et al. · 2022 [cited by applicant]
US 20230260229A1 · Singh et al. · 2023 [cited by applicant]
US 20230401632A1 · Cardelino · 2023 [cited by examiner]
French Preliminary Search Report and Written Opinion issued Dec. 26, 2013, in FR 2302382 (with English Translation of Category of Cited Documents) citing documents 1, 4, 6 therein, 10 pages. [cited by applicant]
International Search Report and Written Opinion issued Jan. 4, 2024, in PCT/EP2023/082620, citing documents 1, 4, 6 therein, 13 pages. [cited by applicant]