IP Library Granted Patent US 12,106,353
Granted Patent B2
US 12,106,353 · App. 17/840,061 · Granted Oct 1, 2024

System and method for generating a product recommendation in a virtual try-on session

Inventors: Chirag Soni (Himachal Pradesh, IN); Prajjwal Agarwal (Uttar Pradesh, IN); Ganga Vara Prasad Miriam (Ongole, IN); Madhusudhan Srinivasan (Karnataka, IN); Ramesh Alagarsamy (Bangalore, IN)
Assignee: ROVI GUIDES, INC.
G06Q30/0631G06Q30/0643
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,106,353
App. No.
17/840,061
Granted
Oct 1, 2024
Kind
B2
Abstract

System and methods for generating a product recommendation based on reactions such as bio-feedback of a subject during a virtual try-on session are described herein. A recommendation engine captures bio-feedback and determines whether the subject has a positive or negative attitude towards a certain feature of a product that is being virtually “tried on” with the subject. The recommendation engine can then provide a product recommendation based on the actual sentiment of the subject towards a product feature.

Claims (82)

1. A method comprising:

receiving, from a mobile device, a user-generated video depicting an object and a selection of a first product;

generating, based on the user-generated video, an interactive visualization comprising a modified video depicting the object on which the first product is overlaid;

transmitting, to the mobile device, the interactive visualization for display at an interface of the mobile device;

during display of the interactive visualization at the interface of the mobile device:

receiving, from the mobile device, an interaction with the interactive visualization at the interface of the mobile device that changes a product attribute of the first product;

receiving, from the mobile device, bio-feedback data associated with the changed product attribute and the interactive visualization, wherein the bio-feedback data is captured via at least one sensor communicatively coupled to the mobile device;

based at least in part on the bio-feedback data captured via the at least one sensor communicatively coupled to the mobile device:

generating one or more preferences toward the first product and the changed product attribute; and

transmitting, to the mobile device for display at the interface, a product recommendation comprising a second product that is selected based on the one or more preferences towards the first product and the changed product attribute, wherein the product recommendation is displayed partially over the object depicted in the interactive visualization at the interface.

2. The method of claim 1 , wherein the mobile device is a smart wearable device, and wherein the bio-feedback data comprises at least one of a biometric measurement or a change of a biometric parameter captured via the at least one sensor of the smart wearable device.

3. The method of claim 1 , wherein the changed product attribute is a first product attribute, the method further comprising:

determining whether an emotion towards the first product and the first product attribute is positive or negative;

in response to determining that the emotion is negative, determining that the first product attribute is a non-preferred attribute; and

selecting the second product to have a second product attribute different from the first product attribute.

4. The method of claim 3 , further comprising:

restricting recommendation of a product comprising the non-preferred attribute.

5. The method of claim 1 , further comprising:

determining a product type of the first product; and

storing the changed product attribute as a preferred attribute for the product type.

6. The method of claim 1 , further comprising:

determining a high priority form of bio-feedback data; and

wherein the one or more preferences are generated based on the high priority form of bio-feedback data.

7. The method of claim 1 , wherein generating the interactive visualization comprising the modified video comprises:

identifying, based on the user-generated video, a plurality of video frames depicting a portion of the object related to a product type of the first product;

for each video frame of the plurality of video frames:

identifying pixels of the video frame that belong to the portion of the object related to the product type; and

generating a modified video frame by modifying the pixels such that the first product is overlaid on the portion; and

generating a composite video comprising the modified video frames, wherein the composite video depicts the object having the first product overlaid on the portion.

8. The method of claim 1 , further comprising:

retrieving a data structure associated with the interactive visualization, wherein the data structure comprises structural data attributes of the object and the first product;

determining, based on metadata associated with the interactive visualization, a change in a structural data attribute corresponding to a portion of the object on which the first product is overlaid from the data structure; and

identifying, from the change in the structural data attribute, a product feature of the first product related to the changed product attribute.

9. The method of claim 1 , wherein the bio-feedback data comprise at least one of a biometric measurement or a body movement.

10. The method of claim 9 , further comprising:

determining, based on the at least one sensor communicatively coupled to the mobile device, an available form of bio-feedback data;

accessing, from a database storing associations between emotions and bio-feedback data, data indicative of an emotional state associated with the available form of bio-feedback data; and

wherein generating the one or more preferences towards the first product and the changed product attribute comprises:

based at least in part on determining that the biometric measurement is available, determining whether an emotion is positive or negative based on the emotional state associated with the biometric measurement; and

based at least in part on determining that the body movement is available, determining whether an emotion is positive or negative based on the emotional state associated with a movement pattern of the body movement.

11. A system comprising:

transceiver circuitry configured to transmit and receive data associated with an interactive visualization for display at an interface of a mobile device; and

control circuitry configured to:

receive, from the mobile device, a user-generated video depicting an object and a selection of a first product;

generate, based on the user-generated video, an interactive visualization comprising a modified video depicting the object on which the first product is overlaid;

transmit, to the mobile device via the transceiver circuitry, the interactive visualization for display at an interface of the mobile device;

during display of the interactive visualization at the interface of the mobile device:

receive, from the mobile device via the transceiver circuitry, an interaction with the interactive visualization at the interface of the mobile device that changes a product attribute of the first product;

receive, from the mobile device, bio-feedback data associated with the changed product attribute and the interactive visualization, wherein the bio-feedback data is captured via at least one sensor communicatively coupled to the mobile device;

based at least in part on the bio-feedback data captured via the at least one sensor communicatively coupled to the mobile device:

generate one or more preferences toward the first product and the changed product attribute;

transmit, to the mobile device for display at the interface, a product recommendation comprising a second product that is selected based on the one or more preferences towards the first product and the changed product attribute, wherein the product recommendation is displayed partially over the object depicted in the interactive visualization at the interface.

12. The system of claim 11 , wherein the mobile device is a smart wearable device, and wherein the bio-feedback data comprises at least one of a biometric measurement or a change of a biometric parameter captured via the at least one sensor of the smart wearable device.

13. The system of claim 11 , wherein the changed product attribute is a first product attribute, and wherein the control circuitry is further configured to:

determine whether an emotion towards the first product and the first product attribute is positive or negative;

in response to determining that the emotion is negative, determine that the first product attribute is a non-preferred attribute; and

select the second product to have a second product attribute different from the first product attribute.

14. The system of claim 13 , wherein the control circuitry is further configured to:

restrict recommendation of a product comprising the non-preferred attribute.

15. The system of claim 11 , wherein the control circuitry is further configured to:

determine a product type of the first product; and

store the changed product attribute as a preferred attribute for the product type.

16. The system of claim 11 , wherein the control circuitry is further configured to:

determine a high priority form of bio-feedback data; and

wherein the control circuitry is configured to generate the one or more preferences based on the high priority form of bio-feedback data.

17. The system of claim 11 , wherein the control circuitry, when generating the interactive visualization comprising the modified video, is configured to:

identify, based on the user-generated video, a plurality of video frames depicting a portion of the object related to a product type of the first product;

for each video frame of the plurality of video frames:

identify pixels of the video frame belonging to the portion of the object related to the product type; and

generate a modified video frame by modifying the pixels such that the first product is overlaid on the portion; and

generate a composite video comprising the modified video frames, wherein the composite video depicts the object having the first product overlaid on the portion.

18. The system of claim 11 , wherein the control circuitry is further configured to:

retrieve a data structure associated with the interactive visualization, wherein the data structure comprises structural data attributes of the modified object and the first product;

determine, based on metadata associated with the interactive visualization, a change in a structural data attribute corresponding to a portion of the object on which the first product is overlaid from the data structure; and

identify, from the change in the structural data attribute, a product feature of the first product related to the changed product attribute.

19. The system of claim 11 , wherein the bio-feedback data comprise at least one of a biometric measurement or a body movement.

20. The system of claim 19 , wherein the control circuitry is further configured to:

determine, based on the at least one sensor communicatively coupled to the mobile device, an available form of bio-feedback data;

access, from a database storing associations between emotions and bio-feedback data, data indicative of an emotional state associated with the available form of bio-feedback data; and

wherein the control circuitry is configured to generate the one or more preferences towards the first product and the changed product attribute by:

based at least in part on determining that the biometric measurement is available, determine whether an emotion is positive or negative based on the emotional state associated with the biometric measurement; and

based at least in part on determining that the body movement is available, determine whether an emotion is positive or negative based on the emotional state associated with a movement pattern of the body movement.

Assignments (3)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0171 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2022
From: SONI, CHIRAG; AGARWAL, PRAJJWAL; MIRIAM, GANGA VARA PRASAD; SRINIVASAN, MADHUSUDHAN; ALAGARSAMY, RAMESH
To: ROVI GUIDES, INC.
Reel/Frame 060195/0809 →
Continuity (2)
Continuation 16155270 · Oct 9, 2018
Related Publication 20220383389A1 · Dec 1, 2022