IP Library Granted Patent US 8,332,255
Granted Patent B2
US 8,332,255 · App. 12/614,922 · Granted Dec 11, 2012

Sensor-integrated mirror for determining consumer shopping behavior

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,332,255
App. No.
12/614,922
Granted
Dec 11, 2012
Kind
B2
Abstract

A mirror system includes an image sensor coupled to a mirror, and gathers consumer shopping preferences for merchandise items. During operation, the system gathers one or more sequential images, from the image sensor, of a consumer wearing a first wearable merchandise item in front of the image sensor. Next, the system identifies in the one or more sequential images a first merchandise item being worn by the consumer. Then, the system determines a demographic group associated with the consumer, and detects behavior patterns for the consumer, wherein the behavior pattern indicates an interest level of the consumer for the identified merchandise item. The system then determines a mapping between the identified consumer demographic group and an interest level for the identified merchandise item, and produces a model which encodes the mapping.

Claims (65)

1. A computer-implemented method for gathering consumer shopping preferences for merchandise items, the method comprising:

gathering one or more sequential images of a consumer trying on a first wearable merchandise item in front of an image sensor at a point-of-decision location, wherein the merchandise item is not purchased later by the consumer;

identifying, by the computer, the first merchandise item being worn by the consumer based on the images;

determining, by the computer, a demographic group associated with the consumer based on the images;

detecting, by the computer, behavior patterns indicating an interest level of the consumer based at least on information about the consumer's decision-making process from the images associated with the merchandise item that is not later purchased;

determining, by the computer, a mapping between the identified consumer demographic group and the interest level for the identified merchandise item;

producing, by the computer, a model which encodes the mapping;

displaying to the consumer a first set of images of a variety of wearable merchandise items overlaid on an image of the consumer; and

analyzing, by the computer, a second set of images of the consumer to detect additional behavior patterns of the consumer, wherein the second set of images of the consumer viewing the first set of images are captured by a second image sensor.

2. The computer-implemented method of claim 1 , further comprising:

analyzing the one or more sequential images to identify a second merchandise item considered by the consumer;

determining one or more matching characteristics between the first and second merchandise items; and

determining a preference of the consumer for merchandise items based at least on the determined matching characteristics.

3. The computer-implemented method of claim 1 , wherein detecting the behavior patterns for the consumer comprises detecting one or more of the following: an eye gaze direction, an eye gesture, a body gesture, a facial expression, a time duration associated with the direction of an eye gaze, and a time duration of the consumer wearing the merchandise item.

4. The computer-implemented method of claim 3 , wherein detecting the behavior patterns for the consumer further comprises:

determining a portion of the merchandise item being gazed upon by the consumer based in part on the determined eye gaze direction; and

determining an interest level of the consumer for the portion of the merchandise item.

5. The computer-implemented method of claim 3 , wherein detecting the behavior patterns for the consumer further comprises:

determining a correlation between two merchandise items that are worn simultaneously by the consumer.

6. The computer-implemented method of claim 1 , wherein identifying the merchandise item comprises performing one or more of the following operations: scanning a radio-frequency identification (RFID) tag, scanning a barcode, and extracting a feature from the one or more sequential Images.

7. The computer-implemented method of claim 1 , wherein determining the demographic group associated with the consumer includes determining one or more of: an age, a gender, an ethnicity, a physical appearance, a body characteristic, and a market segment.

8. A non-transitory computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for gathering consumer shopping preferences for merchandise items, the method comprising:

gathering one or more sequential images of a consumer trying on a first wearable merchandise item in front of an image sensor at a point-of-decision location, wherein the merchandise item is not purchased later by the consumer;

identifying the first merchandise item being worn by the consumer based on the images;

determining a demographic group associated with the consumer based on the images;

detecting behavior patterns indicating an interest level of the consumer based at least on information about the consumer's decision-making process from the images associated with the merchandise item that is not later purchased;

determining a mapping between the identified consumer demographic group and the interest level for the identified merchandise item;

producing a model which encodes the mapping;

displaying to the consumer a first set of images of a variety of wearable merchandise items overlaid on an image of the consumer; and

analyzing a second set of images of the consumer to detect additional behavior patterns of the consumer, wherein the second set of images of the consumer viewing the first set of images are captured by a second image sensor.

9. The non-transitory computer-readable storage medium of claim 8 , further comprising:

analyzing the one or more sequential images to identify a second merchandise item considered by the consumer;

determining one or more matching characteristics between the first and second merchandise items; and

determining a preference of the consumer for merchandise items based at least on the determined matching characteristics.

10. The non-transitory computer-readable storage medium of claim 8 , wherein detecting the behavior patterns for the consumer comprises detecting one or more of the following: an eye gaze direction, an eye gesture, a body gesture, a facial expression, a time duration associated with the direction of an eye gaze, and a time duration of the consumer wearing the merchandise item.

11. The non-transitory computer-readable storage medium of claim 10 , wherein detecting the behavior patterns for the consumer further comprises:

determining a portion of the merchandise item being gazed upon by the consumer based in part on the determined eye gaze direction; and

determining an interest level of the consumer for the portion of the merchandise item.

12. The non-transitory computer-readable storage medium of claim 10 , wherein detecting the behavior patterns for the consumer further comprises:

determining a correlation between two merchandise items that are worn simultaneously by the consumer.

13. The non-transitory computer-readable storage medium of claim 8 , wherein identifying the merchandise item comprises performing one or more of the following operations: scanning a radio-frequency identification (RFID) tag, scanning a barcode, and extracting a feature from the one or more sequential images.

14. The non-transitory computer-readable storage medium of claim 8 , wherein determining the demographic group associated with the consumer includes determining one or more of: an age, a gender, an ethnicity, a physical appearance, a body characteristic, and a market segment.

15. An apparatus for gathering consumer shopping preferences for merchandise items, comprising:

a computer system including a processor configured to:

gather one or more sequential images of a consumer trying on a first wearable merchandise item in front of an image sensor at a point-of-decision location, wherein the merchandise item is not purchased later by the consumer;

identify the first merchandise item being worn by the consumer based on the images;

determine a demographic group associated with the consumer based on the images;

detect behavior patterns indicating an interest level of the consumer based at least on information about the consumer's decision-making process from the images associated with the merchandise item that is not later purchased;

determine a mapping between the identified consumer demographic group and the interest level for the identified merchandise item;

produce a model which encodes the mapping;

display to the consumer a first set of images of a variety of wearable merchandise items overlaid on an image of the consumer; and

analyze a second set of images of the consumer to detect additional behavior patterns of the consumer, wherein the second set of images of the consumer viewing the first set of images are captured by a second image sensor.

16. The apparatus of claim 15 , wherein the computer system is further configured to:

analyze the one or more sequential images to identify a second merchandise item considered by the consumer;

determine one or more matching characteristics between the first and second merchandise items; and

determine a preference of the consumer for merchandise items based at least on the determined matching characteristics.

17. The apparatus of claim 15 , wherein while detecting the behavior patterns for the consumer, the computer system is configured to detect one or more of the following: an eye gaze direction, an eye gesture, a body gesture, a facial expression, a time duration associated with the direction of an eye gaze, and a time duration of the consumer wearing the merchandise item.

18. The apparatus of claim 17 , wherein while detecting the behavior patterns for the consumer, the computer system is configured to:

determine a portion of the merchandise item being gazed upon by the consumer based in part on the determined eye gaze direction; and

determine an interest level of the consumer for the portion of the merchandise item.

19. The apparatus of claim 17 , wherein while detecting the behavior patterns for the consumer, the computer system is configured to:

determine a correlation between two merchandise items that are worn simultaneously by the consumer.

20. The apparatus of claim 15 , further comprising one or more of: a radio-frequency identifier (RFID) reader, and a barcode scanner;

wherein while identifying the merchandise item, the computer system is configured to perform one or more of the following operations: configuring the RFID reader to scan an RFID tag, configuring the barcode scanner to scan a barcode, and extracting a feature from the one or more sequential images.

21. The apparatus of claim 15 , wherein while determining the demographic group associated with the consumer, the computer system is configured to determine one or more of: an age, a gender, an ethnicity, a physical appearance, a body characteristic, and a market segment.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2025
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 073842/0479 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →