IP Library Granted Patent US 8,666,790
Granted Patent B2
US 8,666,790 · App. 12/430,002 · Granted Mar 4, 2014

Point of view shopper camera system with orientation sensor

Inventors: Herb Sorensen (Troutdale, OR); Marcus Hannon Geroux (Gladstone, OR); David Albers (Gresham, OR)
Assignee: Shopper Scientist, LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,666,790
App. No.
12/430,002
Granted
Mar 4, 2014
Kind
B2
Abstract

A point of view shopper camera system is provided to generate and analyze shoppers' view data. The point of view shopper camera system may comprise a head device including an eye camera and a head orientation sensor, a position tracking sensor to identify a shopper's position, and an analysis computing device. The eye camera may be configured to be mounted to the head of the shopper, and to capture a still or moving image of the field of view of the shopper. The analysis computing device may be configured to receive the captured image data from the eye camera, head orientation data from the head orientation sensor, and the shopper's position data from the position tracking sensor, and determine an estimated field of view of the shopper during a trip in a shopping environment.

Claims (50)

1. A method to generate and analyze shopper view data in a shopping environment, comprising:

in a correlation phase, computing a probability ellipse demarcating a percentage of focus within the probability ellipse in a field of view of an eye camera based on test subject eye measurements;

in a measurement phase, capturing an image of a view from the eye camera, the eye camera being mounted on a shopper's head, directed in an orientation of the shopper's head, and pointed in a direction of a line of sight of the shopper to image what the shopper sees;

measuring a head orientation of the shopper's head using a head orientation sensor;

measuring a position of the shopper using a position tracking sensor; and

in an analysis phase, for one or more shopper paths, for each of a plurality of shopper positions in the shopper path, determining an estimated field of view of the shopper based on the computed probability ellipse, captured image data, and the measured orientation of the shopper's head.

2. The method of claim 1 , further comprising, in the analysis phase, calculating a first measure indicating the extent to which a product or display fell within the estimated field of view for the one or more shopper paths.

3. The method of claim 2 , further comprising:

in the correlation phase, computing statistical correlations between measured brainwave responses and measured physiologic responses based on actual measured brainwaves of test subjects, indicating a threshold probability that a measured physiologic response corresponds to a predetermined psychological metric.

4. The method of claim 3 , further comprising:

in the measurement phase, measuring a physiologic response of the shopper using a physiologic response sensor.

5. The method of claim 4 , further comprising:

in the analysis phase, calculating a second measure indicating the extent to which a product or display fell within the estimated field of view of the shopper, concurrent with a measured physiologic response that, based on the statistical correlations, is above the threshold probability indicating that the predetermined psychological metric was exhibited in shoppers while the product or display fell within the estimated field of view.

6. The method of claim 5 , wherein the physiologic response is one or more of galvanic skin response, heartbeat, and/or breathing rate.

7. The method of claim 1 , further comprising:

measuring a torso orientation of the shopper's torso using a torso orientation sensor;

wherein determining an estimated field of view of the shopper is further based on the measured orientation of the shopper's torso.

8. The method of claim 1 , further comprising, for each of the plurality of shopper positions in the shopper path, determining an estimated line of sight and/or estimated focal point, associated with the estimated field of view.

9. A point of view shopper camera system to generate and analyze shopper view data of a shopper from a shopping trip in a shopping environment, comprising:

a head device to be mounted to a shopper's head, including:

a camera configured to point in a direction aligned with an orientation of the head of the shopper to capture image data including an image of a view that the shopper sees when eyes of the shopper focus straight ahead; and

a head orientation sensor to generate head orientation data;

a position tracking sensor to identify shopper position and generate shopper position data; and

a communication interface configured to transmit the captured image data, head orientation data, and shopper position data to an analysis program executed on an analysis computing device;

wherein the analysis program is configured to determine an estimated field of view of the shopper, including a line of sight and surrounding field of view, based on the image data, including a probability ellipse demarcating a percentage of focus within the probability ellipse in a field of view of the camera based on test subject eye measurements, the head orientation data, and the shopper position data.

10. The system of claim 9 , further comprising:

a torso device to be mounted to a shopper's torso, including a torso orientation sensor to generate torso orientation data; and

wherein the analysis program is configured to determine the estimated field of view of the shopper further based on the torso orientation data.

11. The system of claim 10 , wherein the estimated field of view is determined at least in part by calculating an average focal point and a probable field of focus of the shopper using the image data and comparing the average focal point and the probable field of focus with a relative position of between the shopper's head and the shopper's torso using the head orientation data and the torso orientation data.

12. The system of claim 9 , further comprising:

a wrist device worn on a wrist of the shopper, the wrist device including a wrist orientation sensor configured to measure an orientation of the wrist to generate wrist orientation data;

wherein the analysis program is configured to calculate a measure based on the wrist orientation data.

13. The system of claim 9 , wherein the head device further comprises a physiologic response sensor configured to detect a physiologic response of the shopper and generate physiologic response data to be transmitted to the analysis program.

14. The system of claim 13 , wherein the physiologic sensor includes a galvanic skin response sensor, a heartbeat sensor, or a breathing rate sensor.

15. The system of claim 14 , further comprises a timer to track timing and correlate the timing with the image data, the head orientation data, the torso orientation data, the shopper position data, and the physiologic response data during the trip.

16. The system of claim 9 , wherein the position tracking sensor is a radio frequency identification (RFID) reader configured to receive signals from a RFID network in the shopping environment.

17. The system of claim 9 , wherein the head orientation sensor measures a movement of the shopper's head to determine whether the shopper looks up, down, left, or right.

18. A method to generate and analyze shopper view data in a shopping environment, comprising:

in a correlation phase, computing a probability ellipse demarcating a percentage of focus within the probability ellipse of a field of view of an eye camera based on test subject eye measurements;

in a measurement phase, capturing an image of a view from the eye camera, the eye camera being mounted on a shopper's head, directed in an orientation of the shopper's head, and pointed in a direction of a line of sight of the shopper to image what the shopper sees;

measuring a head orientation of the shopper's head using a head orientation sensor;

measuring a position of the shopper using a position tracking sensor;

measuring a torso orientation of the shopper's torso using a torso orientation sensor; and

in an analysis phase, for one or more shopper paths, for each of a plurality of shopper positions in the shopper path, determining an estimated field of view, an estimated line of sight and/or estimated focal point of the shopper based on the computed probability ellipse, captured image data, the measured orientation of the shopper's head, and the measured orientation of the shopper's torso.

19. The method of claim 18 , further comprising, in the analysis phase, calculating a first measure indicating the extent to which a product or display fell within the estimated field of view for the one or more shopper paths.

20. The method of claim 18 , further comprising:

in the correlation phase, computing statistical correlations between measured brainwave responses and measured physiologic responses based on actual measured brainwaves of test subjects, indicating a threshold probability that a measured physiologic response corresponds to a predetermined psychological metric;

in the measurement phase, measuring a physiologic response of the shopper using a physiologic response sensor;

in the analysis phase, calculating a second measure indicating the extent to which a product or display fell within an estimated field of view of shoppers, concurrent with a measured physiologic response that, based on the statistical correlations, is above the threshold probability indicating that the predetermined psychological metric was exhibited in shoppers while the product or display fell within the estimated field of view; and

wherein the physiologic response is one or more of galvanic skin response, heartbeat, and/or breathing rate.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2010
From: SORENSEN ASSOCIATES INC
To: SHOPPER SCIENTIST, LLC
Reel/Frame 025338/0147 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSINGEE MAILING ADDRESS FROM "FORNTAGE" TO "FRONTAGE" PREVIOUSLY RECORDED ON REEL 022607 FRAME 0636. ASSIGNOR(S) HEREBY CONFIRMS THE ASSINGEE MAILING ADDRESS AS "FRONTAGE". Recorded Oct 1, 2009
From: SORENSEN, HERB; GEROUX, MARCUS HANNON; ALBERS, DAVID
To: SORENSEN ASSOCIATES INC
Reel/Frame 023315/0178 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2009
From: SORENSEN, HERB; GEROUX, MARCUS HANNON; ALBERS, DAVID
To: SORENSEN ASSOCIATES INC
Reel/Frame 022607/0636 →
Continuity (2)
Provisional Application 61048105 · Apr 25, 2008
Related Publication 20090271251A1 · Oct 29, 2009