IP Library Granted Patent US 10,650,405
Granted Patent B2
US 10,650,405 · App. 15/465,022 · Granted May 12, 2020

Media content tracking

Inventors: Gustav Hoffman (Richland, MI); Ganapa Sashidhara Murthy (Portage, MI)
Assignee: Kellogg Company
G06Q30/0246A61B5/0077A61B5/1114A61B5/163A61B5/7264G06F3/013G06F3/0304G06F3/1446G06K9/0061G06K9/00268G06K9/00604G06Q30/02H04N21/41415H04N21/4223H04N21/441H04N21/44204H04N21/44218H04N21/44222H04N21/4532A61B2503/12A61B2576/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,650,405
App. No.
15/465,022
Granted
May 12, 2020
Kind
B2
Abstract

A method for media content tracking is disclosed. The method includes receiving a user identifier and instructing display systems to display media content based on the user identifier. Each display system has a corresponding screen. The method also includes receiving image data from an imaging system configured to have a field of view arranged to capture images of a user. The method further includes determining gaze characteristics of the user including a gaze target of the user. The method further includes determining whether the gaze target corresponds to one of the screens. When the gaze target corresponds to one of the screens, the method includes determining a time period of gaze engagement with the corresponding screen. The method also includes storing at least one of the gaze characteristics and the media content or an identifier of the media content displayed on the screen corresponding to the gaze target.

Claims (88)

1. A method comprising:

receiving, at data processing hardware, a user identifier associated with a user, the user identifier associated with the user comprising uniform resource locaters (URLs) indicating a first genre of media content relating to the user;

instructing, by the data processing hardware, each of a plurality of display systems to concurrently display a respective genre of media content with a first display system of the plurality of display systems displaying the first genre of media content relating to the user based on the URLs associated with the received user identifier and a second display system of the plurality of display systems displaying a second genre of media content different than the first genre of media content, each of the plurality of display systems having a corresponding screen arranged about the user, and each of the screens concurrently viewable by the user;

receiving, at the data processing hardware, image data from an imaging system configured to have a field of view arranged to capture images of the user while the user views the corresponding screens of the plurality of display systems;

determining, by the data processing hardware, gaze characteristics of the user based on the image data, the gaze characteristics comprising a gaze target of the user;

determining, by the data processing hardware, whether the gaze target corresponds to one of the screens; and

when the gaze target corresponds to the corresponding screen of the first display system:

determining, by the data processing hardware, a time period of gaze engagement with the corresponding screen of the first display system based on the gaze characteristics of the user; and

storing, by the data processing hardware, in memory hardware, gaze-characteristic data comprising:

at least one of the gaze characteristics of the user or the time period of gaze engagement with the corresponding screen of the first display system; and

the media content or an identifier of the media content displayed on the corresponding screen of the first display system.

2. The method of claim 1 , further comprising, when the gaze target corresponds to the corresponding screen of the first display system:

instructing, by the data processing hardware, one of the plurality of display systems to display on the corresponding screen of another display system away from the gaze target the first genre of media content displayed on the corresponding screen of the first display system; and

determining, by the data processing hardware, whether the gaze characteristics of the user indicate a change in the gaze target to the corresponding screen of the other display system.

3. The method of claim 1 , wherein determining the gaze characteristics of the user comprises determining a gaze direction of the user and the gaze target of the user based on the gaze direction of the user.

4. The method of claim 1 , further comprising, for the second genre of media content, determining, by the data processing hardware, a collective time period of gaze engagement by the user in the second genre of media content based on any time periods of gaze engagement of the user with the second genre of media content.

5. The method of claim 1 , further comprising identifying, by the data processing hardware, which of the first genre of media content and the second genre of media content having received at least one of:

a threshold number of gazes by the user; or

a threshold collective time period of gaze engagement by the user.

6. The method of claim 1 , further comprising determining, by the data processing hardware, the user identifier based on the image data.

7. The method of claim 6 , further comprising:

identifying, by the data processing hardware, facial features of the user identifier based on the image data; and

determining, by the data processing hardware, the user identifier based on the facial features of the user.

8. The method of claim 1 , wherein the imaging system comprises at least one of:

a camera;

a three-dimension volumetric point cloud imaging sensor;

stereo cameras;

a light detection and ranging (LIDAR) system; or

a laser detection and ranging (LADAR) system.

9. The method of claim 1 , wherein receiving the user identifier comprises receiving a near-field measurement from an electro-magnetic near-field scanner.

10. The method of claim 1 , further comprising executing a calibration comprising

displaying, by the data processing hardware, a sequence of calibration gaze targets on the corresponding screens of the plurality of display systems;

receiving, at the data processing hardware, from the imaging system, calibration image data corresponding to each calibration gaze target; and

storing, by the data processing hardware, in the memory hardware, the calibration image data corresponding to each calibration gaze target.

11. The method of claim 10 , wherein determining the gaze characteristics of the user comprises:

retrieving, by the data processing hardware, from the memory hardware, the calibration image data corresponding to each calibration gaze target; and

comparing, by the data processing hardware, the image data with the retrieved calibration image data to determine an association between the image data and the calibration gaze target corresponding to the retrieved calibration image data.

12. The method of claim 1 , wherein the user identifier comprises user information, and wherein the first genre of media content relating to the user is based on the user information.

13. The method of claim 12 , wherein the user information comprises at least one of a name, an age, a gender, a property address, a property size, a property status, an income, a purchasing history, or a partisanship.

14. The method of claim 1 , further comprising:

determining, by the data processing hardware, whether the gaze characteristics satisfy a gaze-characteristic threshold; and

when the gaze characteristics fail to satisfy the gaze-characteristic threshold, not storing the gaze-characteristic data.

15. The method of claim 14 , wherein the gaze-characteristic threshold comprises at least one of a threshold number of gazes by the user, a threshold a collective time period of gaze engagement by the user, or a threshold concentration of collective gaze engagement by the user.

16. A system comprising:

data processing hardware in communication with a plurality of display systems; and

memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:

receiving a user identifier associated with a user, the user identifier associated with the user comprising uniform resource locaters (URLs) indicating a first genre of media content relating to the user;

instructing each of the plurality of display systems to concurrently display a respective genre of media content with a first display system of the plurality of display systems displaying the first genre of media content relating to the user based on the URLs associated with the received user identifier and a second display system of the plurality of display systems displaying a second genre of media content different than the first genre of media content, each of the plurality of display systems having a corresponding screen arranged about the user, and each of the screens concurrently viewable by the user;

receiving image data from an imaging system configured to have a field of view arranged to capture images of the user while the user views the corresponding screens of the plurality of display systems;

determining gaze characteristics of the user based on the image data, the gaze characteristics comprising a gaze target of the user;

determining whether the gaze target corresponds to one of the screens; and

when the gaze target corresponds to the corresponding screen of the first display system:

determining a time period of gaze engagement with the corresponding screen of the first display system based on the gaze characteristics of the user; and

storing, in the memory hardware, gaze-characteristic data comprising:

at least one of the gaze characteristics of the user or the time period of gaze engagement with the corresponding screen of the first display system; and

the media content or an identifier of the media content displayed on the corresponding screen of the first display system.

17. The system of claim 16 , wherein the operations further comprise, when the gaze target corresponds to the corresponding screen of the first display system:

instructing one of the plurality of display systems to display on the corresponding screen of another display system away from the gaze target the first genre of media content displayed on the corresponding screen of the first display system; and

determining whether the gaze characteristics of the user indicate a change in the gaze target to the corresponding screen of the other display system.

18. The system of claim 16 , wherein determining the gaze characteristics of the user comprises determining a gaze direction of the user and the gaze target of the user based on the gaze direction of the user.

19. The system of claim 16 , wherein the operations further comprise, for the second genre of media content, determining a collective time period of gaze engagement by the user in the second genre of media content based on any time periods of gaze engagement of the user with the second genre of media content.

20. The system of claim 16 , wherein the operations further comprise identifying which of the first genre of media content and the second genre of media content having received at least one of:

a threshold number of gazes by the user; or

a threshold collective time period of gaze engagement by the user.

21. The system of claim 16 , wherein the operations further comprise determining the user identifier based on the image data.

22. The system of claim 21 , wherein the operations further comprise:

identifying facial features of the user identifier based on the image data; and

determining the user identifier based on the facial features of the user.

23. The system of claim 16 , wherein the imaging system comprises at least one of:

a camera;

a three-dimension volumetric point cloud imaging sensor;

stereo cameras;

a light detection and ranging (LIDAR) system; or

a laser detection and ranging (LADAR) system.

24. The system of claim 16 , wherein receiving the user identifier comprises receiving a near-field measurement from an electro-magnetic near-field scanner.

25. The system of claim 16 , wherein the operations further comprise executing a calibration comprising:

displaying a sequence of calibration gaze targets on screens of the plurality of display systems;

receiving from the imaging system calibration image data corresponding to each calibration gaze target; and

storing in the memory hardware the calibration image data corresponding to each calibration gaze target.

26. The system of claim 25 , wherein determining the gaze characteristics of the user comprises:

retrieving, from the memory hardware, the calibration image data corresponding to each calibration gaze target; and

comparing the image data with the retrieved calibration image data to determine an association between the image data and the calibration gaze target corresponding to the retrieved calibration image data.

27. The system of claim 16 , wherein the user identifier comprises user information, and wherein the first genre of media content relating to the user is based on the user information.

28. The system of claim 27 , wherein the user information comprises at least one of a name, an age, a gender, a property address, a property size, a property status, an income, a purchasing history, or a partisanship.

29. The system of claim 16 , wherein the operations further comprise:

determining whether the gaze characteristics satisfy a gaze-characteristic threshold; and

when the gaze characteristics fail to satisfy the gaze-characteristic threshold, not storing the gaze-characteristic data.

30. The system of claim 29 , wherein the gaze-characteristic threshold comprises at least one of a threshold number of gazes by the user, a threshold a collective time period of gaze engagement by the user, or a threshold concentration of collective gaze engagement by the user.

Assignments (2)
CHANGE OF NAME Recorded Jul 11, 2024
From: KELLOGG COMPANY
To: KELLANOVA
Reel/Frame 068283/0595 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2018
From: HOFFMAN, GUSTAV; MURTHY, GANAPA SASHIDHARA
To: KELLOGG COMPANY
Reel/Frame 047291/0306 →
Continuity (1)
Related Publication 20180276706A1 · Sep 27, 2018