IP Library Granted Patent US 10,304,209
Granted Patent B2
US 10,304,209 · App. 15/491,682 · Granted May 28, 2019

Methods and systems to increase accuracy of eye tracking

Inventor: Rafael E. Alonso (Tampa, FL)
Assignee: THE NIELSEN COMPANY (US), LLC
G06T7/80G06K9/00604G06T7/74G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,304,209
App. No.
15/491,682
Granted
May 28, 2019
Kind
B2
Abstract

Systems and methods to monitor and interact with users viewing screens are disclosed. An example system includes a sensor to gather gaze data from a user viewing images on a display. The display has spatial coordinates. The system includes a processor communicatively coupled to the display and the sensor. The processor determines a first gaze location having first spatial coordinates based on the gaze data and calibration settings associated with determining gaze locations. The processor alters a portion of the display at or near the first gaze location. After the portion of the display has been altered, the processor determines a second gaze location having second spatial coordinates based on the gaze data and the calibration settings. The processor performs a comparison of the first gaze location to the second gaze location. If the comparison does not meet a threshold, the processor updates the calibration settings based on the comparison and determines a third gaze location having third spatial coordinates based on the gaze data and the updated calibration settings.

Claims (48)

1. A system comprising:

a sensor to gather gaze data from a user viewing images on a display, the display having spatial coordinates; and

a processor communicatively coupled to the display and the sensor, the processor to:

determine a first gaze location having first spatial coordinates based on the gaze data and calibration settings associated with determining gaze locations;

alter a portion of the display that is offset to the first spatial coordinates by a pre-determined distance;

after the portion of the display has been altered, determine a second gaze location having second spatial coordinates based on the gaze data and the calibration settings;

determine a difference between the first gaze location and the second gaze location;

compare the difference to a threshold; and

if the difference does not meet the threshold,

update the calibration settings to updated calibration settings based on the difference; and

determine a third gaze location having third spatial coordinates based on the gaze data and the updated calibration settings.

2. The system of claim 1 , wherein the processor is to continue iterations of display alterations and difference determinations until the threshold is met.

3. The system of claim 1 , wherein the processor is to alter the portion of the display by changing a color of one or more pixels to contrast adjacent pixels.

4. The system of claim 1 , wherein the processor is to alter the portion of the display by including a first shape that contrasts a second shape surrounding or adjacent to the first shape.

5. The system of claim 1 , wherein the processor is to alter the portion of the display for a time interval between about 1 millisecond and about 100 milliseconds.

6. The system of claim 1 , wherein the processor is to alter the portion of the display periodically or aperiodically.

7. The system of claim 1 , wherein the threshold is associated with the pre-determined distance.

8. A method comprising:

presenting images to a user via a display, the display having spatial coordinates associated with the images;

gathering gaze data from the user viewing the images via a sensor;

determining a first gaze location having first spatial coordinates based on the gaze data and calibration settings associated with determining gaze locations;

altering a portion of the display that is offset to the first spatial coordinates by a pre-determined distance;

after the portion of the display has been altered, determining a second gaze location having second spatial coordinates based on the gaze data and the calibration settings;

determining a difference between the first gaze location and the second gaze location;

comparing the difference to a threshold; and

if the difference does not meet the threshold,

updating the calibration settings to updated calibration settings based on the difference; and

determining a third gaze location having third spatial coordinates based on the gaze data and the updated calibration settings.

9. The method of claim 8 , further including continuing iterations of display alterations and difference determinations until the threshold is met.

10. The method of claim 8 , wherein altering the portion of the display includes changing a color of one or more pixels to contrast adjacent pixels.

11. The method of claim 8 , wherein altering the portion of the display includes providing a first shape that contrasts a second shape surrounding or adjacent to the first shape.

12. The method of claim 8 , wherein altering the portion of the display occurs for a time interval between 1 millisecond and 100 milliseconds.

13. The method of claim 8 , wherein the portion is repeatedly altered.

14. A tangible machine-readable storage medium comprising instructions which, when executed, cause a processor to:

present images to a user via a display, the display having spatial coordinates associated with the images;

gather gaze data from the user viewing the images via a sensor;

determine a first gaze location having first spatial coordinates based on the gaze data and calibration settings associated with determining gaze locations;

alter a portion of the display that is offset to the first spatial coordinates by a pre-determined distance;

after the portion of the display has been altered, determine a second gaze location having second spatial coordinates based on the gaze data and the calibration settings;

determine a difference between the first gaze location and the second gaze location;

compare the difference to a threshold; and

if the difference does not meet the threshold,

update the calibration settings to updated calibration settings based on the difference; and

determine a third gaze location having third spatial coordinates based on the gaze data and the updated calibration settings.

15. The tangible machine-readable storage medium of claim 14 , further including instructions which, when executed, cause the processor to continue iterations of display alterations and difference determinations until the threshold is met.

16. The tangible machine-readable storage medium of claim 14 , further including instructions which, when executed, cause the processor to alter the portion of the display by changing a color of one or more pixels to contrast adjacent pixels.

17. The tangible machine-readable storage medium of claim 14 , further including instructions which, when executed, cause the processor to alter the portion of the display by providing a first shape that contrasts a second shape surrounding or adjacent to the first shape.

18. The tangible machine-readable storage medium of claim 14 , further including instructions which, when executed, cause the processor to alter the portion of the display for a time interval between 1 millisecond and 100 milliseconds.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2017
From: ALONSO, RAFAEL E.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 042478/0015 →
Continuity (1)
Related Publication 20180308252A1 · Oct 25, 2018
Cited By (8)
US 12,189,436 US 12,189,452 US 12,210,604 US 12,346,191 US 12,517,562 US 12,531,035 US 12,554,324 US 12,669,867