IP Library Granted Patent US 9,485,534
Granted Patent B2
US 9,485,534 · App. 14/495,323 · Granted Nov 1, 2016

Methods and apparatus to detect user attentiveness to handheld computing devices

Inventor: Jan Besehanic (Tampa, FL)
Assignee: The Nielsen Company (US), LLC
H04N21/44218H04H60/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,485,534
App. No.
14/495,323
Granted
Nov 1, 2016
Kind
B2
Abstract

Methods and apparatus to detect user attentiveness to handheld computing devices are disclosed. An example handheld computing device includes a detector to detect an orientation of the handheld computing and a distance between the handheld computing device and a user; an index associating a plurality of spatial combinations with respective levels of user attentiveness to a presentation on the handheld computing device; and a comparator to compare the orientation and the distance between the handheld computing device and the user to the spatial combinations to identify a level of attentiveness of the user.

Claims (32)

1. A method, comprising:

obtaining data from an orientation sensor and a position sensor with an attentiveness detector in a handheld computing device;

determining an orientation change of the handheld computing device from a starting orientation to an ending orientation based on the data, the starting orientation and the ending orientation being angular orientations relative to a first reference orientation as determined by an orientation detector;

determining a position change of the handheld computing device from a starting position to an ending position based on the data, wherein the position change occurs at a same time as the orientation change, the starting position and the ending positions being positions relative to a user;

querying, via a logic circuit, an index associating a plurality of spatial condition change combinations with respective likelihoods indicative of user attentiveness to a presentation on the handheld computing device to determine if the index includes an entry having both the determined-orientation change and the determined relative position change; and

determining a likelihood of attentiveness of the user to the presentation based on the entry.

2. The method as defined in claim 1 , wherein the starting position and the ending position are distances between the handheld computing device and the user.

3. The method as defined in claim 1 , wherein the starting orientation and the ending orientation are at least one of a horizontal orientation or a vertical orientation.

4. The method as defined in claim 1 , wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user paying attention to the presentation on the handheld computing device.

5. The method as defined in claim 1 , wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to pay attention to the presentation on the handheld computing device.

6. The method as defined in claim 1 , wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user not paying attention to the presentation on the handheld computing device.

7. The method as defined in claim 1 , wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to not pay attention to the presentation on the handheld computing device.

8. A tangible computer readable storage medium comprising instructions that, when executed, cause a processor to at least:

obtain data from an orientation sensor and a position sensor in a handheld computing device;

determine an orientation change of the handheld computing device from a starting orientation to an ending orientation based on the data, the starting orientation and the ending orientation being angular orientations relative to a reference position orientation;

determine a position change of the handheld computing device from a starting position to an ending position based on the data, the position change occurring at a same time as the orientation change, the starting position and the ending positions being distances between the handheld computing device and a user;

reference an index associating a plurality of spatial condition change combinations with respective likelihoods indicative of user attentiveness to a presentation on the handheld computing device to identify an entry having both the determined orientation change and the determined position change; and

determine a likelihood of attentiveness of the user to the presentation based on the entry.

9. The computer readable storage medium as defined in claim 8 , wherein the starting orientation and the ending orientation are at least one of a horizontal orientation or a vertical orientation.

10. The computer readable storage medium as defined in claim 8 , wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user paying attention to the presentation on the handheld computing device.

11. The computer readable storage medium as defined in claim 8 , wherein a first plurality of the likelihoods includes respective engagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to pay attention to the presentation on the handheld computing device.

12. The computer readable storage medium as defined in claim 8 , wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user not paying attention to the presentation on the handheld computing device.

13. The computer readable storage medium as defined in claim 8 , wherein a first plurality of the likelihoods includes respective disengagement likelihoods representing how likely a particular orientation change occurring with a particular position change is to correspond to the user beginning to not pay attention to the presentation on the handheld computing device.

14. A handheld computing device, comprising:

a detector to detect an orientation change of the handheld computing device and a distance change between the handheld computing device and a user;

an index associating a plurality of spatial combinations having both orientation change and distance change with respective levels of user attentiveness to a presentation on the handheld computing device; and

a comparator to compare the orientation change and the distance change between the handheld computing device and the user to the spatial combinations to identify a level of attentiveness of the user.

15. The device as defined in claim 1 , wherein the orientation change is a horizontal orientation or a vertical orientation change relative to the user.

16. The device as defined in claim 1 , wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user paying attention to the presentation on the handheld computing device.

17. The device as defined in claim 1 , wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user beginning to pay attention to the presentation on the handheld computing device.

18. The device as defined in claim 1 , wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user not paying attention to the presentation on the handheld computing device.

19. The device as defined in claim 1 , wherein the likelihoods respectively represent how likely a particular orientation change coinciding with a particular distance change between the handheld computing device and the user corresponds to the user beginning to not pay attention to the presentation on the handheld computing device.

Assignments (10)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2015
From: BESEHANIC, JAN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 034645/0865 →
Continuity (3)
Continuation 13893027 · May 13, 2013
Continuation 13447862 · Apr 16, 2012
Related Publication 20150012927A1 · Jan 8, 2015