IP Library Granted Patent US 10,536,747
Granted Patent B2
US 10,536,747 · App. 16/119,509 · Granted Jan 14, 2020

Methods and apparatus to detect user attentiveness to handheld computing devices

Inventor: Jan Besehanic (Tampa, FL)
Assignee: The Nielsen Company (US), LLC
H04N21/44218H04H60/32H04N21/4126H04N21/6125H04N21/6175G06Q30/0272H04H60/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,536,747
App. No.
16/119,509
Granted
Jan 14, 2020
Kind
B2
Abstract

Methods and apparatus to detect user attentiveness to handheld computing devices are disclosed. An example handheld computing device includes means for detecting at least one of a first orientation change of the handheld computing device or a first position change between the handheld computing device and a user, and means for comparing at least one of the first orientation change or the first position change to a plurality of spatial condition change combinations associated with respective likelihoods indicative of user attentiveness related to the handheld computing device to determine user attentiveness to a presentation on the handheld computing device, the plurality of spatial condition change combinations including a plurality of orientation changes from respective starting orientations to respective ending orientations and a plurality of position changes from respective starting positions to respective ending positions.

Claims (35)

1. A handheld computing device, comprising:

means for detecting at least one of a first orientation change of the handheld computing device or a first position change between the handheld computing device and a user; and

means for comparing at least one of the first orientation change or the first position change to a plurality of spatial condition change combinations associated with respective likelihoods indicative of user attentiveness related to the handheld computing device to determine user attentiveness to a presentation on the handheld computing device, the plurality of spatial condition change combinations including a plurality of orientation changes from respective starting orientations to respective ending orientations and a plurality of position changes from respective starting positions to respective ending positions.

2. The handheld computing device of claim 1 , wherein the first orientation change is at least one of a horizontal orientation change or a vertical orientation change relative to a reference orientation.

3. The handheld computing device of claim 1 , wherein the user attentiveness represents how likely at least one of the first orientation change, the first position change, or a combination of the first orientation change and the first position change corresponds to the user paying attention to the presentation on the handheld computing device.

4. The handheld computing device of claim 1 , wherein the user attentiveness represents how likely at least one of the first orientation change, the first position change, or a combination of the first orientation change and the first position change corresponds to the user beginning to pay attention to the presentation on the handheld computing device.

5. The handheld computing device of claim 1 , wherein the user attentiveness represents how likely at least one of the first orientation change, the first position change, or a combination of the first orientation change and the first position change corresponds to the user not paying attention to the presentation on the handheld computing device.

6. The handheld computing device of claim 1 , wherein the user attentiveness represents how likely at least one of the first orientation change, the first position change, or a combination of the first orientation change and the first position change corresponds to the user beginning to not pay attention to the presentation on the handheld computing device.

7. The handheld computing device of claim 1 , wherein the means for detecting is to detect the first orientation change and the first position change, and the means for comparing is to determine the user attentiveness based on the first orientation change and the first position change.

8. An apparatus, comprising:

means for identifying a change of a handheld computing device from a first starting spatial condition to a first ending spatial condition based on a signal generated by a sensor of the handheld computing device, the means for identifying is to calculate a position of the handheld computing device relative to a user;

means for storing a plurality of spatial condition changes associated with likelihoods indicative of user attentiveness, a first subset of the spatial condition changes being associated with corresponding engagement likelihoods representing how likely respective ones of the first subset of the spatial condition changes correspond to the user beginning to pay attention to a presentation on the handheld computing device; and

means for determining whether the plurality of spatial condition changes includes a first spatial condition change having the first starting spatial condition and the first ending spatial condition of the identified change.

9. The apparatus of claim 8 , wherein the means for identifying is to calculate an angular position of the handheld computing device.

10. The apparatus of claim 8 , wherein a second subset of the spatial condition changes is associated with corresponding disengagement likelihoods representing how likely respective ones of the second subset of the spatial condition changes correspond to the user beginning to disengage from the presentation on the handheld computing device.

11. The apparatus of claim 10 , wherein a third subset of the spatial condition changes is associated with corresponding engagement likelihoods representing how likely respective ones of the first subset of the spatial condition changes coinciding with respective ones of the second subset of the spatial condition changes correspond to the user beginning to engage with the presentation on the handheld computing device.

12. The apparatus of claim 10 , wherein a third subset of the spatial condition changes is associated with corresponding disengagement likelihoods representing how likely respective ones of the first subset of the spatial condition changes coinciding with respective ones of the second subset of the spatial condition changes correspond to the user beginning to disengage from the presentation on the handheld computing device.

13. The apparatus of claim 8 , wherein the means for determining is to, when the plurality of spatial condition changes includes the first spatial condition changes having the first starting spatial condition and the first ending spatial condition of the identified change, select a likelihood associated with the first spatial condition change as a measure of user attentiveness to the handheld computing device.

14. The apparatus of claim 8 , wherein the means for determining is to, when the plurality of spatial condition changes includes the first spatial condition changes having the first starting spatial condition and the first ending spatial condition of the detected change and a second spatial condition change having a second detected starting spatial condition and a second detected ending spatial condition of a second identified change, combine a first likelihood associated with the first spatial condition change with a second likelihood associated with the second spatial condition change to form a measure of user attentiveness to the handheld computing device.

15. An apparatus, comprising:

means for identifying a change of a handheld computing device from a first starting spatial condition to a first ending spatial condition, the first starting spatial condition and the first ending spatial condition being angular orientations of the handheld computing device relative to a reference;

means for storing a plurality of spatial condition changes associated with likelihoods indicative of user attentiveness to a presentation on the handheld computing device; and

means for determining whether the plurality of spatial condition changes includes a first spatial condition change having the first starting spatial condition and the first ending spatial condition of the identified change, a first subset of the spatial condition changes being associated with respective disengagement likelihoods representing how likely respective ones of the first subset of the spatial condition changes correspond to a user beginning to disengage from the presentation on the handheld computing device.

16. The apparatus of claim 15 , wherein the means for identifying is to communicate with a sensor to determine the angular orientations of the handheld computing device.

17. The apparatus of claim 15 , wherein a second subset of the spatial condition changes is associated with corresponding engagement likelihoods representing how likely respective ones of the second plurality of the spatial condition changes correspond to the user beginning to pay attention to the presentation on the handheld computing device.

18. The apparatus of claim 15 , wherein:

a second subset of the spatial condition changes is associated with respective engagement likelihoods representing how likely respective ones of a third subset of spatial condition changes coinciding with respective ones of a fourth subset of spatial condition changes correspond to a user beginning to engage with a presentation on the handheld computing device,

the third subset of the spatial condition changes is associated with corresponding engagement likelihoods representing how likely respective ones of the third subset of spatial condition changes correspond to the user beginning to pay attention to the presentation on the handheld computing device, and

the fourth subset of the spatial condition changes is associated with respective disengagement likelihoods representing how likely respective ones of the fourth subset of spatial condition changes correspond to the user beginning to disengage from the presentation on the handheld computing device.

19. The apparatus of claim 15 , wherein:

a second subset of the spatial condition changes is associated with respective disengagement likelihoods representing how likely respective ones of a third subset of spatial condition changes coinciding with respective ones of a fourth subset of spatial condition changes correspond to the user beginning to disengage from the presentation on the handheld computing device,

the third subset of the spatial condition changes is associated with corresponding engagement likelihoods representing how likely respective ones of the third subset of spatial condition changes correspond to the user beginning to pay attention to the presentation on the handheld computing device,

the fourth subset of the spatial condition changes is associated with respective disengagement likelihoods representing how likely respective ones of the fourth subset of spatial condition changes correspond to the user beginning to disengage from the presentation on the handheld computing device.

20. The apparatus of claim 15 , wherein the means for determining is to, when the plurality of spatial condition changes includes the first spatial condition change having the first starting spatial condition and the first ending spatial condition of the change, select a likelihood associated with the first spatial condition change as a measure of user attentiveness to the handheld computing device.

21. The apparatus of claim 15 , further means for determining is to, when the plurality of spatial condition changes includes the first spatial condition change having the first starting spatial condition and the first ending spatial condition of the change and a second spatial condition change having a second detected starting spatial condition and a second detected ending spatial condition of a second identified change, combine a first likelihood associated with the first spatial condition change with a second likelihood associated with the second spatial condition change to form a measure of user attentiveness to the handheld computing device.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2018
From: BESEHANIC, JAN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 046795/0912 →