IP Library Granted Patent US 10,506,226
Granted Patent B2
US 10,506,226 · App. 16/417,128 · Granted Dec 10, 2019

Display device on/off detection methods and apparatus

Inventors: Christen V. Nielsen (Palm Harbor, FL); Dan Nelson (Tampa, FL)
Assignee: The Nielsen Company (US), LLC
H04N17/04H04H60/32H04N21/4394
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,506,226
App. No.
16/417,128
Granted
Dec 10, 2019
Kind
B2
Abstract

Display device ON/OFF detection methods and apparatus are disclosed. Example display activity detectors disclosed herein are to extract regions from respective ones of captured video frames, the regions corresponding to a depiction of a display of a monitored media device Disclosed example display activity detectors are also to compute a distance metric that is to represent an amount a first one of the regions of a first one of the captured video frames differs from a corresponding second one of the regions of a second one of the captured video frames. Disclosed example display activity detectors are further to compare the distance metric to a threshold to determine whether the monitored media device is ON or OFF.

Claims (39)

1. A display activity detector comprising:

memory including computer readable instructions; and

a processor to execute the instructions to at least:

extract regions from respective ones of captured video frames, the regions corresponding to a depiction of a display of a monitored media device;

compute a metric that is to represent an amount a first one of the regions of a first one of the captured video frames differs from a corresponding second one of the regions of a second one of the captured video frames; and

compare the metric to a threshold to determine whether the monitored media device is ON or OFF.

2. The display activity detector of claim 1 , wherein the first one of the captured video frames and the second one of the captured video frames are successive video frames.

3. The display activity detector of claim 1 , wherein the second one of the regions is at a same respective location in the second one of the captured video frames as the first one of the regions is in the first one of the captured video frames.

4. The display activity detector of claim 1 , wherein the processor is to:

determine that the monitored media device is ON when the metric exceeds the threshold; and

determine that the monitored media device is OFF when the metric does not exceed the threshold.

5. The display activity detector of claim 1 , wherein the processor is to determine whether the monitored media device is ON or OFF based on comparison of the metric to the threshold and a color of at least one of the first one of the regions or the second of the regions.

6. The display activity detector of claim 5 , wherein the processor is to increase a confidence associated with a determination that the monitored media device is OFF when the color is a uniform dark color.

7. The display activity detector of claim 1 , further including:

a video sensor to obtain a video signal representative of an area including the monitored media device; and

a frame grabber to obtain the captured video frames from the video signal.

8. An article of manufacture comprising at least one computer readable storage device or storage disk including computer readable instructions that, when executed, cause a processor to at least:

extract regions from respective ones of captured video frames, the regions corresponding to a depiction of a display of a monitored media device;

compute a metric that is to represent an amount a first one of the regions of a first one of the captured video frames differs from a corresponding second one of the regions of a second one of the captured video frames; and

compare the metric to a threshold to determine whether the monitored media device is ON or OFF.

9. The article of manufacture of claim 8 , wherein the first one of the captured video frames and the second one of the captured video frames are successive video frames.

10. The article of manufacture of claim 8 , wherein the second one of the regions is at a same respective location in the second one of the captured video frames as the first one of the regions is in the first one of the captured video frames.

11. The article of manufacture of claim 8 , wherein the instructions, when executed, cause the processor to: determine that the monitored media device is ON when the metric exceeds the threshold; and determine that the monitored media device is OFF when the metric does not exceed the threshold.

12. The article of manufacture of claim 8 , wherein the instructions, when executed, cause the processor to determine whether the monitored media device is ON or OFF based on comparison of the metric to the threshold and a color of at least one of the first one of the regions or the second of the regions.

13. The article of manufacture of claim 12 , wherein the instructions, when executed, cause the processor to increase a confidence associated with a determination that the monitored media device is OFF when the color is a uniform dark color.

14. A method comprising:

extracting regions from respective ones of captured video frames, the regions corresponding to a depiction of a display of a monitored media device;

computing, by executing an instruction with at least one processor, a metric that is to represent an amount a first one of the regions of a first one of the captured video frames differs from a corresponding second one of the regions of a second one of the captured video frames; and

comparing, by executing an instruction with the at least one processor, the metric to a threshold to determine whether the monitored media device is ON or OFF.

15. The method of claim 14 , wherein the first one of the captured video frames and the second one of the captured video frames are successive video frames.

16. The method of claim 14 , wherein the second one of the regions is at a same respective location in the second one of the captured video frames as the first one of the regions is in the first one of the captured video frames.

17. The method of claim 14 , further including:

determining that the monitored media device is ON when the metric exceeds the threshold; and

determining that the monitored media device is OFF when the metric does not exceed the threshold.

18. The method of claim 14 , further including determining whether the monitored media device is ON or OFF based on comparison of the metric to the threshold and a color of at least one of the first one of the regions or the second of the regions.

19. The method of claim 18 , wherein the determining of whether the monitored media device is ON or OFF includes increasing a confidence associated with a determination that the monitored media device is OFF when the color is a uniform dark color.

20. The method of claim 14 , further including:

obtaining a video signal representative of an area including the monitored media device; and

obtaining the captured video frames from the video signal.

Assignments (10)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2019
From: NIELSEN, CHRISTEN V.; NELSON, DAN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 050527/0557 →
CHANGE OF NAME Recorded Sep 27, 2019
From: NIELSEN MEDIA RESEARCH, INC.
To: NIELSEN MEDIA RESEARCH, LLC
Reel/Frame 050581/0383 →
MERGER Recorded Sep 27, 2019
From: NIELSEN MEDIA RESEARCH, LLC
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 050527/0579 →