IP Library Granted Patent US 8,019,162
Granted Patent B2
US 8,019,162 · App. 11/923,141 · Granted Sep 13, 2011

Methods and apparatus for detecting on-screen media sources

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,019,162
App. No.
11/923,141
Granted
Sep 13, 2011
Kind
B2
Abstract

Methods and apparatus for detecting on-screen media sources are disclosed. An example method includes monitoring a region of interest of a video signal for a first image, comparing the first image to a stored image, and confirming the media device change when the stored image differs from the first image and is associated with a secondary criterion.

Claims (46)

1. A computer implemented method to identify an active household media source device, comprising:

receiving a video signal;

analyzing a portion of the video signal associated with a display region of interest, wherein the video signal is provided to a display device by the active household media source device;

comparing the portion of the video signal to a template programmed state diagram comprising a plurality of device modes, each device mode corresponding to an image and associated with a candidate next mode, to identify the active household media source device from a plurality of household media source devices that are not providing the video signal to the display device; and

generating an output including the identified active household media source device.

2. A method as defined in claim 1 , wherein the template comprises an expected video image at the region of interest.

3. A method as defined in claim 2 , further comprising associating the active household media source device with the video signal when the expected video image is detected in the region of interest.

4. A method as defined in claim 1 , wherein analyzing the portion of the video signal comprises quantizing the portion of the video signal to generate a quantized video signal.

5. A method as defined in claim 4 , further comprising applying a quantization threshold to generate the quantized video signal, the threshold specifying at least one of a color density, a pixel intensity, or a pixel density.

6. A method as defined in claim 1 , wherein analyzing the portion of the video signal comprises detecting an edge of the portion of the video signal.

7. A method as defined in claim 6 , wherein the edge of the portion of the video signal comprises a quiet area surrounding the portion of the video signal.

8. A method as defined in claim 1 , wherein the display device comprises a television.

9. A computer implemented method to identify video output from an alternate household media source device, comprising:

monitoring a region of interest of a video signal for a first image;

comparing the first image to a stored image programmed state diagram comprising a plurality of device modes, each device mode corresponding to an image and associated with a candidate next mode, the first image associated with one of a plurality of household media source devices capable of outputting the video signal to a display device;

confirming current video output from the alternate household media source device when the image associated with the candidate next mode differs from the first image and is associated with a secondary criterion to identify the alternate household media source device from a plurality of household media source devices that are not providing a video signal to the display device; and

generating an output including the confirmed alternate household media source device.

10. A method as defined in claim 9 , wherein the secondary criterion comprises at least one of a second image located in a second region of interest, a quiet area, a presence of a third region of interest, an absence of a fourth region of interest, or a remote control signal.

11. A method as defined in claim 9 , wherein the image associated with the candidate next mode comprises a first pixel sum value and the first image comprises a second pixel sum value.

12. A method as defined in claim 11 , further comprising calculating a dot product of the first and second pixel sums.

13. A method as defined in claim 12 , wherein the dot product yields a positive output when the image associated with the candidate next mode and the first image are similar.

14. A method as defined in claim 12 , wherein the dot product yields a negative output when the image associated with the candidate next mode and the first image are different.

15. A method as defined in claim 12 , wherein the dot product constructively adds when the image associated with the candidate next mode is similar to the first image, and the dot product destructively adds when the image associated with the candidate next mode is different from the first image.

16. A method as defined in claim 9 , further comprising calculating a criterion to determine if the first image differs from the image associated with the candidate next mode.

17. A method as defined in claim 16 , wherein the criterion comprises a ratio of a dot product of the first image and the image associated with the candidate next mode, and the number of pixels in the first image.

18. A method to identify a media device mode comprising:

monitoring a region of interest in a video signal at a first time;

comparing the monitored region of interest to a programmed state diagram comprising a plurality of device modes to determine a media device mode candidate, each device mode corresponding to an image and associated with at least one of the media device mode candidates;

monitoring the region of interest at a second time; and

comparing the monitored region of interest to the programmed state diagram to confirm the media device mode candidate as the media device mode and to identify an active household media source device from a plurality of household media source devices that are not providing the video signal to a display device.

19. A method as defined in claim 18 , wherein the programmed state diagram comprises the plurality of device modes for at least one of a set-top box, a television, a video cassette recorder, a digital video disk player, a people meter, or a game console.

20. An apparatus to monitor a video signal comprising:

a region of interest extractor to extract an image signal from a region of the video signal;

an image quantizer to quantize the extracted image signal; and

an object comparator to compare the quantized image signal with a programmed mode sequence state diagram based on firmware programming of a household media device to identify an operational viewing mode and to identify an active household media source device from a plurality of household media source devices that are not providing the video signal to a display device.

21. An apparatus as defined in claim 20 , further comprising a quantizer threshold module to provide a quantization threshold to the image quantizer to at least one of decrease a pixel density, alter a pixel luminosity, or remove a pixel color.

22. An apparatus to process a video signal comprising:

a framegrabber to capture the video signal at a first rate;

a media source detector to quantize the video signal to improve image detection of a first and second region of interest; and

an on screen display reader to compare detected images in the first and second regions of interest to a programmed mode sequence state diagram to identify an active household media source device from a plurality of household media source devices that are not providing the video signal to a display device when the compared images in the first and second regions of interest match a sequence of images associated with the programmed mode sequence state diagram.

23. An apparatus as defined in claim 22 , wherein the media source detector further comprises a quantizer threshold to adjust at least one of a pixel density, a pixel color, or a pixel luminosity.

24. A computer implemented method, comprising:

capturing a screenshot generated by a media device;

determining image regions of interest based on an operating mode of the media device and a programmed state diagram corresponding to the media device; and

identifying a current operating mode of the media device by analyzing at least one of the image regions of interest within the screenshot to identify an active household media source device from a plurality of household media source devices that are not providing a video signal to a display device.

25. A method as defined in claim 24 , further comprising identifying a plurality of candidate next operating modes based on the identified current operating mode of the media device.

Assignments (14)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
MERGER Recorded Dec 14, 2009
From: NIELSEN MEDIA RESEARCH, LLC (FORMERLY KNOWN AS NIELSEN MEDIA RESEARCH, INC.), A DELAWARE LIMITED LIABILITY COMPANY
To: THE NIELSEN COMPANY (US), LLC, A DELAWARE LIMITED LIABILITY COMPANY
Reel/Frame 023645/0838 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2009
From: NIELSEN COMPANY (U.S.), INC., THE
To: NIELSEN MEDIA RESEARCH, INC.
Reel/Frame 022094/0469 →
RE-RECORD TO CORRECT THE NAME AND THE STATE OF INCORPORATION OF THE ASSIGNEE, PREVIOUSLY RECORDED ON REEL 020475 FRAME 0945. Recorded Jan 8, 2009
From: ZHANG, MIN; WRIGHT, DAVID HOWELL; COOPER, SCOTT; DYKSTRA, REGINA; RAMASWAMY, ARUN; NELSON, DANIEL
To: NIELSEN COMPANY (U.S.), INC., THE, A CORP. OF NEW YORK
Reel/Frame 022094/0496 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2008
From: ZHANG, MIN; WRIGHT, DAVID HOWELL; COOPER, SCOTT; DYKSTRA, REGINA; RAMASWAMY, ARUN; NELSON, DANIEL
To: THE NIELSEN COMPANY (U.S.), INC., A NEW YORK CORPORATION
Reel/Frame 021899/0129 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2008
From: ZHANG, MIN; WRIGHT, DAVID HOWELL; COOPER, SCOTT; DYKSTRA, REGINA; RAMASWAMY, ARUN; NELSON, DANIEL
To: NIELSEN COMPANY, THE
Reel/Frame 020475/0945 →