IP Library Granted Patent US 8,020,180
Granted Patent B2
US 8,020,180 · App. 12/845,660 · Granted Sep 13, 2011

Digital video signature apparatus and methods for use with video program identification systems

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,020,180
App. No.
12/845,660
Granted
Sep 13, 2011
Kind
B2
Abstract

Digital video signature apparatus and methods for use with video program identification systems are disclosed. The disclosed apparatus and methods identify a video program using a sequence of signatures. Each of the signatures includes a set of centroids corresponding to one of a plurality of frames of the video program. The apparatus and methods compare the sequence of signatures to a set of reference sequences of signatures and identify the video program based on the comparison of the sequence of signatures to the set of reference sequences of signatures.

Claims (65)

1. A method of generating a video signature, comprising:

receiving compressed video information;

selecting a frame from the compressed video information based on a number or proportion of intra-coded macro blocks within the frame;

calculating image component centroid information based on the selected frame; and

generating the video signature using the image component centroid information.

2. A method as defined in claim 1 , wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

3. A method as defined in claim 1 , further comprising extracting scaled image information from the frame and using the scaled image information to calculate the image component centroid information.

4. A method as defined in claim 3 , wherein extracting the scaled image information from the frame includes extracting only intra-coded macro blocks from the frame.

5. A method as defined in claim 4 , wherein extracting the scaled image information includes extracting only a portion of each of the intra-coded macro blocks.

6. A method as defined in claim 5 , wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

7. A method as defined in claim 3 , further comprising converting the scaled image information to spatial domain information and using the spatial domain information to calculate the image component centroid information.

8. A method as defined in claim 3 , further comprising weighting the scaled image information prior to generating the video signature.

9. A method as defined in claim 1 , wherein the compressed video information includes at least one MPEG frame.

10. A method as defined in claim 1 , wherein the image component centroid information includes normalized centroid data.

11. A method as defined in claim 1 , wherein the image component centroid information includes centroid information associated with a plurality of image components.

12. A method as defined in claim 1 , wherein the plurality of image components includes image components associated with a color model.

13. A method as defined in claim 1 , wherein generating the video signature using the image component centroid information includes generating a set of image component centroids associated with a plurality of image components.

14. A method as defined in claim 1 , wherein generating the video signature using the image component centroid information includes generating a set of image component centroids associated with a plurality of areas within an image associated with the compressed video information.

15. A method as defined in claim 1 , further comprising inverting at least some of the compressed image information in response to a determination that the at least some of the compressed image information corresponds to relatively dark foreground information on a relatively light background.

16. A method as defined in claim 1 , further comprising determining that at least a portion of the compressed video information is substantially uniform and generating the video signature using a constant associated with an image component value instead of the image centroid information.

17. A method as defined in claim 16 , wherein the constant is one of an average and a trend value associated with a plurality of images.

18. A system for generating a video signature, comprising:

a memory; and

a processor coupled to the memory and programmed to:

receive compressed video information;

select a frame from the compressed video information based on a number or proportion of intra-coded macro blocks within the frame;

calculate image component centroid information based on the selected frame; and

generate the video signature using the image component centroid information.

19. A system as defined in claim 18 , wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

20. A system as defined in claim 18 , wherein the processor is programmed to extract scaled image information from the frame and to use the scaled image information to calculate the image component centroid information.

21. A system as defined in claim 20 , wherein the processor is programmed to extract the scaled image information from the frame by extracting only intra-coded macro blocks from the frame.

22. A system as defined in claim 21 , wherein the processor is programmed to extract the scaled image information by extracting only a portion of each of the intra-coded macro blocks.

23. A system as defined in claim 22 , wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

24. A system as defined in claim 20 , wherein the processor is programmed to convert the scaled image information to spatial domain information and to use the spatial domain information to calculate the image component centroid information.

25. A system as defined in claim 20 , wherein the processor is programmed to weight the scaled image information prior to generating the video signature.

26. A system as defined in claim 18 , wherein the compressed video information includes at least one MPEG frame.

27. A system as defined in claim 18 , wherein the image component centroid information includes normalized centroid data.

28. A system as defined in claim 18 , wherein the image component centroid information includes centroid information associated with a plurality of image components.

29. A system as defined in claim 28 , wherein the plurality of image components includes image components associated with a color model.

30. A system as defined in claim 18 , wherein the processor is programmed to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of image components.

31. A system as defined in claim 18 , wherein the processor is programmed to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of areas within an image associated with the compressed video information.

32. A system as defined in claim 18 , wherein the processor is programmed to invert at least some of the compressed image information in response to a determination that the at least some of the compressed image information corresponds to relatively dark foreground information on a relatively light background.

33. A system as defined in claim 18 , wherein the processor is programmed to determine that at least a portion of the compressed video information is substantially uniform and generate the video signature using a constant associated with an image component value instead of the image centroid information.

34. A system as defined in claim 33 , wherein the constant is one of an average and a trend value associated with a plurality of images.

35. A machine readable medium having instructions stored thereon that, when executed, cause a machine to:

receive compressed video information;

select a frame from the compressed video information based on a number or proportion of intra-coded macro blocks within the frame;

calculate image component centroid information based on the selected frame; and

generating a video signature using the image component centroid information.

36. A machine readable medium as defined in claim 35 , wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

37. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to extract scaled image information from the frame and use the scaled image information to calculate the image component centroid information.

38. A machine readable medium as defined in claim 37 having instructions stored thereon that, when executed, cause the machine to extract the scaled image information from the frame by extracting only intra-coded macro blocks from the frame.

39. A machine readable medium as defined in claim 38 having instructions stored thereon that, when executed, cause the machine to extract the scaled image information by extracting only a portion of each of the intra-coded macro blocks.

40. A machine readable medium as defined in claim 39 , wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

41. A machine readable medium as defined in claim 37 having instructions stored thereon that, when executed, cause the machine to convert the scaled image information to spatial domain information and use the spatial domain information to calculate the image component centroid information.

42. A machine readable medium as defined in claim 37 having instructions stored thereon that, when executed, cause the machine to weight the scaled image information prior to generating the video signature.

43. A machine readable medium as defined in claim 35 , wherein the compressed video information includes at least one MPEG frame.

44. A machine readable medium as defined in claim 35 , wherein the image component centroid information includes normalized centroid data.

45. A machine readable medium as defined in claim 35 , wherein the image component centroid information includes centroid information associated with a plurality of image components.

46. A machine readable medium as defined in claim 45 , wherein the plurality of image components includes image components associated with a color model.

47. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of image components.

48. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of areas within an image associated with the compressed video information.

49. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to invert at least some of the compressed image information in response to a determination that the at least some of the compressed image information corresponds to relatively dark foreground information on a relatively light background.

50. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to determine that at least a portion of the compressed video information is substantially uniform and generate the video signature using a constant associated with an image component value instead of the image centroid information.

51. A machine readable medium as defined in claim 50 , wherein the constant is one of an average and a trend value associated with a plurality of images.

Assignments (12)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
CONVERSION Recorded Oct 6, 2010
From: NIELSEN MEDIA RESEARCH, INC., A DELAWARE CORPORATION
To: NIELSEN MEDIA RESEARCH, LLC, A DELAWARE CORPORATION
Reel/Frame 025100/0865 →
MERGER Recorded Oct 6, 2010
From: NIELSEN MEDIA RESEARCH, LLC, A DELAWARE CORPORATION
To: THE NIELSEN COMPANY (US), LLC, A DELAWARE LIMITED LIABILITY COMPANY
Reel/Frame 025100/0463 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2010
From: DENG, KEVIN
To: NIELSEN MEDIA RESEARCH, INC., A DELAWARE CORPORATION
Reel/Frame 025100/0414 →