IP Library Granted Patent US 7,742,618
Granted Patent B2
US 7,742,618 · App. 11/363,765 · Granted Jun 22, 2010

Methods and apparatus for embedding and recovering an image for use with video content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,742,618
App. No.
11/363,765
Granted
Jun 22, 2010
Kind
B2
Abstract

Methods and apparatus for embedding and recovering an image for use with video content are disclosed. A disclosed system embeds a real component of a spectral representation of an image into a set of video frames and embeds an imaginary component of the spectral representation of the image into a second set of video frames. The two sets of video frames are combined and broadcast. The disclosed system recovers the real component of the spectral representation of an embedded image from a first set of received video frames and the imaginary component of the spectral representation of an embedded image from a second set of the received video frames.

Claims (77)

1. A method of embedding image data within a plurality of video frames, comprising:

embedding a real component of a spectral representation of the image data into a first set of video frames from the plurality of video frames to form a modified first set of video frames; and

embedding an imaginary component of the spectral representation of the image data into a second set of video frames from the plurality of video frames to form a modified second set of video frames.

2. A method as defined in claim 1 , wherein the image data is representative of a two-dimensional image.

3. A method as defined in claim 1 , wherein the image data comprises coded data.

4. A method as defined in claim 1 , further comprising:

associating at least one random phase angle from a plurality of random phase angles to each pixel of at least a portion of the image data to form randomized image data;

applying a two-dimensional Fourier transform to the randomized image data to form a spectral representation of the randomized image data; and

separating the plurality of video frames into the first set of video frames and the second set of video frames.

5. A method as defined in claim 4 , wherein the plurality of random phase angles comprises an uniform distribution of phase angles.

6. A method as defined in claim 4 , wherein a first random phase angle associated with a first pixel is not equal to a second random phase angle associated with a second pixel.

7. A method as defined in claim 4 , further comprising conditioning the spectral representation of the randomized image data.

8. A method as defined in claim 7 , wherein conditioning the spectral representation of the randomized image data comprises at least one of scaling by a gain factor, normalizing, and quantizing the spectral representation of the randomized image data.

9. A method as defined in claim 8 , wherein normalizing the spectral representation of the randomized image data comprises scaling the spectral representation of the randomized image data by an inverse of a maximum amplitude of the spectral representation of the randomized image data.

10. A method as defined in claim 1 , wherein the first set of video frames is not equal to the second set of video frames.

11. A method as defined in claim 1 , wherein the plurality of video frames comprises a set of sequential video frames.

12. A method as defined in claim 11 , wherein the set of sequential video frames comprises a set of consecutive video frames.

13. A method as defined in claim 1 , wherein the plurality of video frames comprises at least four video frames.

14. A method as defined in claim 1 , wherein the plurality of video frames comprises at least two video frames having inter-frame pixel differences less than a predetermined threshold.

15. A method as defined in claim 1 , wherein embedding the real component of the spectral representation of the image data into the first set of video frames comprises at least one of an addition operation and a subtraction operation.

16. A method as defined in claim 1 , wherein embedding the imaginary component of the spectral representation of the image data into the second set of video frames comprises at least one of an addition operation and a subtraction operation.

17. A method as defined in claim 1 , further comprising:

combining the modified first set of video frames and the modified second set of video frames to form a third set of video frames from the plurality of video frames; and

broadcasting the third set of video frames.

18. A method of recovering image data from a plurality of video frames comprising:

recovering a real component of a spectral representation of the image data from a first set of video frames from the plurality of video frames;

recovering an imaginary component of the spectral representation of the image data from a second set of video frames from the plurality of video frames; and

recovering the image data based on the real component of the spectral representation of the image data and the imaginary component of the spectral representation of the image data.

19. A method as defined in claim 18 , wherein the image data recovered from the plurality of video frames comprises coded data.

20. A method as defined in claim 18 , wherein recovering the real component of the spectral representation of the image data from the first set of video frames comprises calculating a difference between two video frames from the first set of video frames.

21. A method as defined in claim 18 , wherein recovering the imaginary component of the spectral representation of the image data from the second set of video frames comprises calculating a difference between two video frames from the second set of video frames.

22. A method as defined in claim 18 , wherein recovering the image data comprises:

combining the real component of the spectral representation of the image data with the imaginary component of the spectral representation of the image data to form a spectral representation of the image data; and

applying an inverse Fourier transform to the spectral representation of the image data to recover the image data.

23. A method as defined in claim 18 , further comprising:

separating the plurality of video frames into the first set of video frames and the second set of video frames.

24. A method as defined in claim 23 , wherein the first set of video frames is not equal to the second set of video frames.

25. A method as defined in claim 18 , further comprising:

receiving a video frame;

storing the video frame in a video frame buffer until at least four video frames have been buffered;

forming the plurality of video frames from the video frames within the video frame buffer; and

removing an oldest video frame from the video frame buffer.

26. A method as defined in claim 22 , further comprising testing the validity of the recovered image data.

27. A method as defined in claim 26 , wherein testing the validity of the recovered image data comprises at least one of a comparison between the recovered image data and images within an image database and decoding of coded data within the recovered image data.

28. A system for embedding image data within a plurality of video frames comprising:

a processor system including a memory; and

instructions stored in the memory that enable the processor system to:

embed a real component of a spectral representation of the image data into a first set of video frames from the plurality of video frames; and

embed an imaginary component of the spectral representation of the image data into a second set of video frames from the plurality of video frames.

29. A system as defined in claim 28 , wherein the instructions stored in the memory enable the processor system to:

combine the first set of video frames from the plurality of video frames with the second set of video frames from the plurality of video frames to form a third set of video frames from the plurality of video frames.

30. A system as defined in claim 28 , wherein the instructions stored in the memory enable the processor system to:

associate at least one random phase angle from a plurality of random phase angles to each pixel in the image data to form randomized image data;

apply a two-dimensional Fourier transform to the randomized image data to form a spectral representation of the randomized image data; and

transmit the third set of video frames from the plurality of video frames.

31. A system as defined in claim 28 , wherein the real component of the spectral representation of the image data is embedded in the first set of video frames using at least one of an addition operation and a subtraction operation.

32. A system as defined in claim 28 , wherein the imaginary component of the spectral representation of the image data is embedded in the second set of video frames using at least one of an addition operation and a subtraction operation.

33. A system to recover image data from a plurality of video frames comprising:

a processor system including a memory; and

instructions stored in the memory that enable the processor system to:

recover a real component of a spectral representation of the image data from a first set of video frames from the plurality of video frames;

recover an imaginary component of the spectral representation of the image data from a second set of video frames from the plurality of video frames; and

recover the image data based on the real component of the spectral representation of the image data and the imaginary component of the spectral representation of the image data.

34. A system as defined in claim 33 , wherein the instructions stored in the memory enable the processor system to:

separate the plurality of video frames into the first set of video frames and the second set of video frames.

35. A system as defined in claim 33 , wherein the real component of the spectral representation of the image data is recovered from the first set of video frames by calculating a difference between two video frames from the first set of video frames.

36. A system as defined in claim 33 , wherein the imaginary component of the spectral representation of the image data is recovered from the second set of video frames by calculating a difference between two video frames from the second set of video frames.

37. A system as defined in claim 33 , wherein the instructions stored in the memory enable the processor system to combine the real component of the spectral representation of the image data with the imaginary component of the spectral representation of the image data to form the spectral representation of the image data.

38. A system as defined in claim 33 , wherein the instructions stored in the memory enable the processor system to:

receive the plurality of video frames; and

transform the spectral representation of the image data to form the image data.

39. A system as defined in claim 33 , wherein the instructions stored in the memory enable the processor system to:

receive a video frame;

store the video frame in a video frame buffer until at least four video frames have been buffered;

form the plurality of video frames from the video frames within the video frame buffer; and

remove an oldest video frame from the video frame buffer.

40. A system as defined in claim 33 , wherein the instructions stored in the memory enable the processor system to test the validity of the recovered image data.

Assignments (11)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
MERGER Recorded Jul 20, 2009
From: NIELSEN MEDIA RESEARCH, LLC (FORMERLY KNOWN AS NIELSEN MEDIA RESEARCH, INC.)
To: NIELSEN COMPANY (US), LLC, THE
Reel/Frame 022995/0165 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2006
From: SRINIVASAN, VENUGOPAL; NELSON, DAN; RAMASWAMY, ARUN
To: NIELSEN MEDIA RESEARCH, INC.
Reel/Frame 017843/0486 →