IP Library Granted Patent US 9,972,332
Granted Patent B2
US 9,972,332 · App. 15/269,158 · Granted May 15, 2018

Methods and apparatus to perform audio watermarking and watermark detection and extraction

Inventors: Alexander Pavlovich Topchy (New Port Richey, FL); Arun Ramaswamy (Tampa, FL); Venugopal Srinivasan (Palm Harbor, FL)
Assignee: The Nielsen Company (US), LLC
G10L19/018G10L19/022G10L19/06H04N19/467H04N21/23892H04N21/8358G10L25/18H04H20/31H04H60/31H04H2201/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,972,332
App. No.
15/269,158
Granted
May 15, 2018
Kind
B2
Abstract

Encoding and decoding methods and apparatus are described. An example method is described for embedding information into audio by determining a first set of frequency components to represent a synchronization block, the synchronization block representing one of a plurality of different message types, one frequency component from each set of frequency components being located in a respective code band, and spacing between adjacent code bands is equal to or less than the spacing between adjacent frequency components of each code band. Determining amplitudes of respective ones of the first set of frequency components representing the synchronization block based on a masking ability of an audio block of the audio. Synthesizing the first set of frequency components representing the synchronization block to determine a first set of synthesized code frequency components, based on the determined amplitudes. Combining the first set of synthesized code frequency components with the audio block.

Claims (48)

1. A method of embedding information into audio, the method comprising:

determining, by executing an instruction with a processor, a first set of frequency components to represent a synchronization block, the synchronization block representing one of a plurality of different message types, different sets of frequency components representing respectively different information, one frequency component from each set of frequency components being located in a respective code band, there are multiple code bands, and spacing between adjacent code bands is equal to or less than spacing between adjacent frequency components of each code band;

determining, by executing an instruction with the processor, amplitudes of respective ones of the first set of frequency components representing the synchronization block, the amplitudes being determined by a masking ability of an audio block of the audio;

synthesizing, by executing an instruction with the processor, the respective ones of the first set of frequency components representing the synchronization block to determine a first set of synthesized code frequency components, the first set of synthesized code frequency components being synthesized with the determined amplitudes; and

combining, by executing an instruction with the processor, the first set of synthesized code frequency components with the audio block.

2. The method as defined in claim 1 , wherein there are sixteen different message types.

3. The method as defined in claim 2 , where a first frequency range including first code frequencies representing each of the sixteen different message types is larger than a frequency amount separating the first frequency range from an adjacent second frequency range including second code frequencies also representing each of the sixteen different message types.

4. The method as defined in claim 1 , further including:

determining a second set of frequency components to represent a data payload of the message specified by the synchronization block;

determining amplitudes of respective ones of the second set of frequency components representing the data payload, the amplitudes of the respective ones of the second set of frequency components being determined by the masking ability of the audio block;

synthesizing the respective ones of the second set of frequency components representing the data payload to determine a second set of synthesized code frequency components, the second set of synthesized code frequency components are synthesized with the determined amplitudes; and

combining the second set of synthesized code frequency components with the audio block.

5. The method as defined in claim 4 , wherein the data payload includes at least one data block following the synchronization block.

6. The method as defined in claim 1 , wherein the respective ones of the first set of frequency components are in an audible frequency range.

7. The method as defined in claim 1 , wherein the multiple code bands include seven code bands.

8. The method as defined in claim 7 , wherein the spacing between adjacent frequency components within a code band correspond to a spacing of one frequency index, the spacing between adjacent code bands correspond to the spacing of one frequency index and the different sets of frequency components include 144 different sets of frequency components and each code band includes 144 different frequency indices.

9. An apparatus to embed auxiliary information into an audio signal, the apparatus comprising:

a code frequency selector to receive a message type and to determine a first set of frequency components to represent a synchronization block, the synchronization block representing one of a plurality of different message types, different sets of frequency components representing respectively different information, one frequency component from each set of frequency components being located in a respective code band, there are multiple code bands, and spacing between adjacent code bands is equal to or less than spacing between adjacent frequency components of each code band;

a masking evaluator to determine amplitudes of respective ones of the first set of frequency components representing the synchronization block, the amplitudes being determined by a masking ability of an audio block of the audio;

a code synthesizer to synthesize the respective ones of the first set of the frequency components representing the synchronization block to determine a first set of synthesized code frequency components, wherein the first set of synthesized code frequency components being synthesized with the determined amplitudes; and

a combiner to combine the first set of synthesized code frequency components with the audio block.

10. The apparatus as defined in claim 9 , wherein there are sixteen different message types.

11. The apparatus as defined in claim 10 , where a first frequency range including first code frequencies representing each of the sixteen different message types is larger than a frequency amount separating the first frequency range from an adjacent second frequency range including second code frequencies also representing each of the sixteen different message types.

12. The apparatus as defined in claim 9 , further including:

the code frequency selector to determine a second set of frequency components to represent a data payload of the message specified by the synchronization block;

the masking evaluator to determine amplitudes of respective ones of the second set of frequency components representing the data payload, the amplitudes of the respective ones of the second set of frequency components being determined by the masking ability of the audio block;

the code synthesizer to synthesize the respective ones of the second set of frequency components representing the data payload to determine a second set of synthesized code frequency components, the second set of synthesized code frequency components being synthesized with the determined amplitudes; and

the combiner to combine the second set of synthesized code frequency components with the audio block.

13. The apparatus as defined in claim 12 , wherein the data payload includes at least one data block following the synchronization block.

14. The apparatus as defined in claim 9 , wherein the respective ones of the first set of frequency components are in an audible frequency range.

15. The apparatus as defined in claim 9 , wherein the multiple code bands include seven code bands.

16. The apparatus as defined in claim 15 , wherein the spacing between adjacent frequency components within a code band correspond to a spacing of one frequency index, the spacing between adjacent code bands correspond to the spacing of one frequency index and the different sets of frequency components include 144 different sets of frequency components and each code band includes 144 different frequency indices.

17. An article of manufacture comprising computer readable instructions which, when executed, cause a computer to:

determine a first set of frequency components to represent a synchronization block, the synchronization block representing one of a plurality of different message types, different sets of frequency components representing respectively different information, one frequency component from each set of frequency components being located in a respective code band, there are multiple code bands, and spacing between adjacent code bands is equal to or less than spacing between adjacent frequency components of each code band;

determine amplitudes of respective ones of the first set of frequency components representing the synchronization block, the amplitudes being determined by a masking ability of an audio block;

synthesize the respective ones of the first set of frequency components representing the synchronization block to determine a first set of synthesized code frequency components, wherein the first set of synthesized code frequency components being synthesized with the determined amplitudes; and

combine the first set of synthesized code frequency components with the audio block.

18. The article of manufacture as defined in claim 17 , wherein there are sixteen different message types.

19. The article of manufacture as defined in claim 18 , where a first frequency range including first code frequencies representing each of the sixteen different message types is larger than a frequency amount separating the first frequency range from an adjacent second frequency range including second code frequencies also representing each of the sixteen different message types.

20. The article of manufacture as defined in claim 17 , wherein the instructions, when executed, further cause the computer to:

determine a second set of frequency components to represent a data payload of the message specified by the synchronization block;

determine amplitudes of respective ones of the second set of frequency components representing the data payload, the amplitudes of respective ones of the second set of frequency components being determined by the masking ability of the audio block;

synthesize the respective ones of the second set of frequency components representing the data payloads to determine a second set of synthesized code frequency components, the second set of synthesized code frequency components being synthesized with the determined amplitudes; and

combine the second set of synthesized code frequency components with the audio block.

21. The article of manufacture as defined in claim 20 , wherein the data payload includes at least one data block following the synchronization block.

22. The article of manufacture as defined in claim 17 , wherein the respective ones of the first set of frequency components are in an audible frequency range.

23. The article of manufacture as defined in claim 17 , wherein the multiple code bands include seven code bands.

24. The article of manufacture as defined in claim 17 , wherein the spacing between adjacent frequency components within a code band correspond to a spacing of one frequency index, the spacing between adjacent code bands correspond to the spacing of one frequency index and the different sets of frequency components include 144 different sets of frequency components and each code band includes 144 different frequency indices.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2016
From: TOPCHY, ALEXANDER PAVLOVICH; RAMASWAMY, ARUN; SRINIVASAN, VENUGOPAL
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 039812/0196 →
Continuity (5)
Continuation 13730271 · Dec 28, 2012
Division 12249619 · Oct 10, 2008
Provisional Application 61043952 · Apr 10, 2008
Provisional Application 60987280 · Nov 12, 2007
Related Publication 20170004837A1 · Jan 5, 2017