IP Library Granted Patent US 10,964,333
Granted Patent B2
US 10,964,333 · App. 16/806,851 · Granted Mar 30, 2021

Methods and apparatus to perform audio watermarking and watermark detection and extraction

Inventors: Alexander Pavlovich Topchy (New Port Richey, FL); Arun Ramaswamy (Tampa, FL); Venugopal Srinivasan (Palm Harbor, FL)
Assignee: The Nielsen Company (US), LLC
G10L19/018G10L19/022G10L19/06H04N19/467H04N21/23892H04N21/8358G10L25/18H04H20/31H04H60/31H04H2201/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,964,333
App. No.
16/806,851
Granted
Mar 30, 2021
Kind
B2
Abstract

Methods and apparatus to perform audio watermarking and watermark detection and extraction are disclosed. Example apparatus include means for transforming an audio signal into a frequency domain representation, and means for determining characteristics of frequencies of the frequency domain representation that may contain the code. In some examples, the means for determining is to normalize the characteristics of the frequencies of the frequency domain representation in respective ones of the code bands that may contain the code to determine normalized characteristics of the frequencies representative of the code, a respective one of the code bands that may contain the code to be normalized against a first characteristic of a first frequency in that code band; sum the normalized characteristics of the frequencies representative of the code; determine the sum is representative of the code when the sum satisfies a threshold; and validate the code based on an encoding scheme.

Claims (42)

1. An apparatus to decode an audio signal to obtain a code, the code encoded in the audio signal with a plurality of frequency components in a plurality of code bands, the apparatus comprising:

means for transforming the audio signal into a frequency domain representation; and

means for determining characteristics of frequencies of the frequency domain representation that may contain the code, the means for determining to:

normalize the characteristics of the frequencies of the frequency domain representation in respective ones of the code bands that may contain the code to determine normalized characteristics of the frequencies representative of the code, a respective one of the code bands that may contain the code to be normalized against a first characteristic of a first frequency in that code band;

sum the normalized characteristics of the frequencies representative of the code to determine a sum for the frequencies representative of the code;

determine that the sum is representative of the code when the sum satisfies a threshold; and

validate the code based on an encoding scheme.

2. The apparatus of claim 1 , wherein different sets of the frequency components represent respectively different information, one frequency component from each of the sets of the frequency components is located in a code band, there are multiple code bands, and spacing between adjacent code bands is equal to or less than the spacing between adjacent frequency components of each code band.

3. The apparatus of claim 2 , wherein the characteristics of the frequencies that may contain the code are amplitudes of the frequencies.

4. The apparatus of claim 2 , wherein the characteristics of the frequencies that may contain the code are energies of the frequencies.

5. The apparatus of claim 1 , wherein the means for determining is to reduce a number of frequencies processed after the code is determined.

6. The apparatus of claim 5 , wherein the code includes synchronization information.

7. The apparatus of claim 1 , wherein the first characteristic is a magnitude of a frequency component having the highest energy in that code band.

8. An apparatus to decode an audio signal to obtain a code, the code encoded in the audio signal with a plurality of frequency components in a plurality of code bands, the apparatus comprising:

a memory; and

a processor to execute instructions stored in the memory to at least:

transform the audio signal into a frequency domain representation;

determine characteristics of frequencies of the frequency domain representation that may contain the code;

normalize the characteristics of the frequencies of the frequency domain representation in respective ones of the plurality of code bands that may contain the code to determine normalized characteristics of the frequencies representative of the code, a respective one of the code bands that may contain the code to be normalized against a first characteristic of a first frequency in that code band;

sum the normalized characteristics of the frequencies representative of the code to determine a sum for the frequencies representative of the code;

determine that the sum is representative of the code when the sum satisfies a threshold; and

validate the code based on an encoding scheme.

9. The apparatus of claim 8 , wherein different sets of the frequency components represent respectively different information, one frequency component from each of the sets of the frequency components is located in a code band, there are multiple code bands, and spacing between adjacent code bands is equal to or less than the spacing between adjacent frequency components of each code band.

10. The apparatus of claim 9 , wherein the characteristics of the frequencies that may contain the code are amplitudes of the frequencies.

11. The apparatus of claim 9 , wherein the characteristics of the frequencies that may contain the code are energies of the frequencies.

12. The apparatus of claim 8 , wherein the processor is to reduce a number of frequencies processed after the code is determined.

13. The apparatus of claim 12 , wherein the code includes synchronization information.

14. A system to decode an audio signal, the system comprising:

a receiver to receive the audio signal;

a converter to transform the encoded audio signal into a frequency domain representation; and

a monitor to:

determine characteristics of frequencies of the frequency domain representation that may contain the code;

normalize the characteristics of the frequencies of the frequency domain representation in respective ones of the code bands that may contain the code to determine normalized characteristics of the frequencies representative of the code, a respective one of the code bands that may contain the code to be normalized against a first characteristic of a first frequency in that code band;

sum the normalized characteristics of the frequencies representative of the code to determine a sum for the frequencies representative of the code;

determine that the sum is representative of the code when the sum satisfies a threshold; and

validate the code based on an encoding scheme.

15. The system of claim 14 , wherein different sets of the frequency components represent respectively different information, one frequency component from each of the sets of the frequency components is located in a code band, there are multiple code bands, and spacing between adjacent code bands is equal to or less than the spacing between adjacent frequency components of each code band.

16. The system of claim 15 , wherein the characteristics of the frequencies that may contain the code are amplitudes of the frequencies.

17. The system of claim 15 , wherein the characteristics of the frequencies that may contain the code are energies of the frequencies.

18. The system of claim 14 , wherein the monitor is to reduce a number of frequencies processed after the code is determined.

19. The system of claim 18 , wherein the code includes synchronization information.

20. The system of claim 14 , wherein the first characteristic is a magnitude of a frequency component having the highest energy in that code band.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2020
From: TOPCHY, ALEXANDER PAVLOVICH; RAMASWAMY, ARUN; SRINIVASAN, VENUGOPAL
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052295/0854 →
Continuity (7)
Continuation 15973154 · May 7, 2018
Continuation 15269158 · Sep 19, 2016
Continuation 13730271 · Dec 28, 2012
Division 12249619 · Oct 10, 2008
Provisional Application 61043952 · Apr 10, 2008
Provisional Application 60987280 · Nov 12, 2007
Related Publication 20200202875A1 · Jun 25, 2020