IP Library Granted Patent US 9,472,198
Granted Patent B2
US 9,472,198 · App. 14/800,376 · Granted Oct 18, 2016

Down-mixing compensation for audio watermarking

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,472,198
App. No.
14/800,376
Granted
Oct 18, 2016
Kind
B2
Abstract

Example methods, apparatus, systems and articles of manufacture to implement down-mixing compensation for audio watermarking are disclosed. Example watermark embedding methods disclosed herein include determining respective attenuation factors for a plurality of audio bands based on energy values associated with down-mixed audio samples corresponding to a first audio channel of a multi-channel audio signal and a second audio channel of the multi-channel audio signal. Disclosed example watermark embedding methods also include embedding a watermark in audio samples of the first audio channel based on the attenuation factors.

Claims (56)

1. A watermark embedding method comprising:

determining, with a processor, respective attenuation factors for a plurality of audio bands based on energy values associated with down-mixed audio samples corresponding to a first audio channel of a multi-channel audio signal and a second audio channel of the multi-channel audio signal; and

embedding a watermark in audio samples of the first audio channel based on the attenuation factors.

2. The method as defined in claim 1 , wherein the determining of the respective attenuation factors includes:

determining, for a first block of the down-mixed audio samples, a first energy value associated with a first one of the audio bands;

determining, for a plurality of blocks of the down-mixed audio samples including the first block, a second energy value associated with the first one of the audio bands; and

determining a respective first attenuation factor for the first one of the audio bands based on the first energy value and the second energy value.

3. The method as defined in claim 2 , wherein the second energy value corresponds to a largest one of a plurality of energy values determined for the plurality of blocks of the down-mixed audio samples.

4. The method as defined in claim 2 , wherein the determining of the respective first attenuation factor for the first one of the audio bands includes:

determining a ratio of the first energy value and the second energy value; and

scaling the ratio by a scale factor to determine the respective first attenuation factor for the first one of the audio bands.

5. The method as defined in claim 2 , wherein the first block of the down-mixed audio samples corresponds to a short block of down-mixed audio samples, and the plurality of blocks of the down-mixed audio samples corresponds to a long block of down-mixed audio samples.

6. The method as defined in claim 1 , wherein the embedding of the watermark includes:

applying a respective first attenuation factor to a first watermark code frequency corresponding to a first one of the audio bands to determine a first attenuated watermark code frequency;

applying a respective second attenuation factor to a second watermark code frequency corresponding to a second one of the audio bands to determine a second attenuated watermark code frequency; and

embedding the first and second attenuated watermark code frequencies in the audio samples of the first audio channel.

7. The method as defined in claim 1 , wherein the down-mixed audio samples correspond to a first plurality of down-mixed audio samples, the attenuation factors correspond to a first set of attenuation factors, and further including:

determining a second set of attenuation factors for the plurality of audio bands based on energy values associated with a second plurality of down-mixed audio samples corresponding to the second audio channel of the multi-channel audio signal and a third audio channel of the multi-channel audio signal; and

embedding the watermark in audio samples of the third audio channel based on the second set of attenuation factors.

8. The method as defined in claim 7 , further including:

determining a third set of attenuation factors for the plurality of audio bands based on the first set of attenuation factors and the second set of attenuation factors; and

embedding the watermark in audio samples of the second audio channel based on the third set of attenuation factors.

9. A non-transitory computer readable medium comprising computer readable instructions which, when executed, cause a processor to at least:

determine respective attenuation factors for a plurality of audio bands based on energy values associated with down-mixed audio samples corresponding to a first audio channel of a multi-channel audio signal and a second audio channel of the multi-channel audio signal; and

embed a watermark in audio samples of the first audio channel based on the attenuation factors.

10. The computer readable medium as defined in claim 9 , wherein the instructions cause the processor to determine the respective attenuation factors by:

determining, for a first block of the down-mixed audio samples, a first energy value associated with a first one of the audio bands;

determining, for a plurality of blocks of the down-mixed audio samples including the first block, a second energy value associated with the first one of the audio bands; and

determining a respective first attenuation factor for the first one of the audio bands based on the first energy value and the second energy value.

11. The computer readable medium as defined in claim 10 , wherein the second energy value corresponds to a largest one of a plurality of energy values determined for the plurality of blocks of the down-mixed audio samples.

12. The computer readable medium as defined in claim 10 , wherein the instructions cause the processor to determine the respective first attenuation factor for the first one of the audio bands by:

determining a ratio of the first energy value and the second energy value; and

scaling the ratio by a scale factor to determine the respective first attenuation factor for the first one of the audio bands.

13. The computer readable medium as defined in claim 9 , wherein the instructions cause the processor to embed the watermark by:

applying a respective first attenuation factor to a first watermark code frequency corresponding to a first one of the audio bands to determine a first attenuated watermark code frequency;

applying a respective second attenuation factor to a second watermark code frequency corresponding to a second one of the audio bands to determine a second attenuated watermark code frequency; and

embedding the first and second attenuated watermark code frequencies in the audio samples of the first audio channel.

14. The computer readable medium as defined in claim 9 , wherein the down-mixed audio samples correspond to a first plurality of down-mixed audio samples, the attenuation factors correspond to a first set of attenuation factors, and the instructions, when executed, further cause the processor to:

determine a second set of attenuation factors for the plurality of audio bands based on energy values associated with a second plurality of down-mixed audio samples corresponding to the second audio channel of the multi-channel audio signal and a third audio channel of the multi-channel audio signal; and

embed the watermark in audio samples of the third audio channel based on the second set of attenuation factors.

15. A watermarking apparatus comprising:

a watermark compensator to determine respective attenuation factors for a plurality of audio bands based on energy values associated with down-mixed audio samples corresponding to a first audio channel of a multi-channel audio signal and a second audio channel of the multi-channel audio signal; and

a watermark embedder to embed a watermark in audio samples of the first audio channel based on the attenuation factors.

16. The apparatus as defined in claim 15 , wherein the watermark compensator is further to:

determine, for a first block of the down-mixed audio samples, a first energy value associated with a first one of the audio bands;

determine, for a plurality of blocks of the down-mixed audio samples including the first block, a second energy value associated with the first one of the audio bands; and

determine a respective first attenuation factor for the first one of the audio bands based on the first energy value and the second energy value.

17. The apparatus as defined in claim 16 , wherein the second energy value corresponds to a largest one of a plurality of energy values determined for the plurality of blocks of the down-mixed audio samples.

18. The apparatus as defined in claim 16 , wherein the watermark compensator is further to;

determine a ratio of the first energy value and the second energy value; and

scale the ratio by a scale factor to determine the respective first attenuation factor for the first one of the audio bands.

19. The apparatus as defined in claim 15 , wherein the watermark embedder is further to:

apply a respective first attenuation factor to a first watermark code frequency corresponding to a first one of the audio bands to determine a first attenuated watermark code frequency;

apply a respective second attenuation factor to a second watermark code frequency corresponding to a second one of the audio bands to determine a second attenuated watermark code frequency; and

embed the first and second attenuated watermark code frequencies in the audio samples of the first audio channel.

20. The apparatus as defined in claim 15 , wherein the down-mixed audio samples correspond to a first plurality of down-mixed audio samples, the attenuation factors correspond to a first set of attenuation factors, the watermark compensator is further to determine a second set of attenuation factors for the plurality of audio bands based on energy values associated with a second plurality of down-mixed audio samples corresponding to the second audio channel of the multi-channel audio signal and a third audio channel of the multi-channel audio signal, and the watermark embedder is further to embed the watermark in audio samples of the third audio channel based on the second set of attenuation factors.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2015
From: SRINIVASAN, VENUGOPAL; TOPCHY, ALEXANDER
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 036395/0001 →