IP Library Granted Patent US 9,704,494
Granted Patent B2
US 9,704,494 · App. 15/282,433 · Granted Jul 11, 2017

Down-mixing compensation for audio watermarking

Inventors: Venugopal Srinivasan (Tarpon Springs, FL); Alexander Topchy (New Port Richey, FL)
Assignee: The Nielsen Company (US), LLC
G10L19/018G10L19/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,704,494
App. No.
15/282,433
Granted
Jul 11, 2017
Kind
B2
Abstract

Example methods, apparatus, systems and articles of manufacture to implement down-mixing compensation for audio watermarking are disclosed. Example watermark embedding methods disclosed herein include determining a first attenuation factor associated with a first audio channel of a multi-channel audio signal based on first down-mixed audio samples obtained from down-mixing the first audio channel and a second audio channel of the multi-channel audio signal, determining a second attenuation factor associated with a third audio channel of the multi-channel audio signal based on second down-mixed audio samples obtained from down-mixing the second audio channel and the third audio channel of the multi-channel audio signal, selecting one of the first attenuation factor or the second attenuation factor to be a third attenuation factor associated with the second audio channel of the multi-channel audio signal, and embedding a watermark in the second audio channel based on the third attenuation factor.

Claims (42)

1. An apparatus comprising:

a watermark compensator to:

determine a first attenuation factor associated with a first audio channel of a multi-channel audio signal based on first down-mixed audio samples obtained from down-mixing the first audio channel and a second audio channel of the multi-channel audio signal;

determine a second attenuation factor associated with a third audio channel of the multi-channel audio signal based on second down-mixed audio samples obtained from down-mixing the second audio channel and the third audio channel of the multi-channel audio signal; and

select one of the first attenuation factor or the second attenuation factor to be a third attenuation factor associated with the second audio channel of the multi-channel audio signal; and

a watermark embedder to embed a watermark in the second audio channel based on the third attenuation factor.

2. The apparatus of claim 1 , wherein the first audio channel is a left audio channel, the second audio channel is a center audio channel, and the third audio channel is a right audio channel.

3. The apparatus of claim 1 , wherein the watermark compensator is to select a smallest one of the first attenuation factor and the second attenuation factor to be the third attenuation factor.

4. The apparatus of claim 1 , wherein the first attenuation factor is associated with a first audio band of the first audio channel, the second attenuation factor is associated with a first audio band of the third audio channel, the third attenuation factor is associated with a first audio band of the second audio channel, and the watermark compensator is further to:

determine a fourth attenuation factor associated with a second audio band of the first audio channel based on the first down-mixed audio samples obtained from down-mixing the first audio channel and the second audio channel;

determine a fifth attenuation factor associated with a second band of the third audio channel signal based on the second down-mixed audio samples obtained from down-mixing the second audio channel and the third audio channel of the multi-channel audio signal; and

select one of the fourth attenuation factor or the fifth attenuation factor to be a sixth attenuation factor associated with a second audio band of the second audio channel.

5. The apparatus of claim 1 , wherein the watermark compensator is to determine the first attenuation factor further based on a first ratio of a first energy to a second energy, the first energy determined from a first one of a plurality of blocks of the first down-mixed audio samples, the second energy determined from the plurality of blocks of the first down-mixed audio samples, and the watermark compensator is to determine the second attenuation factor further based on a second ratio of a third energy to a fourth energy, the third energy determined from a first one of a plurality of blocks of the second down-mixed audio samples, the fourth energy determined from the plurality of blocks of the second down-mixed audio samples.

6. The apparatus of claim 5 , wherein the watermark compensator is to determine the first attenuation factor further based on the first ratio and a scale factor, and the watermark compensator is to determine the second attenuation factor further based on the second ratio and the scale factor.

7. The apparatus of claim 1 , wherein the watermark embedder is to embed the watermark in the second audio channel further based on the second attenuation factor and a masking ratio.

8. A watermark embedding method comprising:

determining, by executing an instruction with a processor, a first attenuation factor associated with a first audio channel of a multi-channel audio signal based on first down-mixed audio samples obtained from down-mixing the first audio channel and a second audio channel of the multi-channel audio signal;

determining, by executing an instruction with the processor, a second attenuation factor associated with a third audio channel of the multi-channel audio signal based on second down-mixed audio samples obtained from down-mixing the second audio channel and the third audio channel of the multi-channel audio signal;

selecting, by executing an instruction with the processor, one of the first attenuation factor or the second attenuation factor to be a third attenuation factor associated with the second audio channel of the multi-channel audio signal; and

embedding, by executing an instruction with the processor, a watermark in the second audio channel based on the third attenuation factor.

9. The watermark embedding method of claim 8 , wherein the first audio channel is a left audio channel, the second audio channel is a center audio channel, and the third audio channel is a right audio channel.

10. The watermark embedding method of claim 8 , wherein the selecting includes selecting a smallest one of the first attenuation factor and the second attenuation factor to be the third attenuation factor.

11. The watermark embedding method of claim 8 , wherein the first attenuation factor is associated with a first audio band of the first audio channel, the second attenuation factor is associated with a first audio band of the third audio channel, the third attenuation factor is associated with a first audio band of the second audio channel, and further including:

determining a fourth attenuation factor associated with a second audio band of the first audio channel based on the first down-mixed audio samples obtained from down-mixing the first audio channel and the second audio channel;

determining a fifth attenuation factor associated with a second band of the third audio channel signal based on the second down-mixed audio samples obtained from down-mixing the second audio channel and the third audio channel of the multi-channel audio signal; and

selecting one of the fourth attenuation factor or the fifth attenuation factor to be a sixth attenuation factor associated with a second audio band of the second audio channel.

12. The watermark embedding method of claim 8 , wherein the determining of the first attenuation factor is further based on a first ratio of a first energy to a second energy, the first energy determined from a first one of a plurality of blocks of the first down-mixed audio samples, the second energy determined from the plurality of blocks of the first down-mixed audio samples, and the determining of the second attenuation factor is further based on a second ratio of a third energy to a fourth energy, the third energy determined from a first one of a plurality of blocks of the second down-mixed audio samples, the fourth energy determined from the plurality of blocks of the second down-mixed audio samples.

13. The watermark embedding method of claim 12 , wherein the determining of the first attenuation factor is further based on the first ratio and a scale factor, and the determining of the second attenuation factor is further based on the second ratio and the scale factor.

14. The watermark embedding method of claim 8 , wherein the embedding of the watermark is further based on the second attenuation factor and a masking ratio.

15. A non-transitory computer readable medium comprising computer readable instructions which, when executed by a processor, cause the processor to at least:

determine a first attenuation factor associated with a first audio channel of a multi-channel audio signal based on first down-mixed audio samples obtained from down-mixing the first audio channel and a second audio channel of the multi-channel audio signal;

determine a second attenuation factor associated with a third audio channel of the multi-channel audio signal based on second down-mixed audio samples obtained from down-mixing the second audio channel and the third audio channel of the multi-channel audio signal;

select one of the first attenuation factor or the second attenuation factor to be a third attenuation factor associated with the second audio channel of the multi-channel audio signal; and

embed a watermark in the second audio channel based on the third attenuation factor.

16. The non-transitory computer readable medium of claim 15 , wherein the first audio channel is a left audio channel, the second audio channel is a center audio channel, and the third audio channel is a right audio channel.

17. The non-transitory computer readable medium of claim 15 , wherein the instructions, when executed, cause the processor to select a smallest one of the first attenuation factor and the second attenuation factor to be the third attenuation factor.

18. The non-transitory computer readable medium of claim 15 , wherein the first attenuation factor is associated with a first audio band of the first audio channel, the second attenuation factor is associated with a first audio band of the third audio channel, the third attenuation factor is associated with a first audio band of the second audio channel, and the instructions, when executed, further cause the processor to:

determine a fourth attenuation factor associated with a second audio band of the first audio channel based on the first down-mixed audio samples obtained from down-mixing the first audio channel and the second audio channel;

determine a fifth attenuation factor associated with a second band of the third audio channel signal based on the second down-mixed audio samples obtained from down-mixing the second audio channel and the third audio channel of the multi-channel audio signal; and

select one of the fourth attenuation factor or the fifth attenuation factor to be a sixth attenuation factor associated with a second audio band of the second audio channel.

19. The non-transitory computer readable medium of claim 15 , wherein the instructions, when executed, cause the processor to determine the first attenuation factor further based on a first ratio of a first energy to a second energy, the first energy determined from a first one of a plurality of blocks of the first down-mixed audio samples, the second energy determined from the plurality of blocks of the first down-mixed audio samples, and the instructions, when executed, cause the processor to determine the second attenuation factor further based on a second ratio of a third energy to a fourth energy, the third energy determined from a first one of a plurality of blocks of the second down-mixed audio samples, the fourth energy determined from the plurality of blocks of the second down-mixed audio samples.

20. The non-transitory computer readable medium of claim 19 , wherein the instructions, when executed, cause the processor to determine the first attenuation factor further based on the first ratio and a scale factor, and the instructions, when executed, cause the processor to determine the second attenuation factor further based on the second ratio and the scale factor.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2016
From: SRINIVASAN, VENUGOPAL; TOPCHY, ALEXANDER
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 040188/0193 →
Continuity (3)
Continuation 14800376 · Jul 15, 2015
Continuation 13793962 · Mar 11, 2013
Related Publication 20170018278A1 · Jan 19, 2017