IP Library Granted Patent US 9,093,064
Granted Patent B2
US 9,093,064 · App. 13/793,962 · Granted Jul 28, 2015

Down-mixing compensation for audio watermarking

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,093,064
App. No.
13/793,962
Granted
Jul 28, 2015
Kind
B2
Abstract

Example methods, apparatus, systems and articles of manufacture to implement down-mixing compensation for audio watermarking are disclosed. Example methods disclosed herein to compensate for audio channel down-mixing when embedding watermarks in a multichannel audio signal include obtaining a watermark to be embedded in respective ones of a plurality of audio channels of the multichannel audio signal. Such example methods also include embedding the watermark in a first one of the plurality of audio channels based on a compensation factor that is to reduce perceptibility of the watermark when the first one of the plurality of audio channels is down-mixed with a second one of the plurality of audio channels after the watermark has been applied to the first and second ones of the plurality of audio channels.

Claims (43)

1. A method to compensate for audio channel down-mixing when embedding watermarks in a multichannel audio signal, the method comprising:

obtaining a watermark to be embedded in respective ones of a plurality of audio channels of the multichannel audio signal; and

embedding the watermark in a first one of the plurality of audio channels based on a compensation factor that is to reduce perceptibility of the watermark when the first one of the plurality of audio channels is down-mixed with a second one of the plurality of audio channels after the watermark has been applied to the first and second ones of the plurality of audio channels.

2. A method as defined in claim 1 , further including determining the compensation factor based on evaluating the first and second ones of the plurality of audio channels.

3. A method as defined in claim 2 , wherein the compensation factor includes an attenuation factor for a first audio band, and determining the compensation factor includes determining the attenuation factor for the first audio band, the attenuation factor being based on a ratio of a first energy and a second energy determined for the first audio band, the first energy corresponding to an energy in the first audio band for a first block of down-mixed audio samples formed by down-mixing the first one of the plurality of audio channels with the second one of the plurality of audio channels, the second energy corresponding to a maximum of a plurality of energies determined for a respective plurality of blocks of down-mixed audio samples including the first block of down-mixed audio samples.

4. A method as defined in claim 3 , further including:

applying the attenuation factor to the watermark when embedding the watermark in the first one of the plurality of audio channels; and

applying the attenuation factor to the watermark when embedding the watermark in the second one of the plurality of audio channels.

5. A method as defined in claim 4 , wherein the multichannel audio signal includes at least three audio channels, the attenuation factor is determined using the down-mixed audio samples formed by down-mixing the first one of the plurality of audio channels with the second one of the plurality of audio channels, and the method further includes applying the attenuation factor to the watermark when embedding the watermark in a third one of the plurality of audio channels different from the first and second ones of the plurality of audio channels.

6. A method as defined in claim 2 , wherein the compensation factor includes a decision factor indicating whether the watermark is permitted to be embedded in a first block of audio samples from the first one of the plurality of audio channels, and determining the compensation factor includes:

determining a delay between the first block of audio samples from the first one of the plurality of audio channels and a second block of audio samples from the second one of the plurality of audio channels, the first and second blocks of audio samples corresponding to a same interval of time;

setting the decision factor to indicate embedding of the watermark in the first block of audio samples from the first one of the plurality of audio channels is not permitted when the delay is in a first range of delays; and

setting the decision factor to indicate embedding of the watermark in the first block of audio samples from the first one of the plurality of audio channels is permitted when the delay is not in the first range of delays.

7. A method as defined in claim 1 , wherein embedding the watermark in the first one of the plurality of audio channels based on the compensation factor includes applying a phase shift to the watermark when embedding the watermark in the first one of the plurality of audio channels, the watermark to be embedded in the second one of the plurality of audio channels without the phase shift being applied to the watermark.

8. A method as defined in claim 1 , wherein the multichannel audio signal includes a front left channel, a front right channel, a center channel, a rear left channel and a rear right channel, the watermark is embedded in at least one of the front left channel, the front right channel or the center channel based on the compensation factor.

9. A non-transitory tangible machine readable storage medium comprising machine readable instructions which, when executed, cause a machine to at least:

obtain a watermark to be embedded in respective ones of a plurality of audio channels of a multichannel audio signal; and

embed the watermark in a first one of the plurality of audio channels based on a compensation factor that is to reduce perceptibility of the watermark when the first one of the plurality of audio channels is down-mixed with a second one of the plurality of audio channels after the watermark has been applied to the first and second ones of the plurality of audio channels.

10. A storage medium as defined in claim 9 , wherein the machine readable instructions, when executed, further cause the machine to determine the compensation factor based on evaluating the first and second ones of the plurality of audio channels.

11. A storage medium as defined in claim 10 , wherein the compensation factor includes an attenuation factor for a first audio band, and to determine the compensation factor, the machine readable instructions, when executed, cause the machine to determine the attenuation factor for the first audio band, the attenuation factor being based on a ratio of a first energy and a second energy determined for the first audio band, the first energy corresponding to an energy in the first audio band for a first block of down-mixed audio samples formed by down-mixing the first one of the plurality of audio channels with the second one of the plurality of audio channels, the second energy corresponding to a maximum of a plurality of energies determined for a respective plurality of blocks of down-mixed audio samples including the first block of down-mixed audio sample.

12. A storage medium as defined in claim 11 , wherein the multichannel audio signal includes at least three audio channels, the attenuation factor is determined using the down-mixed audio samples formed by down-mixing the first one of the plurality of audio channels with the second one of the plurality of audio channels, and the machine readable instructions, when executed, further cause the machine to:

apply the attenuation factor to the watermark when embedding the watermark in the first one of the plurality of audio channels;

apply the attenuation factor to the watermark when embedding the watermark in the second one of the plurality of audio channels; and

apply the attenuation factor to the watermark when embedding the watermark in a third one of the plurality of audio channels different from the first and second ones of the plurality of audio channels.

13. A storage medium as defined in claim 10 , wherein the compensation factor includes a decision factor indicating whether the watermark is permitted to be embedded in a first block of audio samples from the first one of the plurality of audio channels, and to determine the compensation factor, the machine readable instructions, when executed, cause the machine to:

determine a delay between the first block of audio samples from the first one of the plurality of audio channels and a second block of audio samples from the second one of the plurality of audio channels, the first and second blocks of audio samples corresponding to a same interval of time;

set the decision factor to indicate embedding of the watermark in the first block of audio samples from the first one of the plurality of audio channels is not permitted when the delay is in a first range of delays; and

set the decision factor to indicate embedding of the watermark in the first block of audio samples from the first one of the plurality of audio channels is permitted when the delay is not in the first range of delays.

14. A storage medium as defined in claim 10 , wherein to embed the watermark in the first one of the plurality of audio channels based on the compensation factor, the machine readable instructions, when executed, cause the machine to apply a phase shift to the watermark when embedding the watermark in the first one of the plurality of audio channels, the watermark to be embedded in the second one of the plurality of audio channels without the phase shift being applied to the watermark.

15. An apparatus to compensate for audio channel down-mixing when embedding watermarks in a multichannel audio signal, the apparatus comprising:

a watermark determiner to determine a watermark to be embedded in respective ones of a plurality of audio channels of the multichannel audio signal; and

a watermark embedder to embed the watermark in a first one of the plurality of audio channels based on a compensation factor that is to reduce perceptibility of the watermark when the first one of the plurality of audio channels is down-mixed with a second one of the plurality of audio channels after the watermark has been applied to the first and second ones of the plurality of audio channels.

16. An apparatus as defined in claim 15 , further including a watermark compensator to determine the compensation factor based on evaluating the first and second ones of the plurality of audio channels.

17. An apparatus as defined in claim 16 , wherein the compensation factor includes an attenuation factor for a first audio band, and the watermark compensator is to determine the attenuation factor for the first audio band, the attenuation factor being based on a ratio of a first energy and a second energy determined for the first audio band, the first energy corresponding to an energy in the first audio band for a first block of down-mixed audio samples formed by down-mixing the first one of the plurality of audio channels with the second one of the plurality of audio channels, the second energy corresponding to a maximum of a plurality of energies determined for a respective plurality of blocks of down-mixed audio samples including the first block of down-mixed audio samples.

18. An apparatus as defined in claim 17 , wherein the multichannel audio signal includes at least three audio channels, the watermark compensator is to determine the attenuation factor using the down-mixed audio samples formed by down-mixing the first one of the plurality of audio channels with the second one of the plurality of audio channels, and the watermark embedder is to:

apply the attenuation factor to the watermark when embedding the watermark in the first one of the plurality of audio channels;

apply the attenuation factor to the watermark when embedding the watermark in the second one of the plurality of audio channels; and

apply the attenuation factor to the watermark when embedding the watermark in a third one of the plurality of audio channels different from the first and second ones of the plurality of audio channels.

19. An apparatus as defined in claim 15 , wherein the compensation factor includes a decision factor indicating whether the watermark is permitted to be embedded in a first block of audio samples from the first one of the plurality of audio channels, and to determine the compensation factor, the watermark compensator is further to:

determine a delay between the first block of audio samples from the first one of the plurality of audio channels and a second block of audio samples from the second one of the plurality of audio channels, the first and second blocks of audio samples corresponding to a same interval of time;

set the decision factor to indicate embedding of the watermark in the first block of audio samples from the first one of the plurality of audio channels is not permitted when the delay is in a first range of delays; and

set the decision factor to indicate embedding of the watermark in the first block of audio samples from the first one of the plurality of audio channels is permitted when the delay is not in the first range of delays.

20. An apparatus as defined in claim 15 , wherein to embed the watermark in the first one of the plurality of audio channels based on the compensation factor, the watermark embedder is to apply a phase shift to the watermark when embedding the watermark in the first one of the plurality of audio channels, the watermark embedder to embed the watermark in the second one of the plurality of audio channels without applying the phase shift to the watermark.

Assignments (10)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: GRACENOTE, INC.; A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2014
From: SRINIVASAN, VENUGOPAL; TOPCHY, ALEXANDER
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 032008/0405 →