IP Library Granted Patent US 12,327,295
Granted Patent B2
US 12,327,295 · App. 17/967,589 · Granted Jun 10, 2025

Methods, systems, apparatus, and articles of manufacture to perform time alignment for watermarks

Inventors: Vladimir Kuznetsov (Ellicott City, MD); Wendell D. Lynch (East Lansing, MI)
Assignee: The Nielsen Company (US), LLC
G06T1/0078G06T2201/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,327,295
App. No.
17/967,589
Granted
Jun 10, 2025
Kind
B2
Abstract

Methods, apparatus, systems, and articles of manufacture are disclosed to perform time alignment for watermarks. An example apparatus adjusts a power value of an element of a template based on respective average magnitudes and respective tonality ratios corresponding to a plurality of frequency representations of a media signal, the media signal to be encoded with at least one watermark, the element corresponding to one of the plurality of frequency representations. Additionally, the example apparatus computes an alignment of the template to the media signal based on respective power values of elements of the template, the template corresponding to a type of the at least one watermark. The example apparatus also encodes the media signal with the at least one watermark according to the alignment.

Claims (60)

1. An apparatus to perform time alignment for watermarks, the apparatus comprising

memory;

machine readable instructions; and

one or more processors configured to:

adjust a power value of an element of a template based on respective average magnitudes and respective tonality ratios corresponding to a plurality of frequency representations of a media signal, the media signal to be encoded with at least one watermark, the element corresponding to one of the plurality of frequency representations;

compute an alignment of the template to the media signal based on respective power values of elements of the template, the template corresponding to a type of the at least one watermark; and

encode the media signal with the at least one watermark according to the alignment.

2. The apparatus of claim 1 , wherein the one or more processors are configured to determine whether a duration of media represented by the media signal satisfies a threshold, the threshold corresponding to a lower bound of media durations for which watermark detection problems are unlikely.

3. The apparatus of claim 1 , wherein the one or more processors are configured to determine whether a duration of media represented by the media signal satisfies a threshold, the threshold corresponding to an upper bound of media durations for which improved detection of watermarks is feasible.

4. The apparatus of claim 1 , wherein to adjust the power value of the element of the template, the one or more processors are configured to:

determine respective upper values for a bin range of each of the plurality of frequency representations of the media signal, the bin range corresponding to the type of the at least one watermark;

compute the respective average magnitudes across the bin range, the respective average magnitudes excluding the respective upper values; and

compute the respective tonality ratios based on the respective upper values and the respective average magnitudes.

5. The apparatus of claim 1 , wherein the one or more processors are configured to:

determine whether an average magnitude of the one of the plurality of frequency representations satisfies an average magnitude threshold, the average magnitude threshold corresponding to the type of the at least one watermark, the element corresponding to the one of the plurality of frequency representations;

determine whether a tonality ratio for the one of the plurality of frequency representations satisfies a tonality ratio threshold; and

in response to the average magnitude satisfying the average magnitude threshold and the tonality ratio not satisfying the tonality ratio threshold, adjust the power value of the element of the template.

6. The apparatus of claim 1 , wherein the at least one watermark includes a plurality of watermarks, and to compute the alignment of the template to the media signal, the one or more processors are configured to compute respective scores for candidate alignments of the template to the media signal based on respective sums of probabilities of detecting ones of the plurality of watermarks of the template.

7. The apparatus of claim 6 , wherein to determine the probabilities of detecting the ones of the plurality of watermarks of the template, the one or more processors are configured to:

sum power values of first symbols of a first watermark of the template with respective power values of respective symbols of at least two adjacent watermarks of the template;

compute respective probabilities of detecting the first symbols based on respective summed power values for the first symbols and corresponding power values of the media signal; and

compute a product of the respective probabilities to determine a probability of detecting the first watermark.

8. At least one non-transitory computer readable storage medium comprising instructions, that, when executed, cause a computing system to:

adjust a power value of an element of a template based on respective average magnitudes and respective tonality ratios corresponding to a plurality of frequency representations of a media signal, the media signal to be encoded with at least one watermark, the element corresponding to one of the plurality of frequency representations;

compute an alignment of the template to the media signal based on respective power values of elements of the template, the template corresponding to a type of the at least one watermark; and

encode the media signal with the at least one watermark according to the alignment.

9. The at least one non-transitory computer readable storage medium of claim 8 , wherein the instructions cause the computing system to determine whether a duration of media represented by the media signal satisfies a threshold, the threshold corresponding to a lower bound of media durations for which watermark detection problems are unlikely.

10. The at least one non-transitory computer readable storage medium of claim 8 , wherein the instructions cause the computing system to determine whether a duration of media represented by the media signal satisfies a threshold, the threshold corresponding to an upper bound of media durations for which improved detection of watermarks is feasible.

11. The at least one non-transitory computer readable storage medium of claim 8 , wherein to adjust the power value of the element of the template, the instructions cause the computing system to:

determine respective upper values for a bin range of each of the plurality of frequency representations of the media signal, the bin range corresponding to the type of the at least one watermark;

compute the respective average magnitudes across the bin range, the respective average magnitudes excluding the respective upper values; and

compute the respective tonality ratios based on the respective upper values and the respective average magnitudes.

12. The at least one non-transitory computer readable storage medium of claim 8 , wherein the instructions cause the computing system to:

determine whether an average magnitude of the one of the plurality of frequency representations satisfies an average magnitude threshold, the average magnitude threshold corresponding to the type of the at least one watermark, the element corresponding to the one of the plurality of frequency representations;

determine whether a tonality ratio for the one of the plurality of frequency representations satisfies a tonality ratio threshold; and

in response to the average magnitude satisfying the average magnitude threshold and the tonality ratio not satisfying the tonality ratio threshold, adjust the power value of the element of the template.

13. The at least one non-transitory computer readable storage medium of claim 8 , wherein the at least one watermark includes a plurality of watermarks, and to compute the alignment of the template to the media signal, the instructions cause the computing system to compute respective scores for candidate alignments of the template to the media signal based on respective sums of probabilities of detecting ones of the plurality of watermarks of the template.

14. The at least one non-transitory computer readable storage medium of claim 13 , wherein to determine the probabilities of detecting the ones of the plurality of watermarks of the template, the instructions cause the computing system to:

sum power values of first symbols of a first watermark of the template with respective power values of respective symbols of at least two adjacent watermarks of the template;

compute respective probabilities of detecting the first symbols based on respective summed power values for the first symbols and corresponding power values of the media signal; and

compute a product of the respective probabilities to determine a probability of detecting the first watermark.

15. A method for performing time alignment for watermarks, the method comprising:

adjusting, by one or more processors, a power value of an element of a template based on respective average magnitudes and respective tonality ratios corresponding to a plurality of frequency representations of a media signal, the media signal to be encoded with at least one watermark, the element corresponding to one of the plurality of frequency representations;

computing, by the one or more processors, an alignment of the template to the media signal based on respective power values of elements of the template, the template corresponding to a type of the at least one watermark; and

encoding the media signal with the at least one watermark according to the alignment.

16. The method of claim 15 , further including determining whether a duration of media represented by the media signal satisfies a threshold, the threshold corresponding to a lower bound of media durations for which watermark detection problems are unlikely.

17. The method of claim 15 , further including determining whether a duration of media represented by the media signal satisfies a threshold, the threshold corresponding to an upper bound of media durations for which improved detection of watermarks is feasible.

18. The method of claim 15 , wherein adjusting the power value of the element of the template includes:

determining respective upper values for a bin range of each of the plurality of frequency representations of the media signal, the bin range corresponding to the type of the at least one watermark;

computing the respective average magnitudes across the bin range, the respective average magnitudes excluding the respective upper values; and

computing the respective tonality ratios based on the respective upper values and the respective average magnitudes.

19. The method of claim 15 , further including:

determining whether an average magnitude of the one of the plurality of frequency representations satisfies an average magnitude threshold, the average magnitude threshold corresponding to the type of the at least one watermark, the element corresponding to the one of the plurality of frequency representations;

determining whether a tonality ratio for the one of the plurality of frequency representations satisfies a tonality ratio threshold; and

in response to the average magnitude satisfying the average magnitude threshold and the tonality ratio not satisfying the tonality ratio threshold, adjusting the power value of the element of the template.

20. The method of claim 15 , wherein the at least one watermark includes a plurality of watermarks, and computing the alignment of the template to the media signal includes computing respective scores for candidate alignments of the template to the media signal based on respective sums of probabilities of detecting ones of the plurality of watermarks of the template.

21. The method of claim 20 , wherein determining the probabilities of detecting the ones of the plurality of watermarks of the template includes:

summing power values of first symbols of a first watermark of the template with respective power values of respective symbols of at least two adjacent watermarks of the template;

computing respective probabilities of detecting the first symbols based on respective summed power values for the first symbols and corresponding power values of the media signal; and

computing a product of the respective probabilities to determine a probability of detecting the first watermark.

Assignments (4)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2022
From: KUZNETSOV, VLADIMIR; LYNCH, WENDELL D.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061970/0368 →
Continuity (2)
Provisional Application 63294782 · Dec 29, 2021
Related Publication 20230206377A1 · Jun 29, 2023
References Cited (3)
US 5481294A · Thomas et al. · 1996 [cited by applicant]
US 20190295560A1 · Christian · 2019 [cited by examiner]
Kirovski et al., “Spread-Spectrum Watermarking of Audio Signals,” IEEE, IEEE Transactions on Signal Processing, vol. 51, No. 4, Apr. 2003, pp. 1020-1033. [cited by applicant]