IP Library Granted Patent US 10,629,213
Granted Patent B2
US 10,629,213 · App. 15/942,369 · Granted Apr 21, 2020

Methods and apparatus to perform windowed sliding transforms

Inventors: Zafar Rafii (Berkeley, CA); Markus Cremer (Orinda, CA); Bongjun Kim (Evanston, IL)
Assignee: The Nielsen Company (US), LLC
G10L19/02G10L25/51G10L19/0212G10L19/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,629,213
App. No.
15/942,369
Granted
Apr 21, 2020
Kind
B2
Abstract

Methods and apparatus to perform windowed sliding transforms are disclosed. An example apparatus includes a coding format identifier to identify, from a received first audio signal representing a decompressed second audio signal, an audio compression configuration used to compress a third audio signal to form the second audio signal, a source identifier to identify a source of the second audio signal based on the identified audio compression configuration, a windowed sliding transformer to perform a first time-frequency analysis of a first block of the first audio signal according to a first trial compression configuration, and perform a second time-frequency analysis of the first block of the first audio signal according to a second trial compression configuration, wherein the windowed sliding transformer includes a multiplier to multiply a vector including a first frequency-domain representation and a matrix including a third frequency-domain representation, an artifact computer to determine a first compression artifact resulting from the first time-frequency analysis, and determine a second compression artifact resulting from the second time-frequency analysis; and a controller to select between the first trial compression configuration and the second trial compression configuration as the audio compression configuration based on the first compression artifact and the second compression artifact.

Claims (46)

1. An apparatus, comprising:

a coding format identifier to identify, from a received first audio signal representing a decompressed second audio signal, an audio compression configuration used to compress a third audio signal to form the second audio signal;

a source identifier to identify a source of the second audio signal based on an identified audio compression configuration;

a windowed sliding transformer to perform a first time-frequency analysis of a first block of the first audio signal according to a first trial compression configuration, and perform a second time-frequency analysis of the first block of the first audio signal according to a second trial compression configuration, wherein the windowed sliding transformer includes a multiplier to multiply a vector including a first frequency-domain representation and a matrix including a third frequency-domain representation;

an artifact computer to determine a first compression artifact resulting from the first time-frequency analysis, and determine a second compression artifact resulting from the second time-frequency analysis; and

a controller to select between the first trial compression configuration and the second trial compression configuration as the audio compression configuration based on the first compression artifact and the second compression artifact.

2. The apparatus of claim 1 , wherein the controller selects between the first trial compression configuration and the second trial compression configuration based on the first compression artifact and the second compression artifact includes comparing the first compression artifact and the second compression artifact.

3. The apparatus of claim 1 , wherein:

the windowed sliding transformer performs a third time-frequency analysis of a second block of the first audio signal according to the first trial compression configuration, and performs a fourth time-frequency analysis of the second block of the first audio signal according to the second trial compression configuration;

the artifact computer determines a third compression artifact resulting from the third time-frequency analysis, and determine a fourth compression artifact resulting from the fourth time-frequency analysis; and

the controller selects between the first trial compression configuration and the second trial compression configuration as the audio compression configuration based on the first compression artifact, the second compression artifact, the third compression artifact, and the fourth compression artifact.

4. The apparatus of claim 3 , further including a post processor to combine the first compression artifact and the third compression artifact to form a first score, and combine the second compression artifact and the fourth compression artifact to form a second score, wherein the controller selects between the first trial compression configuration and the second trial compression configuration as the audio compression configuration by comparing the first score and the second score.

5. The apparatus of claim 4 , wherein the post processor combines the first compression artifact and the third compression artifact to form the first score by:

mapping the first compression artifact and a first offset associated with the first compression artifact to a first polar coordinate;

mapping the third compression artifact and a second offset associated with the second compression artifact to a second polar coordinate; and

computing the first score as a circular mean of the first polar coordinate and the second polar coordinate.

6. The apparatus of claim 1 , wherein the first audio signal is recorded at a media presentation device.

7. The apparatus of claim 1 , wherein the windowed sliding transformer includes:

a transformer to transform a first block of time-domain samples of an input signal into a first frequency-domain representation based on a second frequency-domain representation of a second block of time-domain samples of the input signal; and

a windower to apply a third frequency-domain representation of a time-domain window function to the first frequency-domain representation.

8. The apparatus of claim 7 , wherein the windower includes a multiplier and a matrix.

9. The apparatus of claim 8 , further including a kernel generator to compute the matrix by computing a transform of the time-domain window function.

10. The apparatus of claim 9 , wherein the kernel generator is to set a value of a cell of the matrix to zero based on a comparison of the value and a threshold.

11. The apparatus of claim 7 , wherein the transformer computes the first frequency-domain representation based on the second frequency-domain representation using a sliding transform.

12. A method, comprising:

receiving a first audio signal that represents a decompressed second audio signal;

identifying, from the first audio signal, an audio compression configuration used to compress a third audio signal to form the second audio signal;

applying a windowed sliding transform to the first audio signal to identify an audio compression configuration used to compress a third audio signal to form the second audio signal, wherein the applying the windowed sliding transform includes multiplying a vector including a first frequency-domain representation and a matrix including a third frequency-domain representation;

identifying a coding format based on the identified audio compression configuration; and

identifying a source of the second audio signal based on the identified audio compression configuration.

13. The method of claim 12 , wherein applying the windowed sliding transform includes:

transforming a first block of time-domain samples of an input signal into a first frequency-domain representation based on a second frequency-domain representation of a second block of time-domain samples of the input signal; and

applying a third frequency-domain representation of a time-domain window function to the first frequency-domain representation.

14. The method of claim 13 , wherein the applying the third frequency-domain representation of a time-domain window function to the first frequency-domain representation includes multiplying a vector and a matrix.

15. The method of claim 14 , further including transforming the time-domain window function to the third frequency-domain representation.

16. The method of claim 15 , wherein transforming the first block of time-domain into the first frequency-domain representation includes computing a sliding discrete Fourier transform.

17. A non-transitory computer-readable storage medium comprising instructions that, when executed, cause a machine to at least:

receive a first audio signal that represents a decompressed second audio signal;

identify, from the first audio signal, an audio compression configuration used to compress a third audio signal to form the second audio signal;

apply a windowed sliding transform to the first audio signal to identify an audio compression configuration used to compress a third audio signal to form the second audio signal, wherein the windowed sliding transform is to multiply a vector including a first frequency-domain representation and a matrix including a third frequency-domain representation;

identify a coding format based on the identified audio compression configuration; and

identify a source of the second audio signal based on the identified audio compression configuration.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the instructions, when executed, cause the machine to:

transform a first block of time-domain samples of an input signal into a first frequency-domain representation based on a second frequency-domain representation of a second block of time-domain samples of the input signal; and

applying a third frequency-domain representation of a time-domain window function to the first frequency-domain representation.

19. The non-transitory computer-readable storage medium of claim 18 , wherein the instructions, when executed, cause the machine to transform the first block of time-domain into the first frequency-domain representation by computing a sliding discrete Fourier transform.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2020
From: RAFII, ZAFAR; CREMER, MARKUS; KIM, BONGJUN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052085/0466 →
Continuity (3)
Continuation In Part 15899220 · Feb 19, 2018
Continuation In Part 15793543 · Oct 25, 2017
Related Publication 20190122678A1 · Apr 25, 2019
Cited By (3)
US 12,230,282 US 12,236,965 US 12,706,106