IP Library Granted Patent US 10,902,831
Granted Patent B2
US 10,902,831 · App. 16/821,567 · Granted Jan 26, 2021

Methods and apparatus to extract a pitch-independent timbre attribute from a media signal

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,902,831
App. No.
16/821,567
Granted
Jan 26, 2021
Kind
B2
Abstract

Methods and apparatus to classify media based on a pitch-independent timbre attribute from a media signal are disclosed. An example apparatus includes means for accessing a media signal; and means for: determining a spectrum of audio corresponding to the media signal; and determining a timbre-independent pitch attribute of audio of the media signal based on an inverse transform of a complex argument of a transform of the spectrum.

Claims (48)

1. An apparatus to extract a timbre-independent pitch attribute from a media signal, the apparatus comprising:

means for accessing a media signal; and

means for:

determining a spectrum of audio corresponding to the media signal; and

determining a timbre-independent pitch attribute of audio of the media signal based on an inverse transform of a complex argument of a transform of the spectrum.

2. The apparatus of claim 1 , wherein the media signal is the audio.

3. The apparatus of claim 1 , wherein the media signal is a video signal having an associated audio component, further including means for extracting the audio from the video signal.

4. The apparatus of claim 1 , wherein the determining means is to determine the spectrum of the audio using a constant Q transform.

5. The apparatus of claim 1 , wherein the determining means is to determine the transform of the spectrum using a Fourier transform and determine the inverse transform using an inverse Fourier transform.

6. The apparatus of claim 1 , wherein the determining means is to determine a pitch-independent timbre attribute of the audio based on an inverse transform of a magnitude of the transform of the spectrum.

7. The apparatus of claim 1 , further including means for:

transmitting the timbre-independent pitch attribute to a processing device; and

in response to transmitting timbre-independent pitch attribute to the processing device, receiving at least one of a classification of the audio or an identifier corresponding to the media signal from the processing device; and

transmitting the at least one of the classification of the audio or the identifier corresponding to the media signal to a user interface.

8. The apparatus of claim 7 , wherein the accessing means is the transmitting means.

9. The apparatus of claim 1 , wherein the accessing means is to receive the media signal via ambient audio.

10. The apparatus of claim 1 , wherein the accessing means is to receive the media signal from a microphone.

11. An apparatus to extract a pitch-independent timbre attribute from a media signal, the apparatus comprising:

means for receiving a media signal; and

means for:

determining a spectrum of audio corresponding to the media signal; and

determining a pitch-independent timbre attribute of audio of the media signal based on an inverse transform of a magnitude of a transform of the spectrum.

12. The apparatus of claim 11 , wherein the media signal is the audio.

13. The apparatus of claim 11 , wherein the media signal is a video signal with an audio component, further including means for extracting the audio from the video signal.

14. The apparatus of claim 11 , wherein the determining means is to determine the spectrum of the audio using a constant Q transform.

15. The apparatus of claim 11 , wherein the determining means is to determine the transform of the spectrum using a Fourier transform and determine the inverse transform using an inverse Fourier transform.

16. The apparatus of claim 11 , wherein the determining means is to determine a timbre-independent pitch attribute of the audio based on an inverse transform of a complex argument of the transform of the spectrum.

17. The apparatus of claim 11 , further including means for:

transmitting the pitch-independent timbre attribute to a processing device; and

in response to transmitting the pitch-independent timbre attribute to the processing device, receiving at least one of a classification of the audio or a first identifier corresponding to the media signal from the processing device; and

transmitting the at least one of the classification of the audio or a second identifier corresponding to the media signal to a user interface.

18. The apparatus of claim 17 , wherein the receiving means is the transmitting means.

19. The apparatus of claim 11 , wherein the receiving means is to receive the media signal via ambient audio.

20. The apparatus of claim 11 , wherein the receiving means is to receive the media signal from a microphone.

21. An apparatus comprising:

means for receiving a media signal;

means for storing reference pitch-less timbre spectrums; and

means for:

comparing a pitch-less timbre spectrum of the media signal to the reference pitch-less timbre spectrums; and

classifying the media signal based on data corresponding to a reference pitch-less timbre spectrum of the reference pitch-less timbre spectrums that matches the pitch-less timbre spectrum, the classification corresponding to at least one of an instrument or a genre.

22. The apparatus of claim 21 , wherein the comparing means is to:

identify a media source of the media signal based on at least one of the pitch-less timbre spectrum or the classification; and

generate report based on at least one of the classification or the identification.

23. The apparatus of claim 21 , wherein the comparing means is to, when the pitch-less timbre spectrum of the media signal does not match a reference pitch-less timbre spectrum of the reference pitch-less timbre spectrums, prompt for additional information corresponding to the media signal.

24. The apparatus of claim 23 , wherein the storing means is to store the pitch-less timbre spectrum of the media signal as a reference pitch-less timbre spectrum in conjunction with the additional information.

25. The apparatus of claim 21 , further including means for determining a device setting adjustment based on the classification, wherein:

the comparing means is to generate a report including the device setting adjustment; and

the receiving means is to transmit the report to a device that output the media signal.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2020
From: RAFII, ZAFAR
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 052395/0061 →