IP Library Granted Patent US 11,847,998
Granted Patent B2
US 11,847,998 · App. 18/052,481 · Granted Dec 19, 2023

Methods and apparatus for harmonic source enhancement

Inventor: Zafar Rafii (Berkley, CA)
Assignee: Gracenote, Inc.
G10K11/175G06F3/162G10L25/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,847,998
App. No.
18/052,481
Granted
Dec 19, 2023
Kind
B2
Abstract

Methods and apparatus for harmonic source enhancement are disclosed herein. An example apparatus includes an interface to receive a media signal. The example apparatus also includes a harmonic source enhancer to determine a magnitude spectrogram of audio corresponding to the media signal; generate a time-frequency mask based on the magnitude spectrogram; and apply the time-frequency mask to the magnitude spectrogram to enhance a harmonic source of the media signal.

Claims (41)

1. A system comprising:

at least one memory;

instructions; and

one or more processors to execute the instructions to:

determine a magnitude spectrogram of audio corresponding to a media signal;

based on the determined magnitude spectrogram, enhance a harmonic source of the media signal;

compare the media signal having the enhanced harmonic source with reference media signals to determine an audio characteristic corresponding to the enhanced harmonic source;

identify an audio classification corresponding to the media signal based on the determined audio characteristic; and

identify at least one of a song, an advertisement, a show, or a video game based on the determined audio characteristic.

2. The system of claim 1 , wherein the determined magnitude spectrogram of audio comprises transforming the audio into a time-frequency representation using at least one of a Fourier transform, or a Constant Q transform.

3. The system of claim 2 , wherein the time-frequency representation includes respective columns corresponding to a spectrum at a particular instant.

4. The system of claim 1 , wherein the audio characteristic comprises an instrument corresponding to the enhanced harmonic source.

5. The system of claim 1 , wherein the audio characteristic comprises a reference harmonic source that corresponds to the enhanced harmonic source.

6. The system of claim 1 , wherein the audio characteristic comprises a genre corresponding to the enhanced harmonic source.

7. The system of claim 1 , wherein the audio classification comprises a genre of the media signal.

8. The system of claim 1 , wherein the instructions further comprise instructions to:

transmit the enhanced harmonic source; and

obtain at least one of an additional classification of the audio or an identifier corresponding to the media signal.

9. A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to at least:

determine a magnitude spectrogram of audio corresponding to a media signal;

based on the determined magnitude spectrogram, enhance a harmonic source of the media signal;

compare the media signal having the enhanced harmonic source with reference media signals to determine an audio characteristic corresponding to the enhanced harmonic source;

identify an audio classification corresponding to the media signal based on the determined audio characteristic; and

identify at least one of a song, an advertisement, a show, or a video game based on the determined audio characteristic.

10. The non-transitory computer readable medium of claim 9 , wherein the determined magnitude spectrogram of audio comprises transforming the audio into a time-frequency representation using at least one of a Fourier transform, or a Constant Q transform.

11. The non-transitory computer readable medium of claim 10 , wherein the time-frequency representation includes respective columns corresponding to a spectrum at a particular instant.

12. The non-transitory computer readable medium of claim 11 , wherein the audio characteristic comprises an instrument corresponding to the enhanced harmonic source.

13. The non-transitory computer readable medium of claim 9 , wherein the audio characteristic comprises a reference harmonic source that corresponds to the enhanced harmonic source.

14. The non-transitory computer readable medium of claim 9 , wherein the audio characteristic comprises a genre corresponding to the enhanced harmonic source.

15. The non-transitory computer readable medium of claim 9 , wherein the audio classification comprises a genre of the media signal.

16. The non-transitory computer readable medium of claim 9 , wherein the instructions further comprise instructions to:

transmit the enhanced harmonic source; and

obtain at least one of an additional classification of the audio or an identifier corresponding to the media signal.

17. A method comprising:

determining, by executing an instruction with one or more processors, a magnitude spectrogram of audio corresponding to a media signal;

based on the determined magnitude spectrogram, enhancing, by executing an instruction with one or more processors, an enhanced harmonic source of the media signal;

comparing, by executing an instruction with one or more processors, the media signal having the enhanced harmonic source with reference media signals to determine an audio characteristic corresponding to the enhanced harmonic source;

identifying, by executing an instruction with one or more processors, an audio classification corresponding to the media signal based on the determined audio characteristic and

identify at least one of a song, an advertisement, a show, or a video game based on the determined audio characteristic.

18. The method of claim 17 , wherein the audio characteristic comprises an instrument corresponding to the enhanced harmonic source.

19. The method of claim 17 , wherein the audio characteristic comprises a reference harmonic source that corresponds to the enhanced harmonic source.

Assignments (4)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2022
From: RAFII, ZAFAR
To: GRACENOTE, INC.
Reel/Frame 061717/0291 →
Continuity (2)
Continuation 16850855 · Apr 16, 2020
Related Publication 20230088351A1 · Mar 23, 2023