IP Library Granted Patent US 10,475,426
Granted Patent B2
US 10,475,426 · App. 16/203,811 · Granted Nov 12, 2019

Characterizing audio using transchromagrams

Inventor: Cameron Aubrey Summers (Oakland, CA)
Assignee: Gracenote, Inc.
G10H1/0008G10H2210/066G10H2210/081G10H2240/075G10H2240/141G10H2250/015G10H2250/215
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,475,426
App. No.
16/203,811
Granted
Nov 12, 2019
Kind
B2
Abstract

Methods, systems and apparatus to characterize audio using transchromagrams are disclosed. An example apparatus includes a transchromagram generator to generate a data structure based on a set of transition matrices corresponding to a plurality of time frames of audio data, the data structure indicative of probabilities that first musical notes will transition to second musical notes, a database controller to prompt a database to store the data structure within the audio data, and a notification manager to generate, based on a comparison between query audio data and the stored data structure of the audio data, a notification identifying at least one characteristic of the query audio data.

Claims (34)

1. An apparatus comprising:

a transchromagram generator to generate a data structure based on a set of transition matrices corresponding to a plurality of time frames of audio data, the data structure indicative of probabilities that first musical notes will transition to second musical notes:

a database controller to prompt a database to store the data structure within the audio data; and

a notification manager to generate, based on a comparison between query audio data and the stored data structure of the audio data, a notification identifying at least one characteristic of the query audio data.

2. The apparatus as defined in claim 1 , wherein the data structure includes a transchromagram, wherein the transchromagram represents attributes of the audio data.

3. The apparatus as defined in claim 2 , further including a chromagram accessor to access a chromagram of audio data, the chromagram indicating energy values that occur in corresponding time frames of the audio data at corresponding frequency ranges that partition a set of musical octaves into musical notes that are each represented by a different frequency range among the frequency ranges, wherein the transchromagram is a transchromagram of the chromagram.

4. The apparatus as defined in claim 1 , wherein generating of a transchromagram, the transchromagram included in the data structure, includes generating a mean transition matrix by averaging the generated set of transition matrices.

5. The apparatus as defined in claim 1 , wherein generating of the set of transition matrices includes generating a two-dimensional transition matrix based on a pair of time frames selected from the plurality of time frames of the audio data.

6. The apparatus as defined in claim 5 , wherein:

the pair of time frames is a sequential pair of adjacent time frames within the audio data; and

the generated two-dimensional transition matrix indicates a probability of a first musical note transitioning to a second musical note during the sequential pair of adjacent time frames.

7. The apparatus as defined in claim 1 , wherein the notification identifies at least one of the query audio data, a musical key of the query audio data, a musical chord of the query audio data, a song structure of the query audio data, or a musical genre of the query audio data.

8. A non-transitory computer readable storage medium comprising instructions that, when executed, cause a machine to, at least:

generate a data structure based on a set of transition matrices corresponding to a plurality of time frames of audio data, the data structure indicative of probabilities that first musical notes will transition to second musical notes;

prompt a database to store the data structure within the audio data; and

generate, based on a comparison between query audio data and the stored data structure of the audio data, a notification identifying at least one characteristic of the query audio data.

9. The non-transitory computer readable storage medium as defined in claim 8 , wherein the data structure includes a transchromagram.

10. The non-transitory computer readable storage medium as defined in claim 9 , further including instructions that, when executed, cause the machine to:

access a chromagram of audio data, the chromagram indicating energy values that occur in corresponding time frames of the audio data at corresponding frequency ranges that partition a set of musical octaves into musical notes that are each represented by a different frequency range among the frequency ranges, the transchromagram a transchromagram of the chromagram.

11. The non-transitory computer readable storage medium as defined in claim 9 , wherein generating of the transchromagram includes generating a mean transition matrix by averaging the generated set of transition matrices.

12. The non-transitory computer readable storage medium as defined in claim 9 , wherein generating of the set of transition matrices includes generating a two-dimensional transition matrix based on a pair of time frames selected from the plurality of time frames of the audio data.

13. The non-transitory computer readable storage medium as defined in claim 12 , wherein:

the pair of time frames is a sequential pair of adjacent time frames within the audio data; and

the generated two-dimensional transition matrix indicates a probability of a first musical note transitioning to a second musical note during the sequential pair of adjacent time frames.

14. The non-transitory computer readable storage medium as defined in claim 8 , wherein the notification identifies at least one of the query audio data, a musical key of the query audio data, a musical chord of the query audio data, a song structure of the query audio data, or a musical genre of the query audio data.

15. A method comprising:

generating a data structure based on a set of transition matrices corresponding to a plurality of time frames of audio data, the data structure indicative of probabilities that first musical notes will transition to second musical notes:

prompting a database to store the data structure within the audio data; and

generating, based on a comparison between query audio data and the stored data structure of the audio data, a notification identifying at least one characteristic of the query audio data.

16. The method as defined in claim 15 , wherein the data structure includes a transchromagram.

17. The method as defined in claim 16 , further including accessing a chromagram of audio data, the chromagram indicating energy values that occur in corresponding time frames of the audio data at corresponding frequency ranges that partition a set of musical octaves into musical notes that are each represented by a different frequency range among the frequency ranges, the transchromagram a transchromagram of the chromagram.

18. The method as defined in claim 16 , wherein generating of the transchromagram includes generating a mean transition matrix by averaging the generated set of transition matrices.

19. The method as defined in claim 16 , wherein generating of the set of transition matrices includes generating a two-dimensional transition matrix based on a pair of time frames selected from the plurality of time frames of the audio data.

20. The method as defined in claim 15 , wherein the notification identifies at least one of the query audio data, a musical key of the query audio data, a musical chord of the query audio data, a song structure of the query audio data, or a musical genre of the query audio data.

Assignments (8)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2019
From: SUMMERS, CAMERON AUBREY
To: GRACENOTE, INC.
Reel/Frame 047988/0402 →
Continuity (3)
Continuation 15689900 · Aug 29, 2017
Provisional Application 62381801 · Aug 31, 2016
Related Publication 20190096371A1 · Mar 28, 2019