IP Library Granted Patent US 10,068,011
Granted Patent B1
US 10,068,011 · App. 15/458,333 · Granted Sep 4, 2018

Systems and methods for determining a repeatogram in a music composition using audio features

Inventor: David Tcheng (San Mateo, CA)
Assignee: GoPro, Inc.
G06F17/30743G10L25/18G10L25/51
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,068,011
App. No.
15/458,333
Granted
Sep 4, 2018
Kind
B1
Abstract

A dataset representing repeated sounds within a musical composition recorded on an audio track may be constructed. An audio track duration of an audio track may be partitioned into partitions of a partition size. A current partition may be compared to remaining partitions of the audio track. Audio information for the current partition may be correlated to audio information for remaining partitions to determine a correlated partition for the current partition from among the remaining partitions of the track duration. The correlated partition determined may be identified as most likely to represent the same sound as the current partition. This comparison process may be performed iteratively, for individual ones of the remaining partitions. Correlation results of the comparison process may be recorded to represent the partition time period of the correlated partition as a function of partition time period of the current partition.

Claims (31)

1. A method for constructing a dataset for representing repeated sounds within an audio, comprising:

obtaining audio information for an audio track recorded over a track duration;

partitioning the track duration into multiple partitions, individual partitions occurring at different time periods along the track duration;

comparing one or more given partitions of the multiple partitions to one or more other partitions of the multiple partitions to determine one or more correlated partitions for the one or more given partitions, individual ones of the correlated partitions being identified as most likely to represent the same sound as individual ones of the given partitions;

recording the one or more correlations between the one or more given partitions and the one or more correlated partitions; and

organizing the recorded correlations to represent the time period of the one or more correlated partitions as a function of the time period of the one or more given partitions.

2. The method of claim 1 , wherein the audio track is generated from a media file, the media file including audio and video information.

3. The method of claim 1 , wherein the audio information including an audio energy representation.

4. The method of claim 3 , wherein the audio energy representation is filtered into a frequency band to produce a frequency energy representation, the frequency energy representation representing individual energy samples associated with sound in the frequency band captured on the audio track.

5. The method of claim 3 , wherein the comparison includes correlating individual energy samples in the frequency band of the one or more given partitions with individual energy samples in the frequency band in the one or more other partitions.

6. The method of claim 3 , wherein the audio energy representations of the individual partitions are transformed into frequency space in which energy is represented as a function of frequency.

7. The method of claim 6 , wherein individual transformed representations of the individual partitions include identifying pitches of harmonic sound and determining magnitudes of harmonic energy at harmonics of the harmonic sound.

8. The method of claim 7 , wherein the comparison includes correlating pitch of the harmonic sound and harmonic energy of the transformed representation of the one or more given partitions with pitch of the harmonic sound and harmonic energy of transformed representations in the one or more other partitions.

9. The method of claim 1 , wherein the one or more other partitions are selected for the comparison based on one or more sizes of the multiple partitions.

10. The method of claim 1 , wherein the one or more other partitions are selected for the comparison based on a stopping criteria.

11. A system for constructing a dataset for representing repeated sounds within an audio, comprising:

one or more physical processors configured to machine readable instructions to:

obtain audio information for an audio track recorded over a track duration;

partition the track duration into multiple partitions, individual partitions occurring at different time periods along the track duration;

compare one or more given partitions of the multiple partitions to one or more other partitions of the multiple partitions to determine one or more correlated partitions for the one or more given partitions, individual ones of the correlated partitions being identified as most likely to represent the same sound as individual ones of the given partitions;

record the one or more correlations between the one or more given partitions and the one or more correlated partitions; and

organize the recorded correlations to represent the time period of the one or more correlated partitions as a function of the time period of the one or more given partitions.

12. The system of claim 11 , wherein the audio track is generated from a media file, the media file including audio and video information.

13. The system of claim 11 , wherein the audio information including an audio energy representation.

14. The system of claim 13 , wherein the audio energy representation is filtered into a frequency band to produce a frequency energy representation, the frequency energy representation representing individual energy samples associated with sound in the frequency band captured on the audio track.

15. The system of claim 13 , wherein the comparison includes correlating individual energy samples in the frequency band of the one or more given partitions with individual energy samples in the frequency band in the one or more other partitions.

16. The system of claim 13 , wherein the audio energy representations of the individual partitions are transformed into frequency space in which energy is represented as a function of frequency.

17. The system of claim 16 , wherein individual transformed representations of the individual partitions include identifying pitches of harmonic sound and determining magnitudes of harmonic energy at harmonics of the harmonic sound.

18. The system of claim 17 , wherein the comparison includes correlating pitch of the harmonic sound and harmonic energy of the transformed representation of the one or more given partitions with pitch of the harmonic sound and harmonic energy of transformed representations in the one or more other partitions.

19. The system of claim 11 , wherein the one or more other partitions are selected for the comparison based on one or more sizes of the multiple partitions.

20. The system of claim 11 , wherein the one or more other partitions are selected for the comparison based on a stopping criteria.

Assignments (7)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SCHEDULE TO REMOVE APPLICATION 15387383 AND REPLACE WITH 15385383 PREVIOUSLY RECORDED ON REEL 042665 FRAME 0065. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Oct 23, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 050808/0824 →
SECURITY INTEREST Recorded Dec 3, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047713/0309 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 042665/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2017
From: TCHENG, DAVID
To: GOPRO, INC.
Reel/Frame 041996/0201 →
Continuity (1)
Continuation 15251571 · Aug 30, 2016