IP Library Granted Patent US 8,706,276
Granted Patent B2
US 8,706,276 · App. 12/902,859 · Granted Apr 22, 2014

Systems, methods, and media for identifying matching audio

Inventors: Daniel P. W. Ellis (New York, NY); Courtenay V. Cotton (New York, NY)
Assignee: The Trustees of Columbia University in the City of New York
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,706,276
App. No.
12/902,859
Granted
Apr 22, 2014
Kind
B2
Abstract

System, methods, and media that: receive a first piece of audio content; identify a first plurality of atoms that describe at least a portion of the first piece of audio content using a Matching Pursuit algorithm; form a first group of atoms from at least a portion of the first plurality of atoms, the first group of atoms having first group parameters; form at least one first hash value for the first group of atoms based on the first group parameters; compare the at least one first hash value with at least one second hash value, wherein the at least one second hash value is based on second group parameters of a second group of atoms associated with a second piece of audio content; and identify a match between the first piece of audio content and the second piece of audio content based on the comparing.

Claims (49)

1. A system for identifying matching audio comprising:

a processor that:

receives a first piece of audio content;

identifies a first plurality of atoms that describe at least a portion of the first piece of audio content using a Matching Pursuit algorithm;

forms a first group of atoms from at least a portion of the first plurality of atoms, the first group of atoms having first group parameters;

forms at least one first hash value for the first group of atoms based on the first group parameters;

compares the at least one first hash value with at least one second hash value, wherein the at least one second hash value is based on second group parameters of a second group of atoms associated with a second piece of audio content; and

identifies a match between the first piece of audio content and the second piece of audio content based on the comparing.

2. The system of claim 1 , wherein the first piece of audio content and the second piece of audio content are from a single recording.

3. The system of claim 1 , wherein the first piece of audio content and the second piece of audio content are each associated with audio-video content.

4. The system of claim 1 , wherein the first piece of audio content is received in digital form.

5. The system of claim 1 , wherein the first piece of audio content is received in analog form.

6. The system of claim 1 , wherein the first plurality of atoms are Gabor atoms.

7. The system of claim 1 , wherein the process also prunes the first plurality of atoms after identifying the first plurality of atoms and before forming of the first group of atoms.

8. The system of claim 7 , wherein pruning is based on at least one mask.

9. The system of claim 1 , wherein forming the at least one first hash value is performed using locality sensitive hashing.

10. The system of claim 1 , wherein the processor also quantizes the at least one first hash value.

11. A method for identifying matching audio comprising:

receiving a first piece of audio content;

identifying a first plurality of atoms that describe at least a portion of the first piece of audio content using a Matching Pursuit algorithm;

forming a first group of atoms from at least a portion of the first plurality of atoms, the first group of atoms having first group parameters;

forming at least one first hash value for the first group of atoms based on the first group parameters;

comparing the at least one first hash value with at least one second hash value, wherein the at least one second hash value is based on second group parameters of a second group of atoms associated with a second piece of audio content; and

identifying a match between the first piece of audio content and the second piece of audio content based on the comparing.

12. The method of claim 11 , wherein the first piece of audio content and the second piece of audio content are from a single recording.

13. The method of claim 11 , wherein the first piece of audio content and the second piece of audio content are each associated with audio-video content.

14. The method of claim 11 , wherein the first piece of audio content is received in digital form.

15. The method of claim 11 , wherein the first piece of audio content is received in analog form.

16. The method of claim 11 , wherein the first plurality of atoms are Gabor atoms.

17. The method of claim 11 , further comprising pruning the first plurality of atoms after the identifying of the first plurality of atoms and before the forming of the first group of atoms.

18. The method of claim 17 , wherein the pruning is based on at least one mask.

19. The method of claim 11 , wherein the forming of the at least one first hash value is performed using locality sensitive hashing.

20. The method of claim 11 , further comprising quantizing the at least one first hash value.

21. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for identifying matching audio, the method comprising:

receiving a first piece of audio content;

identifying a first plurality of atoms that describe at least a portion of the first piece of audio content using a Matching Pursuit algorithm;

forming a first group of atoms from at least a portion of the first plurality of atoms, the first group of atoms having first group parameters;

forming at least one first hash value for the first group of atoms based on the first group parameters;

comparing the at least one first hash value with at least one second hash value, wherein the at least one second hash value is based on second group parameters of a second group of atoms associated with a second piece of audio content; and

identifying a match between the first piece of audio content and the second piece of audio content based on the comparing.

22. The non-transitory computer-readable medium of claim 21 , wherein the first piece of audio content and the second piece of audio content are from a single recording.

23. The non-transitory computer-readable medium of claim 21 , wherein the first piece of audio content and the second piece of audio content are each associated with audio-video content.

24. The non-transitory computer-readable medium of claim 21 , wherein the first piece of audio content is received in digital form.

25. The non-transitory computer-readable medium of claim 21 , wherein the first piece of audio content is received in analog form.

26. The method of claim 21 , wherein the first plurality of atoms are Gabor atoms.

27. The non-transitory computer-readable medium of claim 21 , wherein the method further comprises pruning the first plurality of atoms after the identifying of the first plurality of atoms and before the forming of the first group of atoms.

28. The non-transitory computer-readable medium of claim 27 , wherein the pruning is based on at least one mask.

29. The non-transitory computer-readable medium of claim 21 , wherein the forming of the at least one first hash value is performed using locality sensitive hashing.

30. The non-transitory computer-readable medium of claim 21 , wherein the method further comprises quantizing the at least one first hash value.

Assignments (2)
CONFIRMATORY LICENSE Recorded Jul 11, 2012
From: COLUMBIA UNIVERSITY NEW YORK MORNINGSIDE
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 028546/0172 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2010
From: ELLIS, DANIEL PW; COTTON, COURTENAY V
To: THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK
Reel/Frame 025127/0174 →
Continuity (2)
Provisional Application 61250096 · Oct 9, 2009
Related Publication 20110087349A1 · Apr 14, 2011