IP Library Granted Patent US 7,567,899
Granted Patent B2
US 7,567,899 · App. 10/905,362 · Granted Jul 28, 2009

Methods and apparatus for audio recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,567,899
App. No.
10/905,362
Granted
Jul 28, 2009
Kind
B2
Abstract

A method, apparatus and computer memory are provided for recognizing an audio fingerprint of an unknown audio recording. A database stores a plurality of audio recording identifiers corresponding to a plurality of known audio recordings, where the audio recording identifiers are organized by variation information about the audio recordings. A processor searches a database and identifies at least one of the audio recording identifiers corresponding to the audio fingerprint, where the audio fingerprint includes variation information of the unknown audio recording.

Claims (73)

1. An apparatus for recognizing an audio fingerprint including variation information of an unknown audio recording, comprising:

a database operable to store a plurality of audio recording identifiers and metadata corresponding to a plurality of known audio recordings, wherein each of the plurality of audio recording identifiers are organized by variation information about the known audio recordings;

a processor operable to search the database to identify at least one of the plurality of audio recording identifiers corresponding to the audio fingerprint using the variation information of the unknown audio recording and the variation information of the known audio recordings, wherein the variation information of the unknown audio recording is based at least in part on a time ordered comparison of a plurality of predetermined model frequencies and a portion of audio data from the unknown audio recording, and the variation information of the plurality of known audio recordings is based at least in part on a time ordered comparison of the plurality of predetermined model frequencies and a portion of audio data from the plurality of known audio recordings; and

the processor further operable to cause the database to communicate to a source of the unknown fingerprint metadata corresponding to at least one of the plurality of audio recording identifiers.

2. An apparatus according to claim 1 , wherein the processor is further operable to determine cluster information from the variation information of the unknown audio recording, and identify a subset the audio recording identifiers based on the cluster data.

3. An apparatus according to claim 1 , wherein the variation information of a known audio recording is variation information about a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is variation information about a plurality of frequency families of the unknown recording.

4. An apparatus according to claim 1 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the unknown recording.

5. An apparatus according to claim 1 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the unknown recording.

6. An apparatus according to claim 1 , wherein the variation information of a known recording is based on an average of a summed set of frequency families plus a deviation of the known recording, and wherein the variation information of the unknown recording is based on an average of a summed set of frequency families plus a deviation the unknown recording.

7. An apparatus according to claim 1 , wherein the variation information of a known audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the known audio recording, and wherein the variation information of the unknown audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the unknown audio recording.

8. An apparatus according to claim 1 , wherein the variation information of a known recording is the sum of a predetermined number of the frequency families of the known audio recording having the highest level of variation, and wherein the variation information of the unknown recording is the sum of a predetermined number of the frequency families of the unknown audio recording having the highest level of variation.

9. An apparatus according to claim 1 , wherein the variation information of a known audio recording is based on a translation of a total running time of the known audio recording, and wherein the variation information of the unknown audio recording is based on a translation of a total running time of the unknown audio recording.

10. An apparatus according to claim 1 , wherein the variation information of the unknown audio recording is within a predetermined tolerance of the variation information of at least one of the known audio recordings.

11. An apparatus according to claim 1 , wherein the database is further operable to communicate to the source of the unknown fingerprint at least one of the audio recording identifiers corresponding to the unknown fingerprint.

12. An apparatus according to claim 1 , wherein the processor is further operable to recognize the variation information of a known audio recording that is substantially similar to the variation information of the unknown audio recording.

13. A network computer system, comprising the apparatus for recognizing an audio fingerprint of claim 1 .

14. A device-embedded system, comprising the apparatus for recognizing an audio fingerprint of claim 1 .

15. A method for recognizing an audio fingerprint including variation information of an unknown audio recording, comprising:

organizing a plurality of audio recording identifiers corresponding to a plurality of known audio recordings by variation information about the plurality of known audio recordings;

identifying at least one of the plurality of audio recording identifiers corresponding to the audio fingerprint using the variation information of the unknown audio recording and the variation information of the plurality of known audio recordings, wherein the variation information of the unknown audio recording is based at least in part on a time ordered comparison of a plurality of predetermined model frequencies and a portion of audio data from the unknown audio recording, and the variation information of the plurality of known audio recordings is based at least in part on a time ordered comparison of the plurality of predetermined model frequencies and a portion of audio data from the plurality of known audio recordings; and

communicating to a source of the unknown fingerprint at least metadata corresponding to the unknown fingerprint based on the at least one audio recording identifier obtained by the identifying.

16. A method according to claim 15 , further comprising:

determining cluster information from the variation information of the unknown audio recording; and identifying a subset the audio recording identifiers based on the cluster data.

17. A method according to claim 15 , wherein the variation information of a known audio recording is variation information about a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is variation information about a plurality of frequency families of the unknown recording.

18. A method according to claim 15 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the unknown recording.

19. A method according to claim 15 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the unknown recording.

20. A method according to claim 15 , wherein the variation information of a known recording is based on an average of a summed set of frequency families plus a deviation of the known recording, and wherein the variation information of the unknown recording is based on an average of a summed set of frequency families plus a deviation the unknown recording.

21. A method according to claim 15 , wherein the variation information of a known audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the known audio recording, and wherein the variation information of the unknown audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the unknown audio recording.

22. A method according to claim 15 , wherein the variation information of a known recording is the sum of a predetermined number of the frequency families of the known audio recording having the highest level of variation, and wherein the variation information of the unknown recording is the sum of a predetermined number of the frequency families of the unknown audio recording having the highest level of variation.

23. A method according to claim 15 , wherein the variation information of a known audio recording is based on a translation of a total running time of the known audio recording, and wherein the variation information of the unknown audio recording is based on a translation of a total running time of the unknown audio recording.

24. A method according to claim 15 , wherein the variation information of the unknown audio recording is within a predetermined tolerance of the variation information of at least one of the known audio recordings.

25. A method according to claim 15 , further comprising:

communicating to the source of the unknown fingerprint the audio recording identifier corresponding to the unknown fingerprint.

26. A method according to claim 15 , further comprising:

recognizing the variation information of a known audio recording that is substantially similar to the variation information of the unknown audio recording.

27. An apparatus for recognizing an audio fingerprint including variation information of an unknown audio recording, comprising:

means for organizing a plurality of audio recording identifiers corresponding to a plurality of known audio recordings by variation information about the plurality of known audio recordings;

means for identifying at least one of the audio recording identifiers corresponding to the audio fingerprint using the variation information of the unknown audio recording and the variation information of the plurality of known audio recordings, wherein the variation information of the unknown audio recording is based at least in part on a time ordered comparison of a plurality of predetermined model frequencies and a portion of audio data from the unknown audio recording, and the variation information of the plurality of known audio recordings is based at least in part on a time ordered comparison of the plurality of predetermined model frequencies and a portion of audio data from the plurality of known audio recordings; and

means for communicating to a source of the unknown fingerprint at least metadata corresponding to the unknown fingerprint based on the at least one audio recording identifier obtained by the means for identifying.

28. An apparatus according to claim 27 , further comprising:

means for determining cluster information from the variation information of the unknown audio recording; and identifying a subset the audio recording identifiers based on the cluster data.

29. An apparatus according to claim 27 , wherein the variation information of a known audio recording is variation information about a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is variation information about a plurality of frequency families of the unknown recording.

30. An apparatus according to claim 27 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the unknown recording.

31. An apparatus according to claim 27 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the unknown recording.

32. An apparatus according to claim 27 , wherein the variation information of a known recording is based on an average of a summed set of frequency families plus a deviation of the known recording, and wherein the variation information of the unknown recording is based on an average of a summed set of frequency families plus a deviation the unknown recording.

33. An apparatus according to claim 27 , wherein the variation information of a known audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the known audio recording, and wherein the variation information of the unknown audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the unknown audio recording.

34. An apparatus according to claim 27 , wherein the variation information of a known recording is the sum of a predetermined number of the frequency families of the known audio recording having the highest level of variation, and wherein the variation information of the unknown recording is the sum of a predetermined number of the frequency families of the unknown audio recording having the highest level of variation.

35. An apparatus according to claim 27 , wherein the variation information of a known audio recording is based on a translation of a total running time of the known audio recording, and wherein the variation information of the unknown audio recording is based on a translation of a total running time of the unknown audio recording.

36. An apparatus according to claim 27 , wherein the variation information of the unknown audio recording is within a predetermined tolerance of the variation information of at least one of the known audio recordings.

37. An apparatus according to claim 27 , further comprising:

means for communicating to the source of the unknown fingerprint the audio recording identifier corresponding to the unknown fingerprint.

38. An apparatus according to claim 27 , further comprising:

means for recognizing the variation information of a known audio recording that is substantially similar to the variation information of the unknown audio recording.

39. Computer-readable medium storing computer executable code including instructions which when executed by a computer processor causes the computer processor to perform:

organizing a plurality of audio recording identifiers corresponding to a plurality of known audio recordings by variation information about the plurality of known audio recordings;

identifying at least one of the audio recording identifiers corresponding to the audio fingerprint using the variation information of the unknown audio recording and the variation information of the plurality of known audio recordings, wherein the variation information of the unknown audio recording is based at least in part on a time ordered comparison of a plurality of predetermined model frequencies and a portion of audio data from the unknown audio recording, and the variation information of the plurality of known audio recordings is based at least in part on a time ordered comparison of the plurality of predetermined model frequencies and a portion of audio data from the plurality of known audio recordings; and

communicating to a source of the unknown fingerprint at least metadata corresponding to the unknown fingerprint based on the at least one audio recording identifier obtained by the identifying.

40. Computer-readable medium storing computer executable code according to claim 39 , further including code for causing the computer processor to perform:

determining cluster information from the variation information of the unknown audio recording; and identifying a subset the audio recording identifiers based on the cluster data.

41. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of a known audio recording is variation information about a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is variation information about a plurality of frequency families of the unknown recording.

42. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a plurality of frequency families of the unknown recording.

43. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of a known audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the known recording, and wherein the variation information of the unknown audio recording is based on at least one of the predominance and presence of a combined set of the frequency families of the unknown recording.

44. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of a known recording is based on an average of a summed set of frequency families plus a deviation of the known recording, and wherein the variation information of the unknown recording is based on an average of a summed set of frequency families plus a deviation the unknown recording.

45. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of a known audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the known audio recording, and wherein the variation information of the unknown audio recording is the sum of the total variation of a predetermined number of the highest variation frequency families of the unknown audio recording.

46. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of a known recording is the sum of a predetermined number of the frequency families of the known audio recording having the highest level of variation, and wherein the variation information of the unknown recording is the sum of a predetermined number of the frequency families of the unknown audio recording having the highest level of variation.

47. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of a known audio recording is based on a translation of a total running time of the known audio recording, and wherein the variation information of the unknown audio recording is based on a translation of a total running time of the unknown audio recording.

48. Computer-readable medium storing computer executable code according to claim 39 , wherein the variation information of the unknown audio recording is within a predetermined tolerance of the variation information of at least one of the known audio recordings.

49. Computer-readable medium storing computer executable code according to claim 39 , further including code for causing the computer processor to perform:

communicating to the source of the unknown fingerprint the audio recording identifier corresponding to the unknown fingerprint.

50. Computer-readable medium storing computer executable code according to claim 39 , further including code for causing the computer processor to perform:

recognizing the variation information of a known audio recording that is substantially similar to the variation information of the unknown audio recording.

51. A computer processor implemented to execute the instructions stored on the computer-readable medium of claim 39 .

52. A device-embedded system implemented to execute the instructions stored on the computer-readable medium of claim 39 .

Assignments (16)
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Nov 25, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: APTIV DIGITAL INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; SONIC SOLUTIONS LLC; STARSIGHT TELECAST, INC.; UNITED VIDEO PROPERTIES, INC.; VEVEO, INC.
Reel/Frame 051145/0090 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
PATENT SECURITY AGREEMENT Recorded Jul 24, 2014
From: APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; SONIC SOLUTIONS LLC; STARSIGHT TELECAST, INC.; UNITED VIDEO PROPERTIES, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 033407/0035 →
PATENT RELEASE Recorded Jul 22, 2014
From: JPMORGAN CHASE BANK N.A., AS COLLATERAL AGENT
To: ALL MEDIA GUIDE, LLC; DIVX, LLC; SONIC SOLUTIONS LLC
Reel/Frame 033378/0685 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2013
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ALL MEDIA GUDE, LLC; DIVX, LLC; SONIC SOLUTIONS LLC
Reel/Frame 030591/0534 →
SECURITY AGREEMENT Recorded Mar 25, 2011
From: ALL MEDIA GUIDE, LLC; DIVX, LLC; SONIC SOLUTIONS LLC
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 026026/0111 →
RELEASE OF SECURITY INTEREST Recorded Oct 29, 2010
From: JPMORGAN CHASE BANK, N.A. (A NATIONAL ASSOCIATION)
To: ALL MEDIA GUIDE, LLC; APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ODS PROPERTIES, INC.; ROVI DATA SOLUTIONS, INC. (FORMERLY KNOWN AS TV GUIDE DATA SOLUTIONS, INC.); ROVI GUIDES, INC. (FORMERLY KNOWN AS GEMSTAR-TV GUIDE INTERNATIONAL, INC.); ROVI SOLUTIONS CORPORATION (FORMERLY KNOWN AS MACROVISION CORPORATION); ROVI SOLUTIONS LIMITED (FORMERLY KNOWN AS MACROVISION EUROPE LIMITED); ROVI TECHNOLOGIES CORPORATION; STARSIGHT TELECAST, INC.; TV GUIDE, INC.; TV GUIDE ONLINE, LLC; UNITED VIDEO PROPERTIES, INC.
Reel/Frame 025222/0731 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2009
From: ALL MEDIA GUIDE, LLC
To: ROVI TECHNOLOGIES CORPORATION
Reel/Frame 023273/0825 →
SECURITY AGREEMENT Recorded May 15, 2008
From: APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; GEMSTAR-TV GUIDE INTERNATIONAL, INC.; INDEX SYSTEMS INC; MACROVISION CORPORATION; ODS PROPERTIES, INC.; STARSIGHT TELECAST, INC.; TV GUIDE ONLINE, LLC; UNITED VIDEO PROPERTIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 020986/0074 →
SECURITY AGREEMENT Recorded Oct 18, 2005
From: ALL MEDIA GUIDE, LLC
To: UNION BANK OF CALIFORNIA, N.A.
Reel/Frame 016654/0894 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2005
From: AEC ONE STOP GROUP, INC.
To: ALL MEDIA GUIDE, LLC
Reel/Frame 016767/0024 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2004
From: BOGDANOV, VLADIMIR ASKOLD
To: AEC ONE STOP GROUP, INC.
Reel/Frame 015499/0101 →