IP Library Granted Patent US 8,352,259
Granted Patent B2
US 8,352,259 · App. 12/488,518 · Granted Jan 8, 2013

Methods and apparatus for audio recognition

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,352,259
App. No.
12/488,518
Granted
Jan 8, 2013
Kind
B2
Abstract

Frequencies from a set of audio source files are extracted and measured across the set to determine a range of each of the frequencies. Stable frequencies of the frequencies are detected based on each range and used to create a stable frequency family. An unknown recording is mapped to the stable frequency family to form an audio fingerprint.

Claims (57)

1. An apparatus for generating an audio fingerprint, comprising:

a processor operable to:

extract a plurality of frequencies from two or more audio source files included in a set of audio source files, wherein the two or more audio source files are encoded in different formats;

measure, across the two or more audio source files, a range of variation of each of the plurality of frequencies, the range of variation of a respective frequency being a range of variation of values for the frequency measured from among the two or more audio source files;

for each of the plurality of frequencies, compare the range of variation to a corresponding threshold to determine whether the range of variation is less than the corresponding threshold;

identify a plurality of stable frequencies from among the plurality of frequencies extracted from two or more audio source files, an extracted frequency being identified as a stable frequency if the respective range of variation is determined to be less than the corresponding threshold;

identify harmonically related stable frequencies from among the identified plurality of stable frequencies, each group of harmonically related stable frequencies forming a stable frequency family;

map sample points of an unknown recording to at least a portion of at least one stable frequency family;

generate fingerprint data by analyzing the mapped sample points of the unknown recording; and

form the audio fingerprint from the generated fingerprint data.

2. The apparatus according to claim 1 , wherein the plurality of stable frequencies include at least one set of harmonically related frequencies and the processor is further operable to select a representative frequency of each set of harmonically related frequencies to form the stable frequency family.

3. The apparatus according to claim 1 , wherein two or more of the audio source files are recorded on different physical media.

4. The apparatus according to claim 1 , wherein the range is an audio amplitude range.

5. The apparatus according to claim 1 , wherein the processor is further operable to assign a unique identifier to each of the audio source files and associate the audio fingerprint to a corresponding unique identifier.

6. The apparatus according to claim 4 , further comprising:

a database operable to store metadata associated with the unique identifier; and

a user interface, in communication with the database, operable to present the metadata.

7. A method for generating an audio fingerprint, comprising:

extracting, using an audio processor, a plurality of frequencies from two or more audio source files include in a set of audio source files, wherein the two or more audio source files are encoded in different formats;

measuring, across the two or more audio source files, a range of variation of each of the plurality of frequencies, the range of variation of a respective frequency being a range of variation of values for the frequency measured from among the two or more audio source files;

for each of the plurality of frequencies, comparing the range to a corresponding threshold to determine whether the range of variation is less than the corresponding threshold;

identifying a plurality of stable frequencies from among the plurality of frequencies extracted from two or more audio source files, an extracted frequency being identified as a stable frequency if the respective range of variation is determined to be less than the corresponding threshold;

identifying harmonically related stable frequencies from among the identified plurality of stable frequencies, each group of harmonically related stable frequencies forming a stable frequency family;

mapping sample points of an unknown recording to at least a portion of at least one stable frequency family;

generating fingerprint data by analyzing the mapped sample points of the unknown recording; and

forming the audio fingerprint from the generated fingerprint data.

8. The method according to claim 7 , wherein the plurality of stable frequencies include at least one set of harmonically related frequencies, the method further comprising:

selecting a representative frequency of each set of harmonically related frequencies to form the stable frequency family.

9. The method according to claim 7 , wherein two or more of the audio source files are recorded on different physical media.

10. The method according to claim 7 , wherein the range is an audio amplitude range.

11. The method according to claim 7 , further comprising:

assigning a unique identifier to each of the audio source files; and

associating the audio fingerprint to a corresponding unique identifier.

12. The method according to claim 11 , further comprising:

storing metadata associated with the unique identifier; and

presenting the metadata on a user interface.

13. A non-transitory computer-readable medium having stored thereon sequences of instructions, the sequences of instructions including instructions which when executed by a computer system causes the computer system to perform:

extracting, using an audio processor, a plurality of frequencies from two or more audio source files included in a set of audio source files, wherein the two or more of the audio source files are encoded in different formats;

measuring, across the two or more audio source files, a range of variation of each of the plurality of frequencies, the range of variation of a respective frequency being a range of variation of values for the frequency measured from among the two or more audio source files;

for each of the plurality of frequencies, comparing the range of variation to a corresponding threshold to determine whether the range of variation is less than the corresponding threshold

identifying a plurality of stable frequencies from among the plurality of frequencies extracted from two or more audio source files, an extracted frequency being identified as a stable frequency if the respective range of variation is determined to be less than the corresponding threshold;

identifying harmonically related stable frequencies from among the identified plurality of stable frequencies, each group of harmonically related stable frequencies forming a stable frequency family;

mapping sample points of an unknown recording to at least a portion of at least one stable frequency family

generating fingerprint data by analyzing the mapped sample points of the unknown recording; and

forming the audio fingerprint from the generated fingerprint data.

14. The non-transitory computer-readable medium of claim 13 , further storing a sequence of instructions which when executed by a computer system causes the computer system to perform:

selecting a representative frequency of each set of harmonically related frequencies to form the stable frequency family, wherein the plurality of stable frequencies include at least one set of harmonically related frequencies.

15. The non-transitory computer-readable medium of claim 13 , wherein two or more of the audio source files are recorded on different physical media.

16. The non-transitory computer-readable medium of claim 13 , wherein the range is an audio amplitude range.

17. The non-transitory computer-readable medium of claim 13 , further storing a sequence of instructions which when executed by a computer system causes the computer system to perform:

assigning a unique identifier to each of the audio source files; and

associating the audio fingerprint to a corresponding unique identifier.

18. The non-transitory computer-readable medium of claim 17 , further storing a sequence of instructions which when executed by the computer system causes the computer system to perform:

storing metadata associated with the unique identifier; and

presenting the metadata on a user interface.

19. The apparatus according to claim 1 , wherein the two or more audio source files included in the set of audio source files are encodings of a same audio recording, and wherein each range of variation represents a variation of the respective frequency measured from among the two or more audio source files of the same audio recording.

20. The method according to claim 7 , wherein the two or more audio source files included in the set of audio source files are encodings of a same audio recording, and wherein each range of variation represents a variation of the respective frequency measured from among the two or more audio source files of the same audio recording.

Assignments (12)
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Nov 25, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: APTIV DIGITAL INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; SONIC SOLUTIONS LLC; STARSIGHT TELECAST, INC.; UNITED VIDEO PROPERTIES, INC.; VEVEO, INC.
Reel/Frame 051145/0090 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
PATENT RELEASE Recorded Jul 24, 2014
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ALL MEDIA GUIDE, LLC; APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI CORPORATION; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; STARSIGHT TELECAST, INC.; TV GUIDE INTERNATIONAL, INC.; UNITED VIDEO PROPERTIES, INC.
Reel/Frame 033396/0001 →
PATENT SECURITY AGREEMENT Recorded Jul 24, 2014
From: APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; SONIC SOLUTIONS LLC; STARSIGHT TELECAST, INC.; UNITED VIDEO PROPERTIES, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 033407/0035 →
SECURITY INTEREST Recorded Sep 13, 2011
From: APTIV DIGITAL, INC., A DELAWARE CORPORATION; GEMSTAR DEVELOPMENT CORPORATION, A CALIFORNIA CORPORATION; INDEX SYSTEMS INC, A BRITISH VIRGIN ISLANDS COMPANY; ROVI CORPORATION, A DELAWARE CORPORATION; ROVI GUIDES, INC., A DELAWARE CORPORATION; ROVI SOLUTIONS CORPORATION, A DELAWARE CORPORATION; ROVI TECHNOLOGIES CORPORATION, A DELAWARE CORPORATION; STARSIGHT TELECAST, INC., A CALIFORNIA CORPORATION; UNITED VIDEO PROPERTIES, INC., A DELAWARE CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027039/0168 →
RELEASE OF SECURITY INTEREST Recorded Oct 29, 2010
From: JPMORGAN CHASE BANK, N.A. (A NATIONAL ASSOCIATION)
To: ALL MEDIA GUIDE, LLC; APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ODS PROPERTIES, INC.; ROVI DATA SOLUTIONS, INC. (FORMERLY KNOWN AS TV GUIDE DATA SOLUTIONS, INC.); ROVI GUIDES, INC. (FORMERLY KNOWN AS GEMSTAR-TV GUIDE INTERNATIONAL, INC.); ROVI SOLUTIONS CORPORATION (FORMERLY KNOWN AS MACROVISION CORPORATION); ROVI SOLUTIONS LIMITED (FORMERLY KNOWN AS MACROVISION EUROPE LIMITED); ROVI TECHNOLOGIES CORPORATION; STARSIGHT TELECAST, INC.; TV GUIDE, INC.; TV GUIDE ONLINE, LLC; UNITED VIDEO PROPERTIES, INC.
Reel/Frame 025222/0731 →
SECURITY AGREEMENT Recorded Dec 4, 2009
From: ROVI TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 023607/0249 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2009
From: ALL MEDIA GUIDE, LLC
To: ROVI TECHNOLOGIES CORPORATION
Reel/Frame 023273/0825 →