IP Library Granted Patent US 7,853,344
Granted Patent B2
US 7,853,344 · App. 11/839,768 · Granted Dec 14, 2010

Method and system for analyzing ditigal audio files

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,853,344
App. No.
11/839,768
Granted
Dec 14, 2010
Kind
B2
Abstract

A method and system for analyzing audio files is provided. Plural audio file feature vector values based on an audio file's content are determined and the audio file feature vectors are stored in a database that also stores other pre-computed audio file features. The process determines if the audio files feature vectors match the stored audio file vectors. The process also associates a plurality of known attributes to the audio file.

Claims (99)

1. A method for generating a fingerprint of an audio waveform, comprising:

defining a codebook which represents a multivariate vector of one or more spectral features with one of a plurality of codes, each code corresponding to a bin and representing a portion of a predetermined audio waveform;

dividing the audio waveform into a plurality of bins,

for each bin of the plurality of bins, computing one or more spectral features for the bin,

wherein the computing comprises:

(a) computing the one or more spectral features for a first group of data points within the bin;

(b) shifting some number of data points within the bin; and

(c) computing the one or more spectral features for a second group of data points within the bin;

mapping the one or more spectral features obtained by the computing to a string of codes from the codebook;

generating a fingerprint by representing the audio waveform with the string of codes obtained by the mapping; and

aligning the string of codes in a time series.

2. The method of claim 1 , wherein one or more data points in the first group overlap with one or more data points in the second group.

3. The method of claim 1 , wherein each code is a hash code.

4. The method of claim 1 , further comprising:

compressing the string of codes from the codebook to form a compressed string, wherein the codes of the compressed string are aligned in a time series.

5. A method for creating a signature of an audio waveform, comprising:

dividing the audio waveform into a plurality of bins;

for the plurality of the bins, selecting a first group of data points within each bin, and computing one or more spectral features for each bin based upon the first group of points within the plurality of bins,

and for the plurality of bins, selecting a second group of data points within each bin, and computing one or more spectral features for each bin based upon the second set of data points within the bins of the plurality;

mapping the one or more spectral properties for the plurality of bins to a string of codes by referencing a codebook of multivariate vectors; and

creating one or more signatures representing the audio waveform with the string of codes obtained by the mapping.

6. The method of claim 5 , wherein each code in the string represents the waveform over a portion of the waveform, and wherein the codes are aligned in a time series.

7. The method of claim 6 , further comprising:

compressing the string such that the time series alignment is maintained.

8. The method of claim 5 , further comprising:

comparing a signature of the one or more signatures that initiates at a given time with a representation of an audio segment.

9. The method of claim 8 , further comprising:

defining a codebook which represents a vector of one or more spectral features with a code, prior to referencing said codebook.

10. The method of claim 5 , wherein one or more signatures is created for each bin.

11. A method for creating a signature for an audio waveform, comprising:

dividing the audio waveform into a plurality of bins;

for the plurality of the bins, selecting a first group of data points within each bin, and computing one or more spectral properties for each bin based upon the first group of points within the plurality of bins,

and for the plurality of bins, selecting a second group of data points within each bin, and computing one or more spectral properties for each bin based upon the second set of data points within the plurality of bins;

mapping the one or more spectral properties for the plurality of bins to a string of hash codes by referencing a codebook of hash values representing a multivariate vector; and

creating one or more signatures representing the audio waveform with the string of hash values obtained by the mapping.

12. The method of claim 11 , wherein each code is a hash code.

13. A computer-readable memory medium having computer-executable code stored therein for causing a computer to generate a fingerprint of an audio waveform, said computer-executable code comprising:

code for causing the computer to define a codebook which represents a multivariate vector of one or more spectral features with one of a plurality of codes, each code corresponding to a bin and representing a portion of a predetermined audio waveform;

code for causing the computer to divide the audio waveform into a plurality of bins;

code for causing the computer to compute one or more spectral features for a first group of data points within each bin of the plurality of bins;

code for causing the computer to shift some number of data points within each bin of the plurality of bins; and

code for causing the computer to compute one or more spectral features for a second group of data points within each bin of the plurality of bins;

code for causing the computer to map the one or more spectral features obtained by the computing to a string of codes from the codebook;

code for causing the computer to generate a fingerprint by representing the audio waveform with the string of codes; and

code for causing the computer to align the string of codes in a time series.

14. The memory medium of claim 13 , wherein one or more data points in the first group overlap with one or more data points in the second group.

15. The memory medium of claim 13 , wherein each code is a hash code.

16. The memory medium of claim 13 , wherein said computer-executable code , further comprises:

code for causing the computer to compress the string of codes from the codebook to form a compressed string, wherein the codes of the compressed string are aligned in a time series.

17. An apparatus for fingerprinting an audio waveform, comprising:

means for defining a codebook which represents a multivariate vector of one or more spectral features with one of a plurality of codes, each code corresponding to a bin and representing a portion of a predetermined audio waveform;

means for dividing the audio waveform into a plurality of bins;

means for computing one or more spectral features for a first group of data points within each bin of the plurality of bins;

means for shifting some number of data points within each bin of the plurality of bins; and

means for computing one or more spectral features for a second group of data points within each bin of the plurality of bins;

means for mapping the one or more spectral features for the first and second groups of data points obtained by the means for computing to a string of codes from the codebook;

means for generating a fingerprint by representing the audio waveform with the string of codes obtained by the mapping; and

means for aligning the string of codes in a time series.

18. A computer-readable memory medium having computer-executable code stored therein for causing a computer to create a signature of an audio waveform, said computer-executable code comprising:

code for causing the computer to divide the audio waveform into a plurality of bins;

code for causing the computer to select a first group of data points within each bin;

code for causing the computer to compute one or more spectral features for each bin based upon the first group of points within the plurality of bins;

code for causing the computer to select a second group of data points within each bin;

code for causing the computer to compute one or more spectral features for each bin based upon the second set of data points within the bins of the plurality;

code for causing the computer to map the one or more spectral features for the plurality of bins to a string of codes by referencing a codebook representing at least one multivariate vector; and

code for causing the computer to create one or more signatures representing the audio waveform with the string of codes.

19. The memory medium of claim 18 , wherein each code in the string represents the waveform over a portion of the waveform, and wherein the codes are aligned in a time series.

20. The memory medium of claim 19 , wherein said computer-executable code further comprises:

code for causing the computer to compress the string such that the time series alignment is maintained.

21. The memory medium of claim 19 , wherein said computer-executable code further comprises:

code for causing the computer to compare a signature of the one or more signatures that initiates at a given time with a representation of an audio segment.

22. The memory medium of claim 21 , wherein said computer-executable code further comprises:

code for causing the computer to define a codebook which represents a vector of one or more spectral features with a code, prior to referencing said codebook.

23. The memory medium of claim 18 , wherein one or more signatures is created for each bin.

24. The memory medium of claim 18 , wherein each code is a hash code.

25. An apparatus for creating a signature of an audio waveform, comprising:

means for dividing the audio waveform into a plurality of bins;

means for selecting a first group of data points within each bin;

means for computing one or more spectral features for each bin based upon the first group of points within the plurality of bins;

means for selecting a second group of data points within each bin;

means for computing one or more spectral features for each bin based upon the second set of data points within the bins of the plurality;

means for mapping the one or more spectral features for the plurality of bins to a string of codes by referencing a codebook, wherein the codebook represents at least one multivariate vector; and

means for creating one or more signatures representing the audio waveform with the string of codes.

26. A method for fingerprinting an audio waveform, comprising:

defining a codebook which represents a multivariate vector of one or more spectral features with a corresponding one of a plurality of codes;

dividing the audio waveform into a plurality of bins;

computing one or more spectral features for each bin; and

generating a fingerprint by mapping the one ore more spectral features to a string of codes from the codebook to represent the audio waveform based on the computed one or more spectral features for each bin.

27. A computer-readable memory medium having computer-executable code stored therein for causing a computer to create a signature of an audio waveform, said computer-executable code comprising:

code for causing the computer to define a codebook which represents a multivariate vector of one or more spectral features with a corresponding one of a plurality of codes;

code for causing the computer to divide the audio waveform into a plurality of bins;

code for causing the computer to compute one or more spectral features for each bin; and

code for causing the computer to map the one ore more spectral features to a string of codes from the codebook to generate a fingerprint representing the audio waveform based on the computed one or more spectral features for each bin.

28. An apparatus for fingerprinting an audio waveform, comprising:

means for defining a codebook which represents a multivariate vector of one or more spectral features with a corresponding one of a plurality of codes;

means for dividing the audio waveform into a plurality of bins;

means for computing one or more spectral features for each bin;

means for mapping the one ore more spectral features to a string of codes from the codebook; and

generating a fingerprint by representing the audio waveform with the string of codes.

Assignments (12)
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Nov 25, 2019
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: APTIV DIGITAL INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; SONIC SOLUTIONS LLC; STARSIGHT TELECAST, INC.; UNITED VIDEO PROPERTIES, INC.; VEVEO, INC.
Reel/Frame 051145/0090 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
PATENT RELEASE Recorded Jul 24, 2014
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ALL MEDIA GUIDE, LLC; APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI CORPORATION; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; STARSIGHT TELECAST, INC.; TV GUIDE INTERNATIONAL, INC.; UNITED VIDEO PROPERTIES, INC.
Reel/Frame 033396/0001 →
PATENT SECURITY AGREEMENT Recorded Jul 24, 2014
From: APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ROVI GUIDES, INC.; ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; SONIC SOLUTIONS LLC; STARSIGHT TELECAST, INC.; UNITED VIDEO PROPERTIES, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 033407/0035 →
SECURITY INTEREST Recorded Sep 13, 2011
From: APTIV DIGITAL, INC., A DELAWARE CORPORATION; GEMSTAR DEVELOPMENT CORPORATION, A CALIFORNIA CORPORATION; INDEX SYSTEMS INC, A BRITISH VIRGIN ISLANDS COMPANY; ROVI CORPORATION, A DELAWARE CORPORATION; ROVI GUIDES, INC., A DELAWARE CORPORATION; ROVI SOLUTIONS CORPORATION, A DELAWARE CORPORATION; ROVI TECHNOLOGIES CORPORATION, A DELAWARE CORPORATION; STARSIGHT TELECAST, INC., A CALIFORNIA CORPORATION; UNITED VIDEO PROPERTIES, INC., A DELAWARE CORPORATION
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 027039/0168 →
RELEASE OF SECURITY INTEREST Recorded Oct 29, 2010
From: JPMORGAN CHASE BANK, N.A. (A NATIONAL ASSOCIATION)
To: ALL MEDIA GUIDE, LLC; APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; INDEX SYSTEMS INC.; ODS PROPERTIES, INC.; ROVI DATA SOLUTIONS, INC. (FORMERLY KNOWN AS TV GUIDE DATA SOLUTIONS, INC.); ROVI GUIDES, INC. (FORMERLY KNOWN AS GEMSTAR-TV GUIDE INTERNATIONAL, INC.); ROVI SOLUTIONS CORPORATION (FORMERLY KNOWN AS MACROVISION CORPORATION); ROVI SOLUTIONS LIMITED (FORMERLY KNOWN AS MACROVISION EUROPE LIMITED); ROVI TECHNOLOGIES CORPORATION; STARSIGHT TELECAST, INC.; TV GUIDE, INC.; TV GUIDE ONLINE, LLC; UNITED VIDEO PROPERTIES, INC.
Reel/Frame 025222/0731 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2009
From: MOODLOGIC, INC.
To: ROVI TECHNOLOGIES CORPORATION
Reel/Frame 023273/0821 →
SECURITY AGREEMENT Recorded May 15, 2008
From: APTIV DIGITAL, INC.; GEMSTAR DEVELOPMENT CORPORATION; GEMSTAR-TV GUIDE INTERNATIONAL, INC.; INDEX SYSTEMS INC; MACROVISION CORPORATION; ODS PROPERTIES, INC.; STARSIGHT TELECAST, INC.; TV GUIDE ONLINE, LLC; UNITED VIDEO PROPERTIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 020986/0074 →