IP Library Granted Patent US 8,468,357
Granted Patent B2
US 8,468,357 · App. 12/720,537 · Granted Jun 18, 2013

Multiple step identification of recordings

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,468,357
App. No.
12/720,537
Granted
Jun 18, 2013
Kind
B2
Abstract

Multiple information is extracted from an unknown recording and information associated therewith. Associated information includes the filename, if the recording is a computer file in, e.g., MP3 format, or table of contents (TOC) data, if the recording is on a removable medium, such as a compact disc. At least one and preferably several algorithmically determined fingerprints are extracted from the recording using one or more fingerprint extraction methods. The information extracted is compared with corresponding information in a database maintained for reference recordings. Identification starts with the most accurate and efficient method available, e.g., using a hash ID, a unique ID or text. Fingerprint matching is used to confirm other matches and validation is performed by comparing the duration of the unknown and a possibly matching reference recording.

Claims (73)

1. A method, comprising:

accessing associated data that is associated with a recording, the associated data forming part of metadata associated with the recording;

extracting at least one fingerprint from at least one portion of the recording containing at least one of audio or video content data, the accessing and the extracting being performed for different copies of the recording;

storing the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

comparing the at least one fingerprint extracted from a first one of the different copies with the at least one fingerprint extracted from a second one of the different copies; and

updating the at least one fingerprint in the database based on the comparing.

2. The method of claim 1 , wherein the associated data indicates the length of the recording.

3. The method of claim 1 , wherein the recording is stored on a removable medium and the associated data is derived from table of contents data for the recording.

4. The method of claim 1 , wherein the associated data includes text associated with the recording.

5. The method of claim 4 , wherein the text includes at least one of a file path and a filename of the recording, a title of the recording, an artist name of a participant in creation of the recording, or an album name associated with the recording.

6. The method of claim 1 , wherein the associated data has been derived from an ID3 tag.

7. The method of claim 6 ,

wherein the ID3 tag includes encoded information, and

wherein the database is maintained by a provider of identification services and the encoded information is generated under control of the provider of identification services.

8. The method of claim 7 , further comprising:

validating the associated data by decoding the encoded information prior to the storing of the identifying information in the database.

9. The method of claim 1 , wherein the associated data includes a watermark.

10. The method of claim 1 , wherein the associated data includes media information regarding source media type.

11. The method of claim 10 , wherein the media information identifies the source media type as one of CD-R, CD-DA, a digital file, or a digital versatile disc.

12. The method of claim 1 , wherein the accessing and the extracting are performed by client equipment, and wherein the at least one fingerprint is stored in the database in response to receiving the at least one fingerprint from the client equipment.

13. The method of claim 12 , further comprising:

maintaining the database on at least one server under control of a provider of identification services, and

transmitting extraction instructions from the at least one server to the client equipment to guide the client equipment in the extracting.

14. The method of claim 13 , further comprising:

transmitting the associated data from the client equipment to the at least one server; and

selecting the extraction instructions by the at least one server for transmitting the extraction instructions from the at least one server to the client equipment based on the associated data.

15. The method of claim 13 , further comprising:

updating the extraction instructions based at least in part on at least one of frequency of receipt of the associated data for the recording or a number of users that have supplied the identifying information.

16. The method of claim 14 , wherein the selecting of the extraction instructions is based at least in part on at least one of type of the client equipment receiving the extraction instructions, geographical location of the client equipment receiving the extraction instructions, software operating on the client equipment receiving the extraction instructions, or quality of copies of the recording.

17. The method of claim 13 , further comprising:

transmitting the at least one fingerprint from the client equipment to the at least one server at a time specified by the extraction instructions.

18. The method of claim 13 , further comprising:

storing the at least one fingerprint at the client equipment until a specified number of fingerprints are ready for transmitting to the at least one server.

19. The method of claim 17 , wherein the transmitting the at least one fingerprint occurs when a communication channel coupled to the at least one server is available.

20. The method of claim 12 ,

wherein the recording is stored on a removable medium and the client equipment generates at least one encoded file from the recording.

21. The method of claim 1 , wherein the database includes the identifying information for music recordings.

22. The method of claim 1 , wherein the database includes the identifying information for video recordings.

23. The method of claim 1 , further comprising:

detecting a quality of the at least one fingerprint;

identifying a copy of the recording using the at least one fingerprint; and

replacing the at least one fingerprint with a higher quality fingerprint when the copy of the recording produces the higher quality fingerprint.

24. The method of claim 23 , wherein the detecting is based on at least one of an encoding technique used for the recording, a media type used to store the recording, error correction capability of user equipment accessing the recording, or a number of errors detected during the extracting.

25. The method of claim 1 , wherein the updating is performed after the comparing determines that fingerprints extracted from the different copies have a predetermined correlation.

26. The method of claim 1 , wherein the updating comprises:

combining fingerprints extracted from the different copies for storage in the database.

27. The method of claim 1 , wherein at least two fingerprints are derived from the at least one of audio or video content data using different fingerprinting techniques.

28. The method of claim 1 , wherein the associated data comprises table of contents data, and wherein the at least one fingerprint is extracted from one or more tracks of the recording.

29. A system, comprising:

a receiving unit to access associated data associated with a recording, the associated data forming part of metadata associated with the recording;

an extraction unit to extract at least one fingerprint from at least one of audio or video content data contained in at least one portion of the recording, the accessing and the extracting being performed for different copies of the recording; and

a storage unit, coupled to the receiving unit and the extraction unit, the storage unit to:

store the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

compare the at least one fingerprint extracted from a first one of the different copies with the at least one fingerprint extracted from a second one of the different copies; and

update the at least one fingerprint in the database based on the comparing.

30. The system of claim 29 , wherein the extraction unit is to extract at least two fingerprints from the at least one of audio or video content data using different fingerprinting techniques.

31. The system of claim 29 , wherein the associated data includes at least one of a file path and a filename of the recording.

32. The system of claim 29 , wherein the associated data comprises table of contents data, and wherein the at least one fingerprint is extracted from one or more tracks of the recording.

33. A method, comprising:

accessing associated data that is associated with a recording, the associated data forming part of metadata associated with the recording;

extracting at least one fingerprint from at least one portion of the recording containing at least one of audio or video content data;

storing the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

detecting a quality of the at least one fingerprint;

identifying a copy of the recording using the at least one fingerprint; and

replacing the at least one fingerprint with a higher quality fingerprint when the copy of the recording produces the higher quality fingerprint.

34. A system, comprising:

a receiving unit to access associated data associated with a recording, the associated data forming part of metadata associated with the recording;

an extraction unit to extract at least one fingerprint from at least one of audio or video content data contained in at least one portion of the recording; and

a storage unit, coupled to the receiving unit and the extraction unit, the storage unit to:

store the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

detect a quality of the at least one fingerprint;

identify a copy of the recording using the at least one fingerprint; and

replace the at least one fingerprint with a higher quality fingerprint when the copy of the recording produces the higher quality fingerprint.

Assignments (11)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Feb 8, 2017
From: JPMORGAN CHASE BANK, N.A.
To: GRACENOTE, INC.; CASTTV INC.; TRIBUNE MEDIA SERVICES, LLC; TRIBUNE DIGITAL VENTURES, LLC
Reel/Frame 041656/0804 →
SECURITY INTEREST Recorded Mar 19, 2014
From: GRACENOTE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 032480/0272 →