IP Library Granted Patent US 12,393,629
Granted Patent B2
US 12,393,629 · App. 18/751,738 · Granted Aug 19, 2025

Methods and apparatus to identify media

Inventors: Robert Coover (Orinda, CA); Matthew James Wilkinson (Emeryville, CA); Jeffrey Scott (Berkeley, CA); Yongju Hong (Seoul, KR)
Assignee: GRACENOTE, INC.
G06F16/683G06F16/632G06F16/65G06F16/686
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,393,629
App. No.
18/751,738
Granted
Aug 19, 2025
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed to identify media. An example method includes: in response to a query, generating an adjusted sample media fingerprint by applying an adjustment to a sample media fingerprint; comparing the adjusted sample media fingerprint to a reference media fingerprint; and in response to the adjusted sample media fingerprint matching the reference media fingerprint, transmitting information associated with the reference media fingerprint and the adjustment.

Claims (46)

1. A tangible, non-transitory computer readable storage medium comprising instruction which, when executed, cause one or more processors to perform a set of operations comprising:

receiving a query comprising one or more suspected alterations applied to a media signal from a client device, wherein the one or more suspected alterations corresponds to a pitch shift value in the media signal, wherein the media signal is associated with a sample fingerprint from the client device;

in response to receiving the query, applying one or more adjustments to at least one reference fingerprint to generate one or more adjusted reference fingerprints;

determining a match between at least one of the one or more adjusted reference fingerprints and the sample fingerprint; and

causing transmission of a communication to the client device, wherein the communication indicates an identification of the media signal and at least one of the one or more adjustments that, when applied to the at least one reference fingerprint, caused the sample fingerprint to match the at least one reference fingerprint.

2. The tangible, non-transitory computer readable storage medium of claim 1 , wherein the identification of the media signal comprises a title of a song.

3. The tangible, non-transitory computer readable storage medium of claim 1 , wherein the media signal comprises an audio signal, wherein the one or more suspected alterations applied to the audio signal further comprise at least one of a suspected time shift applied to the audio signal and a suspected resample ratio applied to the audio signal.

4. The tangible, non-transitory computer readable storage medium of claim 3 , wherein the set of operations further comprises:

generating a time shifted reference fingerprint to accommodate for the suspected time shift; and

generating a resampled reference fingerprint to accommodate for the suspected resample ratio.

5. The tangible, non-transitory computer readable storage medium of claim 4 , wherein the set of operations further comprises:

comparing the time shifted reference fingerprint to the sample fingerprint; and

comparing the resampled reference fingerprint to the sample fingerprint.

6. The tangible, non-transitory computer readable storage medium of claim 5 , wherein the set of operations further comprises generating, in parallel, the time shifted reference fingerprint and the resampled reference fingerprint and comparing, in parallel, the time shifted reference fingerprint and the resampled reference fingerprint to the sample fingerprint.

7. The tangible, non-transitory computer readable storage medium of claim 1 , wherein the set of operations further comprises comparing the at least one of the one or more adjusted reference fingerprints and the sample fingerprint based on at least one comparison criteria, wherein the at least one comparison criteria comprises one or more of a cross-correlation value between the at least one of the one or more adjusted reference fingerprints and the sample fingerprint or a Hamming distance between the at least one of the one or more adjusted reference fingerprints and the sample fingerprint.

8. A computer-implemented method comprising:

receiving a query comprising one or more suspected alterations applied to a media signal from a client device, wherein the one or more suspected alterations corresponds to a pitch shift value in the media signal, wherein the media signal is associated with a sample fingerprint from the client device;

in response to receiving the query, applying one or more adjustments to at least one reference fingerprint to generate one or more adjusted reference fingerprints;

determining a match between at least one of the one or more adjusted reference fingerprints and the sample fingerprint; and

causing transmission of a communication to the client device, wherein the communication indicates an identification of the media signal and at least one of the one or more adjustments that, when applied to the at least one reference fingerprint, caused the sample fingerprint to match the at least one reference fingerprint.

9. The computer-implemented method of claim 8 , wherein the identification of the media signal comprises a title of a song.

10. The computer-implemented method of claim 8 , wherein the media signal comprises an audio signal, wherein the one or more suspected alterations applied to the audio signal further comprise at least one of a suspected time shift applied to the audio signal and a suspected resample ratio applied to the audio signal.

11. The computer-implemented method of claim 10 , wherein the method further comprises:

generating a time shifted reference fingerprint to accommodate for the suspected time shift; and

generating a resampled reference fingerprint to accommodate for the suspected resample ratio.

12. The computer-implemented method of claim 11 , wherein the method further comprises:

comparing the time shifted reference fingerprint to the sample fingerprint; and

comparing the resampled reference fingerprint to the sample fingerprint.

13. The computer-implemented method of claim 12 , wherein the method further comprises generating, in parallel, the time shifted reference fingerprint and the resampled reference fingerprint and comparing, in parallel, the time shifted reference fingerprint and the resampled reference fingerprint to the sample fingerprint.

14. The computer-implemented method of claim 8 , wherein the method further comprises comparing the at least one of the one or more adjusted reference fingerprints and the sample fingerprint based on at least one comparison criteria, wherein the at least one comparison criteria comprises one or more of a cross-correlation value between the at least one of the one or more adjusted reference fingerprints and the sample fingerprint or a Hamming distance between the at least one of the one or more adjusted reference fingerprints and the sample fingerprint.

15. A computing device comprising:

at least one processors; and

tangible, non-transitory computer readable medium comprising instructions that, when executed, cause the at least one processor to perform a set of operations comprising:

receiving a query comprising one or more suspected alterations applied to a media signal from a client device, wherein the one or more suspected alterations corresponds to a pitch shift value in the media signal, wherein the media signal is associated with a sample fingerprint from the client device;

in response to receiving the query, applying one or more adjustments to at least one reference fingerprint to generate one or more adjusted reference fingerprints;

determining a match between at least one of the one or more adjusted reference fingerprints and the sample fingerprint; and

causing transmission of a communication to the client device, wherein the communication indicates an identification of the media signal and at least one of the one or more adjustments that, when applied to the at least one reference fingerprint, caused the sample fingerprint to match the at least one reference fingerprint.

16. The computing device of claim 15 , wherein the identification of the media signal comprises a title of a song.

17. The computing device of claim 15 , wherein the media signal comprises an audio signal, wherein the one or more suspected alterations applied to the audio signal further comprise at least one of a suspected time shift applied to the audio signal and a suspected resample ratio applied to the audio signal.

18. The computing device of claim 17 , wherein the set of operations further comprises:

generating a time shifted reference fingerprint to accommodate for the suspected time shift;

generating a resampled reference fingerprint to accommodate for the suspected resample ratio;

comparing the time shifted reference fingerprint to the sample fingerprint; and

comparing the resampled reference fingerprint to the sample fingerprint.

19. The computing device of claim 18 , wherein the set of operations further comprises generating, in parallel, the time shifted reference fingerprint and the resampled reference fingerprint and comparing, in parallel, the time shifted reference fingerprint and the resampled reference fingerprint to the sample fingerprint.

20. The computing device of claim 15 , wherein the set of operations further comprises comparing the at least one of the one or more adjusted reference fingerprints and the sample fingerprint based on at least one comparison criteria, wherein the at least one comparison criteria comprises one or more of a cross-correlation value between the at least one of the one or more adjusted reference fingerprints and the sample fingerprint or a Hamming distance between the at least one of the one or more adjusted reference fingerprints and the sample fingerprint.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2024
From: COOVER, ROBERT; WILKINSON, MATTHEW JAMES; SCOTT, JEFFREY; HONG, YONGJU
To: GRACENOTE, INC.
Reel/Frame 067815/0501 →
Continuity (4)
Continuation 17833717 · Jun 6, 2022
Continuation 16698899 · Nov 27, 2019
Provisional Application 62896460 · Sep 5, 2019
Related Publication 20240346073A1 · Oct 17, 2024
References Cited (58)
US 5276629A · Reynolds · 1994 [cited by applicant]
US 5400261A · Reynolds · 1995 [cited by applicant]
US 5481294A · Thomas et al. · 1996 [cited by applicant]
US 9052986B1 · Postelnicu et al. · 2015 [cited by applicant]
US 9071868B2 · Neumeier et al. · 2015 [cited by applicant]
US 9258383B2 · Harrison · 2016 [cited by applicant]
US 9510044B1 · Pereira et al. · 2016 [cited by applicant]
US 9679573B1 · Postelnicu et al. · 2017 [cited by applicant]
US 10236006B1 · Gurijala et al. · 2019 [cited by applicant]
US 11392640B2 · Coover et al. · 2022 [cited by applicant]
US 11392641B2 · Coover et al. · 2022 [cited by applicant]
US 20030045954A1 · Weare et al. · 2003 [cited by applicant]
US 20030061490A1 · Abajian · 2003 [cited by examiner]
US 20030125936A1 · Dworzak · 2003 [cited by applicant]
US 20100305732A1 · Serletic · 2010 [cited by applicant]
US 20110307085A1 · Selby et al. · 2011 [cited by applicant]
US 20120209612A1 · Bilobrov · 2012 [cited by applicant]
US 20120278326A1 · Bauer · 2012 [cited by examiner]
US 20130096926A1 · Maling, III et al. · 2013 [cited by applicant]
US 20130197913A1 · Bilobrov · 2013 [cited by applicant]
US 20130318157A1 · Harrison · 2013 [cited by applicant]
US 20140115716A1 · Schmelzer · 2014 [cited by examiner]
US 20140254807A1 · Fonseca, Jr. et al. · 2014 [cited by applicant]
US 20150199974A1 · Bilobrov, I · 2015 [cited by examiner]
US 20150302086A1 · Roberts et al. · 2015 [cited by applicant]
US 20160110537A1 · Harrison · 2016 [cited by applicant]
US 20160112770A1 · Harrison · 2016 [cited by applicant]
US 20160132600A1 · Woodhead · 2016 [cited by examiner]
US 20160241933A1 · Harrison · 2016 [cited by applicant]
US 20160241934A1 · Harrison · 2016 [cited by applicant]
US 20160300579A1 · Bilobrov et al. · 2016 [cited by applicant]
US 20160330530A1 · Harrison · 2016 [cited by applicant]
US 20160337713A1 · Harrison · 2016 [cited by applicant]
US 20160344848A1 · Harrison · 2016 [cited by applicant]
US 20180047416A1 · Bilobrov · 2018 [cited by applicant]
US 20180285455A1 · DiMaria et al. · 2018 [cited by applicant]
US 20190043152A1 · Srinivasan · 2019 [cited by applicant]
US 20210073273A1 · Cremer et al. · 2021 [cited by applicant]
US 20210073274A1 · Cremer et al. · 2021 [cited by applicant]
US 20210073275A1 · Coover et al. · 2021 [cited by applicant]
WO 2016109500A1 · 2016 [cited by applicant]
WO 2017222569A1 · 2017 [cited by applicant]
WO 2021046392A1 · 2021 [cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Patent Application No. PCT/US2020/049463, on Dec. 21, 2020, 6 pages. [cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with International Patent Application No. PCT/US2020/049463, on Dec. 21, 2020, 4 pages. [cited by applicant]
European Patent Office, “Communication pursuant to Rules 161(2) and 162 EPC,” issued in connection with European Patent Application No. 20860978.4, on Apr. 13, 2022, 3 pages. [cited by applicant]
Son et al., “Illegal Audio Copy Detection using Fundamental Frequency Map,” In Proceedings of the 16th International Joint Conference one-Business and Telecommunications (ICETE 2019), pp. 350-355, 2019, 6 pages. [cited by applicant]
Joren et al., “PANAKO—A Scalable Acoustic Fingerprinting System Handling Time-Scale and Pitch Modification,” 15th International Society for Music Information Retrieval Conference (ISMIR 2014), 6 pages. [cited by applicant]
Malekesmaeili et al., “A local fingerprinting approach for audio copy detection,” Department of Electrical and Computer Engineering, The University of Columbia, Vancouver, Canada, Apr. 2, 2013, 29 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/698,899, on Aug. 13, 2021, 17 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 16/698,899, on Jan. 12, 2022, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/698,897, on Aug. 5, 2021, 10 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 16/698,897, on Dec. 1, 2021, 8 pages. [cited by applicant]
The International Bureau, “International Preliminary Report on Patentability,” issued in connection with Intemational Patent Application No._ PCT/US2020/049463, on Mar. 8, 2022 5 pages_. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No._ 16/698,900, on Dec. 24, 2021, 10 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 16/698,897, on Mar. 18, 2022, 8 pages. [cited by applicant]
United Stated Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 16/698,900, on Jun. 30, 2022, 13 pages. [cited by applicant]
European Examination Report for EP App. No. 20860978.4, dated Mar. 19, 2025. [cited by applicant]