IP Library Granted Patent US 12,436,993
Granted Patent B2
US 12,436,993 · App. 18/760,704 · Granted Oct 7, 2025

Methods and apparatus to identify media that has been pitch shifted, time shifted, and/or resampled

Inventors: Robert Coover (Orinda, CA); Matthew James Wilkinson (Emeryville, CA); Jeffrey Scott (Berkeley, CA); Yongju Hong (Seoul, KR)
Assignee: GRACENOTE, INC.
G06F16/683G06F16/632G06F16/65G06F16/686
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,436,993
App. No.
18/760,704
Granted
Oct 7, 2025
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed to identify media that has been pitch shifted, time shifted, and/or resampled. An example apparatus includes: memory; instructions in the apparatus; and processor circuitry to execute the instructions to: transmit a fingerprint of an audio signal and adjusting instructions to a central facility to facilitate a query, the adjusting instructions identifying at least one of a pitch shift, a time shift, or a resample ratio; obtain a response including an identifier for the audio signal and information corresponding to how the audio signal was adjusted; and change the adjusting instructions based on the information.

Claims (37)

1. A tangible, non-transitory computer readable medium comprising instructions that, when executed, cause at least one processor to perform a set of operations comprising:

transmitting a fingerprint of an audio signal and adjusting instructions to a server, wherein the adjusting instructions comprise at least one of a pitch shift, a time shift, or a resample ratio;

receiving from the server information corresponding to how the at least one of the pitch shift, the time shift, or the resample ratio were used by the server to adjust the fingerprint to match a reference fingerprint to identify the audio signal, wherein the server adjusts the fingerprint according to the pitch shift by altering bin values associated with the fingerprint, wherein the server adjusts the fingerprint according to the time shift by copying or deleting frames of the fingerprint, where in the server adjusts the fingerprint according to the resample ratio by resampling the fingerprint according to a ratio between a resample pitch shift value and a resample time shift value; and

in response to receiving the information, modifying the adjusting instructions for a subsequent query based on the information.

2. The tangible, non-transitory computer readable medium of claim 1 , wherein the adjusting instructions are in response to a client input.

3. The tangible, non-transitory computer readable medium of claim 1 , wherein the received information is displayed via a user interface.

4. The tangible, non-transitory computer readable medium of claim 1 , wherein the set of operations further comprises transmitting a prompt to a user to identify the adjusting instructions.

5. The tangible, non-transitory computer readable medium of claim 1 , wherein the set of operations further comprises generating the fingerprint from the audio signal.

6. The tangible, non-transitory computer readable medium of claim 1 , wherein the set of operations further comprises transmitting a data packet including the received information to a client.

7. The tangible, non-transitory computer readable medium of claim 1 , wherein the set of operations further comprises:

receiving an identifier corresponding to the audio signal from the server; and

storing the identifier and the received information in a database.

8. A computer-implemented method comprising:

transmitting a fingerprint of an audio signal and adjusting instructions to a server, wherein the adjusting instructions comprise at least one of a pitch shift, a time shift, or a resample ratio;

receiving from the server information corresponding to how the at least one of the pitch shift, the time shift, or the resample ratio were used by the server to adjust the fingerprint to match a reference fingerprint to identify the audio signal, wherein the server adjusts the fingerprint according to the pitch shift by altering bin values associated with the fingerprint, wherein the server adjusts the fingerprint according to the time shift by copying or deleting frames of the fingerprint, wherein the server adjusts the fingerprint according to the resample ratio by resampling the fingerprint according to a ratio between a resample pitch shift value and a resample time shift value; and

in response to receiving the information, modifying the adjusting instructions for a subsequent query based on the information.

9. The computer-implemented method of claim 8 , wherein the adjusting instructions are in response to a client input.

10. The computer-implemented method of claim 8 , wherein the received information is displayed via a user interface.

11. The computer-implemented method of claim 8 , further comprising transmitting a prompt to a user to identify the adjusting instructions.

12. The computer-implemented method of claim 8 , further comprising generating the fingerprint from the audio signal.

13. The computer-implemented method of claim 8 , further comprising transmitting a data packet including the received information to a client.

14. The computer-implemented method of claim 8 , further comprising:

receiving an identifier corresponding to the audio signal from the server; and

storing the identifier and the received information in a database.

15. A computing device comprising:

at least one processor; and

tangible, non-transitory computer readable medium comprising instructions that, when executed, cause the at least one processor to perform a set of operations comprising:

transmitting a fingerprint of an audio signal and adjusting instructions to a server, wherein the adjusting instructions comprise at least one of a pitch shift, a time shift, or a resample ratio;

receiving from the server information corresponding to how the at least one of the pitch shift, the time shift, or the resample ratio were used by the server to adjust the fingerprint to match a reference fingerprint to identify the audio signal, wherein the server adjusts the fingerprint according to the pitch shift by altering bin values associated with the fingerprint, wherein the server adjusts the fingerprint according to the time shift by copying or deleting frames of the fingerprint, wherein the server adjusts the fingerprint according to the resample ratio by resampling the fingerprint according to a ratio between a resample pitch shift value and a resample time shift value; and

in response to receiving the information, modifying the adjusting instructions for a subsequent query based on the information.

16. The computing device of claim 15 , wherein the adjusting instructions are in response to a client input.

17. The computing device of claim 15 , wherein the received information is displayed via a user interface.

18. The computing device of claim 15 , wherein the set of operations further comprises transmitting a prompt to a user to identify the adjusting instructions.

19. The computing device of claim 15 , wherein the set of operations further comprises generating the fingerprint from the audio signal.

20. The computing device of claim 15 , wherein the set of operations further comprises:

receiving an identifier corresponding to the audio signal from the server; and

storing the identifier and the received information in a database.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2024
From: COVER, ROBERT; WILKINSON, MATTHEW JAMES; SCOTT, JEFFREY; HONG, YONGJU
To: GRACENOTE, INC.
Reel/Frame 067886/0923 →
Continuity (5)
Continuation 18347363 · Jul 5, 2023
Continuation 17866272 · Jul 15, 2022
Continuation 16698897 · Nov 27, 2019
Provisional Application 62896460 · Sep 5, 2019
Related Publication 20240354339A1 · Oct 24, 2024
References Cited (51)
US 5276629A · Reynolds · 1994 [cited by applicant]
US 5400201A · Pederson · 1995 [cited by applicant]
US 5400261A · Reynolds · 1995 [cited by applicant]
US 9052986B1 · Postelnicu et al. · 2015 [cited by applicant]
US 9071868B2 · Neumeier et al. · 2015 [cited by applicant]
US 9258383B2 · Harrison · 2016 [cited by applicant]
US 9510044B1 · Pereira et al. · 2016 [cited by applicant]
US 9679573B1 · Postelnicu et al. · 2017 [cited by applicant]
US 10236006B1 · Gurijala et al. · 2019 [cited by applicant]
US 20030045954A1 · Weare et al. · 2003 [cited by applicant]
US 20030061490A1 · Abajian · 2003 [cited by applicant]
US 20030125936A1 · Dworzak · 2003 [cited by applicant]
US 20100305732A1 · Serletic · 2010 [cited by applicant]
US 20110307085A1 · Selby et al. · 2011 [cited by applicant]
US 20120209612A1 · Bilobrov · 2012 [cited by applicant]
US 20120304212A1 · Lee · 2012 [cited by applicant]
US 20130096926A1 · Maling, III · 2013 [cited by applicant]
US 20130103810A1 · Papakipos · 2013 [cited by examiner]
US 20130197913A1 · Bilobrov · 2013 [cited by applicant]
US 20130318157A1 · Harrison · 2013 [cited by applicant]
US 20140254807A1 · Fonseca, Jr. et al. · 2014 [cited by applicant]
US 20150199974A1 · Bilobrov et al. · 2015 [cited by applicant]
US 20150302086A1 · Roberts et al. · 2015 [cited by applicant]
US 20160110537A1 · Harrison · 2016 [cited by applicant]
US 20160112770A1 · Harrison · 2016 [cited by applicant]
US 20160132600A1 · Woodhead et al. · 2016 [cited by applicant]
US 20160241933A1 · Harrison · 2016 [cited by applicant]
US 20160241934A1 · Harrison · 2016 [cited by applicant]
US 20160300579A1 · Bilobrov et al. · 2016 [cited by applicant]
US 20160330530A1 · Harrison · 2016 [cited by applicant]
US 20160337713A1 · Harrison · 2016 [cited by applicant]
US 20160344848A1 · Harrison · 2016 [cited by applicant]
US 20180047416A1 · Bilobrov · 2018 [cited by applicant]
US 20180285455A1 · DiMaria et al. · 2018 [cited by applicant]
US 20190043152A1 · Srinivasan · 2019 [cited by applicant]
US 20210073273A1 · Cremer et al. · 2021 [cited by applicant]
US 20210073275A1 · Coover et al. · 2021 [cited by applicant]
WO 2016109500A1 · 2016 [cited by applicant]
WO 2017222569A1 · 2017 [cited by applicant]
WO 2021046392 · 2021 [cited by applicant]
International Searching Authority, “International Preliminary Report on patentability,” issued in connection with Application No. PCT/US20/49463, issued on Mar. 8, 2022, 5 pages. [cited by applicant]
European Patent Office, “Communication pursuant to Rules 161(2) and 162 EPC,” issued in connection with Application No. 20860978.4, dated Apr. 13, 2022, 3 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/698,900, dated Dec. 24, 2021, 10 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 16/698,899, dated Jan. 12, 2022, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/698,899, dated Aug. 13, 2021, 17 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/698,866, dated Aug. 31, 2021, 18 pages. [cited by applicant]
Son, et al., “Illegal Audio Copy Detection using Fundamental Frequency Map,” In Proceedings of the 16th International Joint Conference on e-Business and Telecommunications (ICETE 2019), pp. 350-355, Jul. 2019, 6 pages. [cited by applicant]
Joren, et al., “Panako- A scalable Acoustic Fingerprinting System Handling Time-Scale and Pitch Modification,” 15th International Society for Music Information Retrieval Conference (ISMIR 2014) pp. 259-264, 6 pages. [cited by applicant]
Malekesmaeili, et al., “A local fingerprinting approach for audio copy detection,” arXiv, dated Apr. 2, 2013, 29 pages. [cited by applicant]
International Searching Authority, “International Search Report and Written Opinion,” issued in connection with Application No. PCT/US2020/049463, mailed Dec. 21, 2010, 10 pages. [cited by applicant]
European Examination Report for EP App. No. 20860978.4, dated Mar. 19, 2025. [cited by applicant]