IP Library › Granted Patent US 12,237,912
Granted Patent B2
US 12,237,912 · App. 18/149,415 · Granted Feb 25, 2025

Modifying playback of content using pre-processed profile information

Inventors: Vadim Brenner (San Francisco, CA); Markus K. Cremer (Orinda, CA); Michael Becker (San Francisco, CA)
Assignee: GRACENOTE, INC.
H04H60/47G06F3/165H04H60/58H04H60/65H04N21/233H04N21/23418H04N21/26603H04N21/26606H04N21/41422H04N21/4325H04N21/654H04N21/8106H04R3/04H04R2499/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,237,912
App. No.
18/149,415
Granted
Feb 25, 2025
Kind
B2
Abstract

Example methods and systems for modifying the playback of content using pre-processed profile information are described. Example instructions, when executed, cause at least one processor to access a media stream that includes media and a profile of equalization parameters, the media stream provided to a device via a network, the profile of equalization parameters included in the media stream selected based on a comparison of a reference fingerprint to a query fingerprint generated based on the media, the profile of equalization parameters including an equalization parameter for the media; and modify playback of the media based on the equalization parameter specified in the accessed profile.

Claims (43)

1. A non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by a processor, cause performance of a set of operations comprising:

accessing a query fingerprint corresponding to a piece of media in a media stream, the media stream provided to a device via a network;

identifying the piece of media by comparing the query fingerprint to one or more reference fingerprints;

determine a plurality of first characteristics of the identified piece of media, wherein each of the plurality of first characteristics corresponds to one of a plurality of time segments of the identified piece of media, wherein each of the first characteristics of the plurality of first characteristics represents a mood for the corresponding time segment;

in response to determining the plurality of first characteristics of the identified piece of media, generating a profile of equalization settings, the generated profile specifying an equalization setting for each time segment of the plurality of time segments of the piece of media based on the determined characteristic of the plurality of first characteristics corresponding to the time segment; and

modifying playback of the piece of media on the device based on the equalization settings specified in the generated profile corresponding to each time segment of the plurality of time segments of the piece of media as that time segment is being played.

2. The non-transitory machine readable storage medium of claim 1 , wherein the profile of equalization settings specifies at least one corresponding output frequency setting by specifying a frequency equalization setting for the piece of media.

3. The non-transitory machine readable storage medium of claim 1 , wherein the profile of equalization settings specifies at least one of a virtualization setting for the piece of media or a spatialization setting for the piece of media.

4. The non-transitory machine readable storage medium of claim 1 , wherein the generated profile of equalization settings specifies the at least one corresponding output frequency setting by specifying a video modification setting, the video modification setting comprising a color temperature for the piece of media or a color palette for the piece of media.

5. The non-transitory machine readable storage medium of claim 1 , wherein the profile of equalization settings comprises a plurality of sub-profiles of equalization settings, each of the plurality of sub-profiles corresponding to a different time segment of the plurality of time segments of the piece of media, a first sub-profile corresponding to a first time segment of the piece of media and specifying a first output frequency setting for the first time segment, and a second sub-profile corresponding to a second time segment of the piece of media and specifying a second output frequency setting for the second time segment.

6. The non-transitory machine readable storage medium of claim 5 , wherein:

the first time segment of the piece of media has a first musical tempo, and the first output frequency setting specified by the first sub-profile corresponds to the first musical tempo; and

the second time segment of the piece of media has a second musical tempo, and the second output frequency setting specified by the second sub-profile corresponds to the second musical tempo.

7. The non-transitory machine readable storage medium of claim 1 , wherein the instructions, when executed, cause the processor to synchronize the playback of the piece of media based on the profile of equalization settings, the synchronizing including modifying a sequential order in which the piece of media is to be played.

8. The non-transitory machine readable storage medium of claim 1 , wherein the instructions, when executed, cause the processor synchronize the playback of the piece of media based on the profile of equalization settings, the synchronizing including aligning the profile with an acoustic event within the piece of media.

9. A computing device comprising:

a processor; and

a non-transitory computer-readable storage medium, having stored thereon program instructions that, upon execution by the processor, cause performance of a set of operations comprising:

accessing a query fingerprint corresponding to a piece of media in a media stream, the media stream provided to a device via a network;

identifying the piece of media by comparing the query fingerprint to one or more reference fingerprints;

determine a plurality of first characteristics of the identified piece of media, wherein each of the plurality of first characteristics corresponds to one of a plurality of time segments of the identified piece of media, wherein each of the first characteristics of the plurality of first characteristics represents a mood for the corresponding time segment;

in response to determining the plurality of first characteristics of the identified piece of media, generating a profile of equalization settings, the generated profile specifying an equalization setting for each time segment of the plurality of time segments of the piece of media based on the determined characteristic of the plurality of first characteristics corresponding to the time segment; and

modifying playback of the piece of media on the device based on the equalization setting specified in the generated profile corresponding to each time segment of the plurality of time segments of the piece of media as that time segment is being played.

10. The computing device of claim 9 , wherein the profile of equalization settings specifies at least one corresponding output frequency setting by specifying a frequency equalization setting for the piece of media.

11. The computing device of claim 9 , wherein the profile of equalization settings specifies at least one of a virtualization setting for the piece of media or a spatialization setting for the piece of media.

12. The apparatus of claim 9 , wherein the generated profile of equalization settings specifies the at least one corresponding output frequency setting by specifying a video modification setting, the video modification setting comprising a color temperature for the piece of media or a color palette for the piece of media.

13. A method comprising:

accessing, by a computing system, a query fingerprint corresponding to a piece of media in a media stream, the media stream provided to a device via a network;

identifying the piece of media by comparing the query fingerprint to one or more reference fingerprints;

determine a plurality of first characteristics of the identified piece of media, wherein each of the plurality of first characteristics corresponds to one of a plurality of time segments of the identified piece of media, wherein each of the first characteristics of the plurality of first characteristics represents a mood for the corresponding time segment;

in response to determining the plurality of first characteristics of the identified piece of media, generating, by the computing device, a profile of equalization settings, the generated profile specifying an equalization setting for each time segment of the plurality of time segments of the media based on the determined characteristic of the plurality of first characteristics corresponding to the time segment; and

modifying, by the computing device, playback of the piece of media on the device based on the equalization setting specified in the generated profile corresponding to each time segment of the plurality of time segments of the piece of media as that time segment is being played.

14. The method of claim 13 , wherein the profile of equalization settings specifies at least one corresponding output frequency setting by specifying a frequency equalization setting for the piece of media.

15. The method of claim 13 , wherein the profile of equalization settings specifies at least one of a virtualization setting for the piece of media or a spatialization setting for the piece of media.

16. The method of claim 13 , wherein the profile of equalization settings specifies at least one corresponding output frequency setting by specifying a video modification setting, the video modification setting comprising a color temperature for the piece of media or a color palette for the piece of media.

17. The method of claim 13 , wherein the profile of equalization settings comprises a plurality of sub-profiles of equalization settings, each of the plurality of sub-profiles corresponding to a different time segment of the plurality of time segments of the piece of media, a first sub-profile corresponding to a first time segment of the piece of media and specifying a first output frequency setting for the first time segment, and a second sub-profile corresponding to a second time segment of the piece of media and specifying a second output frequency setting for the second time segment.

18. The method of claim 17 , wherein:

the first time segment of the piece of media has a first musical tempo, and the first output frequency setting specified by the first sub-profile corresponds to the first musical tempo; and

the second time segment of the piece of media has a second musical tempo, and the second output frequency setting specified by the second sub-profile corresponds to the second musical tempo.

19. The method of claim 13 , further comprising:

synchronizing the playback of the piece of media based on the profile of equalization settings, the synchronizing including modifying a sequential order in which the piece of media is to be played.

20. The method of claim 13 , further comprising:

synchronizing the playback of the piece of media based on the profile of equalization settings, the synchronizing including aligning the profile with an acoustic event within the piece of media.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2023
From: BRENNER, VADIM; CREMER, MARKUS K.; BECKER, MICHAEL
To: GRACENOTE, INC.
Reel/Frame 062262/0250 →
Continuity (4)
Continuation 16983787 · Aug 3, 2020
Continuation 15186945 · Jun 20, 2016
Continuation 14020420 · Sep 6, 2013
Related Publication 20230142641A1 · May 11, 2023
References Cited (68)
US 6587127B1 · Leeke et al. · 2003 [cited by applicant]
US 6704421B1 · Kitmura · 2004 [cited by applicant]
US 6760635B1 · Bates et al. · 2004 [cited by applicant]
US 6834308B1 · Ikezoye et al. · 2004 [cited by applicant]
US 7711129B2 · Lindahl et al. · 2010 [cited by applicant]
US 8027487B2 · Park · 2011 [cited by applicant]
US 8615316B2 · Oh et al. · 2013 [cited by applicant]
US 9160837B2 · Jeffrey et al. · 2015 [cited by applicant]
US 9330720B2 · Lee · 2016 [cited by applicant]
US 9380383B2 · Brenner et al. · 2016 [cited by applicant]
US 10735119B2 · Brenner et al. · 2020 [cited by applicant]
US 20020072816A1 · Shdema et al. · 2002 [cited by applicant]
US 20020159607A1 · Ford et al. · 2002 [cited by applicant]
US 20030007001A1 · Zimmerman · 2003 [cited by applicant]
US 20030154128A1 · Liga et al. · 2003 [cited by applicant]
US 20030212466A1 · Alferness · 2003 [cited by applicant]
US 20040237750A1 · Smith et al. · 2004 [cited by applicant]
US 20060008252A1 · Kim · 2006 [cited by applicant]
US 20060046685A1 · Hjelemland · 2006 [cited by applicant]
US 20070127739A1 · Park · 2007 [cited by examiner]
US 20080002839A1 · Eng · 2008 [cited by examiner]
US 20080003839A1 · Park et al. · 2008 [cited by applicant]
US 20080049943A1 · Faller et al. · 2008 [cited by applicant]
US 20080075303A1 · Kim et al. · 2008 [cited by applicant]
US 20080154401A1 · Wang · 2008 [cited by applicant]
US 20080175411A1 · Greve · 2008 [cited by applicant]
US 20090047993A1 · Vasa · 2009 [cited by applicant]
US 20090049634A1 · Popov · 2009 [cited by applicant]
US 20090222853A1 · White et al. · 2009 [cited by applicant]
US 20090290725A1 · Huang · 2009 [cited by applicant]
US 20090313564A1 · Rottier et al. · 2009 [cited by applicant]
US 20100017003A1 · Oh et al. · 2010 [cited by applicant]
US 20100083344A1 · Schildbach et al. · 2010 [cited by applicant]
US 20100114344A1 · Hannaby · 2010 [cited by applicant]
US 20100305729A1 · Glitsch et al. · 2010 [cited by applicant]
US 20100319015A1 · Remington · 2010 [cited by applicant]
US 20110273455A1 · Powar et al. · 2011 [cited by applicant]
US 20110276333A1 · Wang et al. · 2011 [cited by applicant]
US 20110276334A1 · Wang · 2011 [cited by examiner]
US 20130315400A1 · Lection et al. · 2013 [cited by applicant]
US 20140003625A1 · Sheen et al. · 2014 [cited by applicant]
US 20140180818A1 · Mistler et al. · 2014 [cited by applicant]
US 20140288686A1 · Sant et al. · 2014 [cited by applicant]
US 20140355789A1 · Bohrarper et al. · 2014 [cited by applicant]
US 20160056787A1 · Lu et al. · 2016 [cited by applicant]
KR 20060116383 · 2006 [cited by applicant]
KR 1020050133557 · 2007 [cited by applicant]
KR 1020080011831 · 2008 [cited by applicant]
KR 1020090036220 · 2009 [cited by applicant]
WO 2012013858 · 2012 [cited by applicant]
ID3 draft specification (Year: 2000). [cited by examiner]
D3 Chapter tool; available on-line at least 2012 (Year: 2012). [cited by applicant]
SSL AWS Manual (Year: 2009). [cited by applicant]
Sony Oxford Manual (Year: 1999). [cited by applicant]
Protools Manual (Year: 2005). [cited by applicant]
Baluja et al. “Content Fingerprinting Using Wavelets”, Google, Inc., Dec. 2006 (10 pages). [cited by applicant]
Haitsma et al. “Robust Audio Hashing for Content Identification”, Philips Research, Feb. 2002 (8 pages). [cited by applicant]
OSXDAILY “How to Set the Equalizer for Specific Genres, Songs, & Albums in iTunes”, retrieved from http://osxdaily_com/2013/03/25/how-to-equalize-specific-genres-songs-albums-in-itunes/, Mar. 25, 2013 (5 pages). [cited by applicant]
Reddit.com, “[Request]: automatically change equalizer settings based on currently playing song's genre (user configurable of course)”, retrieved from https://www.reddit.com/r/jailbreak/comments/1zmlt8/request_automatic… [cited by applicant]
ARS Technica, “Auto change equalizer settings based on ID3 tag info”, retrieved from hltps://arstechnica.com/civis/viewtopic.php?f=6&t=411960, Mar. 11, 2005 (3 pages). [cited by applicant]
Spotify, “Equalizer auto preset by music genre”, The Spotify Community, retrieved from https://community.spotify.com/t5/Closed-Ideas/Equalizer-auto-preset-by-music-genre/idi-p/894673, Aug. 22, 2014, 8 pages. [cited by applicant]
Kioskea, “AIMP-Auto-adjust equalizer preset for your music tracks,” Jun. 2014, retrieved from www.kioskea.net, 1 page. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/186,945, dated Dec. 16, 2016, 8 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/186,945, dated Oct. 18, 2018, 9 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action, ” issued in connection with U.S. Appl. No. 15/186,945, dated Jan. 3, 2020, 7 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 15/186,945, dated Nov. 16, 2017, 10 pages. [cited by applicant]
United States Patent and Trademark Office, “Final Office Action,” issued in connection with U.S. Appl. No. 15/186,945, dated Feb. 26, 2019, 11 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/186,945, dated Apr. 1, 2020, 7 pages. [cited by applicant]