IP Library › Granted Patent US 12,204,817
Granted Patent B2
US 12,204,817 · App. 18/503,399 · Granted Jan 21, 2025

Machine-led mood change

Inventors: Aneesh Vartakavi (Emeryville, CA); Peter C. DiMaria (Berkeley, CA); Michael Gubman (San Francisco, CA); Markus K. Cremer (Orinda, CA); Cameron Aubrey Summers (Oakland, CA); Gregoire Tronel (Santa Monica, CA)
Assignee: Gracenote, Inc.
G06F3/165G06F16/639H04L67/535
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,204,817
App. No.
18/503,399
Granted
Jan 21, 2025
Kind
B2
Abstract

A machine is configured to identify a media file that, when played to a user, is likely to modify an emotional or physical state of the user to or towards a target emotional or physical state. The machine accesses play counts that quantify playbacks of media files for the user. The playbacks may be locally performed or detected by the machine from ambient sound. The machine accesses arousal scores of the media files and determines a distribution of the play counts over the arousal scores. The machine uses one or more relative maxima in the distribution in selecting a target arousal score for the user based on contextual data that describes an activity of the user. The machine selects one or more media files based on the target arousal score. The machine may then cause the selected media file to be played to the user.

Claims (37)

1. A non-transitory machine readable storage medium comprising instructions that, when executed, cause one or more processors to perform a set of operations comprising:

accessing play counts of one or more media files;

comparing the accessed play counts to a threshold play count;

determining a user state score based on a biometric measurement of a user via a vehicle sensor;

selecting a target user state score; and

selecting a particular media file of the one or more media files based on the user state score, the target user state score, and a status of the one or more media files as meeting or not meeting the threshold play count.

2. The non-transitory machine readable storage medium of claim 1 , wherein the vehicle sensor comprises a facial sensor to detect a facial characteristic of the user.

3. The non-transitory machine readable storage medium of claim 2 , wherein the facial characteristic includes a duration of a blink of an eye of the user.

4. The non-transitory machine readable storage medium of claim 2 , wherein the facial characteristic includes a frequency of blinks of an eye of the user.

5. The non-transitory machine readable storage medium of claim 2 , wherein the facial characteristic includes a frequency of movement of an eye of the user.

6. The non-transitory machine readable storage medium of claim 1 , wherein the vehicle sensor comprises a biometric sensor.

7. The non-transitory machine readable storage medium of claim 1 , wherein the vehicle sensor comprises a heart rate sensor to detect a heart rate of the user.

8. The non-transitory machine readable storage medium of claim 1 , wherein the target user state score is based on a driving condition.

9. The non-transitory machine readable storage medium of claim 8 , wherein the vehicle sensor detects a fluctuation in a force applied on a steering wheel to detect the driving condition.

10. The non-transitory machine readable storage medium of claim 8 , wherein the vehicle sensor detects use of windshield wipers to detect the driving condition.

11. The non-transitory machine readable storage medium of claim 8 , wherein the vehicle sensor detects brake pedal depression frequency to detect the driving condition.

12. The non-transitory machine readable storage medium of claim 8 , wherein the vehicle sensor detects vehicle direction change frequency to detect the driving condition.

13. The non-transitory machine readable storage medium of claim 8 , wherein the vehicle sensor detects use of vehicle climate control to detect the driving condition.

14. A computer-implemented method comprising:

accessing play counts of one or more media files;

comparing the accessed play counts to a threshold play count;

determining a user state score based on a biometric measurement of a user via a vehicle sensor;

selecting a target user state score; and

selecting a particular media file of the one or more media files based on the user state score, the target user state score, and a status of the one or more media files as meeting or not meeting the threshold play count.

15. The computer-implemented method of claim 14 , wherein the vehicle sensor comprises a facial sensor to detect a facial characteristic of the user.

16. The computer-implemented method of claim 15 , wherein the facial characteristic includes a frequency of movement of an eye of the user.

17. The computer-implemented method of claim 14 , wherein the vehicle sensor comprises a biometric sensor.

18. The computer-implemented method of claim 14 , wherein the vehicle sensor comprises a heart rate sensor to detect a heart rate of the user.

19. The computer-implemented method of claim 14 , wherein the target user state score is based on a driving condition.

20. A computing device comprising;

one or more processors; and

non-transitory machine readable storage medium comprising instructions that, when executed, cause the one or more processors to perform a set of operations comprising:

accessing play counts of one or more media files;

comparing the accessed play counts to a threshold play count;

determining a user state score based on a biometric measurement of a user via a vehicle sensor;

selecting a target user state score; and

selecting a particular media file of the one or more media files based on the user state score, the target user state score, and a status of the one or more media files as meeting or not meeting the threshold play count.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2023
From: VARTAKAVI, ANEESH; DIMARIA, PETER C.; GUBMAN, MICHAEL; CREMER, MARKUS K.; SUMMERS, CAMBERON AUBREY; TRONEL, GREGOIRE
To: GRACENOTE, INC.
Reel/Frame 065589/0647 →
Continuity (7)
Continuation 18070214 · Nov 28, 2022
Continuation 16837539 · Apr 1, 2020
Continuation 16102143 · Aug 13, 2018
Continuation 15721161 · Sep 29, 2017
Continuation 14980650 · Dec 28, 2015
Provisional Application 62099401 · Jan 2, 2015
Related Publication 20240069854A1 · Feb 29, 2024
References Cited (69)
US 5243517A · Schmidt et al. · 1993 [cited by applicant]
US 5676138A · Zawilinski · 1997 [cited by applicant]
US 6212502B1 · Ball et al. · 2001 [cited by applicant]
US 6520905B1 · Surve et al. · 2003 [cited by applicant]
US 6888457B2 · Wilkinson et al. · 2005 [cited by applicant]
US 7031980B2 · Logan et al. · 2006 [cited by applicant]
US 7698238B2 · Barletta et al. · 2010 [cited by applicant]
US 7921067B2 · Kemp et al. · 2011 [cited by applicant]
US 8260778B2 · Ghatak · 2012 [cited by applicant]
US 8373768B2 · Bill · 2013 [cited by applicant]
US 8671068B2 · Harber et al. · 2014 [cited by applicant]
US 8855798B2 · DiMaria et al. · 2014 [cited by applicant]
US 9317185B2 · Martin et al. · 2016 [cited by applicant]
US 9613466B1 · Bullock · 2017 [cited by examiner]
US 9792084B2 · Vartakavi et al. · 2017 [cited by applicant]
US 10048931B2 · Vartakavi et al. · 2018 [cited by applicant]
US 10373611B2 · Jeyachandran et al. · 2019 [cited by applicant]
US 10613821B2 · Vartakavi et al. · 2020 [cited by applicant]
US 20030028383A1 · Guerin et al. · 2003 [cited by applicant]
US 20030063222A1 · Creed et al. · 2003 [cited by applicant]
US 20040128286A1 · Yasushi et al. · 2004 [cited by applicant]
US 20060212478A1 · Plastina et al. · 2006 [cited by applicant]
US 20070074619A1 · Vergo · 2007 [cited by applicant]
US 20080030313A1 · Obradovich · 2008 [cited by examiner]
US 20080091512A1 · Marci et al. · 2008 [cited by applicant]
US 20080109391A1 · Chan · 2008 [cited by applicant]
US 20090234888A1 · Holmes et al. · 2009 [cited by applicant]
US 20090281906A1 · Cai et al. · 2009 [cited by applicant]
US 20100011388A1 · Bull et al. · 2010 [cited by applicant]
US 20110289075A1 · Nelson · 2011 [cited by applicant]
US 20120226706A1 · Choi et al. · 2012 [cited by applicant]
US 20120259683A1 · Cochran et al. · 2012 [cited by applicant]
US 20130178962A1 · DiMaria et al. · 2013 [cited by applicant]
US 20130339877A1 · Skeen et al. · 2013 [cited by applicant]
US 20140277649A1 · Chong et al. · 2014 [cited by applicant]
US 20140330848A1 · Chen et al. · 2014 [cited by applicant]
US 20160162565A1 · Jung et al. · 2016 [cited by applicant]
EP 2579169A1 · 2013 [cited by applicant]
WO 2008004181A2 · 2008 [cited by applicant]
Barthet et al., “Moodplay: an interactive mood-based musical experience”, Queen Mary, University of London, 2015, 9 pages. [cited by applicant]
Borghini et al., “Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness”, Neuroscience and Biobehavioral Reviews 44, (2014), 18 pages. [cited by applicant]
Cox, “Roughness”, University of Salford Manchester, <http://www.acoustics.salford.ac.uk/acoustics info/sound_quality/?content>, retrived on Mar. 21, 2014, 3 pages. [cited by applicant]
Fairclough, Stephen, et al., “A metabolic measure of mental effo1t”, [Online]. Retrieved from the Internet: <URL: http://physiologicalcomputing.org/wpcontent/uploads/20 I 5/03/faircloughhouston041.pdf, (Oct. 9, 2003), 1… [cited by applicant]
Gerhard, David, “Automatic Interval Naming Using Relative Pitch”, School of Computing Science, Simon Fraser University, May 16, 2014, 11 pages. [cited by applicant]
Hu et al., “Improving Mood Classification in Music Digital Libraries by Combining Lyrics and Audio”, Association of Computing Machinery, JCDL '10 Proceedings of the 10th annual joint conference on Digital libraries, Ret… [cited by applicant]
International Searching Authority, “International Search Report,” issued in connection with International Application No. PCT/US2015/067889, mailed Mar. 25, 2016, 2 pages. [cited by applicant]
International Searching Authority, “Written Opinion,” issued in connection with International Application No. PCT/US2015/067889, mailed Mar. 25, 2016, 8 pages. [cited by applicant]
Liu, David, et al., “Listen to Your Heart: Stress Prediction Using Consumer Heart Rate Sensors”, [Online]. Retrieved from the Internet: <URL:http://cs229.stanford.edu/proj2013/LiuUlrich-ListenToYourHeart-StressPredictio… [cited by applicant]
The Local, “New mobile tech makes music to suit moods”, <http://www.thelocal.no/20141114/new-mobile-tech-makes-music-to-suit-moods>, published on Nov. 17, 2014, 2 pages. [cited by applicant]
Lu, et al., “A Technique towards Automatic Audio Classification and Retrieval”, Gippsland School of Computing and Information Technology, Monash University, 1998, 4 pages. [cited by applicant]
Owen Craigie Meyers, “A Mood-Based Music Classification and Exploration System”, School of Architecture and Planning, Massachusetts Institute of Technology, Jun. 2007, 93 pages. [cited by applicant]
“PAD emotional state model”, Wikipedia, [OnlineJ. Retrieved from the Internet: <URL: https://en.wikipedia.org/wikiiPADemotional state model, (Accessed Nov. 11, 2015 ), 3 pages. [cited by applicant]
Peeters, Geoffroy, “A Large Set of Audio Features for Sound Description”, Apr. 23, 2004, 25 pages. [cited by applicant]
Peeters, Geoffroy, “Chroma-based estimation of musical key from audio-signal analysis”, Ircam—Sound Analysis/Synthesis Team, 2006, 6 pages. [cited by applicant]
Renneker, Will, “The Effects of Calming and Exciting Music on Galvanic Skin Response and Cognition”, [Online]. Retrieved from the Internet: <URL:http:/webs.wofford.edu/pittmandw/psy330/exps/20 I 0/WR2.htm, ( Accessed Oc… [cited by applicant]
Rowe, Dennis W., et al., “Heart Rate Valiability: Indicator of User State as an Aid to Human-Computer Interaction”, [Online]. Retrieved from the Internet: <URL: http://www.labs.iro.umontreal.ca/˜blanchae/papers/physiolo… [cited by applicant]
Sullivan, Thomas J., et al., “A Low-Noise, Non-Contact EEG/ECG Sensor”, [Online]. Retrieved from the Internet: <URL: http://isn.ucsd.edu/pubs/biocas07 eeg.pdf, (2007), 4 pages. [cited by applicant]
West, Kris, “IVhrex Audio Genre Classification”, School of Computing Sciences, University of East Anglia, 2005, 3 pages. [cited by applicant]
Wikipedia, “Brightness”, <http://en.vvikipedia.org/w/index.php?title=Brightness&oldid=543629699>, dated Mar. 12, 2013, 2 pages. [cited by applicant]
Wikipedia, “Spectral Flatness”, <http://en.wikipedia.org/w/index.php?title'''Spectral_flatness&oldid=0586657451>, dated Dec. 18, 2013, 2 pages. [cited by applicant]
International Bureau, “International Preliminary Report on Patentability,” issued in connection with International Patent Application No. PCT/US 15167889, dated Jan. 11, 2017, 25 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 14/980,650, dated Jun. 16, 2017, 16 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 14/980,650, dated Jan. 26, 2017, 20 pages. [cited by applicant]
United States Patent and Trademark Office,“Final Office Action,” issued in connection with U.S. Appl. No. 15/721,161, dated Mar. 26, 2018, 5 pages. [cited by applicant]
United States Patent and Tr.a.demark. Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 15/721,161, dated Dec. 5, 2017, 10 pages. [cited by applicant]
United States Patent and Trademark Office, “Notice of Allowance,” issued in connection with U.S. Appl. No. 15/721,161, dated Apr. 13, 2018, 5 pages. [cited by applicant]
United States Patent and Trademark Office, “Non-Final Office Action,” issued in connection with U.S. Appl. No. 16/102,143, dated Mar. 7, 2019, 9 pages. [cited by applicant]
United States Patent and Tr.a.demark. Office,“Final Office Action,” issued in connection with U.S. Appl. No. 16/102,143, dated Sep. 19, 2019, 5 pages. [cited by applicant]
United States Patent and Trademark Office,“Notice of Allowance,” issued in connection with U.S. Appl. No. 16/102,143, dated Nov. 20, 2019, 5 pages. [cited by applicant]