IP Library Granted Patent US 10,613,821
Granted Patent B2
US 10,613,821 · App. 16/102,143 · Granted Apr 7, 2020

Machine-led mood change

Inventors: Aneesh Vartakavi (Emeryville, CA); Peter C. DiMaria (Berkeley, CA); Michael Gubman (San Francisco, CA); Markus K. Cremer (Orinda, CA); Cameron Aubrey Summers (Oakland, CA); Gregoire Tronel (Santa Monica, CA)
Assignee: Gracenote, Inc.
G06F3/165G06F16/639H04L67/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,613,821
App. No.
16/102,143
Granted
Apr 7, 2020
Kind
B2
Abstract

A machine is configured to identify a media file that, when played to a user, is likely to modify an emotional or physical state of the user to or towards a target emotional or physical state. The machine accesses play counts that quantify playbacks of media files for the user. The playbacks may be locally performed or detected by the machine from ambient sound. The machine accesses arousal scores of the media files and determines a distribution of the play counts over the arousal scores. The machine uses one or more relative maxima in the distribution in selecting a target arousal score for the user based on contextual data that describes an activity of the user. The machine selects one or more media files based on the target arousal score. The machine may then cause the selected media file to be played to the user.

Claims (60)

1. A system comprising:

a sensor in a vehicle to obtain a biometric measurement of a driver of the vehicle;

a play count accessor to access play counts that quantify playback of media files; and

a media selector machine to:

compare play counts of the media files to a threshold number of playbacks;

categorize respective ones of the media files as familiar media files when the corresponding play counts satisfy the threshold number of playbacks;

categorize respective ones of the media files as unfamiliar media files when the corresponding play counts do not satisfy the threshold number of playbacks;

access user state scores of the of media files;

select a target user state score based on the biometric measurement of the driver; and

select, as a selected media file, one of the media files to present to the driver based on the user state score of the selected media file, the target user state score, and a status of the selected media file as a familiar media file or an unfamiliar media file.

2. The system of claim 1 , wherein the sensor includes a facial sensor to detect a facial characteristic of the driver.

3. The system of claim 2 , wherein the facial characteristic includes a duration of a blink of an eye of the driver.

4. The system of claim 2 , wherein the facial characteristic includes a frequency of blinks of an eye of the driver.

5. The system of claim 2 , wherein the facial characteristic includes a frequency of movement of an eye of the driver.

6. The system of claim 1 , wherein the sensor includes a heart rate sensor to detect a heart rate of the driver.

7. The system of claim 1 , wherein the media selector machine is to select the target user state score further based on contextual data associated with a user activity.

8. The system of claim 7 , wherein the sensor is a first sensor, and wherein the media selector machine is to identify the user activity based on a measurement from a second sensor in the vehicle.

9. The system of claim 7 , wherein the media selector machine is to identify the user activity based on at least one of Global Positioning System (GPS) data, address book data, calendar data, or prior logged activity data.

10. The system of claim 1 , wherein the biometric measurement includes at least one of:

a force applied by the driver to a portion of a car seat of the vehicle; or

a frequency at which the force applied by the driver to the portion of the car seat fluctuates.

11. The system of claim 1 , wherein the biometric measurement includes at least one of:

a force applied by the driver to a portion of a steering wheel of the vehicle; or

a frequency at which the force applied by the driver to the portion of the steering wheel fluctuates.

12. The system of claim 1 , wherein the sensor is a first sensor, and the system further including a second sensor to detect a vehicle measurement including at least one of:

a frequency at which a brake pedal of the vehicle is pressed by the driver;

a speed of the vehicle; or

a frequency at which the vehicle changes direction, wherein the media selector machine is to select the target user state score based on the vehicle measurement.

13. The system of claim 1 , wherein the media selector machine is to determine a current user state score of the driver based on the biometric measurement of the driver and select the target user state score based on the current user state score.

14. The system of claim 13 , wherein the target user state score and the current user state score relate to extent of arousal and, when the biometric measurement indicates the driver is drowsy, the media selector machine is to select the target user state score corresponding to a higher extent of arousal than the current user state score.

15. The system of claim 13 , wherein the target user state score and the current user state score relate to extent of arousal and, when the biometric measurement indicates the driver is agitated, the media selector machine is to select the target user state score corresponding to a lower extent of arousal than the current user state score.

16. The system of claim 13 , wherein the user state scores of the media files, the target user state score, and the current user state score are multi-dimensional user state scores including at least one of an arousal score, a valence score, or a dominance score.

17. The system of claim 1 , wherein the media selector machine is to select the target user state score from a plurality of target user state scores mapped to predetermined activities.

18. The system of claim 1 , further including a speaker in the vehicle to play the selected media file to the driver.

19. A method comprising:

accessing, by executing an instruction with at least one processor, play counts that quantify playback of media files;

comparing, by executing an instruction with at least one processor, play counts of the media files to a threshold number of playbacks;

selecting, by executing an instruction with at least one processor, a target user state score based on a biometric measurement of a driver of a vehicle obtained via a sensor in the vehicle;

accessing, by executing an instruction with the at least one processor, user state scores of a plurality of media files; and

selecting, by executing an instruction with the at least one processor, as a selected media file, one of the plurality of media files to present to the driver based on the user state score of the selected media file, the target user state score, and a status of the selected media file as meeting or not meeting the threshold number of playbacks.

20. A non-transitory machine readable storage medium comprising instructions that, when executed, cause at least one machine to at least:

access play counts that quantify playback of media files;

compare play counts of the media files to a threshold number of playbacks;

select a target user state score based on a biometric measurement of a driver of a vehicle obtained via a sensor in the vehicle;

access user state scores of a plurality of media files; and

select, as a selected media file, one of the plurality of media files to present to the driver based on the user state score of the selected media file, the target user state score, and a status of the selected media file as meeting or not meeting the threshold number of playbacks.

21. A vehicle comprising:

a sensor to obtain a biometric measurement from a driver of the vehicle, the biometric measurement including at least one of a duration of a blink of an eye of the driver, a frequency of blinks of the eye of the driver, or a frequency of movement of the eye of the driver; and

a media selector machine to:

select a target user state based on the biometric measurement of the driver; and

select as a media file from a plurality of media files to present to the driver based on the target user state.

22. The vehicle of claim 21 , wherein the sensor is a first sensor and the biometric measurement is a first biometric measurement, further including a second sensor to obtain a second biometric measurement of the driver, the second biometric measurement being a heart rate of the driver, the media selector machine to select the target user state further based on the second biometric measurement.

23. The vehicle of claim 22 , wherein the media selector machine is to select the target user state further based on at least one of:

a force applied by the driver to a portion of a car seat of the vehicle;

a frequency at which the force applied by the driver to the portion of the car seat fluctuates;

a force applied by the driver to a portion of a steering wheel of the vehicle;

a frequency at which the force applied by the driver to the portion of the steering wheel fluctuates;

a frequency at which a brake pedal of the vehicle is pressed by the driver;

a speed of the vehicle; or

a frequency at which the vehicle changes direction.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 21, 2018
From: VARTAKAVI, ANEESH; DIMARIA, PETER C.; GUBMAN, MICHAEL; CREMER, MARKUS K.; SUMMERS, CAMERON AUBREY; TRONEL, GREGOIRE
To: GRACENOTE, INC.
Reel/Frame 046937/0502 →
Cited By (2)
US 12,204,817 US 12,454,180