IP Library Granted Patent US 12,282,643
Granted Patent B1
US 12,282,643 · App. 18/511,678 · Granted Apr 22, 2025

Identifying and rendering content relevant to a user's current mental state and context

Inventors: Thabet Alfishawi (Seattle, WA); Sagar Mittal (San Francisco, CA); Mark Stevens (San Francisco, CA)
Assignee: Google LLC
G06F3/048A61B5/11A61B5/165G06F3/0481G06F13/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,282,643
App. No.
18/511,678
Granted
Apr 22, 2025
Kind
B1
Abstract

Systems and methods are provided for identifying and rendering content relevant to a user's current mental state and context. In an aspect, a system includes a state component that determines a state of a user during a current session of the user with the media system based on navigation of the media system by the user during the current session, media items provided by the media system that are played for watching by the user during the current session, and a manner via which the user interacts with or reacts to the played media items. In an aspect, the state of the user includes a mood of the user. A selection component then selects a media item provided by the media provider based on the state of the user, and a rendering component effectuates rendering of the media item to the user during the current session.

Claims (43)

1. A computer-implemented method, comprising:

obtaining characteristics of a current context of a user comprising obtaining information specifying a current location of the user and one or more media items requested by the user during a current viewing session with a media player;

determining a current state of mind of the user based on (i) the current location and (ii) characteristics of the one or more media items that have been requested by the user during the current viewing session;

selecting a subsequent media item to provide through the media player, wherein the subsequent media item is selected based on the subsequent media item having at least a threshold relevance to the determined current state of mind of the user; and

effectuating playing of the subsequent media item to the user through the media player.

2. The method of claim 1 , wherein the characteristics of the current context of the user comprises a length of each media item viewed by the user during the current viewing session.

3. The method of claim 1 , wherein the state of mind of the user comprises one of an entertainment state or a work related state.

4. The method of claim 1 , wherein obtaining the information specifying the current location of the user comprises obtaining location information from a global positioning system.

5. The method of claim 1 , wherein the characteristics of the current context of the user comprises at least one of (i) events at the current location of the user, (ii) one or more other users at the current location of the user, (iii) weather at the current location of the user, or (iv) traffic at the current location of the user.

6. The method of claim 1 , further comprising:

determining that the user's level of engagement with the media player has become a passive engagement;

selecting a content item to display through the media player while the user is passively engaged with media content played by the media player; and

effectuating playing of the content item to the user through the media player.

7. The method of claim 1 , wherein the characteristics of the current context of the user comprises characteristics of media items viewed by other users that are connected to the user in a social graph.

8. A system comprising:

a data storage device; and

one or more processors configured to interact with the data storage device executing instructions that cause the one or more processors to perform operations comprising:

obtaining characteristics of a current context of a user comprising obtaining information specifying a current location of the user and one or more media items requested by the user during a current viewing session with a media player;

determining a current state of mind of the user based on (i) the current location and (ii) characteristics of the one or more media items that have been requested by the user during the current viewing session;

selecting a subsequent media item to provide through the media player, wherein the subsequent media item is selected based on the subsequent media item having at least a threshold relevance to the determined current state of mind of the user; and

effectuating playing of the subsequent media item to the user through the media player.

9. The system of claim 8 , wherein the characteristics of the current context of the user comprises a length of each media item viewed by the user during the current viewing session.

10. The system of claim 8 , wherein the state of mind of the user comprises one of an entertainment state or a work related state.

11. The system of claim 8 , wherein obtaining the information specifying the current location of the user comprises obtaining location information from a global positioning system.

12. The system of claim 8 , wherein the characteristics of the current context of the user comprises at least one of (i) events at the current location of the user, (ii) one or more other users at the current location of the user, (iii) weather at the current location of the user, or (iv) traffic at the current location of the user.

13. The system of claim 8 , wherein the operations comprise:

determining that the user's level of engagement with the media player has become a passive engagement;

selecting a content item to display through the media player while the user is passively engaged with media content played by the media player; and

effectuating playing of the content item to the user through the media player.

14. The system of claim 8 , wherein the characteristics of the current context of the user comprises characteristics of media items viewed by other users that are connected to the user in a social graph.

15. A non-transitory computer readable medium storing instructions that, upon execution, cause one or more processors to perform operations comprising:

obtaining characteristics of a current context of a user comprising obtaining information specifying a current location of the user and one or more media items requested by the user during a current viewing session with a media player;

determining a current state of mind of the user based on (i) the current location and (ii) characteristics of the one or more media items that have been requested by the user during the current viewing session;

selecting a subsequent media item to provide through the media player, wherein the subsequent media item is selected based on the subsequent media item having at least a threshold relevance to the determined current state of mind of the user; and

effectuating playing of the subsequent media item to the user through the media player.

16. The non-transitory computer readable medium of claim 15 , wherein the characteristics of the current context of the user comprises a length of each media item viewed by the user during the current viewing session.

17. The non-transitory computer readable medium of claim 15 , wherein the state of mind of the user comprises one of an entertainment state or a work related state.

18. The non-transitory computer readable medium of claim 15 , wherein obtaining the information specifying the current location of the user comprises obtaining location information from a global positioning system.

19. The non-transitory computer readable medium of claim 15 , wherein the characteristics of the current context of the user comprises at least one of (i) events at the current location of the user, (ii) one or more other users at the current location of the user, (iii) weather at the current location of the user, or (iv) traffic at the current location of the user.

20. The non-transitory computer readable medium of claim 15 , wherein the operations comprise:

determining that the user's level of engagement with the media player has become a passive engagement;

selecting a content item to display through the media player while the user is passively engaged with media content played by the media player, and

effectuating playing of the content item to the user through the media player.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2023
From: ALFISHAWI, THABET; MITTAL, SAGAR; STEVENS, MARK
To: GOOGLE INC.
Reel/Frame 065690/0641 →
CHANGE OF NAME Recorded Nov 28, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 065706/0177 →
Continuity (5)
Continuation 17833061 · Jun 6, 2022
Continuation 17118068 · Dec 10, 2020
Continuation 16597307 · Oct 9, 2019
Continuation 15651232 · Jul 17, 2017
Continuation In Part 14556802 · Dec 1, 2014
References Cited (56)
US 9399111B1 · Hanina · 2016 [cited by applicant]
US 9454289B2 · Wheeler et al. · 2016 [cited by applicant]
US 9641488B2 · Mityagin et al. · 2017 [cited by applicant]
US 9652783B2 · Roberts et al. · 2017 [cited by applicant]
US 9736603B2 · Osborne · 2017 [cited by examiner]
US 9788777B1 · Knight et al. · 2017 [cited by applicant]
US 10037339B1 · Kleinpeter et al. · 2018 [cited by applicant]
US 10264067B2 · Subramani et al. · 2019 [cited by applicant]
US 10397319B2 · Kaplan et al. · 2019 [cited by applicant]
US 10805388B2 · Rashid et al. · 2020 [cited by applicant]
US 20030128871A1 · Naske et al. · 2003 [cited by applicant]
US 20040191737A1 · Doehner · 2004 [cited by applicant]
US 20040249650A1 · Freedman · 2004 [cited by examiner]
US 20080082613A1 · Szeto et al. · 2008 [cited by applicant]
US 20080256458A1 · Aldred · 2008 [cited by examiner]
US 20100011388A1 · Bull et al. · 2010 [cited by applicant]
US 20100122174A1 · Snibbe et al. · 2010 [cited by applicant]
US 20100211966A1 · Zhang et al. · 2010 [cited by applicant]
US 20120304206A1 · Roberts et al. · 2012 [cited by applicant]
US 20130080907A1 · Skelton et al. · 2013 [cited by applicant]
US 20130081081A1 · Wang · 2013 [cited by applicant]
US 20130243270A1 · Kamhi et al. · 2013 [cited by applicant]
US 20130290843A1 · Lehtiniemi et al. · 2013 [cited by applicant]
US 20130298044A1 · Bill · 2013 [cited by applicant]
US 20140052282A1 · Balassanian · 2014 [cited by applicant]
US 20140114899A1 · Wan et al. · 2014 [cited by applicant]
US 20140164511A1 · Williams · 2014 [cited by examiner]
US 20140172431A1 · Song · 2014 [cited by examiner]
US 20140200463A1 · El Kaliouby et al. · 2014 [cited by applicant]
US 20140210640A1 · Rahman et al. · 2014 [cited by applicant]
US 20140215568A1 · Kirigin · 2014 [cited by examiner]
US 20140307878A1 · Osborne · 2014 [cited by examiner]
US 20140337790A1 · Kim · 2014 [cited by examiner]
US 20150018660A1 · Thomson et al. · 2015 [cited by applicant]
US 20150032899A1 · Willars et al. · 2015 [cited by applicant]
US 20150053066A1 · Hampiholi et al. · 2015 [cited by applicant]
US 20150067708A1 · Jensen et al. · 2015 [cited by applicant]
US 20150153910A1 · Wheeler et al. · 2015 [cited by applicant]
US 20150200945A1 · Edson · 2015 [cited by applicant]
US 20150206523A1 · Song · 2015 [cited by examiner]
US 20150264431A1 · Cheng · 2015 [cited by applicant]
US 20150297109A1 · Garten et al. · 2015 [cited by applicant]
US 20150318020A1 · Pribula · 2015 [cited by applicant]
US 20150338917A1 · Steiner et al. · 2015 [cited by applicant]
US 20160065724A1 · Lee et al. · 2016 [cited by applicant]
US 20160234369A1 · Jung et al. · 2016 [cited by applicant]
US 20160300102A1 · Hajiyev et al. · 2016 [cited by applicant]
US 20160308925A1 · Pathak et al. · 2016 [cited by applicant]
US 20160335047A1 · Alaoui et al. · 2016 [cited by applicant]
US 20170046496A1 · Johnstone et al. · 2017 [cited by applicant]
US 20200275875A1 · Johnstone et al. · 2020 [cited by applicant]
Cowie et al., “Emotion recognition in human-computer interaction.” IEEE Signal processing magazine 18.1, Jan. 2001, 32-80. [cited by applicant]
Jung et al., “Product-Awareness Through Smart Audio Navigation in a Retail Environment” 2011 Seventh International Conference on Intelligent Environments, Jul. 2011, 186-191. [cited by applicant]
Lehtiniemi et al., “Evaluating MoodPic—A concept for collaborative mood music playlist creation.” 2013 17th International Conference on Information Visualisation. IEEE, Jul. 2013, 10 pages. [cited by applicant]
Schatter et al., “Mood-based Selection of Music Collections by Speech” 2011 IEEE 15th International Symposium on Consumer Electronics (ISCE). IEEE, Jun. 2011, 249-253. [cited by applicant]
Yu et al., “Design of a mobile telephony system for social interaction.” 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing… [cited by applicant]