IP Library Granted Patent US 12,213,103
Granted Patent B2
US 12,213,103 · App. 18/521,402 · Granted Jan 28, 2025

Dynamically adapting provision of notification output to reduce user distraction and/or mitigate usage of computational resources

Inventors: Vikram Aggarwal (Palo Alto, CA); Moises Morgenstern Gali (San Francisco, CA)
Assignee: GOOGLE LLC
H04W68/02B60W40/08G06F9/546H04L67/535H04W4/029H04W4/12H04W4/46
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,213,103
App. No.
18/521,402
Granted
Jan 28, 2025
Kind
B2
Abstract

Dynamically adapting provision of notification output to reduce distractions and/or to mitigate usage of computational resources. In some implementations, an automated assistant application predicts a level of engagement for a user and determines, based on the predicted level of engagement (and optionally future predicted level(s) of engagement), provisioning (e.g., whether, when, and/or how) of output that is based on a received notification. For example, the automated assistant application can, based on predicted level(s) of engagement, determine whether to provide any output based on a received notification, determine whether to suppress provision of output that is based on the received notification (e.g., until a later time with a decreased predicted level of engagement), determine whether to provide output that is a condensed version of the received notification, determine whether to automatically respond to the notification, and/or select an output modality for providing output that is based on the received notification.

Claims (73)

1. A method implemented by one or more processors, the method comprising:

identifying, at a vehicle computing device of a vehicle, an electronic notification designated for rendering to a user via the vehicle computing device;

generating, by the vehicle computing device, a current predicted level of driving engagement being exerted in navigating the vehicle;

selecting, based on both (i) one or more properties of the electronic notification and (ii) the current predicted level of driving engagement, a particular modality for rendering notification content that is based on the electronic notification, wherein selecting the particular modality is from amongst a plurality of candidate modalities, including:

an audible only modality,

a graphical only modality, and

an audible and graphical modality;

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a first level of driving engagement:

selecting, based on both (i) one or more of the properties of the electronic notification and (ii) the first level of driving engagement, the audible only modality as the particular modality for rendering the notification content;

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a second level of driving engagement:

selecting, based on both (i) one or more of the properties of the electronic notification and (ii) the second level of driving engagement, the graphical only modality as the particular modality for rendering the notification content; and

causing the vehicle computing to immediately render the notification content in the selected particular modality.

2. The method of claim 1 , further comprising:

generating the notification content as a function of the current predicted level of driving engagement.

3. The method of claim 2 , wherein generating the notification content as a function of the current predicted level of driving engagement comprises:

determining, based on a magnitude of the current predicted level of driving engagement, to generate, as the notification content, a condensed version of the electronic notification.

4. The method of claim 3 , wherein the electronic notification includes text, and wherein the notification content, for the condensed version of the electronic notification, includes less text than the electronic notification.

5. The method of claim 1 , further comprising:

determining, based on both (i) the one or more properties of the electronic notification and (ii) the current predicted level of driving engagement, to immediately render the notification content in lieu of delaying rendering of the notification content;

wherein causing the vehicle computing device to immediately render the notification content is in response to determining to immediately render the electronic content in lieu of delaying rendering of the notification content.

6. The method of claim 1 , further comprising:

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a third level of driving engagement:

selecting, based on both (i) one or more of the properties of the electronic notification and (ii) the third level of driving engagement, the audible and graphical modality as the particular modality for rendering the notification content.

7. The method of claim 1 , wherein the one or more properties of the electronic notification comprise one or more of: a type of the electronic notification, a source of the electronic notification, a time the electronic notification is received, or the notification content that is included in the electronic notification.

8. The method of claim 1 , wherein selecting the particular modality for rendering the notification content that is based on the electronic notification is further based on past user interactions, of the user, with one or more past electronic notifications that include a same source as the electronic notification.

9. A method implemented by one or more processors, the method comprising:

identifying, at a vehicle computing device of a vehicle, an electronic notification designated for rendering to a user via the vehicle computing device;

generating, by the vehicle computing device, a current predicted level of driving engagement being exerted in navigating the vehicle;

determining, based on both (i) one or more properties of the electronic notification and (ii) the current predicted level of driving engagement, whether to generate notification content as a condensed version of the electronic notification, or to generate the notification content as a non-condensed version of the electronic notification;

generating, based on the determining, the notification content as either the condensed version or the non-condensed version;

determining, based on both (i) the one or more properties of the electronic notification and (ii) the current predicted level of driving engagement, to immediately render the notification content in lieu of delaying rendering of the notification content; and

in response to determining to immediately render the electronic content in lieu of delaying rendering of the notification content:

causing the vehicle computing to immediately render the notification content.

10. The method of claim 9 , further comprising:

generating the notification content, as either the condensed version or the non-condensed version, as a function of the current predicted level of driving engagement.

11. The method of claim 10 , wherein generating the notification content as a function of the current predicted level of driving engagement comprises:

determining, based on a magnitude of the current predicted level of driving engagement, to generate, as the notification content, the condensed version of the electronic notification.

12. The method of claim 11 , wherein the electronic notification includes text, and wherein the notification content, for the condensed version of the electronic notification, includes less text than the non-condensed version of the electronic notification.

13. The method of claim 9 , further comprising:

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a first level of driving engagement:

determining, based on both (i) one or more of the properties of the electronic notification and (ii) the first level of driving engagement, to generate the notification content as the condensed version of the electronic notification.

14. The method of claim 13 , further comprising:

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a second level of driving engagement:

determining, based on both (i) one or more of the properties of the electronic notification and (ii) the second level of driving engagement, to generate the notification content as the non-condensed version of the electronic notification.

15. The method of claim 9 , wherein the one or more properties of the electronic notification comprise one or more of: a type of the electronic notification, a source of the electronic notification, a time the electronic notification is received, or the notification content that is included in the electronic notification.

16. The method of claim 9 , wherein determining whether to generate the notification content as the condensed version of the electronic notification, or to generate the notification content as the non-condensed version of the electronic notification, is further based on past user interactions, of the user, with one or more past electronic notifications that include a same source as the electronic notification.

17. A system comprising:

at least one processor; and

memory storing instructions that, when executed, cause the at least one processor to perform operations, the operations comprising:

identifying, at a vehicle computing device of a vehicle, an electronic notification designated for rendering to a user via the vehicle computing device;

generating, by the vehicle computing device, a current predicted level of driving engagement being exerted in navigating the vehicle;

selecting, based on both (i) one or more properties of the electronic notification and (ii) the current predicted level of driving engagement, a particular modality for rendering notification content that is based on the electronic notification, wherein selecting the particular modality is from amongst a plurality of candidate modalities, including:

an audible only modality,

a graphical only modality, and

an audible and graphical modality;

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a first level of driving engagement:

selecting, based on both (i) one or more of the properties of the electronic notification and (ii) the first level of driving engagement, the audible only modality as the particular modality for rendering the notification content;

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a second level of driving engagement:

selecting, based on both (i) one or more of the properties of the electronic notification and (ii) the second level of driving engagement, the graphical only modality as the particular modality for rendering the notification content;

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a third level of driving engagement:

selecting, based on both (i) one or more of the properties of the electronic notification and (ii) the third level of driving engagement, the audible and graphical modality as the particular modality for rendering the notification content; and

causing the vehicle computing to immediately render the notification content in the selected particular modality.

18. The system of claim 17 , the operations further comprising:

generating the notification content as a function of the current predicted level of driving engagement,

wherein generating the notification content as a function of the current predicted level of driving engagement comprises:

determining, based on a magnitude of the current predicted level of driving engagement, to generate, as the notification content, a condensed version of the electronic notification, and

wherein the electronic notification includes text, and wherein the notification content, for the condensed version of the electronic notification, includes less text than the electronic notification.

19. The system of claim 17 , the operations further comprising:

determining, based on both (i) the one or more properties of the electronic notification and (ii) the current predicted level of driving engagement, to immediately render the notification content in lieu of delaying rendering of the notification content;

wherein causing the vehicle computing device to immediately render the notification content is in response to determining to immediately render the electronic content in lieu of delaying rendering of the notification content.

20. The system of claim 17 , the operations further comprising:

in response to determining that the current predicted level of driving engagement being exerted in navigating the vehicle is a third level of driving engagement:

selecting, based on both (i) one or more of the properties of the electronic notification and (ii) the third level of driving engagement, the audible and graphical modality as the particular modality for rendering the notification content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2023
From: AGGARWAL, VIKRAM; GALI, MOISES MORGENSTERN
To: GOOGLE LLC
Reel/Frame 065962/0790 →
Continuity (5)
Continuation 17479135 · Sep 20, 2021
Continuation 16819326 · Mar 16, 2020
Continuation 16451447 · Jun 25, 2019
Continuation 15818310 · Nov 20, 2017
Related Publication 20240098698A1 · Mar 21, 2024
References Cited (74)
US 9548050B2 · Gruber et al. · 2017 [cited by applicant]
US 9903725B2 · Sato et al. · 2018 [cited by applicant]
US 10368333B2 · Aggarwal · 2019 [cited by applicant]
US 10624060B2 · Aggarwal · 2020 [cited by applicant]
US 11009873B2 · Ueno · 2021 [cited by applicant]
US 11129134B2 · Aggarwal · 2021 [cited by applicant]
US 20020177928A1 · Moriguchi et al. · 2002 [cited by applicant]
US 20050021227A1 · Matsumoto et al. · 2005 [cited by applicant]
US 20050071078A1 · Yamada et al. · 2005 [cited by applicant]
US 20080021632A1 · Amano · 2008 [cited by applicant]
US 20100082246A1 · Crane · 2010 [cited by applicant]
US 20110040579A1 · Havens · 2011 [cited by examiner]
US 20110210865A1 · Lee et al. · 2011 [cited by applicant]
US 20120322473A1 · Cazanas et al. · 2012 [cited by applicant]
US 20130173147A1 · Takeuchi · 2013 [cited by examiner]
US 20130332172A1 · Prakash et al. · 2013 [cited by applicant]
US 20140022121A1 · Donovan et al. · 2014 [cited by applicant]
US 20140280051A1 · Djugash · 2014 [cited by applicant]
US 20140303842A1 · Boelter et al. · 2014 [cited by applicant]
US 20140310075A1 · Ricci · 2014 [cited by applicant]
US 20150292893A1 · Bartsch et al. · 2015 [cited by applicant]
US 20160311323A1 · Lee · 2016 [cited by applicant]
US 20160349075A1 · Son · 2016 [cited by applicant]
US 20170028995A1 · Mori · 2017 [cited by applicant]
US 20170368936A1 · Kojima · 2017 [cited by applicant]
US 20180063282A1 · Crowe et al. · 2018 [cited by applicant]
US 20180105186A1 · Motomura · 2018 [cited by applicant]
US 20220007331A1 · Aggarwal et al. · 2022 [cited by applicant]
CN 102148888 · 2011 [cited by applicant]
CN 103051803 · 2013 [cited by applicant]
CN 105144133 · 2015 [cited by applicant]
CN 106716468 · 2017 [cited by applicant]
CN 104584096 · 2017 [cited by applicant]
EP 2814229 · 2014 [cited by applicant]
EP 3038047 · 2016 [cited by applicant]
JP 2001141475 · 2001 [cited by applicant]
JP 2003348193 · 2003 [cited by applicant]
JP 2004251790 · 2004 [cited by applicant]
JP 2005001533 · 2005 [cited by applicant]
JP 2007051932 · 2007 [cited by applicant]
JP 2008299528 · 2008 [cited by applicant]
JP 2009134525 · 2009 [cited by applicant]
JP 2009253807 · 2009 [cited by applicant]
JP 2011039629 · 2011 [cited by applicant]
JP 2011229097 · 2011 [cited by applicant]
JP 2015092311 · 2015 [cited by applicant]
JP 2015169472 · 2015 [cited by applicant]
JP 2016001984 · 2016 [cited by applicant]
JP 2016012292 · 2016 [cited by applicant]
JP 2016119080 · 2016 [cited by applicant]
JP 2016208124 · 2016 [cited by applicant]
JP 2017030555 · 2017 [cited by applicant]
JP 2017138741 · 2017 [cited by applicant]
WO 2013029258 · 2013 [cited by applicant]
WO 2017085981 · 2017 [cited by applicant]
WO 2016001984 · 2017 [cited by applicant]
China National Intellectual Property Administration; Notification of Second Office Action issued in Application No. 201880039448.0; 27 pages; dated Nov. 8, 2023. [cited by applicant]
Korean Patent Office; Office Action issued in Application No. KR10-2023-7006146; 10 pages; dated Sep. 25, 2023. [cited by applicant]
Intellectual Property India; Hearing Notice issued in Application No. 201927050989; 3 pages; dated Aug. 16, 2023. [cited by applicant]
Japan Patent Office; Notice of Reasons for Rejection issued for Application No. 2022-072349, 7 pages, dated Apr. 24, 2023. [cited by applicant]
China National Intellectual Property Administration; Notification of First Office Action issued in Application No. 201880039448.0; 6 pages; dated Feb. 21, 2023. [cited by applicant]
Korean Patent Office; Notice of Allowance issued in Application No. KR10-2022-7002793; 5 pages; dated Nov. 28, 2022. [cited by applicant]
European Patent Office; Communication pursuant to Article 94(3) issued in Application No. 18839953.9, 8 pages, dated Sep. 5, 2022. [cited by applicant]
Japanese Patent Office; Notice of Allowance issued in Application No. 2019-568360, 9 pages, dated Mar. 28, 2022. [cited by applicant]
Korean Patent Office; Office Action issued in Application No. KR10-2022-7002793; 11 pages; dated Apr. 26, 2022. [cited by applicant]
Korean Patent Office; Office Action issued in Application No. 1020197038223; 33 pages; dated Feb. 21, 2021. [cited by applicant]
Korean Patent Office; Notice of Allowance issued in Application No. 1020197038223; 5 pages; dated Oct. 29, 2021. [cited by applicant]
Japanese Patent Office; Office Action issued in Application No. 2019-568360; 10 pages; dated Sep. 13, 2021. [cited by applicant]
Japanese Patent Office; Office Action issued in Application No. 2019-568360; 14 pages; dated Mar. 8, 2021. [cited by applicant]
Intellectual Property India; Office Action issued in Application No. 201927050989; 6 pages; dated Mar. 22, 2021. [cited by applicant]
“Samsung Creates In-Traffic Reply App to Prevent Distracted Driving.” Samsung Global Newsroom. https://news.samsung.com/global/samsung-creates-in-traffic-reply-app-to-prevent-distracted-driving. 2 pages; Apr. 26, 2017. [cited by applicant]
European Patent Office; Invitation to Pay Additional Fees and, Where Applicable, Protest Fee of Ser. No. PCT/US2018/061312; 15 pages; dated May 2, 2019. [cited by applicant]
European Patent Office; International Search Report and Written Opinion of Ser. No. PCT/US2018/061312; 20 pages; dated Jul. 4, 2019. [cited by applicant]
Japanese Patent Office; Notice of Refusal issued in Application No. 2023-207559; 4 pages; dated Nov. 11, 2024. [cited by applicant]