IP Library Granted Patent US 12,203,767
Granted Patent B2
US 12,203,767 · App. 18/425,595 · Granted Jan 21, 2025

Conditional preparation for automated assistant input from a user in a vehicle

Inventors: Vikram Aggarwal (Palo Alto, CA); Steven B. Huang (Palo Alto, CA)
Assignee: GOOGLE LLC
G01C21/3608G01C21/3617
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,203,767
App. No.
18/425,595
Granted
Jan 21, 2025
Kind
B2
Abstract

Implementations set forth herein relate to pre-emptively initializing an automated assistant in a vehicle according to certain indications, in order to reduce latency while also seeking to preserve computational resources. In some implementations, data for effectuating one or more features of an automated assistant can be loaded into memory of a computing device based on vehicle interaction data. For example, the vehicle interaction data can characterize instances in which the user, from within their vehicle, invoked the automated assistant within a threshold period of time of an application completing an operation. Based on the vehicle interaction data, subsequent instances of the operation being completed while the user is in the vehicle can cause data to be loaded into memory in order to pre-emptively prepare the automated assistant to be utilized by the user.

Claims (73)

1. A system comprising:

memory storing instructions;

one or more processors operable to execute the instructions to:

determine that an operation of an application has experienced a status change;

process, based on the status change, interaction data that is based on whether, for each of one or more prior instances, a corresponding user interacted with an automated assistant within a threshold period of time of one or more operation status changes occurring at the application or a separate application;

determine that the status change occurred while a user is in a vehicle that is driving toward a destination, wherein a vehicle computing device provides access to features of the automated assistant while the user is in the vehicle;

process vehicle data in furtherance of determining whether the status change occurred within another threshold period of time of an estimated time of arrival at the destination; and

when the interaction data satisfies one or more criteria and when the status change is determined not to have occurred within the other threshold period of time of the estimated time of arrival at the destination:

cause one or more operations to be initialized via the vehicle computing device,

wherein the one or more operations are associated with an action that is performed via the automated assistant.

2. The system of claim 1 , wherein one or more of the processors are further operable to execute the instructions to:

when the status change is determined to have occurred within the other threshold period of time of the estimated time of arrival at the destination:

cause one or more other operations to be initialized via the vehicle computing device without initializing the one or more operations,

wherein the one or more other operations are associated with another action that is performed via the automated assistant or a separate application.

3. The system of claim 1 , wherein in causing the one or more operations to be initialized one or more of the processors are to:

identify a portion of memory of the vehicle computing device to load data associated with the one or more operations,

wherein the application is of a portable computing device that the user has positioned inside of the vehicle.

4. The system of claim 3 , wherein one or more of the processors are further operable to execute the instructions to:

subsequent to causing the one or more operations to be initialized:

determine that the user provided a spoken utterance that includes a request for the automated assistant to perform the action,

wherein the automated assistant accesses the portion of memory in response to the spoken utterance, and

cause the automated assistant to perform the action in response to the spoken utterance.

5. The system of claim 1 , wherein in processing the interaction data one or more of the processors are to:

determine, based on the interaction data, that the user caused the application to perform the operation that experienced the status change, and

identify, based on the user, one or more actions initialized by the user via the automated assistant during the one or more prior instances in which the user interacted with the automated assistant within the threshold period of time of the one or more operation status changes occurring at the application,

wherein the one or more operations are selected for initializing based on the one or more actions.

6. The system of claim 1 , wherein in determining that the operation corresponding to the application has experienced the status change one or more of the processors are to:

determine that the application has ceased rendering certain information.

7. The system of claim 1 , wherein in determining that the status change occurred while the user is in the vehicle that is driving toward the destination one or more of the processors are to:

determine that a portion of the route to the destination includes an area of limited network activity,

wherein the one or more operations initialized via the vehicle computing device include a separate operation of retrieving data over a wireless network connection.

8. A system comprising:

memory storing instructions;

one or more processors operable to execute the instructions to:

determine that an electronic communication was received while a user is in a vehicle,

wherein the electronic communication is received at a vehicle computing device, or another computing device that is paired with the vehicle computing device;

identify, based on processing interaction data, an action that the user has previously initialized, from within the vehicle via an automated assistant, within a threshold amount of time of receiving a previous communication;

determine, based on processing the interaction data, that the user initialized the action within the threshold amount of time of receiving the previous communication when the previous communication had one or more characteristics; and

when the electronic communication received by the user has the one or more characteristics:

cause one or more operations to be initialized via the vehicle computing device or the other computing device,

wherein the one or more operations are associated with the action that was performed via the automated assistant.

9. The system of claim 8 , wherein the one or more characteristics correspond to a contact, who authored a communication, having contact information that is stored, in association with the user, at the vehicle computing device or the other computing device.

10. The system of claim 8 , wherein the one or more characteristics correspond to a communication that is received at a time of day.

11. The system of claim 8 , wherein the one or more characteristics correspond to a communication that includes certain content.

12. The system of claim 8 , wherein one or more of the processors are further operable to execute the instructions to:

when the other user, who authored the electronic communication received by the user, does not have the one or more characteristics:

cause one or more other operations to be initialized via the vehicle computing device or the other computing device,

wherein the one or more other operations are performed via the automated assistant or a separate application without initializing the one or more operations.

13. The system of claim 8 , wherein in causing the one or more operations to be initialized one or more of the processors are to:

identify a portion of memory of the vehicle computing device or other computing device to load data associated with the one or more operations,

wherein the data corresponds to an automatic speech recognition (ASR) feature of the automated assistant.

14. The system of claim 8 , wherein in causing the one or more operations to be initialized one or more of the processors are to:

communicate authentication data, via a wireless network connection, to a remote server device that is associated with the automated assistant.

15. The system of claim 14 , wherein one or more of the processors are further operable to execute the instructions to:

subsequent to causing one or more operations to be initialized via the vehicle computing device or the other computing device:

determine that the user provided a spoken utterance to the automated assistant in furtherance of causing the automated assistant to perform the action or another action, and

cause audio data, corresponding to the spoken utterance, to be communicated to the remote server device via a secured connection that is established using the authentication data.

16. The system of claim 15 , wherein the action or the other action corresponds to a request for the automated assistant to generate a reminder associated with a received communication.

17. The system of claim 8 , wherein one or more of the processors are further operable to execute the instructions to:

determine that a computational resource will be limited, at the vehicle computing device, within the threshold amount of time of the user receiving the electronic communication,

wherein causing the one or more operations to be initialized, via the vehicle computing device or the other computing device, is performed within the threshold amount of time of the user receiving the electronic communication.

18. The system of claim 17 , wherein the computational resource corresponds to an amount of memory that is available to one or more applications that are accessible via the vehicle computing device.

19. The system of claim 17 , wherein in causing the one or more operations to be initialized via the vehicle computing device one or more of the processors are to:

cause operation data associated with the one or more operations to be copied to a memory of the vehicle computing device.

20. A system comprising:

memory storing instructions;

one or more processors operable to execute the instructions to:

determine that a navigation operation of a vehicle has experienced a status change,

wherein a vehicle computing device, of the vehicle, provides access to features of an automated assistant when a user is in the vehicle;

process, based on determining the navigation operation experienced the status change, interaction data that is based on one or more prior instances in which the user interacted with the automated assistant within a threshold period of time of the vehicle computing device experiencing a separate status change during a prior navigation operation;

identify, based on the interaction data, an action initialized by the user via the automated assistant within the threshold period of time of the vehicle experiencing the separate status change to the prior navigation operation; and

cause, based on the interaction data, one or more operations to be initialized via the vehicle computing device,

wherein the one or more operations are associated with the action that was initialized via the automated assistant.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2024
From: AGGARWAL, VIKRAM; HUANG, STEVEN B.
To: GOOGLE LLC
Reel/Frame 066900/0371 →
Continuity (2)
Continuation 17231926 · Apr 15, 2021
Related Publication 20240167833A1 · May 23, 2024
References Cited (20)
US 10160463B1 · Weaver · 2018 [cited by examiner]
US 20120016678A1 · Gruber · 2012 [cited by examiner]
US 20160098992A1 · Renard · 2016 [cited by examiner]
US 20190159166A1 · Aggarwal · 2019 [cited by examiner]
US 20200175983A1 · Goodman · 2020 [cited by applicant]
US 20200412566A1 · Mo et al. · 2020 [cited by applicant]
US 20220333947A1 · Aggarwal et al. · 2022 [cited by applicant]
CN 110100258 · 2019 [cited by applicant]
DE 112015006545 · 2018 [cited by applicant]
WO 2020219085 · 2020 [cited by applicant]
S. Ilarri, T. Delot and R. Trillo-Lado, “A Data Management Perspective on Vehicular Networks,” in IEEE Communications Surveys & Tutorials, vol. 17, No. 4, pp. 2420-2460, Fourthquarter 2015, doi: 10.1109/COMST.2015.24723… [cited by examiner]
J. F. Dillenburg, O. Wolfson and P. C. Nelson, “The Intelligent Travel Assistant,” Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems, Singapore, 2002, pp. 691-696, doi: 10.1109/ITS… [cited by examiner]
N. Reddy, C. Papachristou and F. Wolff, “On board assistant to GPS navigation of vehicles,” Proceedings of the IEEE 2009 National Aerospace & Electronics Conference (NAECON), Dayton, OH, USA, 2009, pp. 7-13, doi: 10.110… [cited by examiner]
China National Intellectual Property Administration; Notification of First Office Action issued in Application No. 202210383133.6; 14 pages; dated Jan. 26, 2024. [cited by applicant]
Joshi, A. et al; A reliable and secure approach for efficient Car-to-Car communication in intelligent transportation systems; WISPNET; 20 pages; dated 2017. [cited by applicant]
Yang H. et al.; Auto AI Voice Interaction is Making Machine Interaction Closer to Human Interaction; 9 pages; dated 2020. [cited by applicant]
China National Intellectual Property Administration; Notice of Grant issued in Application No. 202210383133.6; 4 pages; dated Jun. 5, 2024. [cited by applicant]
Dillenburg, J.F. et al.; The Intelligent Travel Assistant; Proceeding; The IEEE 5th International Conference on Intelligent Transportation Systems; Singapore; pp. 691-696; doi: 10.1109/ITSC.2002.1041302; dated 2002. [cited by applicant]
Reddy, N. e al.; On Board Assistant tp GPS Navigation of Vehicles; Proceedings of the IEEE 2009 National Aerospace & Electronics Conference (NAECON), Dayton OH; USA; pp. 7-13; doi. 10.1109/NAECON.2009.5426660; dated 200… [cited by applicant]
Ilarri, S.; et al.; A Data Management Perspective on Vehicular Networks; in IEEE Communications Surveys & Tutorials; vol. 17, No. 4; pp. 2420-2460; Fourthquarter 2015; doi. 10.1109/COMST.2015.2472395; dated 2015. [cited by applicant]