IP Library › Granted Patent US 11,721,135
Granted Patent B2
US 11,721,135 · App. 17/192,272 · Granted Aug 8, 2023

Providing a communications channel between instances of automated assistants

Inventors: Alexandr Maltsev (Mountain View, CA); Vikram Aggarwal (Palo Alto, CA); Moises Morgenstern Gali (San Francisco, CA); Joseph Pirozzo (Los Altos, CA)
Assignee: GOOGLE LLC
G07C5/008G06F3/00G07C5/006G07C5/0825G10L15/26H04L67/12H04L67/14H04L67/52H04W4/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,721,135
App. No.
17/192,272
Granted
Aug 8, 2023
Kind
B2
Abstract

Implementations relate to interactions, over a wireless communication modality, between an automated assistant of an automobile computer system, and separate client device(s). In some of those implementations, the client device(s) can be paired with the automobile computer system, and the client device(s) and the automobile computer system can include separate instances of an automated assistant, which can be associated with different user accounts. In some additional or alternative implementations, particular actions to be performed by a local application of a client device can be advanced via user interaction with the automobile automated assistant, despite a counterpart to the local application not being installed directly on automobile computer system. For example, despite an automobile computer system not having a third-party messaging application installed, the automobile automated assistant can access requested actions to be performed by the third-party messaging application in order to further a requested action. The automobile computer system can transmit, via the wireless communication modality, content to cause the third-party application to further the requested action.

Claims (55)

1. A method implemented by one or more processors, the method comprising:

connecting, by a client device via a wireless modality, with an automobile computer system that is integral to a vehicle;

accessing, by the client device via the automobile computer system, an action intent request that was received from an application of the automobile computer system, wherein the application is in communication with a sensor of the vehicle that detects a state of at least one component of the vehicle, wherein the action intent request is based at least on data, from the sensor of the vehicle, that indicates the state of the at least one component of the vehicle, and wherein the action intent request identifies (i) an action to be performed relating to the state of the at least one component of the vehicle and (ii) content associated with the action;

generating, via the client device and based on accessing the action intent request, a corresponding instance of the action intent request, wherein the client device includes one or more other action intent requests provided by one or more other applications at the client device;

causing the client device to disconnect from the automobile computer system; and

causing, subsequent to the client device disconnecting from the automobile computer system, the client device to perform the action based on the action being identified by the corresponding instance of the action intent request, wherein performing the action includes rendering, via an interface of the client device, the content identified by the action intent request.

2. The method of claim 1 , wherein the client device is void of an installed application that:

(i) is provided by a third party who provided the application at the automobile computer system, and/or

(ii) is at least partially correlated to the application at the automobile computer system.

3. The method of claim 1 , further comprising:

determining a particular context of the client device subsequent to causing the client device to disconnect from the automobile computer system, wherein causing the client device to perform the action is in response to determining the particular context.

4. The method of claim 3 , wherein determining the particular context includes determining a location of the client device, and the method further comprises:

determining that the content identified by the action intent request is associated with the location of the client device, wherein the action is performed in response to determining that the content identified by the action intent request is associated with the location of the client device.

5. The method of claim 1 , further comprising:

providing, by the client device and based on the client device performing the action according to the corresponding instance of the action intent request, a request for the action intent request to be dismissed at the automobile computer system.

6. The method of claim 5 , wherein the request is provided by the client device to a remote server device that is configured to communicate with the automobile computer system and cause the action intent request to be dismissed at the automobile computer system.

7. The method of claim 1 , wherein the corresponding instance of the action intent request is generated in response to a user providing a spoken utterance to an automated assistant interface of the automobile computer system, and wherein the method further comprises:

receiving, from the automobile computer system in response to the user providing the spoken utterance to the automated assistant interface, data corresponding to the spoken utterance; and

causing responsive data to be provided to the automobile computer system based on the received data from the automobile computer system, wherein the corresponding instance of the action intent request is further based on the responsive data received by the automobile computer system.

8. The method of claim 1 , wherein the client device disconnects from the automobile computer system at least based on the client device becoming less proximate to the vehicle and/or the automobile computer system.

9. A non-transitory computer-readable medium configured to store instructions that, when executed by one or more processors, cause the one or more processors to perform operations that include:

connecting, by a client device via a wireless modality, with an automobile computer system that is integral to a vehicle;

accessing, by the client device via the automobile computer system, an action intent request that was received from an application of the automobile computer system, wherein the application is in communication with a sensor of the vehicle that detects a state of at least one component of the vehicle, wherein the action intent request is based at least on data, from the sensor of the vehicle, that indicates the state of the at least one component of the vehicle, and wherein the action intent request identifies (i) an action to be performed relating to the state of the at least one component of the vehicle and (ii) content associated with the action;

generating, based on accessing the action intent request, a corresponding instance of the action intent request, wherein the client device includes one or more other action intent requests provided by one or more other applications at the client device;

causing the client device to disconnect from the automobile computer system; and

causing, subsequent to the client device disconnecting from the automobile computer system, the client device to perform the action based on the action being identified by the corresponding instance of the action intent request, wherein performing the action includes rendering, via an interface of the client device, the content identified by the action intent request.

10. The non-transitory computer-readable medium of claim 9 , wherein the client device is void of an installed application that:

(i) is provided by a third party who provided the application at the automobile computer system, and/or

(ii) is at least partially correlated to the application at the automobile computer system.

11. The non-transitory computer-readable medium of claim 9 , wherein the operations further include:

determining a particular context of the client device subsequent to causing the client device to disconnect from the automobile computer system, wherein causing the client device to perform the action is in response to determining the particular context.

12. The non-transitory computer-readable medium of claim 11 , wherein determining the particular context includes determining a location of the client device, and the operations further include:

determining that the content identified by the action intent request is associated with the location of the client device, wherein the action is performed in response to determining that the content identified by the action intent request is associated with the location of the client device.

13. The non-transitory computer-readable medium of claim 9 , wherein the operations further include:

providing, by the client device and based on the client device performing the action according to the corresponding instance of the action intent request, a request for the action intent request to be dismissed at the automobile computer system.

14. The non-transitory computer-readable medium of claim 13 , wherein the request is provided by the client device to a remote server device that is configured to communicate with the automobile computer system and cause the action intent request to be dismissed at the automobile computer system.

15. The non-transitory computer-readable medium of claim 9 , wherein the corresponding instance of the action intent request is generated in response to a user providing a spoken utterance to an automated assistant interface of the automobile computer system, and wherein the operations further include:

receiving, from the automobile computer system in response to the user providing the spoken utterance to the automated assistant interface, data corresponding to the spoken utterance; and

causing responsive data to be provided to the automobile computer system based on the received data from the automobile computer system, wherein the corresponding instance of the action intent request is further based on the responsive data received by the automobile computer system.

16. The non-transitory computer-readable medium of claim 9 , wherein the client device disconnects from the automobile computer system at least based on the client device becoming less proximate to the vehicle and/or the automobile computer system.

17. A system comprising:

one or more processors; and

memory configured to store instructions that, when executed by one or more processors, cause the one or more processors to perform operations that include:

connecting, by a client device via a wireless modality, with an automobile computer system that is integral to a vehicle;

accessing, by the client device via the automobile computer system, an action intent request that was received from an application of the automobile computer system, wherein the application is in communication with a sensor of the vehicle that detects a state of at least one component of the vehicle, wherein the action intent request is based at least on data, from the sensor of the vehicle, that indicates the state of the at least one component of the vehicle, and wherein the action intent request identifies (i) an action to be performed relating to the state of the at least one component of the vehicle and (ii) content associated with the action;

generating, based on accessing the action intent request, a corresponding instance of the action intent request, wherein the client device includes one or more other action intent requests provided by one or more other applications at the client device;

causing the client device to disconnect from the automobile computer system; and

causing, subsequent to the client device disconnecting from the automobile computer system, the client device to perform the action based on the action being identified by the corresponding instance of the action intent request, wherein performing the action includes rendering, via an interface of the client device, the content identified by the action intent request.

18. The system of claim 17 , wherein the client device is void of an installed application that:

(i) is provided by a third party who provided the application at the automobile computer system, and/or

(ii) is at least partially correlated to the application at the automobile computer system.

19. The system of claim 17 , wherein the operations further include:

determining a particular context of the client device subsequent to causing the client device to disconnect from the automobile computer system, wherein causing the client device to perform the action is in response to determining the particular context.

20. The system of claim 19 , wherein determining the particular context includes determining a location of the client device, and the operations further include:

determining that the content identified by the action intent request is associated with the location of the client device, wherein the action is performed in response to determining that the content identified by the action intent request is associated with the location of the client device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2021
From: MALTSEV, ALEXANDR; AGGARWAL, VIKRAM; GALI, MOISES MORGENSTERN; PIROZZO, JOSEPH
To: GOOGLE LLC
Reel/Frame 056206/0821 →
Continuity (5)
Continuation 16713039 · Dec 13, 2019
Continuation 16260974 · Jan 29, 2019
Continuation 16009116 · Jun 14, 2018
Provisional Application 62675342 · May 23, 2018
Related Publication 20210192866A1 · Jun 24, 2021