IP Library Granted Patent US 10,691,409
Granted Patent B2
US 10,691,409 · App. 16/157,751 · Granted Jun 23, 2020

Providing a communications channel between instances of automated assistants

Inventors: Alexandr Maltsev (Mountain View, CA); Vikram Aggarwal (Palo Alto, CA); Moises Morgenstern Gali (San Francisco, CA); Joseph Pirozzo (Los Altos, CA)
Assignee: GOOGLE LLC
G06F3/167B60K35/00G07C5/008G10L15/22B60K2370/148G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,691,409
App. No.
16/157,751
Granted
Jun 23, 2020
Kind
B2
Abstract

Implementations relate to interactions, over a wireless communication modality, between an automated assistant of an automobile computer system, and separate client device(s). In some of those implementations, the client device(s) can be paired with the automobile computer system, and the client device(s) and the automobile computer system can include separate instances of an automated assistant, which can be associated with different user accounts. In some additional or alternative implementations, particular actions to be performed by a local application of a client device can be advanced via user interaction with the automobile automated assistant, despite a counterpart to the local application not being installed directly on automobile computer system. For example, despite an automobile computer system not having a third-party messaging application installed, the automobile automated assistant can access requested actions to be performed by the third-party messaging application in order to further a requested action. The automobile computer system can transmit, via the wireless communication modality, content to cause the third-party application to further the requested action.

Claims (66)

1. A system to establish communication channels between networked devices, comprising an automobile-based data processing system comprising at least one processor to:

receive, by an interface of the automobile-based data processing system, a first input audio signal from a client device;

determine, by the automobile-based data processing system and based on the first input audio signal, a first action intent request and an identifier of an application associated with the first action intent request;

output, by the interface of the automobile-based data processing system, an output response based on the first action intent request;

receive, by the interface of the automobile-based data processing system, a second input audio signal, the second input audio signal generated in response to the output response;

determine, by the automobile-based data processing system, a digital component and a second action intent request based on the second input audio signal, the second action intent request comprising the identifier of the application associated with the first action intent;

set, by the automobile-based data processing system, a priority of the second action intent request, the priority of the second action intent request based on the client device; and

transmit, by the automobile-based data processing system, the second action intent request and the digital component to the client device to process the second action intent request with the application identified by the identifier of the second action intent request based on the priority of the second action intent request.

2. The system of claim 1 , further comprising the automobile-based data processing system to:

receive the first input audio signal from the client device, the client device paired with the automobile-based data processing system via a wireless communication channel.

3. The system of claim 1 , the interface of the automobile-based data processing system further comprising:

at least one microphone to receive the first input audio signal.

4. The system of claim 1 , the automobile-based data processing system to:

set a pendency of the second action intent request.

5. The system of claim 1 , wherein the identifier comprises a deep link to the application and execution of the deep link by the client device opens the application on the client device.

6. The system of claim 1 , the automobile-based data processing system to:

generate a digital component request based on the second input audio signal;

transmit the digital component request based on the second input audio signal to a remote data processing system;

receive, from the remote data processing system, the digital component based on the digital component request; and

render, by the interface of the automobile-based data processing system, the digital component.

7. The system of claim 1 , the automobile-based data processing system to:

generate a digital component request based on the second input audio signal;

transmit the digital component request based on the second input audio signal to a remote data processing system;

receive, from the remote data processing system, the digital component based on the digital component request; and

transmit the digital component to the client device.

8. The system of claim 1 , the automobile-based data processing system to:

render the second action intent request and the digital component at the interface.

9. The system of claim 1 , the automobile-based data processing system to:

determine an automobile associated with the automobile-based data processing system is in motion; and

prevent transmission of the second action intent request and the digital component to the client device until the automobile-based data processing system determines the automobile is stopped.

10. The system of claim 1 , the automobile-based data processing system to:

transmit a third action intent request to the client device, the third action intent request to dismiss a pendency of the second action intent request.

11. The system of claim 1 , the automobile-based data processing system to:

receive a notification the client device received a response to the second action intent request; and

dismiss a pendency of the second action intent request based on receipt of the notification that the client device received the response to the second action intent request.

12. A method to establish communication channels between networked devices, comprising:

receiving, by an interface of an automobile-based data processing system, a first input audio signal from a client device;

determining, by the automobile-based data processing system and based on the first input audio signal, a first action intent request and an identifier of an application associated with the first action intent request;

outputting, by the interface of the automobile-based data processing system, an output response based on the first action intent request;

receiving, by the interface of the automobile-based data processing system, a second input audio signal, the second input audio signal generated in response to the output response;

determining, by the automobile-based data processing system, content data and a second action intent request based on the second input audio signal, the second action intent request comprising the identifier of the application associated with the first action intent; and

transmitting, by the automobile-based data processing system, the second action intent request and the content data to the client device to process the second action intent request with the application identified by the identifier of the second action intent request.

13. The method of claim 12 , further comprising:

receiving the first input audio signal from the client device, the client device paired with the automobile-based data processing system via a wireless communication channel.

14. The method of claim 12 , further comprising:

receiving the first input audio signal by at least one microphone of the automobile-based data processing system.

15. The method of claim 12 , further comprising:

generating a digital component request based on the second input audio signal;

transmitting the digital component request based on the second input audio signal to a remote data processing system;

receiving, from the remote data processing system, a digital component based on the digital component request, wherein the digital component comprises the content data; and

rendering, by the interface of the automobile-based data processing system, the digital component.

16. The method of claim 12 , further comprising:

generating a digital component request based on the second input audio signal;

transmitting the digital component request based on the second input audio signal to a remote data processing system;

receiving, from the remote data processing system, a digital component based on the digital component request; and

transmitting the digital component to the client device.

17. The method of claim 12 , further comprising:

rendering the second action intent request and a digital component at the interface.

18. The method of claim 12 , further comprising:

determining an automobile associated with the automobile-based data processing system is in motion; and

preventing transmission of the second action intent request and a digital component to the client device until the automobile-based data processing system determines the automobile is stopped.

19. The method of claim 12 , further comprising:

transmitting a third action intent request to the client device, the third action intent request to dismiss a pendency of the second action intent request.

20. The method of claim 12 , further comprising:

receiving a notification that the client device received a response to the second action intent request; and

dismissing a pendency of the second action intent request based on receipt of the notification that the client device received the response to the second action intent request.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2019
From: MALTZEV, ALEXANDR; AGGARWAL, VIKRAM; GALI, MOISES MORGENSTERN; PIROZZO, JOSEPH
To: GOOGLE LLC
Reel/Frame 051054/0119 →
Cited By (5)
US 12,248,941 US 12,255,860 US 12,379,903 US 12,626,263 US 12,639,049