Automated assistant suggestions for third-party vehicle computing devices with restricted architecture
Implementations set forth herein relate an automated assistant that provides suggestion elements at an OEM application and/or third-party application that is accessible via an OEM vehicle computing device, which employs restrictions on communications between local applications. The automated assistant can render suggestions via OEM vehicle applications and/or third-party applications, and initialize actions for performance via the OEM vehicle applications and/or the third-party applications—despite the limitations. The suggestions can be rendered at a graphical user interface of a vehicle, and include content that, when spoken by a user, causes the automated assistant to initialize such actions. Actions that are suggested by the automated assistant can be performed by third-party applications that are different from a third-party application that is rendering the suggestion. In this way, a common automated assistant can be indiscriminately available via various vehicle computing devices, despite differences in restrictions of communications between vehicle applications.
1. A method implemented by one or more processors, the method comprising:
receiving, via a vehicle application that is operational when a user is riding in a vehicle, vehicle application data indicating a destination location of the user, that corresponds to content being rendered at a graphical user interface of the vehicle application, where the graphical user interface is displayed at a display panel that is in communication with a vehicle computing device of the vehicle;
receiving assistant data including a communication from an additional user, not riding in the vehicle, that is available via an automated assistant, where the automated assistant is accessible via the vehicle computing device;
in response to receiving the assistant data and receiving the vehicle application data that indicates the destination location, determining an estimated time of arrival of the user to the destination location;
in response to determining the estimated time of arrival, generating suggestion data which identifies an action of transmitting the estimated time of arrival to the additional user; and
causing, while the user is riding in the vehicle and before the user arrives at the destination location, a particular suggestion element to be rendered at a first area of the graphical user interface of the vehicle application based on the suggestion data, and a separate suggestion element to be rendered at a separate area of the graphical user interface based on the suggestion data,
wherein the particular suggestion element, when selected via touch input by the user, causes transmission of the estimated time of arrival to the additional user by an application, and
wherein the separate suggestion element, when selected via touch input by the user, causes the action to be performed by a separate application; and
causing a particular additional suggestion element to be rendered at a second area of the graphical user interface of the vehicle application and to be rendered in the second area, separate from, but along with, rendering of the particular suggestion element in the first area and the separate suggestion element in the separate area,
wherein the particular additional suggestion element, when selected via touch input by the user, enables the user to provide an utterance and causes transmission of content, determined from the utterance, to the additional user, and
wherein the particular suggestion element is presented and the particular additional suggestion element is presented based on a measurement satisfying a threshold, wherein the measurement reflects an amount of travel remaining prior to the user reaching the destination.
2. The method of claim 1 , wherein generating the suggestion data which identifies the action of transmitting the estimated time of arrival to the additional user comprises:
generating natural language content identifying the action of transmitting the estimated time of arrival to the additional user.
3. The method of claim 2 , wherein the natural language content of the particular suggestion element characterizes a spoken utterance that, when spoken by the user to the vehicle computing device, causes the action to be initialized via the automated assistant.
4. The method of claim 3 , subsequent to the natural language content being rendered at the graphical user interface:
determining the user and/or another user has provided the spoken utterance, and
causing, in response to determining the user and/or another user has provided the spoken utterance, the automated assistant agent to initialize performance of the action of transmitting the estimated time of arrival to the additional user.
5. The method of claim 1 , wherein determining the estimated time of arrival of the user to the destination location comprises determining an amount of time remaining for the vehicle to navigate the user to the destination location.
6. The method of claim 1 , wherein determining the estimated time of arrival of the user to the destination location comprises determining a distance remaining for the vehicle to navigate the user to the destination location.
7. The method of claim 1 , wherein the measurement reflects an amount of time remaining to reach the destination.
8. The method of claim 1 , wherein the measurement reflects a distance remaining to reach the destination.
9. A system, comprising:
one or more processors; and
memory configured to store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations that include:
receiving, via a vehicle application that is operational when a user is riding in a vehicle, vehicle application data indicating a destination location of the user, that corresponds to content being rendered at a graphical user interface of the vehicle application, where the graphical user interface is displayed at a display panel that is in communication with a vehicle computing device of the vehicle;
receiving assistant data including a communication from an additional user, not riding in the vehicle, that is available via an automated assistant, where the automated assistant is accessible via the vehicle computing device;
in response to receiving the assistant data, determining an estimated time of arrival of the user to the destination location;
in response to determining the estimated time of arrival, generating suggestion data which identifies an action of transmitting the estimated time of arrival to the additional user; and
causing, while the user is riding in the vehicle and before the user arrives at the destination location, a particular suggestion element to be rendered at a first area of the graphical user interface of the vehicle application based on the suggestion data, and a separate suggestion element to be rendered at a separate area of the graphical user interface based on the suggestion data,
wherein the particular suggestion element, when selected via touch input by the user, causes transmission of the estimated time of arrival to the additional user by an application, and
wherein the separate suggestion element, when selected via touch input by the user, causes the action to be performed by a separate application; and
causing a particular additional suggestion element to be rendered at a second area of the graphical user interface of the vehicle application and to be rendered in the second area, separate from, but along with rendering of the particular suggestion element in the first area,
wherein the particular additional suggestion element, when selected via touch input by the user, enables the user to provide an utterance and causes transmission of content, determined from the utterance, to the additional user, and
wherein the particular suggestion element is presented and the particular additional suggestion element is presented based on a measurement satisfying a threshold, wherein the measurement reflects an amount of travel remaining prior to the user reaching the destination.
10. The system of claim 9 , wherein generating the suggestion data which identifies the action of transmitting the estimated time of arrival to the additional user comprises:
generating natural language content identifying the action of transmitting the estimated time of arrival to the additional user.
11. The system of claim 10 , wherein the natural language content of the particular suggestion element characterizes a spoken utterance that, when spoken by the user to the vehicle computing device, causes the action to be initialized via the automated assistant.
12. The system of claim 11 , subsequent to the natural language content being rendered at the graphical user interface, the operations further include:
determining the user and/or another user has provided the spoken utterance, and
causing, in response to determining the user and/or another user has provided the spoken utterance, the automated assistant agent to initialize performance of the action of transmitting the estimated time of arrival to the additional user.
13. The system of claim 9 , wherein determining the estimated time of arrival of the user to the destination location comprises determining an amount of time remaining for the vehicle to navigate the user to the destination location.
14. The system of claim 9 , wherein determining the estimated time of arrival of the user to the destination location comprises determining a distance remaining for the vehicle to navigate the user to the destination location.
15. A non-transitory computer-readable medium configured to store instructions that, when executed by one or more processes, cause the one or more processors to perform operations that include:
receiving, via a vehicle application that is operational when a user is riding in a vehicle, vehicle application data indicating a destination location of the user, that corresponds to content being rendered at a graphical user interface of the vehicle application, where the graphical user interface is displayed at a display panel that is in communication with a vehicle computing device of the vehicle;
receiving assistant data including a communication from an additional user, not riding in the vehicle, that is available via an automated assistant, where the automated assistant is accessible via the vehicle computing device;
in response to receiving the assistant data, determining an estimated time of arrival of the user to the destination location;
in response to determining the estimated time of arrival, generating suggestion data which identifies an action of transmitting the estimated time of arrival to the additional user; and
causing, while the user is riding in the vehicle and before the user arrives at the destination location, a particular suggestion element to be rendered at a first area of the graphical user interface of the vehicle application based on the suggestion data, and a separate suggestion element to be rendered at a separate area of the graphical user interface based on the suggestion data,
wherein the particular suggestion element, when selected via touch input by the user, causes transmission of the estimated time of arrival to the additional user by an application, and
wherein the separate suggestion element, when selected via touch input by the user, causes the action to be performed by a separate application; and
causing a particular additional suggestion element to be rendered at a second area of the graphical user interface of the vehicle application and to be rendered in the second area, separate from, but along with rendering of the particular suggestion element in the first area,
wherein the particular additional suggestion element, when selected via touch input by the user, enables the user to provide an utterance and causes transmission of content, determined from the utterance, to the additional user, and
wherein the particular suggestion element is presented and the particular additional suggestion element is presented based on a measurement satisfying a threshold, wherein the measurement reflects an amount of travel remaining prior to the user reaching the destination.
16. The non-transitory computer-readable medium of claim 15 , wherein generating the suggestion data which identifies the action of transmitting the estimated time of arrival to the additional user comprises:
generating natural language content identifying the action of transmitting the estimated time of arrival to the additional user.
17. The non-transitory computer-readable medium of claim 16 , wherein the natural language content of the particular suggestion element characterizes a spoken utterance that, when spoken by the user to the vehicle computing device, causes the action to be initialized via the automated assistant.
18. The non-transitory computer-readable medium of claim 17 , subsequent to the natural language content being rendered at the graphical user interface, the operations further include:
determining the user and/or another user has provided the spoken utterance, and
causing, in response to determining the user and/or another user has provided the spoken utterance, the automated assistant agent to initialize performance of the action of transmitting the estimated time of arrival to the additional user.
19. The non-transitory computer-readable medium of claim 15 , wherein determining the estimated time of arrival of the user to the destination location comprises determining an amount of time remaining for the vehicle to navigate the user to the destination location.
20. The non-transitory computer-readable medium of claim 15 , wherein determining the estimated time of arrival of the user to the destination location comprises determining a distance remaining for the vehicle to navigate the user to the destination location.