Automated assistant for introducing or controlling search filter parameters at a separate application
Implementations set forth herein relate to an automated assistant that can operate as an interface between a user and a separate application to search application content of the separate application. The automated assistant can interact with existing search filter features of another application and can also adapt in circumstances when certain filter parameters are not directly controllable at a search interface of the application. For instance, when a user requests that a search operation be performed using certain terms, those terms may refer to content filters that may not be available at a search interface of the application. However, the automated assistant can generate an assistant input based on those content filters in order to ensure that any resulting search results will be filtered accordingly. The assistant input can then be submitted into a search field of the application and a search operation can be executed.
1. A method implemented by one or more processors, the method comprising:
receiving, at a computing device, a spoken utterance from a user in furtherance of causing an automated assistant to initialize a search operation using an application that is separate from the automated assistant,
wherein the spoken utterance identifies one or more terms;
determining, based on the spoken utterance, whether the one or more terms of the spoken utterance is associated with one or more selectable graphical user interface (GUI) elements rendered at an interface of the application,
wherein the one or more selectable GUI elements control one or more filter parameters of the search feature of the application; and
when the one or more terms of the spoken utterance correspond to the one or more selectable GUI elements rendered at the interface of the application:
causing one or more particular selectable GUI elements of the one or more selectable GUI elements to control one or more particular filter parameters, and
causing the application to initialize the search operation according to the one or more particular filter parameters.
2. The method of claim 1 , wherein causing the application to initialize the search operation includes:
causing a search field of the application to include the one or more terms identified in the spoken utterance, without the search field including the one or more particular filter parameters.
3. The method of claim 1 , further comprising:
when the one or more terms of the spoken utterance do not correspond to the one or more selectable GUI elements rendered at the interface of the application:
generating an application input that characterizes the one or more particular filter parameters, and
causing the application to initialize the search operation using the application input.
4. The method of claim 3 , wherein causing the application to initialize the search operation using the application input includes:
causing a search field of the application to include the application input,
wherein the application input identifies the one or more particular filter parameters.
5. The method of claim 4 , wherein the application input includes a non-alphanumeric character that is selected based on the one or more particular filter parameters.
6. The method of claim 1 , wherein the spoken utterance includes a request for the automated assistant to: search for certain content using the application, and subsequently render the certain content for the user.
7. The method of claim 6 , further comprising:
when the one or more terms of the spoken utterance do not correspond to the one or more selectable GUI elements rendered at the interface of the application:
accessing particular application content that satisfies the one or more particular filter parameters, and
causing, subsequent to accessing the particular application content, the automated assistant to render audible content that is based on the particular application content.
8. The method of claim 1 , further comprising:
when the one or more terms of the spoken utterance correspond to the one or more selectable GUI elements rendered at the interface of the application:
causing, based on the search operation, multiple different search results to be rendered at another interface of the application,
receiving, subsequent to rendering the multiple different search results, an additional spoken utterance from the user,
wherein the additional spoken utterance identifies one or more additional terms for identifying a subset of the multiple different search results, and
causing, in response to receiving the additional spoken utterance, the multiple different search results to be filtered according to the one or more additional terms.
9. The method of claim 8 , wherein causing the multiple different search results to be filtered according to the one or more additional terms includes:
determining that one or more other selectable GUI elements rendered at the other interface correspond to the one or more additional terms, and
selecting the one or more other selectable GUI elements according to the one or more additional terms.
10. A system comprising:
memory storing instructions;
one or more processors operable to execute the instructions to:
receive a spoken utterance from a user in furtherance of causing an automated assistant to initialize a search operation using an application that is separate from the automated assistant,
wherein the spoken utterance identifies one or more terms;
determine, based on the spoken utterance, whether the one or more terms of the spoken utterance is associated with one or more selectable graphical user interface (GUI) elements rendered at an interface of the application,
wherein the one or more selectable GUI elements control one or more filter parameters of the search feature of the application; and
when the one or more terms of the spoken utterance correspond to the one or more selectable GUI elements rendered at the interface of the application:
cause one or more particular selectable GUI elements of the one or more selectable GUI elements to control one or more particular filter parameters, and
cause the application to initialize the search operation according to the one or more particular filter parameters.
11. The system of claim 10 , wherein in causing the application to initialize the search operation one or more of the processors are to:
cause a search field of the application to include the one or more terms identified in the spoken utterance, without the search field including the one or more particular filter parameters.
12. The system of claim 10 , wherein one or more of the processors are further operable to execute the instructions to:
when the one or more terms of the spoken utterance do not correspond to the one or more selectable GUI elements rendered at the interface of the application:
generate an application input that characterizes the one or more particular filter parameters, and
cause the application to initialize the search operation using the application input.
13. The system of claim 10 , wherein in causing the application to initialize the search operation using the application input one or more of the processors are to:
cause a search field of the application to include the application input,
wherein the application input identifies the one or more particular filter parameters.
14. The system of claim 13 , wherein the application input includes a non-alphanumeric character that is selected based on the one or more particular filter parameters.
15. The system of claim 10 , wherein the spoken utterance includes a request for the automated assistant to: search for certain content using the application, and subsequently render the certain content for the user.
16. The system of claim 15 , wherein one or more of the processors are further operable to execute the instructions to:
when the one or more terms of the spoken utterance do not correspond to the one or more selectable GUI elements rendered at the interface of the application:
access particular application content that satisfies the one or more particular filter parameters, and
cause, subsequent to accessing the particular application content, the automated assistant to render audible content that is based on the particular application content.
17. The system of claim 16 , wherein one or more of the processors are further operable to execute the instructions to:
when the one or more terms of the spoken utterance correspond to the one or more selectable GUI elements rendered at the interface of the application:
cause, based on the search operation, multiple different search results to be rendered at another interface of the application,
receive, subsequent to rendering the multiple different search results, an additional spoken utterance from the user,
wherein the additional spoken utterance identifies one or more additional terms for identifying a subset of the multiple different search results, and
cause, in response to receiving the additional spoken utterance, the multiple different search results to be filtered according to the one or more additional terms.
18. The system of claim 17 , wherein in causing the multiple different search results to be filtered according to the one or more additional terms one or more of the processors are to:
determine that one or more other selectable GUI elements rendered at the other interface correspond to the one or more additional terms, and
select the one or more other selectable GUI elements according to the one or more additional terms.