IP Library Granted Patent US 10,237,209
Granted Patent B2
US 10,237,209 · App. 15/589,645 · Granted Mar 19, 2019

Initializing a conversation with an automated agent via selectable graphical element

Inventors: Vikram Aggarwal (Palo Alto, CA); Dina Elhaddad (Mountain View, CA)
Assignee: GOOGLE LLC
H04L51/02G06F9/06G06F9/453G06F17/21G10L15/22H04L51/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,237,209
App. No.
15/589,645
Granted
Mar 19, 2019
Kind
B2
Abstract

Methods, apparatus, systems, and computer-readable media are provided for invoking an agent module in an automated assistant application in response to user selection of a selectable element presented at a graphical user interface rendered by a non-automated assistant application. The invoked agent module can be associated with other content rendered in the non-automated assistant graphical user interface, and can optionally be invoked with values that are based on user interactions via the non-automated assistant application. Responsive content can be received from the agent module in response to the invocation, and corresponding content provided by the automated assistant application via an automated assistant interface. In these and other manners, selection of the selectable element causes transition from a non-conversational interface, to a conversational automated assistant interface—where an agent (relevant to content in the non-conversational interface) is invoked in the automated assistant interface.

Claims (59)

1. A method implemented by one or more processors, the method comprising:

causing a selectable element to be displayed at a computing device that is operating a non-automated assistant application, the selectable element configured to cause an automated assistant to initialize an agent module associated with the non-automated assistant application;

receiving a selection of the selectable element;

in response to receiving the selection of the selectable element:

determining whether the automated assistant is accessible to the computing device; and

when it is determined that the automated assistant is inaccessible to the computing device:

executing a link corresponding to the selectable element to cause a default webpage to open and present speakable command phrases for communicating with the agent module.

2. The method of claim 1 , further comprising:

when it is determined that the automated assistant is accessible to the computing device:

initializing the automated assistant for communicating with the agent module.

3. The method of claim 1 , wherein the link identifies the agent module and an action to be performed by the agent module.

4. The method of claim 3 , wherein the speakable command phrases are based on the action identified in the link.

5. The method of claim 4 , further comprising:

when it is determined that the automated assistant is accessible to the computing device:

transmitting an invocation request to the agent module;

receiving responsive content from the agent module in response to the invocation request; and

providing, through an interface associated with the automated assistant, output that is based on the responsive content.

6. The method of claim 1 , further comprising:

sending a signal over a network to determine whether the automated assistant is available at a separate computing device on the network.

7. A system, comprising:

one or more processors; and

memory configured to stored instructions that, when executed by the one or more processors, cause the one or more processors to perform operations that include:

causing a selectable element to be displayed at a computing device that is operating a non-automated assistant application, the selectable element configured to cause an automated assistant to initialize an agent module associated with the non-automated assistant application;

receiving a selection of the selectable element;

in response to receiving the selection of the selectable element:

determining whether the automated assistant is accessible to the computing device; and

when it is determined that the automated assistant is inaccessible to the computing device:

executing a link corresponding to the selectable element to cause a default webpage to open and present speakable command phrases for communicating with the agent module.

8. The system of claim 7 , further comprising:

when it is determined that the automated assistant is accessible to the computing device:

initializing the automated assistant for communicating with the agent module.

9. The system of claim 7 , wherein the link identifies the agent module and an action to be performed by the agent module.

10. The system of claim 9 , wherein the speakable command phrases are based on the action identified in the link.

11. The system of claim 10 , further comprising:

when it is determined that the automated assistant is accessible to the computing device:

transmitting an invocation request to the agent module;

receiving responsive content from the agent module in response to the invocation request; and

providing, through an interface associated with the automated assistant, output that is based on the responsive content.

12. The system of claim 7 , further comprising:

sending a signal over a network to determine whether the automated assistant is available at a separate computing device on the network.

13. A non-transitory computer-readable medium configured to store instructions that, when executed by one or more processors, cause the one or more processors to perform operations that include:

causing a selectable element to be displayed at a computing device that is operating a non-automated assistant application, the selectable element configured to cause an automated assistant to initialize an agent module associated with the non-automated assistant application;

receiving a selection of the selectable element;

in response to receiving the selection of the selectable element:

determining whether the automated assistant is accessible to the computing device; and

when it is determined that the automated assistant is inaccessible to the computing device:

executing a link corresponding to the selectable element to cause a default webpage to open and present speakable command phrases for communicating with the agent module.

14. The non-transitory computer-readable medium of claim 13 , further comprising:

when it is determined that the automated assistant is accessible to the computing device:

initializing the automated assistant for communicating with the agent module.

15. The non-transitory computer-readable medium of claim 13 , wherein the link identifies the agent module and an action to be performed by the agent module.

16. The non-transitory computer-readable medium of claim 15 , wherein the speakable command phrases are based on the action identified in the link.

17. The non-transitory computer-readable medium of claim 16 , further comprising:

when it is determined that the automated assistant is accessible to the computing device:

transmitting an invocation request to the agent module;

receiving responsive content from the agent module in response to the invocation request; and

providing, through an interface associated with the automated assistant, output that is based on the responsive content.

18. The non-transitory computer-readable medium of claim 13 , further comprising:

sending a signal over a network to determine whether the automated assistant is available at a separate computing device on the network.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2017
From: AGGARWAL, VIKRAM; ELHADDAD, DINA
To: GOOGLE INC.
Reel/Frame 042335/0192 →
Continuity (1)
Related Publication 20180324115A1 · Nov 8, 2018
Cited By (1)
US 12,574,343