IP Library Granted Patent US 11,170,415
Granted Patent B2
US 11,170,415 · App. 16/424,783 · Granted Nov 9, 2021

Enhancing functionalities of virtual assistants and dialog systems via plugin marketplace

Inventors: Ilya Gennadyevich Gelfenbeyn (Sunnyvale, CA); Artem Goncharuk (Mountain View, CA); Pavel Aleksandrovich Sirotin (Sunnyvale, CA)
Assignee: GOOGLE LLC
G06Q30/0601
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,170,415
App. No.
16/424,783
Granted
Nov 9, 2021
Kind
B2
Abstract

A method for enhancing dialog systems is disclosed herein. The method may include maintaining an online marketplace that may have a plurality of dialog system extension elements. The plurality of dialog system extension elements may include at least one of a dialog system plugin, a dialog system add-on, a dialog system update, and a dialog system upgrade. The method may further include receiving a selection of one of the plurality of dialog system extension elements from an end user. The end user may be associated with a dialog system. The method may continue with associating the one of the plurality of dialog system extension elements with the dialog system of the end user.

Claims (42)

1. A method performed by at least one processor, the method comprising:

maintaining, in memory, an online marketplace comprising a plurality of dialog system extension elements, wherein each of the plurality of dialog system extension elements includes a dialog system plugin, a dialog system add-on, a dialog system update, or a dialog system upgrade;

receiving a speech-based user request from an end user via a dialog system interface of a dialog system associated with the end user, wherein the dialog system is associated with a virtual assistant at least partially installed on a user device of the end user and wherein one or more existing dialog system extension elements are already installed in the dialog system;

processing the user request using at least an automatic speech recognizer and a natural language processing module;

determining, based on processing the user request using at least the automatic speech recognizer and the natural language processing module, that the dialog system associated with the end user cannot process the user request with functionalities of the one or more existing dialog system extension elements of the dialog system that is associated with the end user;

in response to determining that the dialog system associated with the end user cannot process the user request with the one or more existing dialog extension elements:

identifying, from the online marketplace, a given dialog system extension element, of the plurality of dialog system extension elements, that is capable of processing the user request, wherein the given dialog extension element is in addition to the existing dialog extension elements;

providing a recommendation to the end user to authorize installing the given dialog system extension element in the dialog system;

receiving authorization for installing the given dialog system extension element in the dialog system from the end user; and

based on the received authorization:

installing the given dialog system extension element in the dialog system, and

causing the user request to be processed with the given dialog system extension element.

2. The method of claim 1 , further comprising:

selecting the given dialog extension element, for use in the recommendation, based on the given dialog extension element being designed to handle a type of user requests, and based on the processing indicating that the user request is of the type.

3. The method of claim 2 , wherein selecting the given dialog extension element, for use in the recommendation, is further based on a ranking of the given dialog extension element in the online marketplace.

4. The method of claim 1 , further comprising:

selecting the given dialog extension element, for use in the recommendation, based on a ranking of the given dialog extension element in the online marketplace.

5. The method of claim 1 , wherein installing the given dialog system extension element in the dialog system comprises:

responsive to receiving the authorization, using associated authorization data to link the given dialog extension element with the dialog system associated with the end user.

6. The method of claim 5 , wherein using the associated authorization data to link the given dialog extension element with the dialog system associated with the end user comprises embedding the given dialog extension element into the dialog system associated with the end user.

7. The method of claim 1 , wherein the given dialog extension element is a dialog system plugin.

8. A system, comprising:

a memory operable to maintain an online marketplace comprising a plurality of dialog system extension elements, wherein each of the plurality of dialog system extension elements includes a dialog system plugin, a dialog system add-on, a dialog system update, or a dialog system upgrade; and

at least one processor operable to:

receive a speech-based user request from an end user via a dialog system interface of a dialog system associated with the end user, wherein the dialog system is associated with a virtual assistant at least partially installed on a user device of the end user and wherein one or more existing dialog system extension elements are already installed in the dialog system;

process the user request using at least an automatic speech recognizer and a natural language processing module;

determine, based on processing the user request using at least the automatic speech recognizer and the natural language processing module, that the dialog system associated with the end user cannot process the user request with functionalities of the one or more existing dialog system extension elements of the dialog system that is associated with the end user;

in response to determining that the dialog system associated with the end user cannot process the user request with the existing dialog extension elements:

identify, from the online marketplace, a given dialog system extension element, of the plurality of dialog system extension elements, that is capable of processing the user request, wherein the given dialog extension element is in addition to the existing dialog extension elements;

provide a recommendation to the end user to authorize installing the given dialog system extension element in the dialog system;

receive authorization for installing the given dialog system extension element in the dialog system from the end user; and

based on the received authorization:

install the given dialog system extension element in the dialog system, and

cause the user request to be processed with the given dialog system extension element.

9. The system of claim 8 , wherein the at least one processor is further operable to:

select the given dialog extension element, for use in the recommendation, based on the given dialog extension element being designed to handle a type of user requests, and based on the processing indicating that the user request is of the type.

10. The system of claim 9 , wherein in selecting the given dialog extension element, for use in the recommendation, the at least one processor is operable to select the given dialog extension element further based on a ranking of the given dialog extension element in the online marketplace.

11. The system of claim 8 , wherein the at least one processor is further operable to:

select the given dialog extension element, for use in the recommendation, based on a ranking of the given dialog extension element in the online marketplace.

12. The system of claim 8 , wherein, in installing the given dialog system extension element in the dialog system, the at least one processor is further operable to: responsive to receiving the authorization, use associated authorization data to link the given dialog extension element with the dialog system associated with the end user.

13. The system of claim 12 , wherein in using the associated authorization data to link the given dialog extension element with the dialog system associated with the end user, the at least one processor is to embed the given dialog extension element into the dialog system associated with the end user.

14. The system of claim 8 , wherein the given dialog extension element is a dialog system plugin.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2019
From: GELFENBEYN, ILYA GENNADYEVICH; GONCHARUK, ARTEM; SIROTIN, PAVEL ALEKSANDROVICH
To: SPEAKTOIT, INC.
Reel/Frame 050633/0972 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2019
From: SPEAKTOIT, INC.
To: GOOGLE INC.
Reel/Frame 050633/0975 →
CHANGE OF NAME Recorded Oct 6, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 050638/0896 →
Continuity (3)
Continuation 15166293 · May 27, 2016
Provisional Application 62166686 · May 27, 2015
Related Publication 20190279264A1 · Sep 12, 2019
Cited By (1)
US 12,271,934