IP Library Granted Patent US 10,129,720
Granted Patent B1
US 10,129,720 · App. 13/731,488 · Granted Nov 13, 2018

Conversation assistant

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,129,720
App. No.
13/731,488
Granted
Nov 13, 2018
Kind
B1
Abstract

A graphical user interface (GUI) on a display of an electronic device visually presents to a user a group of voice bundles that are available for use on the electronic device. Each voice bundle includes a software application for performing a call flow that includes a sequence of prompt instructions and grammar instructions executable to result in a simulated multi-step spoken interaction between the electronic device and the user. An input is received from the user entered through the GUI indicating a selection of a voice bundle from the group of voice bundles. In response to the input, a remote server is identified that stores the selected voice bundle. Network communications is established between the electronic device and the remote server. The selected voice bundle is located on the remote server. A copy of the selected voice bundle is downloaded from the remote server onto the electronic device.

Claims (68)

1. A method comprising:

providing, by a processor, a graphical user interface (GUI) on a display of an electronic device, the GUI visually presenting to a user a group of voice bundles that are available for use on the electronic device, each of the voice bundles including instructions executable within an environment provided by an application executed by the processor to perform a call flow that includes a sequence of prompt instructions and grammar instructions executable to result in a simulated multi-step spoken interaction between the electronic device and the user, each of the prompt instructions being executable to ask for information from the user and each of the grammar instructions being executable to interpret information entered through the electronic device by the user, wherein the application is configured to execute, within the environment provided by the application, a plurality of voice bundles that are independent of each other and that are downloaded onto the electronic device, the application being configured to automatically select one of the plurality of voice bundles to execute based on a user voice command by:

receiving the user voice command;

automatically disambiguating and identifying a topic associated with the user voice command; and

automatically selecting the one of the plurality of voice bundles to execute based on the automatically identified topic of the user voice command;

receiving, by the processor, an input from the user indicating a selection of a voice bundle from the group of voice bundles;

in response to the input, identifying, by the processor, a remote server that is configured to store the selected voice bundle;

establishing, by the processor, network communications between the electronic device and the remote server;

locating, by the processor, the selected voice bundle on the remote server; and

downloading, by the processor, a copy of the selected voice bundle from the remote server onto the electronic device,

wherein a voice bundle in the group of voice bundles is directed to enabling the user to perform a particular action through a multi-step spoken interaction between the user and the electronic device,

wherein the particular action is interacting with a social networking site audibly, and

wherein interacting with a social networking site audibly includes at least one of reading a newsfeed, informing the user regarding a number of friend requests that the user has, reading messages to the user, reading friend requests to the user and confirming friends of the user.

2. The method of claim 1 , wherein the GUI visually presenting the group of voice bundles comprises the GUI displaying a group of icons corresponding to voice bundles in the group.

3. The method of claim 2 , wherein receiving an input from the user comprises receiving an indication that the user has selected the icon corresponding to the selected voice bundle from the displayed group of icons.

4. The method of claim 1 , wherein each voice bundle in the group of voice bundles is directed to enabling the user to perform a particular action through a multi-step spoken interaction between the user and the electronic device.

5. The method of claim 1 , wherein the group of voice bundles includes a premium voice bundle that is configured to be used on the electronic device conditioned on receipt of payment of a fee.

6. The method of claim 5 , wherein the fee is displayed along with a graphical representation of the premium voice bundle on the GUI.

7. The method of claim 1 , wherein the group of voice bundles includes a free voice bundle that is configured to be used on the electronic device for free.

8. The method of claim 1 ,

wherein the group of voice bundles includes a private voice bundle that is configured to be accessed on the electronic device by the user conditioned on the user being authorized to receive the private voice bundle, and

wherein the user being authorized to receive the private voice bundle comprises the user entering a valid password or a valid special key through an interface corresponding to the application.

9. The method of claim 1 , further comprising:

based on downloading a copy of the selected voice bundle, executing the selected voice bundle on the electronic device for performing a task in response to information entered by the user.

10. The method of claim 9 , wherein comprises:

upon receiving the information entered by the user through the GUI, performing a call flow that simulates a multi-step interaction between the electronic device and the user and audibly or visually presents a result of executing the selected voice bundle.

11. The method of claim 10 , wherein the selected voice bundle includes media used in the call flow and parameters used to guide the call flow and the media used, the media selected from the group consisting of voice, audio, video, graphics and text.

12. The method of claim 10 , further comprising:

visually presenting, using the GUI, a transcription of the call flow.

13. The method of claim 1 , wherein the selected voice bundle is implemented using State Chart Extensible Markup Language (SCXML).

14. The method of claim 1 , wherein the application is configured to provide an interface between each of the voice bundles and a speech recognition resource, the speech recognition resource configured to recognize speech received from the user via the application.

15. The method of claim 1 , wherein receiving the input from the user indicating the selection of a voice bundle from the group of voice bundles comprises:

receiving, by the processor, an input from the user that is one of a voice input entered through a microphone coupled to the processor or an input through the GUI.

16. The method of claim 1 , wherein the plurality of voice bundles that are independent of each other include a first voice bundle configured to order a first product from a first vendor, and a second voice bundle configured to order a second product from a second vendor that is distinct from the first vendor.

17. A system comprising:

a processor; and

instructions encoded in a non-transitory machine-readable medium for execution by the processor, the instructions, when executed, configured to cause the processor to perform operations comprising:

providing a graphical user interface (GUI) on a display of an electronic device, the GUI visually presenting to a user a group of voice bundles that are available for use on the electronic device, each of the voice bundles including instructions executable within an environment provided by an application executed by the processor to perform a call flow that includes a sequence of prompt instructions and grammar instructions executable to result in a simulated multi-step spoken interaction between the electronic device and the user, each of the prompt instructions being executable to ask for information from the user and each of the grammar instructions being executable to interpret information entered through the electronic device by the user,

wherein the application is configured to execute, within the environment provided by the application, a plurality of voice bundles that are independent of each other and that are downloaded onto the electronic device, each of the voice bundles comprising instructions, the application being configured to automatically select one of the plurality of voice bundles to execute based on a user voice command by:

receiving the user voice command;

automatically disambiguating and identify a topic associated with the user command; and

automatically selecting the one of the plurality of voice bundles to execute based on the instructions of the voice bundles and the automatically identified topic of the user voice command;

receiving an input from the user indicating a selection of a voice bundle from the group of voice bundles;

in response to the input, identifying a remote server that is configured to store the selected voice bundle;

establishing network communications between the electronic device and the remote server;

locating the selected voice bundle on the remote server; and

downloading a copy of the selected voice bundle from the remote server onto the electronic device,

wherein each voice bundle in the group of voice bundles is directed to enabling the user to perform a particular action through a multi-step spoken interaction between the user and the electronic device,

wherein the particular action is one of ordering a product, requesting a service or interacting with a social networking site audibly, and

wherein interacting with a social networking site audibly includes at least one of reading a newsfeed, informing the user regarding a number of friend requests that the user has, reading messages to the user, reading friend requests to the user and confirming friends of the user.

18. The system of claim 17 , wherein the GUI visually presenting the group of voice bundles comprises the GUI displaying a group of icons corresponding to voice bundles in the group.

19. The system of claim 18 , wherein receiving an input from the user comprises receiving an indication that the user has selected the icon corresponding to the selected voice bundle from the displayed group of icons.

20. The system of claim 17 , wherein the group of voice bundles includes a premium voice bundle that is configured to be used on the electronic device conditioned on receipt of payment of a fee.

21. The system of claim 20 , wherein the fee is displayed along with a graphical representation of the premium voice bundle on the GUI.

22. The system of claim 17 , wherein the group of voice bundles includes a free voice bundle that is configured to be used on the electronic device for free.

23. The system of claim 17 , wherein the group of voice bundles includes a private voice bundle that is configured to be accessed on the electronic device upon the user entering a password or a special key through an interface corresponding to the application.

24. The system of claim 17 , including instructions that are configured to cause the processor to perform operations comprising:

based on downloading a copy of the selected voice bundle, executing the selected voice bundle on the electronic device for performing a task in response to information entered by the user.

25. The system of claim 24 , wherein the instructions that are configured to cause the processor to perform operations comprising executing the selected voice bundle includes instructions that are configured to cause the processor to perform operations comprising:

upon receiving the information entered by the user through the GUI, performing a call flow that simulates a multi-step interaction between the electronic device and the user and audibly or visually presents a result of executing the selected voice bundle.

26. The system of claim 25 , wherein the selected voice bundle includes media used in the call flow and parameters used to guide the call flow and the media used, the media selected from the group consisting of voice, audio, video, graphics and text.

27. The system of claim 25 , including instructions that are configured to cause the processor to perform operations comprising:

visually presenting, using the GUI, a transcription of the call flow.

28. The system of claim 17 , wherein the selected voice bundle is implemented using State Chart Extensible Markup Language (SCXML).

29. The system of claim 17 , wherein the application is configured to provide an interface between each of the voice bundles and a speech recognition resource, the speech recognition resource configured to recognize speech received from the user via the application.

30. The system of claim 17 , wherein receiving the input from the user indicating the selection of a voice bundle from the group of voice bundles comprises:

receiving an input from the user that is one of a voice input entered through a microphone coupled to the processor or an input through the GUI.

31. The system of claim 17 , wherein the plurality of voice bundles that are independent of each other include a first voice bundle configured to order a first product from a first vendor, and a second voice bundle configured to order a second product from a second vendor that is distinct from the first vendor.

Assignments (10)
NOTICE OF SUCCESSION OF SECURITY INTERESTS AT REEL/FRAME 04814/0387 Recorded Feb 5, 2025
From: BANK OF AMERICA, N.A., AS RESIGNING AGENT
To: GOLDMAN SACHS BANK USA, AS SUCCESSOR AGENT
Reel/Frame 070115/0445 →
NOTICE OF SUCCESSION OF SECURITY INTERESTS AT REEL/FRAME 040815/0001 Recorded Feb 3, 2025
From: BANK OF AMERICA, N.A., AS RESIGNING AGENT
To: GOLDMAN SACHS BANK USA, AS SUCCESSOR AGENT
Reel/Frame 070498/0001 →
CHANGE OF NAME Recorded May 13, 2024
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.
To: GENESYS CLOUD SERVICES, INC.
Reel/Frame 067391/0117 →
SECURITY AGREEMENT Recorded Feb 22, 2019
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.; ECHOPASS CORPORATION; GREENEDEN U.S. HOLDINGS II, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 048414/0387 →
MERGER Recorded Jan 4, 2017
From: ANGEL.COM INCORPORATED
To: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.
Reel/Frame 040840/0832 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2017
From: AHNEMANN, MICHAEL; BOUZID, AHMED TEWFIK; DULAM, ASHWINI SWAROOP REDDY; PHILLIPS, BRANDON ALAN; POPLI, PARESH; RAMCHANDER, RAJESH; RENNYSON, DAVID JAMES; SAYLOR, MICHAEL JERRY; PERERA, PRASANNA SAJEEWA NALEEN; RODRIGUEZ, BRIAM; SNITKOVSKY, VADIM
To: ANGEL.COM INCORPORATED
Reel/Frame 040832/0712 →
SECURITY AGREEMENT Recorded Dec 5, 2016
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC., AS GRANTOR; ECHOPASS CORPORATION; INTERACTIVE INTELLIGENCE GROUP, INC.; BAY BRIDGE DECISION TECHNOLOGIES, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 040815/0001 →
PATENT RELEASE (REEL:031644/FRAME:0814) Recorded Dec 2, 2016
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: GENESYS TELECOMMUNICATIONS LABORATORIES, INC., AS GRANTOR; ANGEL.COM INCORPORATED; UTOPY, INC.; SOUNDBITE COMMUNICATIONS, INC.
Reel/Frame 040798/0428 →
SECURITY AGREEMENT Recorded Nov 15, 2013
From: GENESYS TELECOMMUNICATIONS LABORATORIES, INC.; ANGEL.COM INCORPORATED; UTOPY, INC.; SOUNDBITE COMMUNICATIONS, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 031644/0814 →
SECURITY AGREEMENT Recorded Apr 22, 2013
From: UTOPY, INC.; ANGEL.COM INCORPORATED
To: GOLDMAN SACHS USA BANK
Reel/Frame 030273/0226 →
Cited By (5)
US 12,400,655 US 12,425,812 US 12,457,476 US 12,549,431 US 12,671,964