IP Library Granted Patent US 11,790,902
Granted Patent B2
US 11,790,902 · App. 16/781,773 · Granted Oct 17, 2023

Speech-processing system

Inventors: Timothy Whalin (Seattle, WA); Catherine Michelle Loo (Los Angeles, CA); Calvin Phuong Nguyen (Seattle, WA)
Assignee: Amazon Technologies, Inc.
G10L15/22G06F40/30G10L15/1815G10L15/1822G06F40/279G06F40/295G06F40/35G10L13/04G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,790,902
App. No.
16/781,773
Granted
Oct 17, 2023
Kind
B2
Abstract

A system may include first and second speech-processing systems. The first speech-processing system may process received audio data and determine that a command represented therein is associated with a second speech-processing system. The first speech-processing system may send command data to the second speech-processing system and receive response data in return. The first speech-processing system may then process the response data to determine second response data that includes an indication of the second speech-processing system and cause output of audio corresponding to the second response data.

Claims (95)

1. A method for processing data representing a spoken command, the method comprising:

receiving, from a voice-controlled device, first audio data representing an utterance;

determining that the first audio data includes:

a first portion of audio data representing a wakeword corresponding to a first speech-processing system having a first style of synthesized speech, and

a second portion of audio data representing a command;

determining a domain associated with the command;

determining that the domain is associated with a second speech-processing system having a second style of synthesized speech;

determining an indication that the second speech-processing system is capable of processing command data including the command;

sending, from the first speech-processing system to the second speech-processing system, the command data;

receiving, from the second speech-processing system, a first response to the command, the first response including a representation of first natural language corresponding to the second style of synthesized speech;

determining, using the first speech-processing system and based at least in part on the first response, a second response to the command, the second response including a representation of second natural language corresponding to the first style of synthesized speech; and

sending second audio data to the voice-controlled device corresponding to the second response associated with the first style of synthesized speech.

2. The method of claim 1 , further comprising:

determining that the command corresponds to an action set to occur at a later time; and

sending, from the second speech-processing system to the voice-controlled device, a second command to execute the action,

wherein the second audio data includes a representation of a name of the second speech-processing system.

3. The method of claim 1 , further comprising:

receiving, from the voice-controlled device, third audio data representing a second utterance;

determining that the third audio data corresponds to a second command;

determining that the second command corresponds to a user device proximate a user; and

sending, to the user device via an application programming interface, an instruction corresponding to the second command.

4. A computer-implemented method comprising:

receiving input data corresponding to a command;

determining, using a first natural-understanding system, that the command is associated with a second natural-understanding system;

determining a first indication that the second natural-understanding system is capable of processing first data corresponding to the command;

sending, from the first natural-understanding system to the second natural-understanding system, the first data;

receiving, from the second natural-understanding system, second data corresponding to a first response to the command, the second data including a second indication of the second natural-understanding system;

determining, by the first natural-understanding system and based at least in part on the second data, third data corresponding to a second response to the command, the third data including a third indication of the first natural-understanding system; and

causing output corresponding to the third data associated with the first natural-understanding system.

5. The computer-implemented method of claim 4 , further comprising:

prior to causing the output, determining that the second natural-understanding system is associated with a request for permission;

determining to cause second output corresponding to the request for permission before sending the first data; and

receiving fourth input data corresponding to the request for permission,

wherein the third data further includes a representation of the request for permission.

6. The computer-implemented method of claim 4 , further comprising:

determining that the command corresponds to a second output of the second natural-understanding system, the second output occurring after the output,

wherein the third data includes a representation of a name of the second natural-understanding system.

7. The computer-implemented method of claim 4 , further comprising:

determining that receiving the input data is associated with a first device; and

determining that causing the output is associated with a second device,

wherein the third data includes a representation of a name of the second natural-understanding system.

8. The computer-implemented method of claim 4 , further comprising:

determining that receiving the input data is associated with a first device;

determining a user account associated with the first device; and

determining that the user account includes a fourth indication of the second natural-understanding system,

wherein the third data includes a representation of a name of the second natural-understanding system.

9. The computer-implemented method of claim 4 , further comprising:

determining that the input data includes a representation of a wakeword associated with the first natural-understanding system.

10. The computer-implemented method of claim 4 , wherein determining that the command is associated with the second natural-understanding system comprises:

determining a domain corresponding to the input data; and

determining that the second natural-understanding system corresponds to the domain.

11. The computer-implemented method of claim 4 , further comprising:

receiving second audio data corresponding to a second command;

determining that the second command is associated with the second natural-understanding system; and

sending, to the second natural-understanding system, a third command to process third audio data.

12. The computer-implemented method of claim 4 , further comprising:

determining that the second data lacks first information;

sending, from the first natural-understanding system to the second natural-understanding system, fourth data corresponding to a request for the first information; and

receiving, from the second natural-understanding system, fifth data corresponding to the first information.

13. A computing device comprising:

at least one processor; and

at least one memory including instructions that, when executed by the at least one processor, cause the computing device to:

receive input data corresponding to a command;

determine, using a first natural-understanding system, that the command is associated with a second natural-understanding system;

determine a first indication that the second natural-understanding system is capable of processing first data corresponding to the command;

send, from the first natural-understanding system to the second natural-understanding system, the first data;

receive, from the second natural-understanding system, second data corresponding to a first response to the command, the second data including a second indication of the second natural-understanding system;

determine, by the first natural-understanding system and based at least in part on the second data, third data corresponding to a second response to the command, the third data including a third indication of the first natural-understanding system; and

cause output corresponding to the third data associated with the first natural-understanding system.

14. The computing device of claim 13 , wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the computing device to:

prior to causing the output, determine that the second natural-understanding system is associated with a request for permission,

determine to cause second output corresponding to the request for permission before sending the first data; and

receive fourth input data corresponding to the request for permission,

wherein the third data further includes a representation of the request for permission.

15. The computing device of claim 13 , wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the computing device to:

determine that the command corresponds to a second output of the second natural-understanding system, the second output occurring after the output,

wherein the third data includes a representation of a name of the second natural-understanding system.

16. The computing device of claim 13 , wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the computing device to:

determine that receiving the input data is associated with a first device; and

determine that causing the output is associated with a second device,

wherein the third data includes a representation of a name of the second natural-understanding system.

17. The computing device of claim 13 , wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the computing device to:

determine that receiving the input data is associated with a first device;

determine a user account associated with the first device; and

determine that the user account includes a fourth indication of the second natural-understanding system,

wherein the third data includes a representation of a name of the second natural-understanding system.

18. The computing device of claim 13 , wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the computing device to:

determine that the input data includes a representation of a wakeword associated with the first natural-understanding system.

19. The computing device of claim 13 , wherein the at least one memory further includes instructions to determine that the command is associated with the second natural-understanding system and that, when executed by the at least one processor, further cause the computing device to:

determine a domain corresponding to the input data; and

determine that the second natural-understanding system corresponds to the domain.

20. The computing device of claim 13 , wherein the at least one memory further includes instructions that, when executed by the at least one processor, further cause the computing device to:

determine that the second data lacks first information;

send, from the first natural-understanding system to the second natural-understanding system, fourth data corresponding to a request for the first information; and

receive, from the second natural-understanding system, fifth data corresponding to the first information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2020
From: WHALIN, TIMOTHY; LOO, CATHERINE MICHELLE; NGUYEN, CALVIN PHUONG
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 051717/0399 →
Continuity (1)
Related Publication 20210241760A1 · Aug 5, 2021
Cited By (2)
US 12,482,465 US 12,518,109