IP Library › Granted Patent US 11,783,833
Granted Patent B2
US 11,783,833 · App. 17/849,820 · Granted Oct 10, 2023

Multi-device output management based on speech characteristics

Inventor: Ezekiel Wade Sanborn de Asis (Santa Clara, CA)
Assignee: Amazon Technologies, Inc.
G10L15/22G06F3/165G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,783,833
App. No.
17/849,820
Granted
Oct 10, 2023
Kind
B2
Abstract

A system is provided for modifying how an output is presented via a multi-device synchronous configuration based on detecting a speech characteristic in the user input. For example, if the user whispers a request, then the system may temporarily modify how the responsive output is presented to the user via multiple devices. In one example, the system may lower the volume on all devices presented the output. In another example, the system may present the output via a single device rather than multiple devices. The system may also determine to operate in a alternate output mode based on certain non-audio data.

Claims (50)

1. A computer-implemented method, comprising:

receiving input audio data corresponding to an utterance;

performing speech processing using the input audio data to determine a command corresponding to changing an audio output mode of a first device;

determining the first device is configured to operate in a first mode corresponding to coordinated audio output with a second device;

based at least in part on the command, sending, to the first device, data causing the first device to operate in a second mode corresponding to discontinuation of coordinated audio output with the second device; and

causing the first device to output audio corresponding to operation in the second mode.

2. The computer-implemented method of claim 1 , further comprising:

processing, by the first device, input audio to determine the input audio data.

3. The computer-implemented method of claim 1 , wherein the data corresponds to discontinuation of audio output by the first device and the method further comprises:

continuing to output audio by the second device.

4. The computer-implemented method of claim 1 , wherein the second mode corresponds to a single device playback mode.

5. The computer-implemented method of claim 1 , further comprising:

determining the first mode corresponds to the first device configured to function as a first stereo channel type of speaker and the second device configured to function as a second stereo channel type of speaker,

wherein sending the data comprises sending the data causing the first device to operate in the second mode in which the first device functions as the first stereo channel type of speaker and the second stereo channel type of speaker.

6. The computer-implemented method of claim 1 , further comprising:

causing the first device to output first audio at a first volume when operating in the first mode; and

after receipt of the input audio data, causing the first device to output second audio at a second volume quieter than the first volume.

7. The computer-implemented method of claim 1 , further comprising:

receiving, from a third device, non-audio data, the non-audio data associated with an environment of the first device; and

determining to operate in the second mode based at least in part on the non-audio data.

8. The computer-implemented method of claim 1 , further comprising:

determining a first identifier corresponding to the first mode; and

prior to receipt of the input audio data, sending, to the first device, the first identifier,

wherein sending the data to the first device comprises sending a second identifier corresponding to the second mode.

9. A system, comprising:

at least one processor; and

at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:

receive input audio data corresponding to an utterance;

perform speech processing using the input audio data to determine a command corresponding to changing an audio output mode of a first device;

determine the first device is configured to operate in a first mode corresponding to coordinated audio output with a second device;

based at least in part on the command, send, to the first device, data causing the first device to operate in a second mode corresponding to discontinuation of coordinated audio output with the second device; and

cause the first device to output audio corresponding to operation in the second mode.

10. The system of claim 9 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

processing, by the first device, input audio to determine the input audio data.

11. The system of claim 9 , wherein the data corresponds to discontinuation of audio output by the first device and wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

continue to output audio by the second device.

12. The system of claim 9 , wherein the second mode corresponds to a single device playback mode.

13. The system of claim 9 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

determine the first mode corresponds to the first device configured to function as a first stereo channel type of speaker and the second device configured to function as a second stereo channel type of speaker,

wherein the instructions to send the data to the first device comprise instructions that, when executed by the at least one processor, cause the system to send the data causing the first device to operate in the second mode in which the first device functions as the first stereo channel type of speaker and the second stereo channel type of speaker.

14. The system of claim 9 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

cause the first device to output first audio at a first volume when operating in the first mode; and

after receipt of the input audio data, cause the first device to output second audio at a second volume quieter than the first volume.

15. The system of claim 9 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from a third device, non-audio data, the non-audio data associated with an environment of the first device; and

determine to operate in the second mode based at least in part on the non-audio data.

16. The system of claim 9 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

determine a first identifier corresponding to the first mode; and

prior to receipt of the input audio data, send, to the first device, the first identifier,

wherein the instructions to send the data to the first device comprise instructions that, when executed by the at least one processor, cause the system to send a second identifier corresponding to the second mode.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2022
From: SANBORN DE ASIS, EZEKIEL WADE
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 060316/0493 →
Continuity (2)
Continuation 16834874 · Mar 30, 2020
Related Publication 20230063853A1 · Mar 2, 2023