IP Library › Granted Patent US 12,014,117
Granted Patent B2
US 12,014,117 · App. 17/301,703 · Granted Jun 18, 2024

Grouping devices for voice control

Inventors: Rohan Mutagi (Redmond, WA); He Lu (Bothell, WA); Willy Lew Yuk Vong (Seattle, WA); Michael Dale Whiteley (Redmond, WA); Fred Torok (Mercer Island, WA); Shikher Sitoke (Seattle, WA); David Ross Bronaugh (Seattle, WA); Bo Li (Seattle, WA)
Assignee: Amazon Technologies, Inc.
G06F3/167G10L15/02G10L15/18G10L15/22G10L15/26G10L17/22H04L12/2816G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,014,117
App. No.
17/301,703
Granted
Jun 18, 2024
Kind
B2
Abstract

Techniques for creating groups of devices for controlling these groups with voice commands are described herein. For instance, an environment may include an array of secondary devices (or “smart appliances”, or simply “devices”) that are configured to perform an array of operations. Users may request to create different groups of these devices, such that the users may control entire groups at a single time with individual voice commands.

Claims (51)

1. A method comprising:

receiving, from a first device, an audio signal representing sound in an environment;

performing speech-recognition on the audio signal;

identifying, based at least in part on the performing of the speech-recognition, a request associated with a group of devices that is associated with a user account;

identifying one or more devices, configured to perform one or more operations, that are part of the group of devices;

associating a second device with the user account;

identifying that the second device includes a capability to perform the one or more operations;

determining, based at least in part on identifying that the second device includes the capability, an updated group of devices by adding the second device to the group of devices; and

causing at least one of the one or more devices and the second device to perform an operation identified from the request.

2. The method as recited in claim 1 , further comprising:

receiving a request to form the group of devices;

identifying one or more devices based on the request to form the group of devices; and

storing an indication that the one or more devices are associated with the group of devices.

3. The method as recited in claim 2 , wherein the request to form the group of devices is received via user selection on a graphical user interface (GUI), the GUI including an option to request to form the group of devices by identifying at least one of the one or more devices or one or more device capabilities.

4. The method as recited in claim 1 , further comprising:

receiving, from the first device, a second audio signal; and

performing speech-recognition on the second audio signal to identify a request to form the group of devices.

5. The method as recited in claim 1 , wherein identifying the one or more devices comprises identifying that the one or more devices include one or more device capabilities.

6. The method as recited in claim 1 , further comprising:

identifying a sequence of operations performed by devices within the environment more than a threshold number of times; and

generating a suggestion that a group be formed from the devices associated with the sequence of operations.

7. The method as recited in claim 1 , further comprising:

determining that a user is in the environment; and

causing at least one of the one or more devices and the second device to perform the operation identified from the request based at least in part on the determining that the user is in the environment.

8. The method as recited in claim 7 , wherein determining that the user is in the environment comprises analyzing motion data received from a motion sensor to determine that the user is in the environment.

9. The method as recited in claim 1 , wherein identifying the one or more devices is based at least in part on a name associated with the group of devices that is identified from the request.

10. A system, comprising:

one or more processors; and

one or more computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising:

performing speech-recognition on an audio signal, the audio signal representing sound in an environment;

identifying, based at least in part on the performing of the speech-recognition, a request associated with a group of devices;

identifying one or more devices, configured to perform one or more operations, that are part of the group of devices associated with a user account;

associating a first device with the user account;

identifying that the first device includes a capability to perform the one or more operations;

determining, based at least in part on identifying that the first device includes the capability, an updated group of devices by adding the first device to the group of devices; and

causing at least one of the one or more devices and the first device to perform an operation identified from the request.

11. The system as recited in claim 10 , the acts further comprising receiving the audio signal from an input device in the environment.

12. The system as recited in claim 10 , the acts further comprising:

receiving a request to form the group of devices;

identifying one or more devices based on the request to form the group of devices; and

storing an indication that the one or more devices are associated with the group of devices.

13. The system as recited in claim 12 , wherein the request to form the group of devices is received via user selection on a graphical user interface (GUI), the GUI including an option to request to form the group of devices by identifying at least one of the one or more devices or one or more device capabilities.

14. The system as recited in claim 10 , the acts further comprising performing speech-recognition on a second audio signal to identify a request to form the group of devices.

15. The system as recited in claim 10 , wherein identifying the one or more devices comprises identifying that the one or more devices include one or more device capabilities.

16. The system as recited in claim 10 , the acts further comprising:

identifying a sequence of operations performed by devices within the environment more than a threshold number of times; and

generating a suggestion that a group be formed from the devices associated with the sequence of operations.

17. The system as recited in claim 10 , wherein the audio signal was uttered by a user, the acts further comprising:

analyzing motion data received from a motion sensor to determine that the user is in the environment; and

causing at least one of the one or more devices and the first device to perform the operation identified from the request based at least in part on the determining that the user is in the environment.

18. The system as recited in claim 10 , wherein identifying the one or more devices is based at least in part on a name associated with the group of devices that is identified from the request.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2021
From: MUTAGI, ROHAN; LU, HE; LEW YUK VONG, WILLY; WHITELEY, MICHAEL DALE; TOROK, FRED; SITOKE, SHIKHER; BRONAUGH, DAVID ROSS; LI, BO
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 057535/0138 →
Continuity (4)
Continuation 16042389 · Jul 23, 2018
Continuation 14752198 · Jun 26, 2015
Provisional Application 62134465 · Mar 17, 2015
Related Publication 20210326103A1 · Oct 21, 2021