IP Library Granted Patent US 11,797,268
Granted Patent B2
US 11,797,268 · App. 17/533,655 · Granted Oct 24, 2023

Audio-based load control system

Inventors: Rhodes B. Baker (Allentown, PA); Matthew V. Harte (Stewartsville, PA); Jeffrey Karc (Danielsville, PA); Galen E. Knode (Macungie, PA); John B. Nill (Emmaus, PA); Jaykrishna A. Shukla (Mays Landing, NJ)
Assignee: Lutron Technology Company LLC
G06F3/167G10L15/22G10L15/30H05B47/115H05B47/12H05B47/19G10L2015/223G10L2015/228H05B47/13H05B47/195
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,797,268
App. No.
17/533,655
Granted
Oct 24, 2023
Kind
B2
Abstract

A scalable, distributed load control system for home automation based on a network of microphones may include control devices (e.g., load control devices) that may include microphones for monitoring the system and communicating audio data to a cloud server for processing. The control devices of the load control system may receive a single voice command and may be configured to choose one of the load control devices to transmit the voice command to the cloud server. The load control devices may be configured to receive a voice command, control a connected load according to the voice command if the voice command is a validated command, and transmit the voice command to a voice service in the cloud if the voice command is not a validated command. The voice service to which the load control devices transmit audio data to may be selectable.

Claims (76)

1. A load control device for controlling an amount of power to an electrical load, the load control device comprising:

a microphone for receiving voice commands;

a communication circuit;

a controllably conductive device configured to control the amount of power to the electrical load; and

a control circuit operably connected to the microphone, the communication circuit, and the controllably conductive device, the control circuit configured to:

receive a wake word;

receive a voice command following the wake word;

determine whether the voice command is associated with a voice service of a group of voice services;

based at least in part on a determination that the voice command is associated with a voice service of the group of voice services, transmit the voice command to the associated voice service;

based at least in part on a determination that the voice command is not associated with a voice service of the group of voice services, transmit the voice command to a default voice service of the group of voice services;

receive a response from one of the associated voice service or the default voice service;

interpret the response to determine whether the response comprises a command for controlling the electrical load; and

based at least in part on a determination that the response comprises a command for controlling the electrical load, control the controllably conductive device to control the amount of power to the electrical load in response to the command.

2. The load control device of claim 1 , wherein the control circuit is further configured to cause the response to be played via a speaker based at least in part on determining that the response does not comprise a command for controlling the electrical load.

3. The load control device of claim 2 , wherein the speaker is integral with the load control device.

4. The load control device of claim 2 , wherein the speaker is separate from the load control device and wherein to cause the response to be played via the speaker comprises to communicate the response to the speaker via the communication circuit.

5. A method comprising:

receiving a wake word;

receiving a voice command following the wake word;

determining whether the voice command is associated with a voice service of a group of voice services;

based at least in part on determining that the voice command is associated with a voice service of the group of voice services, transmitting the voice command to the associated voice service;

based at least in part on determining that the voice command is not associated with a voice service of the group of voice services, transmitting the voice command to a default voice service of the group of voice services;

receiving a response from one of the associated voice service or the default voice service;

interpreting the response to determine whether the response comprises a command for controlling an electrical load; and

based at least in part on determining that the response comprises a command for controlling the electrical load, controlling an amount of power to the electrical load in response to the command.

6. The method of claim 5 , further comprising causing the response to be played via a speaker based at least in part on determining that the response does not comprise a command for controlling the electrical load.

7. At least one non-transitory computer-readable storage medium comprising executable instructions for configuring at least one processor to:

receive a wake word;

receive a voice command following the wake word;

determine whether the voice command is associated with a voice service of a group of voice services;

based at least in part on a determination that the voice command is associated with a voice service of the group of voice services, transmit the voice command to the associated voice service;

based at least in part on a determination that the voice command is not associated with a voice service of the group of voice services, transmit the voice command to a default voice service of the group of voice services;

receive a response from one of the associated voice service or the default voice service;

interpret the response to determine whether the response comprises a command for controlling an electrical load; and

based at least in part on a determination that the response comprises a command for controlling the electrical load, control an amount of power to the electrical load in response to the command.

8. The at least one non-transitory computer-readable storage medium of claim 7 , the executable instructions further for configuring the at least one processor to cause the response to be played via a speaker based at least in part on determining that the response does not comprise a command for controlling the electrical load.

9. The load control device of claim 1 , the control circuit further configured to:

determine that the wake word comprises a generic wake word;

based at least in part on a determination that the wake word comprises the generic wake word, process the received voice command to determine whether a word of interest is present, wherein to determine whether the voice command is associated with a voice service of the group of voice services comprises to determine

whether the determined word of interest is associated with a voice service of the group of voice services; and

based at least in part on determining that the determined word of interest is associated with a voice service of the group of voice services, transmit the voice command to the associated voice service.

10. The load control device of claim 9 , wherein, based at least in part on a determination that the determined word of interest is not associated with a voice service of the group of voice services, transmit the voice command to the default voice service of the of the group of voice services.

11. The load control device of claim 1 , wherein:

the control circuit is further configured to receive from a mobile application a selection of one of the voice services of the group of voice services; and

to transmit the voice command to the default voice service further comprises to transmit the voice command to the selected voice service.

12. The load control device of claim 1 , the control circuit further configured to:

start a timer upon transmitting the voice command;

determine whether a response is received prior to the timer exceeding a threshold; and

based at least in part on determining that a response is not received prior to the timer exceeding the threshold, transmit the voice command to a second voice service of the group of voice services.

13. The load control device of claim 1 , further configured to be installed in an electrical wallbox.

14. The method of claim 5 , wherein transmitting the voice command to the at least one voice service further comprises:

determining that the wake word comprises a generic wake word;

based at least in part on determining that the wake word comprises the generic wake word, processing the received voice command to determine whether a word of interest is present, wherein the determining whether the voice command is associated with a voice service of the group of voice services comprises

determining whether the determined word of interest is associated with a voice service of the group of voice services; and

based at least in part on determining that the determined word of interest is associated with a voice service of the group of voice services, transmitting the voice command to the associated voice service.

15. The method of claim 14 , based at least in part on determining that the determined word of interest is not associated with a voice service of the group of voice services, transmitting the voice command to the default voice service of the of the group of voice services.

16. The method of claim 5 , further comprising:

receiving from a mobile application a selection of one of the voice services of the group of voice services, wherein transmitting the voice command to the default voice service comprises

transmitting the voice command to the selected voice service.

17. The method of claim 5 further comprising

starting a timer upon transmitting the voice command;

determining whether a response is received prior to the timer exceeding a threshold; and

based at least in part on determining that a response is not received prior to the timer exceeding the threshold, transmitting the voice command to a second voice service of the group of voice services.

18. The at least one non-transitory computer-readable storage medium of claim 7 , wherein to transmit the voice command to the at least one voice service further comprises:

determine that the wake word comprises a generic wake word;

based at least in part on a determination that the wake word comprises the generic wake word, process the received voice command to determine whether a word of interest is present, wherein to determine whether the voice command is associated with a voice service of the group of voice services comprises to;

determine whether the determined word of interest is associated with a voice service of the group of voice services; and

based at least in part on a determination that the determined word of interest is associated with a voice service of the group of voice services, transmit the voice command to the associated voice service.

19. The at least one non-transitory computer-readable storage medium of claim 18 , based at least in part on a determination that the determined word of interest is not associated with a voice service of the group of voice services, transmit the voice command to the default voice service of the of the group of voice services.

20. The at least one non-transitory computer-readable storage medium of claim 7 , the executable instructions further for configuring the at least one processor to:

receive from a mobile application a selection of one of the voice services of the group of voice services as the default voice service; and

transmit the voice command to the default voice service.

21. The at least one non-transitory computer-readable storage medium of claim 7 , the executable instructions further for configuring the at least one processor to

start a timer upon transmitting the voice command;

determine whether a response is received prior to the timer exceeding a threshold;

based at least in part on a determination that a response is not received from the first voice service prior to the timer exceeding the threshold, transmit the voice command to a second voice service of the group of voice services.

Continuity (4)
Continuation 16906011 · Jun 19, 2020
Continuation 15891079 · Feb 7, 2018
Provisional Application 62455973 · Feb 7, 2017
Related Publication 20220113936A1 · Apr 14, 2022