IP Library › Granted Patent US 10,878,826
Granted Patent B2
US 10,878,826 · App. 16/230,797 · Granted Dec 29, 2020

Method and system for controlling multiple home devices

Inventors: Baojie Li (Santa Clara, CA); Bihai Peng (Foshan, CN); Liwei Luo (Foshan, CN); Haisong Gu (Cupertino, CA)
Assignee: MIDEA GROUP CO., LTD.
G10L17/22G06F3/167G10L15/26G10L15/22G10L17/00G10L21/00H04L12/2807
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,878,826
App. No.
16/230,797
Granted
Dec 29, 2020
Kind
B2
Abstract

System and method for controlling a home assistant device include: receiving an audio input; performing speech-to-text conversion on the audio input to obtain a textual string; searching a name list of multiple home devices to determine whether the textual string includes a respective alias of at least one home device in the name list; in accordance with a determination that the textual string includes a first alias corresponding to a first home device of a first device type, generating a first actionable intent to operate the first home device of the first device type; and in accordance with a determination that the textual string includes a second alias corresponding to a second home device of the first device type that is distinct from the first home device, generating a second actionable intent to operate the second home device of the first device type.

Claims (64)

1. A method of controlling a home assistant device, comprising:

at a computing system having one or more processors and memory:

receiving an audio input;

performing speech-to-text conversion on the audio input to obtain a textual string;

searching a name list of multiple home devices to determine whether the textual string includes a respective alias of at least one home device in the name list;

in accordance with a determination that the textual string includes a first alias corresponding to a first home device of a first device type, generating a first actionable intent to operate the first home device of the first device type; and

in accordance with a determination that the textual string includes a second alias corresponding to a second home device of the first device type that is distinct from the first home device, generating a second actionable intent to operate the second home device of the first device type,

the method further including:

receiving from a first user, in conjunction with a first home identifier, a first device registration request for the first home device of the first device type;

in response to receiving the first device registration request, determining whether another device of the first device type has already been registered under the first home identifier; and

in accordance with a determination that at least one other home device of the first device type has already been registered under the first home identifier by another user distinct from the first user, providing, to the first user, respective aliases of the at least one other home devices of the first device type that have been registered under the first home identifier.

2. The method of claim 1 , including:

registering the first home device of the first device type in response to a first device registration request received from a first user; and

registering the second home device of the first device type in response to a second device registration request received from a second user that is distinct from the first user.

3. The method of claim 2 , including:

in response to receiving the audio input, performing speaker recognition on the audio input, wherein generating the first actionable intent to operate the first home device is performed in accordance with a determination that the speaker recognition indicates that the audio input is provided by the first user, and in accordance with a determination that the first alias is registered by the first user for the first home device.

4. The method of claim 3 , including:

in accordance with a determination that the textual string includes the first alias corresponding to the first home device, and in accordance with a determination that the first alias is not an alias registered by the first user for the first home device, forgoing generation of the first actionable intent to operate the first home device.

5. The method of claim 1 , wherein providing the respective aliases of the at least one other home devices of the first device type that have been registered under the first home identifier includes:

providing an alert to the first user in accordance with a determination that a respective alias given to the first device in the first device registration request is identical to a respective alias given to at least one of the at least one other devices of the first device type that have been registered under the first home identifier.

6. The method of claim 5 , including:

receiving user confirmation for registering the first device using the respective alias in the first device registration request; and

registering the first device with the respective alias in the first device registration request in the name list in accordance with a determination that the respective alias in the first device registration request has not been given to other devices that have been registered by the first user.

7. A system for controlling a home assistant device, comprising:

one or more processors; and

memory storing instructions, the instructions, when executed by the processors, cause the processors to perform operations comprising:

receiving an audio input;

performing speech-to-text conversion on the audio input to obtain a textual string;

searching a name list of multiple home devices to determine whether the textual string includes a respective alias of at least one home device in the name list;

in accordance with a determination that the textual string includes a first alias corresponding to a first home device of a first device type, generating a first actionable intent to operate the first home device of the first device type; and

in accordance with a determination that the textual string includes a second alias corresponding to a second home device of the first device type that is distinct from the first home device, generating a second actionable intent to operate the second home device of the first device type, wherein the operations further include:

receiving from a first user, in conjunction with a first home identifier, a first device registration request for the first home device of the first device type;

in response to receiving the first device registration request, determining whether another device of the first device type has already been registered under the first home identifier; and

in accordance with a determination that at least one other home device of the first device type has already been registered under the first home identifier by another user distinct from the first user, providing, to the first user, respective aliases of the at least one other home devices of the first device type that have been registered under the first home identifier.

8. The system of claim 7 , wherein the operations further include:

registering the first home device of the first device type in response to a first device registration request received from a first user; and

registering the second home device of the first device type in response to a second device registration request received from a second user that is distinct from the first user.

9. The system of claim 8 , wherein the operations further include:

in response to receiving the audio input, performing speaker recognition on the audio input, wherein generating the first actionable intent to operate the first home device is performed in accordance with a determination that the speaker recognition indicates that the audio input is provided by the first user, and in accordance with a determination that the first alias is registered by the first user for the first home device.

10. The system of claim 9 , wherein the operations further include:

in accordance with a determination that the textual string includes the first alias corresponding to the first home device, and in accordance with a determination that the first alias is not an alias registered by the first user for the first home device, forgoing generation of the first actionable intent to operate the first home device.

11. The system of claim 7 , wherein providing the respective aliases of the at least one other home devices of the first device type that have been registered under the first home identifier includes:

providing an alert to the first user in accordance with a determination that a respective alias given to the first device in the first device registration request is identical to a respective alias given to at least one of the at least one other devices of the first device type that have been registered under the first home identifier.

12. The system of claim 11 , wherein the operations further include:

receiving user confirmation for registering the first device using the respective alias in the first device registration request; and

registering the first device with the respective alias in the first device registration request in the name list in accordance with a determination that the respective alias in the first device registration request has not been given to other devices that have been registered by the first user.

13. A non-transitory computer-readable storage medium storing instructions, the instructions, when executed by one or more processors, cause the processors to perform operations comprising:

receiving an audio input;

performing speech-to-text conversion on the audio input to obtain a textual string;

searching a name list of multiple home devices to determine whether the textual string includes a respective alias of at least one home device in the name list;

in accordance with a determination that the textual string includes a first alias corresponding to a first home device of a first device type, generating a first actionable intent to operate the first home device of the first device type; and

in accordance with a determination that the textual string includes a second alias corresponding to a second home device of the first device type that is distinct from the first home device, generating a second actionable intent to operate the second home device of the first device type, wherein the operations further include:

receiving from a first user, in conjunction with a first home identifier, a first device registration request for the first home device of the first device type;

in response to receiving the first device registration request, determining whether another device of the first device type has already been registered under the first home identifier; and

in accordance with a determination that at least one other home device of the first device type has already been registered under the first home identifier by another user distinct from the first user, providing, to the first user, respective aliases of the at least one other home devices of the first device type that have been registered under the first home identifier.

14. The computer-readable storage medium of claim 13 , wherein the operations further include:

registering the first home device of the first device type in response to a first device registration request received from a first user; and

registering the second home device of the first device type in response to a second device registration request received from a second user that is distinct from the first user.

15. The computer-readable storage medium of claim 14 , wherein the operations further include:

in response to receiving the audio input, performing speaker recognition on the audio input, wherein generating the first actionable intent to operate the first home device is performed in accordance with a determination that the speaker recognition indicates that the audio input is provided by the first user, and in accordance with a determination that the first alias is registered by the first user for the first home device.

16. The computer-readable storage medium of claim 15 , wherein the operations further include:

in accordance with a determination that the textual string includes the first alias corresponding to the first home device, and in accordance with a determination that the first alias is not an alias registered by the first user for the first home device, forgoing generation of the first actionable intent to operate the first home device.

17. The computer-readable storage medium of claim 13 , wherein providing the respective aliases of the at least one other home devices of the first device type that have been registered under the first home identifier includes:

providing an alert to the first user in accordance with a determination that a respective alias given to the first device in the first device registration request is identical to a respective alias given to at least one of the at least one other devices of the first device type that have been registered under the first home identifier.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2020
From: LI, BAOJIE; PENG, BIHAI; LUO, LIWEI; GU, HAISONG
To: MIDEA GROUP CO., LTD.
Reel/Frame 054244/0696 →
Continuity (2)
Provisional Application 62612620 · Dec 31, 2017
Related Publication 20190206411A1 · Jul 4, 2019
Cited By (29)
US 12,211,490 US 12,212,945 US 12,217,748 US 12,217,765 US 12,230,291 US 12,236,932 US 12,283,269 US 12,288,558 US 12,314,633 US 12,322,390 US 12,327,549 US 12,327,556 US 12,360,734 US 12,375,052 US 12,387,716 US 12,424,220 US 12,438,977 US 12,462,802 US 12,498,899 US 12,505,832 US 12,513,479 US 12,518,755 US 12,518,756 US 12,579,978 US 12,626,717 US 12,699,543 US 12,711,962 US 12,732,547 US 12,744,035