IP Library Granted Patent US 11,037,561
Granted Patent B2
US 11,037,561 · App. 16/325,635 · Granted Jun 15, 2021

Method and apparatus for voice interaction control of smart device

Inventors: Honglong Ma (Shandong Province, CN); Chuan Chen (Shandong Province, CN); Cui Liu (Shandong Province, CN)
Assignee: Goertek Inc.
G10L15/22G05D1/02G06F3/167G10L15/08G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,037,561
App. No.
16/325,635
Granted
Jun 15, 2021
Kind
B2
Abstract

A method and apparatus for voice interaction control of a smart device, wherein the method comprises: monitoring and collecting in real time a voice signal emitted by a user of the smart device (S 11 ); conducting voice recognition to the collected voice signal (S 12 ); and according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move, and if yes, acquiring a position of the user and controlling the smart device to move toward the user, to shorten a distance between the smart device and the user, and then recognizing a voice signal that the user again emits; and if not, directly according to the result of the voice recognition controlling the smart device to execute a corresponding operation (S 13 ).

Claims (61)

1. A method for voice interaction control of a smart device, wherein the method comprises:

monitoring and collecting in real time a voice signal emitted by a user of the smart device;

conducting voice recognition to the collected voice signal; and

according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move, and if yes, acquiring a position of the user and controlling the smart device to move toward the user, to shorten a distance between the smart device and the user, and then recognizing a voice signal that the user again emits; and if not, directly according to the result of the voice recognition controlling the smart device to execute a corresponding operation;

acquiring a position of the user and controlling the smart device to move toward the user comprises:

according to the collected voice signal, calculating by sound source localization to obtain position information of a sound source relative to the smart device, and according to the position information determining a distance and direction of the user relative to the smart device; and

by using the determined distance and direction of the user relative to the smart device, controlling the smart device to move toward the user.

2. The method according to claim 1 , wherein the step of acquiring a position of the user and controlling the smart device to move toward the user comprises:

controlling the smart device to move toward the user to a first preset position, wherein a distance between the first preset position and the user is less than a first distance threshold.

3. The method according to claim 2 , wherein the method further comprises:

according to a result of the voice recognition to the voice signal that the user again emits by the smart device, judging whether to control the smart device to move again, and if yes, controlling the smart device to move toward the user to a second preset position, wherein a distance between the second preset position and the user is less than a second di stance threshold.

4. The method according to claim 1 , wherein the step of conducting voice recognition to the collected voice signal comprises: recognizing out a wake-up word from the collected voice signal; and

the step of according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move comprises:

when the recognized-out wake-up word matches a saved preset wake-up word, wakening a corresponding function of the smart device and controlling the smart device to move.

5. The method according to claim 1 , wherein the step of by using the determined distance and direction of the user relative to the smart device, controlling the smart device to move toward the user comprises:

determining by distance localization position coordinates of the user and current position coordinates of the smart device in an indoor space,

according to the determined position coordinates of the user and a preset first distance threshold, calculating to obtain corresponding position coordinates of the first preset position, and

by indoor navigation, generating a preset path that uses the current position coordinates of the smart device as a starting point and the corresponding position coordinates of a first preset position as an end point, and controlling in real time the smart device to move to the first preset position along the preset path and with a preset constant step length.

6. The method according to claim 1 , wherein the step of conducting voice recognition to the collected voice signal comprises: recognizing out a wake-up word and a commanding word from the collected voice signal; and

the step of according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move comprises:

when the recognized-out wake-up word matches a saved preset wake-up word and the recognized-out commanding word does not match a saved preset commanding word, wakening a corresponding function of the smart device and controlling the smart device to move; and

when the recognized-out wake-up word matches a saved preset wake-up word and the recognized-out commanding word matches a saved preset commanding word, wakening a corresponding function of the smart device and according to an instruction of the commanding word controlling the smart device to execute the corresponding operation.

7. An apparatus for voice interaction control of a smart device, wherein the apparatus comprises: a processor and a computer readable medium, wherein the computer readable medium stores a computer readable code that is readable by the processor, and the processor executes the computer readable code to perform the following steps:

monitoring and collecting in real time a voice signal emitted by a user of the smart device;

conducting voice recognition to the collected voice signal; and

according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move, and if yes, acquiring a position of the user and controlling the smart device to move toward the user, to shorten a distance between the smart device and the user, and then recognizing a voice signal that the user again emits; and if not, directly according to the result of the voice recognition controlling the smart device to execute a corresponding operation;

acquiring a position of the user and controlling the smart device to move toward the user further comprises:

according to the collected voice signal, calculating by sound source localization to obtain position information of a sound source relative to the smart device, and according to the position information determining a distance and direction of the user relative to the smart device; and by using the determined distance and direction of the user relative to the smart device, controlling the smart device to move toward the user.

8. The apparatus according to claim 7 , wherein acquiring a position of the user and controlling the smart device to move toward the user comprises:

controlling unit is for controlling the smart device to move toward the user to a first preset position, wherein a distance between the first preset position and the user is less than a first distance threshold.

9. The apparatus according to claim 8 , wherein the processor executes the machine executable instructions further to implement steps:

according to a result of the voice recognition to the voice signal that the user again emits by the smart device, judging whether to control the smart device to move again, and if yes, controlling the smart device to move toward the user to a second preset position, wherein a distance between the second preset position and the user is less than a second distance threshold.

10. The apparatus according to claim 7 , wherein conducting voice recognition to the collected voice signal comprises: recognizing out a wake-up word from the collected voice signal; and

according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move comprises:

when the recognized-out wake-up word matches a saved preset wake-up word, wakening a corresponding function of the smart device and controlling the smart device to move.

11. The apparatus according to claim 7 , wherein conducting voice recognition to the collected voice signal comprises: recognizing out a wake-up word and a commanding word from the collected voice signal; and

according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move comprises:

when the wake-up word matches a saved preset wake-up word and the commanding word does not match a saved preset commanding word, wakening a corresponding function of the smart device and controlling the smart device to move; and when the wake-up word matches a saved preset wake-up word and the commanding word matches a saved preset commanding word, wakening a corresponding function of the smart device and according to an instruction of the commanding word controlling the smart device to execute the corresponding operation.

12. The apparatus according to claim 7 , wherein according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move comprises:

determining by distance localization position coordinates of the user and current position coordinates of the smart device in an indoor space, according to the determined position coordinates of the user and a preset first distance threshold, calculating to obtain corresponding position coordinates of a first preset position, by indoor navigation, generating a preset path that uses the current position coordinates of the smart device as a starting point and the corresponding position coordinates of the first preset position as an end point, and controlling in real time the smart device to move to the first preset position along the preset path and with a preset constant step length.

13. An apparatus for voice interaction control of a smart device, the smart device is a service robot, wherein the apparatus comprises a processor and a machine readable storage medium, the machine readable storage medium stores machine executable instructions that are executable by the processor, and the processor executes the machine executable instructions to implement steps as follows:

monitoring and collecting in real time a voice signal emitted by a user of the smart device;

conducting voice recognition to the collected voice signal; and

according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move, and if yes, acquiring a position of the user and controlling the smart device to move toward the user, to shorten a distance between the smart device and the user, and then recognizing a voice signal that the user again emits; and if not, directly according to the result of the voice recognition controlling the smart device to execute a corresponding operation;

acquiring a position of the user and controlling the smart device to move toward the user comprises:

controlling the smart device to move toward the user to a first preset position, wherein a distance between the first preset position and the user is less than a first distance threshold;

according to the collected voice signal, calculating by sound source localization to obtain position information of a sound source relative to the smart device, and according to the position information determining a distance and direction of the user relative to the smart device; and

by using the determined distance and direction of the user relative to the smart device, controlling the smart device to move toward the user.

14. The apparatus according to claim 13 , wherein the processor executes the machine executable instructions further to implement steps:

according to a result of the voice recognition to the voice signal that the user again emits by the smart device, judging whether to control the smart device to move again, and if yes, controlling the smart device to move toward the user to a second preset position, wherein a distance between the second preset position and the user is less than a second distance threshold.

15. The apparatus according to claim 13 , wherein the step of conducting voice recognition to the collected voice signal comprises: recognizing out a wake-up word from the collected voice signal; and

the step of according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move comprises:

when the recognized-out wake-up word matches a saved preset wake-up word, wakening a corresponding function of the smart device and controlling the smart device to move.

16. The apparatus according claim 13 , wherein the step of by using the determined distance and direction of the user relative to the smart device, controlling the smart device to move toward the user comprises:

determining by distance localization position coordinates of the user and current position coordinates of the smart device in an indoor space,

according to the determined position coordinates of the user and preset first distance threshold, calculating to obtain corresponding position coordinates of the first preset position, and

by indoor navigation, generating a preset path that uses the current position coordinates of the smart device as a starting point and the corresponding position coordinates of the first preset position as an end point, and controlling in real time the smart device to move to the first preset position along the preset path and with a preset constant step length.

17. The apparatus according to claim 13 , wherein the step of conducting voice recognition to the collected voice signal comprises: recognizing out a wake-up word and a commanding word from the collected voice signal; and

the step of according to a result of the voice recognition to the voice signal by the smart device, wakening a corresponding function of the smart device and judging whether to control the smart device to move comprises:

when the recognized-out wake-up word matches a saved preset wake-up word and the recognized-out commanding word does not match a saved preset commanding word, wakening a corresponding function of the smart device and controlling the smart device to move; and

when the recognized-out wake-up word matches a saved preset wake-up word and the recognized-out commanding word matches a saved preset commanding word, wakening a corresponding function of the smart device and according to an instruction of the commanding word controlling the smart device to execute the corresponding operation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2019
From: MA, HONGLONG; CHEN, CHUAN; LIU, CUI
To: GOERTEK INC.
Reel/Frame 048350/0442 →
Priority Claims (1)
CN 201610671251.1 · Aug 15, 2016 · national
Continuity (1)
Related Publication 20190214010A1 · Jul 11, 2019