IP Library Granted Patent US 11,488,592
Granted Patent B2
US 11,488,592 · App. 16/580,836 · Granted Nov 1, 2022

Communication robot and method for operating the same

Inventors: Sang Won Kim (Seoul, KR); Sun Chan Park (Seoul, KR)
Assignee: LG ELECTRONICS INC.
G10L15/22A61H7/007A61H9/0071A61H15/0078A61H99/00G06V40/161G10L15/08A61H2201/501A61H2201/5007A61H2201/5041A61H2201/5043A61H2201/5046A61H2201/5048A61H2203/0431A61H2230/805A61H2230/825A61H2230/855G10L2015/088G10L2015/223H04L67/12H04W84/042
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,488,592
App. No.
16/580,836
Granted
Nov 1, 2022
Kind
B2
Abstract

A communication robot for operating a massage providing apparatus by executing an artificial intelligence algorithm (AI) and/or machine learning algorithm in a 5G environment connected for the Internet of things and a method for operating the communication robot are provided. The method for operating the communication robot may include acquiring a spoken utterance of a user positioned within a prescribed range from the massage providing apparatus, tracking a spoken utterance direction of the user from the spoken utterance of the user, orienting the communication robot towards the spoken utterance direction of the user, acquiring a voice command included in the spoken utterance in relation to operation of the massage providing apparatus, and operating the massage providing apparatus according to the voice command.

Claims (70)

1. A method of operating a communication robot configured to interwork with a massage providing apparatus, the method comprising:

acquiring, by a controller, a spoken utterance of a user positioned within a predetermined range from the massage providing apparatus;

tracking a spoken utterance direction of the user from the spoken utterance of the user;

orienting the communication robot toward the spoken utterance direction of the user;

acquiring a voice command included in the spoken utterance in relation to an operation of the massage providing apparatus; and

operating the massage providing apparatus according to the voice command,

wherein the method further includes, after acquiring the voice command and before operating the massage providing apparatus according to the voice command:

acquiring an image of the user positioned within the predetermined range from the massage providing apparatus; and

calculating a facial direction from the image of the user,

wherein the operating the massage providing apparatus includes:

controlling the communication robot to gaze at a massage portion included in the voice command; and

operating the massage providing apparatus to massage the massage portion included in the voice command, and

wherein the controlling the communication robot includes:

determining a final direction of the communication robot's gaze based on the facial direction and a direction of the massage portion included in the voice command; and

restoring the communication robot to a previous orientation of the communication robot after an elapse of a fixed period of time during which the communication robot is oriented toward the massage portion.

2. The method of claim 1 , wherein a predetermined start word is included in a memory of the communication robot, and

wherein the acquiring the spoken utterance includes detecting the start word in the spoken utterance.

3. The method of claim 2 , wherein the acquiring the voice command occurs after detecting the start word.

4. The method of claim 1 , wherein the orienting the communication robot includes directing a gaze of the communication robot toward the spoken utterance direction of the user.

5. The method of claim 1 , further comprising:

acquiring an image of a user's gesture of massaging a massage portion in relation to the operation of the massage providing apparatus; and

operating the massage providing apparatus according to the image of the user's gesture.

6. The method of claim 5 , wherein a predetermined start word is included in a memory of the communication robot,

wherein the acquiring the spoken utterance includes detecting the start word in the spoken utterance, and

wherein acquiring the image of the user's gesture occurs after detecting the start word.

7. A communication robot configured to interwork with a massage providing apparatus, the communication robot comprising:

a memory storing one or more instructions; and

one or more processors configured to execute the one or more instructions to:

acquire a spoken utterance of a user positioned within a predetermined range from the massage providing apparatus,

track a spoken utterance direction of the user from the spoken utterance of the user,

orient the communication robot toward the spoken utterance direction of the user,

acquire a voice command included in the spoken utterance in relation to an operation of the massage providing apparatus, and

operate the massage providing apparatus according to the voice command,

wherein the one or more processors are further configured to, after acquiring the voice command and before operating the massage providing apparatus according to the voice command:

acquire an image of the user positioned within the predetermined range from the massage providing apparatus; and

calculate a facial direction from the image of the user,

wherein the operating the massage providing apparatus includes:

controlling the communication robot to gaze at a massage portion included in the voice command; and

operating the massage providing apparatus to massage the massage portion included in the voice command, and

wherein the controlling the communication robot includes:

determining a final direction of the communication robot's gaze based on the facial direction and a direction of the massage portion included in the voice command; and

restoring the communication robot to a previous orientation of the communication robot after an elapse of a fixed period of time during which the communication robot is oriented toward the massage portion.

8. The communication robot of claim 7 , further comprising a memory storing a predetermined start word,

wherein the one or more processors are further configured to detect the start word in the spoken utterance.

9. The communication robot of claim 8 , wherein the one or more processors are further is configured to acquire the voice command after detecting the start word.

10. The communication robot of claim 7 , wherein the one or more processors are further is configured to direct a gaze of the communication robot toward the spoken utterance direction of the user.

11. The communication robot of claim 7 , wherein the one or more processors are further is configured to acquire an image of a user's gesture of massaging a massage portion in relation to the operation of the massage providing apparatus, and to operate the massage providing apparatus according to the image of the user's gesture.

12. The communication robot of claim 11 , further comprising a memory storing a predetermined start word,

wherein the one or more processors are further configured to detect the start word in the spoken utterance, and to acquire the image of the user's gesture after detecting the start word.

13. A massage system comprising:

a massage providing apparatus; and

a communication robot configured to interwork with the massage providing apparatus, the communication robot including:

a memory storing one or more instructions; and

one or more processors configured to execute the one or more instructions to:

acquire a spoken utterance of a user positioned within a predetermined range from the massage providing apparatus,

track a spoken utterance direction of the user from the spoken utterance of the user,

orient the communication robot toward the spoken utterance direction of the user,

acquire a voice command included in the spoken utterance in relation to an operation of the massage providing apparatus, and

operate the massage providing apparatus according to the voice command,

wherein the one or more processors are further configured to, after acquiring the voice command and before operating the massage providing apparatus according to the voice command:

acquire an image of the user positioned within the predetermined range from the massage providing apparatus; and

calculate a facial direction from the image of the user,

wherein the operating the massage providing apparatus includes:

controlling the communication robot to gaze at a massage portion included in the voice command; and

operating the massage providing apparatus to massage the massage portion included in the voice command, and

wherein the controlling the communication robot includes:

determining a final direction of the communication robot's gaze based on the facial direction and a direction of the massage portion included in the voice command; and

restoring the communication robot to a previous orientation of the communication robot after an elapse of a fixed period of time during which the communication robot is oriented toward the massage portion.

14. The massage system of claim 13 , wherein the communication robot further comprises a memory storing a predetermined start word, and

wherein the one or more processors are further configured to detect the start word in the spoken utterance and to acquire the voice command after detecting the start word.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2019
From: KIM, SANG WON; PARK, SUN CHAN
To: LG ELECTRONICS INC.
Reel/Frame 050476/0796 →
Priority Claims (1)
KR 10-2019-0082619 · Jul 9, 2019 · national
Continuity (1)
Related Publication 20200035237A1 · Jan 30, 2020
Cited By (7)
US 12,285,379 US 12,290,486 US 12,295,900 US 12,329,711 US 12,402,686 US 12,447,099 US 12,478,546