IP Library › Granted Patent US 12,005,579
Granted Patent B2
US 12,005,579 · App. 16/768,474 · Granted Jun 11, 2024

Robot reacting on basis of user behavior and control method therefor

Inventors: Jin-won Kim (Gyeonggi-do, KR); Jung-gap Kuk (Seoul, KR)
Assignee: Samsung Electronics Co., Ltd
B25J9/163B25J9/1697B25J11/001B25J11/0015B25J13/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,005,579
App. No.
16/768,474
Filed
May 29, 2020
Granted
Jun 11, 2024
Kind
B2
Art Unit
3667
USPC
700/250
Abstract

A robot for outputting various reactions according to user behaviors is disclosed. A control method for a robot using an artificial intelligence model, according to the present disclosure, comprises the steps of: acquiring data related to at least one user; inputting the data related to the at least one user into the artificial intelligence model as learning data so as to learn a user state for each user of which there is at least one; determining representative reactions corresponding to the user states learned on the basis of the data related to the at least one user; and inputting the input data into the artificial intelligence model so as to determine a user state of a first user and controlling the robot on the basis of a representative reaction corresponding to the determined user state, when input data related to the first user among the users, of which there is a least one, is acquired.

Claims (53)

1. A control method for a robot using an artificial intelligence model, the control method comprising:

acquiring user data related to at least one user;

training the artificial intelligence model to acquire an emotional state for each of the at least one user by inputting the user data related to the at least one user to the artificial intelligence model, the user data comprising at least one image data;

acquiring first data related to a first user, the first data including information regarding a first schedule of the first user;

determining, based on the first data, a first emotional state of the first user by inputting the first data to the trained artificial intelligence model;

controlling the robot to output a first reaction based on the first data and the first emotional state;

determining a character of the robot based on a character area of a character model including a first axis indicating whether an emotion of the robot is positive or negative and a second axis indicating an activity of the robot, wherein the character area of the character model is determined based on a feedback of the first user for the first reaction, a number of interactions with the first user and a service completion rate representing an accuracy of the first reaction of the robot;

acquiring second data related to the first user after determining the character of the robot;

determining, based on acquiring the second data related to the first user, a second emotional state of the first user by inputting the second data to the trained artificial intelligence model; and

controlling the robot to output a second reaction based on the second emotional state and the character of the robot.

2. The control method of claim 1 , further comprising:

detecting, by the robot, a second user;

determining a third emotional state by inputting third data related to the second user to the artificial intelligence model; and

controlling the robot based on a representative reaction corresponding to the determined third emotional state.

3. The control method of claim 1 , wherein training the artificial intelligence model comprises:

clustering a plurality of learning data into a plurality of clusters by inputting the plurality of learning data into the artificial intelligence model; and

labeling emotional states corresponding to respective clusters of the plurality of clusters.

4. The control method of claim 3 , further comprising:

acquiring a variance value of learning data included in a cluster generated by the clustering; and

determining a representative reaction of the cluster by analyzing the acquired variance value.

5. The control method of claim 4 , wherein the representative reaction includes at least one of a facial expression reaction, a motion reaction, or a voice reaction.

6. The control method of claim 4 , wherein controlling the robot to output the first reaction comprises:

determining a robot reaction corresponding to the representative reaction; and

outputting the robot reaction.

7. The control method of claim 6 , wherein the character of the robot is determined according to a number of interactions with the first user, the first emotional state, and a degree of completion of the robot reaction.

8. The control method of claim 1 , wherein the learning data includes at least one of the image data, voice data, data about peripheral users, or data received from peripheral devices.

9. The control method of claim 1 , wherein the artificial intelligence model is learned using unsupervised learning, and

wherein the unsupervised learning uses at least one of a K-mean clustering technique or a gaussian mixture model (GMM) technique.

10. A robot using an artificial intelligence model, the robot comprising:

a processor configured to:

acquire user data related to at least one user;

train the artificial intelligence model to acquire an emotional state for each of the at least one user by inputting the user data related to the at least one user to the artificial intelligence model as learning data, the user data comprising at least one image data;

acquire first data related to a first user, the first data including information regarding a first schedule of the first user;

determine, based on the first data, a first emotional state of the first user by inputting the first data to the trained artificial intelligence model;

output a first reaction based on the first data and the first emotional state;

determine a character of the robot based on a character area of a character model including a first axis indicating whether an emotion of the robot is positive or negative and a second axis indicating an activity of the robot, wherein the character area of the character model is determined based on a feedback of the first user for the first reaction, a number of interactions with the first user and a service completion rate representing an accuracy of the first reaction of the robot;

acquiring second data related to the first user after the character of the robot is determined;

determine, based on acquiring the second data related to the first user, a second emotional state of the first user by inputting the second data to the trained artificial intelligence model; and

output a second reaction based on the second emotional state and the character of the robot.

11. The robot of claim 10 , wherein the processor is further configured to:

detect a second user;

determine a third emotional state by inputting third data related to the second user to the artificial intelligence model; and

control the robot based on a representative reaction corresponding to the determined third emotional state.

12. The robot of claim 10 , wherein the processor is further configured to:

cluster a plurality of learning data into a plurality of clusters by inputting the plurality of learning data into the artificial intelligence model; and

label emotional states corresponding to respective clusters of the plurality of clusters.

13. The robot of claim 12 , wherein the processor is further configured to:

acquire a variance value of learning data included in a cluster generated by the clustering; and

determine a representative reaction of the cluster by analyzing the acquired variance value.

14. The robot of claim 13 , wherein the representative reaction includes at least one of a facial expression reaction, a motion reaction, or a voice reaction.

15. The robot of claim 13 , wherein the processor is further configured to:

determine a robot reaction corresponding to the representative reaction; and

control output of the robot reaction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2020
From: KIM, JIN-WON; KUK, JUNG-GAP
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 052987/0223 →
Priority Claims (1)
KR 10-2018-0010927 · Jan 29, 2018 · national
Continuity (1)
Related Publication 20210170585A1 · Jun 10, 2021