IP Library › Granted Patent US 11,498,222
Granted Patent B2
US 11,498,222 · App. 16/814,977 · Granted Nov 15, 2022

Autonomously acting robot that stares at companion

Inventors: Yuuki Takada (Tokyo, JP); Takuma Miyamoto (Tokyo, JP); Kaname Hayashi (Tokyo, JP); Shunsuke Otsubo (Tokyo, JP); Hiroki Nakazato (Tokyo, JP); Naoto Yoshioka (Tokyo, JP); Masahiro Emoto (Tokyo, JP)
Assignee: GROOVE X, INC.
B25J11/0015B25J9/161B25J9/1679B25J9/1694B25J13/086B25J19/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,498,222
App. No.
16/814,977
Granted
Nov 15, 2022
Kind
B2
Abstract

A robot includes an operation control unit that selects a motion of the robot, a drive mechanism that executes a motion selected by the operation control unit, an eye control unit that causes an eye image to be displayed on a monitor installed in the robot, and a recognizing unit that detects a user. The eye control unit causes a pupil region included in the eye image to change in accordance with a relative position of the user and the robot. A configuration may be such that the eye control unit causes the pupil region to change when detecting a sight line direction of the user, or when the user is in a predetermined range.

Claims (122)

1. A robot, comprising:

a non-transitory computer readable medium configured to store instructions;

a display;

a sensor configured to detect a location of a user; and

a processor connected to the display and the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

generating an eye image, wherein the eye image includes a pupil region;

instructing the display to display the eye image, and

changing the pupil region in accordance with the detected location of the user, and

causing the pupil region to vibrate in the eye image.

2. The robot according to claim 1 , wherein the processor is configured to execute the instructions for changing the pupil region in response to the detected location of the user being within a predetermined range from the robot.

3. A robot, comprising:

a non-transitory computer readable medium configured to store instructions;

a display;

a sensor configured to detect a location of a user; and

a processor connected to the display and the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

generating an eye image, wherein the eye image includes a pupil region;

instructing the display to display the eye image, and

changing the pupil region in accordance with the detected location of the user,

generating an eyeball model, the eyeball model is a three-dimensional model of an eyeball, and the display is configured to project the eyeball model onto a first face virtual plane,

generating an eyelid image, and

instructing the display to display the eyelid image on a second face virtual plane, different from the first face virtual plane, wherein the eyelid image is superimposed on the eye image projected onto the first face virtual plane.

4. The robot according to claim 1 , wherein the processor is configured to execute the instructions for causing the pupil region to vibrate with an axial point as a center, while causing the axial point to move in the eye image.

5. The robot according to claim 1 , wherein the processor is configured to execute the instructions for causing the pupil region to expand or contract.

6. The robot according to claim 1 , wherein the sensor is configured to detects a sight line of the user, and

the processor is configured to execute the instructions for changing the eye image in response to the detected sight line of the user being toward the robot.

7. A robot, comprising:

a non-transitory computer readable medium configured to store instructions;

a display;

a sensor configured to detect a location of a user; and

a processor connected to the display and the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

generating an eye image, wherein the eye image includes a pupil region;

instructing the display to display the eye image, and

changing the pupil region in accordance with the detected location of the user, wherein display comprises a first display device and a second display device,

the processor is configured to execute the instructions for instructing the display to display the eye image on each of the first display device and the second display device, the first display device is closer to the detected location of the user than the second display device, and

the processor is configured to execute the instructions for changing the pupil region of the eye image on the first display device to a greater degree than the pupil region of the eye image on the second display device.

8. A robot, comprising:

a non-transitory computer readable medium configured to store instructions;

a display;

a sensor configured to detect a location of a user; and

a processor connected to the display and the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

generating an eye image, wherein the eye image includes a pupil region;

instructing the display to display the eye image, and

changing the pupil region in accordance with the detected location of the user;

a drive mechanism for executing a motion of the robot selected by the operation control unit, wherein

the processor is configured to execute the instructions for selecting the motion of directing a predetermined region of a head portion or a trunk portion of the robot toward the detected location of the user in response to an amount of change of the pupil region being greater than or equal to a predetermined value.

9. The robot according to claim 8 , wherein the display device is in the head portion of the robot.

10. The robot according to claim 8 , wherein the head portion is coupled to the trunk portion, and

the processor is configured to execute the instructions for selecting the motion of the trunk portion so that the display device faces the detected location of the user.

11. The robot according to claim 8 , wherein the processor is configured to execute the instructions for avoiding selection of the motion of directing the display device or the trunk portion of the robot toward the detected location of the user in response to the amount of change of the pupil region being less than the predetermined value.

12. A robot, comprising:

a non-transitory computer readable medium configured to store instructions;

a display;

a sensor configured to detect a location of a user; and

a processor connected to the display and the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

generating an eye image, wherein the eye image includes a pupil region;

instructing the display to display the eye image, and

changing the pupil region in accordance with the detected location of the user, wherein the processor is configured to execute the instructions for selecting the eye image from multiple kinds of eye images as a control target, and changing the pupil region based on the selected eye image.

13. A robot, comprising:

a non-transitory computer readable medium configured to store instructions;

a display;

a sensor configured to detect a location of a user; and

a processor connected to the display and the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

generating an eye image, wherein the eye image includes a pupil region;

instructing the display to display the eye image, and

changing the pupil region in accordance with the detected location of the user, wherein the processor is configured to execute the instructions for:

setting an eye of the user as a gaze point,

changing the eye image to direct a perceived sight line of the robot toward the gaze point, and

changing the perceived sight line of the robot to remain directed toward the eye of the user based on detected changes in the location of the user.

14. The robot according to claim 6 , wherein processor is configured to execute the instructions for:

setting an eye of the user as a gaze point,

changing the eye image to direct a perceived sight line of the robot toward the gaze point, and

changing the gaze point from the eye of the user in response to detected that a sight line of the user is directed away from the robot.

15. A non-transitory computer readable medium for storing instructions that when executed by a processor cause a robot to:

display an eye image on a display device in the robot, wherein the eye image comprises a pupil region;

detect a location of a user;

change the pupil region in accordance with a relative position of the detected location of the user and the robot;

generate an eyeball model, the eyeball model is a three-dimensional model of an eyeball, and the display is configured to project the eyeball model onto a first face virtual plane,

generate an eyelid image, and

instruct the display device to display the eyelid image on a second face virtual plane, different from the first face virtual plane, wherein the eyelid image is superimposed on the eye image projected onto the first face virtual plane.

16. A robot, comprising:

a camera;

a temperature sensor;

a display;

a non-transitory computer readable medium configured to store instructions; and

a processor connected to the camera, the temperature sensor, the display and the non-transitory computer readable medium, wherein the processor is configured to execute the instructions for:

generating an eye image, wherein the eye image comprises a pupil region;

instructing the display to display the eye image,

detecting a user based on first information from the camera or second information from the temperature sensor,

selecting either the first information or the second information based on a positional relationship between the robot and the user,

identifying a face region of the user,

setting the identified face region as a gaze point, and

changing a location of the pupil region in the eye image in accordance with detected changes in the gaze point.

17. The robot according to claim 16 , wherein the processor is configured to execute the instructions for causing the pupil region to vibrate in the eye image.

18. The robot according to claim 17 , wherein the processor is configured to execute the instructions for causing the pupil region to vibrate with an axial point as a center, while causing the axial point to move in the eye image.

19. A non-transitory computer readable medium for storing instructions that when executed by a processor cause a robot to:

display an eye image on a first display device and a second display device in the robot, wherein the eye image comprises a pupil region;

detect a location of a user;

change the pupil region in accordance with a relative position of the detected location of the user and the robot,

instruct the first display device to display a first eye image and the second display device to display a second eye image, the first display device is closer to the detected location of the user than the second display device, and

change the pupil region of the first eye image on the first display device to a greater degree than the pupil region of the second eye image on the second display device.

20. A non-transitory computer readable medium for storing instructions that when executed by a processor cause a robot to:

display an eye image on a display device in the robot, wherein the eye image comprises a pupil region;

detect a location of a user;

change the pupil region in accordance with a relative position of the detected location of the user and the robot, and

select a motion, for execution by a drive mechanism, of directing a predetermined region of a head portion or a trunk portion of the robot toward the detected location of the user in response to an amount of change of the pupil region being greater than or equal to a predetermined value.

21. A non-transitory computer readable medium for storing instructions that when executed by a processor cause a robot to:

display an eye image on a display device in the robot, wherein the eye image comprises a pupil region;

detect a location of a user;

change the pupil region in accordance with a relative position of the detected location of the user and the robot, and

select the eye image from multiple kinds of eye images as a control target, and change the pupil region based on the selected eye image.

22. A non-transitory computer readable medium for storing instructions that when executed by a processor cause a robot to:

display an eye image on a display device in the robot, wherein the eye image comprises a pupil region;

detect a location of a user;

change the pupil region in accordance with a relative position of the detected location of the user and the robot,

set an eye of the user as a gaze point,

change the eye image to direct a perceived sight line of the robot toward the gaze point, and

change the perceived sight line of the robot to remain directed toward the eye of the user based on detected changes in the location of the user.

23. A non-transitory computer readable medium for storing instructions that when executed by a processor cause a robot to:

display an eye image on a display device in the robot, wherein the eye image comprises a pupil region;

detect a location of a user;

change the pupil region in accordance with a relative position of the detected location of the user and the robot; and

cause the pupil region to vibrate in the eye image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2020
From: TAKADA, YUUKI; MIYAMOTO, TAKUMA; HAYASHI, KANAME; OTSUBO, SHUNSUKE; NAKAZATO, HIROKI; YOSHIOKA, NAOTO; EMOTO, MASAHIRO
To: GROOVE X, INC.
Reel/Frame 052090/0595 →
Priority Claims (1)
JP JP2017-173975 · Sep 11, 2017 · national
Continuity (2)
Continuation PCTJP2018033466 · Sep 10, 2018
Related Publication 20200206940A1 · Jul 2, 2020
Cited By (1)
US 12,454,062