IP Library › Granted Patent US 11,986,746
Granted Patent B2
US 11,986,746 · App. 17/597,265 · Granted May 21, 2024

Information processing device and information processing method

Inventors: Jun Yokono (Tokyo, JP); Midori Kawano (Tokyo, JP); Natsuko Ozaki (Tokyo, JP); Jingjing Guo (Tokyo, JP); Jianing Wu (Tokyo, JP); Sayaka Watanabe (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
A63H11/20B25J13/088A63H2200/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,986,746
App. No.
17/597,265
Granted
May 21, 2024
Kind
B2
Abstract

An information processing device includes: a joint detection unit that detects a joint of a person striking a pose to imitate a pose of a robot device including a joint; a human body joint angle estimation unit that estimates an angle of the joint of the person; and a mapping learning unit that learns mapping between the angle of the joint of the person and an angle of the joint of the robot device in the pose.

Claims (33)

1. An information processing device, comprising:

circuitry configured to:

control a motion of a robot device to strike a pose, wherein the robot device includes a joint;

detect a joint of a person that strikes a pose to imitate the pose of the robot device;

estimate an angle of the joint of the person that imitates the pose of the robot device; and

learn mapping between the estimated angle of the joint of the person and an angle of the joint of the robot device.

2. The information processing device according to claim 1 , wherein the circuitry is further configured to control the motion of the robot device so that the robot device strikes the pose to be imitated by the person.

3. The information processing device according to claim 2 , further comprising a pose database configured to store, in advance, information regarding the pose of the robot device to be imitated by the person.

4. The information processing device according to claim 1 , wherein the circuitry is further configured to calculate a function used to derive the angle of the joint of the robot device from the angle of the joint of the person.

5. The information processing device according to claim 1 , wherein

the circuitry is further configured to detect a plurality of joints of the person from an image of the person striking the pose to imitate the pose of the robot device by using a camera, and

the plurality of joints includes the joint of the person.

6. The information processing device according to claim 1 , wherein the circuitry is further configured to detect the joint of the person as coordinates.

7. The information processing device according to claim 1 , wherein the circuitry is further configured to:

detect the joint of the person who is a target for the robot device to imitate to strike the pose; and

estimate the angle of the joint of the person who is the target for the robot device.

8. The information processing device according to claim 7 , wherein the circuitry is further configured to estimate the angle of the joint of the robot device based on a the estimated angle of the joint of the person and a learning result obtained from the mapping.

9. The information processing device according to claim 8 , wherein the circuitry is further configured to control the motion of the robot device based on the estimated angle of the joint of the person.

10. The information processing device according to claim 1 , wherein the circuitry is further configured to control a speaker included in the robot device to output a message that prompts the person to imitate a posture.

11. The information processing device according to claim 1 , wherein the circuitry is further configured to perform the detection in a case where content of a determined utterance is detected from a voice of the person collected by a microphone included in the robot device.

12. The information processing device according to claim 1 , wherein the circuitry is further configured to:

determine whether the person that strikes the pose is a registered person based on one of voice recognition or face recognition of the person; and

learn the mapping between the estimated angle of the joint of the person and the angle of the joint of the robot device based on the determination that the person that imitates the pose of the robot device is the registered person.

13. An information processing method, comprising:

controlling a motion of a robot device to strike a pose, wherein the robot device includes a joint;

detecting a joint of a person that strikes a pose to imitate the pose of the robot device;

estimating an angle of the joint of the person that imitates the pose of the robot device; and

learning mapping between the estimated angle of the joint of the person and an angle of the joint of the robot device.

14. A non-transitory computer-readable medium having stored thereon computer-executable instructions, that when executed by a processor, cause the processor to execute operations, the operations comprising:

controlling a motion of a robot device to strike a pose, wherein the robot device includes a joint;

detecting a joint of a person that strikes a pose to imitate the pose of the robot device;

estimating an angle of the joint of the person that imitates the pose of the robot device; and

learning mapping between the estimated angle of the joint of the person and an angle of the joint of the robot device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 5, 2022
From: YOKONO, JUN; KAWANO, MIDORI; OZAKI, NATSUKO; GUO, JINGJING; WU, JIANING; WATANABE, SAYAKA
To: SONY GROUP CORPORATION
Reel/Frame 059823/0402 →
Priority Claims (1)
JP 2019-128928 · Jul 11, 2019 · national
Continuity (1)
Related Publication 20220314133A1 · Oct 6, 2022