IP Library Granted Patent US 12,233,554
Granted Patent B2
US 12,233,554 · App. 17/616,315 · Granted Feb 25, 2025

Robot control system

Inventor: Kensaku Ishizuka (Tokyo, JP)
Assignee: Sony Interactive Entertainment Inc.
B25J9/1664B25J9/1653B25J9/1697B25J11/0005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,233,554
App. No.
17/616,315
Filed
Dec 3, 2021
Granted
Feb 25, 2025
Kind
B2
Art Unit
3657
USPC
700/253
Abstract

A posture estimating section acquires image data in which images of a person are recorded, to estimate a posture of the person. A motion control section controls the motion of a robot device on the basis of an estimation result of the posture estimating section. A synchronization control section synchronizes a posture of the robot device with the posture of the person estimated by the posture estimating section. A correction processing section corrects the synchronized motion of the robot device made by the synchronization control section.

Claims (14)

1. A robot control system comprising:

a posture estimating section that acquires image data in which an image of a person is recorded, and estimates a posture of the person;

a mode setting section that sets an operation mode; and

a motion control section that controls a motion of a robot device on a basis of an estimation result of the posture estimating section,

wherein the motion control section includes:

a synchronization control section that synchronizes a posture of the robot device with the posture of the person estimated by the posture estimating section,

a correction processing section that corrects a synchronized motion of the robot device made by the synchronization control section and according to the set operation mode, and

the mode setting section sets the operation mode according to an object that is grasped by the robot device such that the correction processing section corrects the synchronized motion of the robot, including the posture of the robot device in accordance with the object that is mounted to the robot device, and

wherein the correction processing section modifies the posture of the robot device differently depending upon whether the object is formed of: (i) a single rigid section; or (ii) at least two rigid sections coupled together by a flexible joint.

2. The robot control system according to claim 1 , wherein,

on a basis of an arithmetic expression for calculating a target angle of each of a plurality of joints of the robot device by using posture information of a human body, the synchronization control section uses information regarding the posture of the person estimated by the posture estimating section, to determine target angles of the plurality of joints of the robot device and cause the robot device to perform the synchronized motion, and

the correction processing section changes at least part of the arithmetic expression in the synchronization control to correct the synchronized motion.

3. The robot control system according to claim 1 , wherein the correction processing section sets a limit on an angle of a joint of the robot device.

4. The robot control system according to claim 1 , wherein, in a case where a change in the posture of the robot device indicates a predetermined pattern, the correction processing section causes the robot device to move according to a motion pattern associated with the predetermined pattern subsequently.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2021
From: ISHIZUKA, KENSAKU
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 058281/0763 →
Priority Claims (1)
JP 2019-112103 · Jun 17, 2019 · national
Continuity (1)
Related Publication 20220305654A1 · Sep 29, 2022
References Cited (25)
US 7689322B2 · Tanaka · 2010 [cited by applicant]
US 9207771B2 · Antoniac · 2015 [cited by applicant]
US 10899005B2 · Hayaishi · 2021 [cited by applicant]
US 20060020368A1 · Tanaka · 2006 [cited by applicant]
US 20100057255A1 · Ra · 2010 [cited by applicant]
US 20140378281A1 · Mazi · 2014 [cited by examiner]
US 20180250086A1 · Grubbs · 2018 [cited by examiner]
US 20180257219A1 · Oleynik · 2018 [cited by examiner]
US 20190099894A1 · Mimlitch, III · 2019 [cited by examiner]
US 20200180156A1 · Hayaishi · 2020 [cited by examiner]
US 20210387346A1 · Gillett · 2021 [cited by examiner]
JP 2002086380A · 2002 [cited by applicant]
JP 2005262415A · 2005 [cited by applicant]
JP 2005342873A · 2005 [cited by applicant]
JP 2017207901A · 2017 [cited by applicant]
WO 2016067474A1 · 2016 [cited by applicant]
WO 2017086364A1 · 2017 [cited by applicant]
International Search Report for corresponding PCT Application No. PCT/JP2020/022803, 4 pages, dated Aug. 25, 2020. [cited by applicant]
Notification for Reasons for Refusal for corresponding JP Application No. 2019-112103, 8 pages, dated Jul. 25, 2022. [cited by applicant]
Extended European Search Report for corresponding EP Application No. 20827569.3, 17 pages, dated Jun. 12, 2023. [cited by applicant]
Gobee Suresh et al: “Humanoid robot upper limb control using microsoft kinect”, 2017 International Conference on Robotics, Automation and Sciences (ICORAS), IEEE, 5 pages, dated Nov. 27, 2017. [cited by applicant]
Zhang Liang et al: “Fast human whole body motion imitation algorithm for humanoid robots”, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), IEEE, pp. 1430-1435, dated Dec. 3, 2016. [cited by applicant]
Yavsan Emrehan et al: “Gesture imitation and recognition using Kinect sensor and extreme learning machines”, Measurement, vol. 94, pp. 852-861, dated Dec. 1, 2016. [cited by applicant]
Li Chunxu et al: “Development of Kinect based teleoperation of Nao robot”, 2016 International Conference on Advanced Robotics and Mechatronics (ICARM), IEEE, pp. 133-138, dated Aug. 18, 2016. [cited by applicant]
Buss Samuel R. et al: “Selectively Damped Least Squares for Inverse Kinematics”, Journal of Graphics Tools., vol. 10, No. 3, 13 pages, dated Oct. 25, 2004. [cited by applicant]