IP Library Granted Patent US 12,358,151
Granted Patent B2
US 12,358,151 · App. 18/246,498 · Granted Jul 15, 2025

Robot control system and control device

Inventors: Kozo Moriyama (Kyoto, JP); Shin Kameyama (Kyoto, JP); Truong Gia Vu (Kyoto, JP); Lucas Brooks (Kyoto, JP)
Assignee: JOHNAN CORPORATION
B25J9/1697
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,358,151
App. No.
18/246,498
Granted
Jul 15, 2025
Kind
B2
Abstract

Provided is a robot control system ( 1 ) including a robot ( 200 ), at least one first camera ( 300 ) attached or fixed to the robot, a second camera ( 400 ) attached to a worker, and a control device ( 100 ). The control device controls the robot by specifying a position of a workpiece W or a component, or a skeletal posture or states of a worker based on an image of the first camera and an image of the second camera.

Claims (42)

1. A robot control system, comprising:

a robot;

at least one first camera attached or fixed to the robot;

a second camera attached to a worker; and

a control device configured to:

control the robot, when part of a work target is blocked from the at least one first camera due to the worker's body, based on an image from the at least one first camera and an image from the second camera, by:

specifying a position of a workpiece or a component,

specifying a skeletal posture of the worker, or

specifying states of the worker;

or

control the robot, when an entirety of the work target appears in an image from the at least one first camera, based on an image from the at least one first camera, by:

specifying a position of the workpiece or the component,

specifying the skeletal posture of the worker, or

specifying states of the worker.

2. A robot control system, comprising:

a robot;

at least one first camera attached or fixed to the robot;

a second camera attached to a worker,

wherein the second camera includes an acceleration sensor; and

a control device, configured to:

control the robot, when a change in the position or the posture of the second camera is less than a predetermined degree, based on the image of the at least one first camera and the image of the second camera, by:

specifying a position of the workpiece or the component,

specifying the skeletal posture of the worker, or

specifying states of the worker;

or

control the robot, when the change in the position or the posture of the second camera is larger than the predetermined degree, based on the image of the at least one camera, by:

specifying the position of the workpiece or the component,

specifying the skeletal posture of the worker, or

specifying states of the worker.

3. A control device, comprising:

a communication interface between a first camera, a second camera, and a robot;

a memory; and

a processor configured to execute a program stored in the memory:

control the robot based on an image of the first camera and an image of the second camera by:

specifying a position of a workpiece or a component,

specifying a skeletal posture of a worker, or

specifying states of the worker;

or

control the robot, when an entirety of the work target appears in an image from the first camera, based on an image from the first camera, by:

specifying a position of the workpiece or the component,

specifying the skeletal posture of the worker, or

specifying states of the worker.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2023
From: MORIYAMA, KOZO; KAMEYAMA, SHIN; VU, TRUONG GIA; BROOKS, LUCAS
To: JOHNAN CORPORATION
Reel/Frame 063084/0905 →
Priority Claims (1)
JP 2021-060233 · Mar 31, 2021 · national
Continuity (1)
Related Publication 20230339119A1 · Oct 26, 2023
References Cited (30)
US 10486307B2 · Wang · 2019 [cited by examiner]
US 10960550B2 · Namiki · 2021 [cited by examiner]
US 11254005B2 · Yoshida · 2022 [cited by examiner]
US 11645531B2 · Moore · 2023 [cited by examiner]
US 20030180697A1 · Kim · 2003 [cited by examiner]
US 20040189675A1 · Pretlove et al. · 2004 [cited by applicant]
US 20100185327A1 · Nakajima et al. · 2010 [cited by applicant]
US 20140067317A1 · Kobayashi · 2014 [cited by examiner]
US 20160270867A1 · Scholan · 2016 [cited by examiner]
US 20170206710A1 · Touma et al. · 2017 [cited by applicant]
US 20170320210A1 · Ding · 2017 [cited by examiner]
US 20180099408A1 · Shibata · 2018 [cited by applicant]
US 20180126558A1 · Ooba · 2018 [cited by applicant]
US 20180326584A1 · Wang · 2018 [cited by examiner]
US 20190099892A1 · Namiki · 2019 [cited by examiner]
US 20190184582A1 · Namiki · 2019 [cited by applicant]
US 20200114512A1 · Yoshida · 2020 [cited by examiner]
US 20200198148A1 · Ueno · 2020 [cited by examiner]
US 20200337776A1 · Saun · 2020 [cited by examiner]
US 20210252713A1 · Mimura · 2021 [cited by examiner]
JP 2004213673 · 2004 [cited by applicant]
JP 2007216350 · 2007 [cited by applicant]
JP 2017094466 · 2017 [cited by applicant]
JP 2017177181 · 2017 [cited by applicant]
JP 2017177181A · 2017 [cited by examiner]
JP 2018058178 · 2018 [cited by applicant]
JP 2018062016 · 2018 [cited by applicant]
JP 2019038075A · 2019 [cited by examiner]
JP 2019113895 · 2019 [cited by applicant]
International Search Report and Written Opinion of PCT/JP2022/009343, May 24, 2022, 10 pages including English translation of the International Search Report. [cited by applicant]