IP Library › Granted Patent US 11,370,105
Granted Patent B2
US 11,370,105 · App. 16/643,767 · Granted Jun 28, 2022

Robot system and method for operating same

Inventors: Masayuki Watanabe (Kobe, JP); Takayuki Yoshimura (Kakogawa, JP)
Assignee: KAWASAKI JUKOGYO KABUSHIKI KAISHA
B25J3/00B25J13/065B25J19/023B25J19/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,370,105
App. No.
16/643,767
Filed
Mar 2, 2020
Granted
Jun 28, 2022
Kind
B2
Art Unit
3664
USPC
700/259
Abstract

A robot system includes an operating device that receives an operation instruction from an operator, a real robot that is installed in a work space and performs a series of works constituted of a plurality of steps, a camera configured to image the real robot, a display device configured to display video information of the real robot imaged by the camera and a virtual robot, and a control device, in which the control device is configured to operate the virtual robot displayed on the display device based on instruction information input from the operating device, and thereafter operate the real robot in a state that the virtual robot is displayed on the display device when operation execution information to execute an operation of the real robot is input from the operating device.

Claims (33)

1. A robot system comprising:

an operating device that receives an operation instruction from an operator;

a real robot that is installed in a work space and performs a series of works constituted of a plurality of steps;

a camera configured to image the real robot;

a display device configured to display video information of the real robot imaged by the camera and a virtual robot; and

a control device configured to:

operate the virtual robot displayed on the display device in a state based on instruction information input from the operating device, and

operate, after operating the virtual robot, the real robot in a state corresponding to the state that the virtual robot is displayed on the display device when operation execution information to execute an operation of the real robot is input from the operating device.

2. The robot system according to claim 1 , wherein the control device is configured to display the virtual robot and the video information of the real robot imaged by the camera so as to overlap each other on the display device, and operate the virtual robot based on the instruction information when the instruction information is input from the operating device.

3. The robot system according to claim 1 , wherein the camera is disposed at a distal end of the real robot.

4. The robot system according to claim 1 , wherein the operating device is constituted of at least one of a mobile terminal, a touch panel, a master arm, a teaching pendant, a joystick, or a voice input device.

5. The robot system according to claim 1 , wherein

the operating device is constituted of a measuring device that measures movement of a hand of the operator, and

the control device is configured to display a virtual hand on the display device so as to correspond to movement of the hand of the operator measured by the measuring device.

6. The robot system according to claim 1 , wherein the display device is constituted of a transmission type display device configured to allow the operator to visually recognize a real world.

7. The robot system according to claim 6 , wherein the display device is configured to be attachable to the operator.

8. A method for operating a robot system, wherein the robot system includes:

an operating device that receives an operation instruction from an operator;

a real robot that is installed in a work space and performs a series of works constituted of a plurality of steps;

a camera configured to image the real robot; and

a display device configured to display video information of the real robot imaged by the camera and a virtual robot, and

the method comprising:

(A) displaying, by the display device, the video information of the real robot imaged by the camera and the virtual robot;

(B) displaying, by the display device, an operation of the virtual robot based on instruction information input from the operating device, after the (A); and

(C) causing the real robot to operate based on the instruction information input from the operating device after the display device displays the operation of the virtual robot when operation execution information is input from the operating device to execute an operation of the real robot, after the (B), the real robot operating in a state corresponding to the operations of the virtual robot.

9. The method for operating the robot system according to claim 8 , wherein, in the (A), the display device displays the virtual robot so as to overlap the video information of the real robot.

10. The method for operating the robot system according to claim 8 , wherein the camera is disposed at a distal end of the real robot.

11. The method for operating the robot system according to claim 8 , wherein the operating device is constituted of at least one of a mobile terminal, a touch panel, a master arm, a teaching pendant, a joystick, or a voice input device.

12. The method for operating the robot system according to claim 8 , wherein

the operating device is constituted of a measuring device that measures movement of a hand of the operator, and

in the (B), the display device displays a virtual hand so as to correspond to movement of the hand of the operator measured by the measuring device, and displays the operation of the virtual robot.

13. The method for operating the robot system according to claim 8 , wherein the display device is constituted of a transmission type display device configured to allow the operator to visually recognize a real world.

14. The method for operating the robot system according to claim 13 , wherein the display device is configured to be attachable to the operator.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: WATANABE, MASAYUKI; YOSHIMURA, TAKAYUKI
To: KAWASAKI JUKOGYO KABUSHIKI KAISHA
Reel/Frame 053139/0600 →
Priority Claims (1)
JP JP2017-167120 · Aug 31, 2017 · national
Continuity (1)
Related Publication 20210154826A1 · May 27, 2021