IP Library Granted Patent US 11,865,697
Granted Patent B2
US 11,865,697 · App. 16/636,139 · Granted Jan 9, 2024

Robot system and method for operating same

Inventors: Masayuki Watanabe (Kobe, JP); Takayuki Yoshimura (Kakogawa, JP)
Assignee: KAWASAKI JUKOGYO KABUSHIKI KAISHA
B25J13/065B25J13/003G02B27/0172G06F3/011G06T11/00G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,865,697
App. No.
16/636,139
Granted
Jan 9, 2024
Kind
B2
Abstract

A robot system includes an operating device that receives an operation instruction from an operator. The system further includes a real robot that is installed in a work space and performs a series of works constituted of a plurality of steps. The system further includes transmission type display device configured to allow the operator to visually recognize a real world and configured to display a virtual. The system further includes a control device configured to operate the virtual robot displayed on the transmission type display device based on instruction information input from the operating device. The control device is further configured to thereafter operate the real robot while maintaining a state that the virtual robot is displayed on the transmission type display device when operation execution information to execute an operation of the real robot is input from the operating device.

Claims (23)

1. A robot system comprising:

an operating device that receives an operation instruction from an operator and comprises a sensor that measures movement of a hand of the operator;

a real robot that is installed in a work space and performs a series of works constituted of a plurality of steps;

a display configured to allow the operator to visually recognize a real world and configured to display a virtual robot; and

a controller implemented with hardware configured to:

cause the display to display the virtual robot so as to overlap the real robot, the virtual robot having a shape that corresponds to a shape of the real robot;

operate the virtual robot displayed on the display based on the operation instruction input from the operating device, such that the virtual robot moves away from the real robot on the display and either only partially overlaps the real robot or does not overlap the real robot at all; and

thereafter, operate the real robot when the operation instruction input from the operating device is an instruction to execute an operation of the real robot.

2. The robot system according to claim 1 , wherein the operating device is constituted of at least one of a mobile terminal, a master arm, a teaching pendant, a joystick, or a voice input device.

3. The robot system according to claim 1 , wherein the display is configured to be worn by the operator.

4. The robot system according to claim 1 , wherein the controller is configured to:

operate a virtual robot arm of the virtual robot displayed on the display based on the operation instruction input from the operating device; and

thereafter, operate a robot arm of the real robot while maintaining a state that at least a virtual base of the virtual robot overlaps a base of the real robot on the display when the operation instruction to execute the operation of the real robot is input from the operating device.

5. The robot system according to claim 1 , wherein the controller is further configured to display a virtual hand on the display so as to correspond to movement of the hand of the operator measured by the sensor.

6. A method for operating a robot system that includes: an operating device that receives an operation instruction from an operator and includes a sensor that measures movement of a hand of the operator; a real robot that is installed in a work space and performs a series of works constituted of a plurality of steps; and a display configured to allow the operator to visually recognize a real world and configured to display a virtual robot so as to overlap the real robot, the virtual robot having a shape that corresponds to a shape of the real robot, the method comprising:

displaying, by the display, an operation of the virtual robot based on the operation instruction input from the operating device, such that the virtual robot moves away from the real robot on the display and either only partially overlaps the real robot or does not overlap the real robot at all; and

thereafter, operating the real robot based on the operation instruction input from the operating device when the operation instruction input from the operating device is an instruction to execute an operation of the real robot.

7. The method for operating the robot system according to claim 6 , wherein the operating device is constituted of at least one of a mobile terminal, a master arm, a teaching pendant, a joystick, or a voice input device.

8. The method for operating the robot system according to claim 6 , wherein the display is configured to be worn by the operator.

9. The method for operating the robot system according to claim 6 , further comprising:

displaying, by the display, an operation of a virtual robot arm of the virtual robot based on the operation information input from the operating device; and

thereafter, operating a robot arm of the real robot based on the operation instruction input from the operating device in a state that the display displays at least a virtual base of the virtual robot so as to overlap a base of the real robot when the operation instruction to execute the operation of the real robot is input from the operating device.

10. The method for operating the robot system according to claim 6 , further comprising displaying, by the display, a virtual hand so as to correspond to movement of the hand of the operator measured by the sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2020
From: WATANABE, MASAYUKI; YOSHIMURA, TAKAYUKI
To: KAWASAKI JUKOGYO KABUSHIKI KAISHA
Reel/Frame 053203/0224 →
Priority Claims (1)
JP 2017-149757 · Aug 2, 2017 · national
Continuity (1)
Related Publication 20200156258A1 · May 21, 2020