Imaging system and robot system
An imaging system includes: an unmanned flight vehicle; an imager that is mounted on the unmanned flight vehicle and takes an image of a robot which performs work with respect to a target object; a display structure which is located away from the unmanned flight vehicle and displays the image taken by the imager to a user who manipulates the robot; and circuitry which controls operations of the imager and the unmanned flight vehicle. The circuitry acquires operation related information that is information related to an operation of the robot. The circuitry moves the unmanned flight vehicle such that a position and direction of the imager are changed so as to correspond to the operation related information.
1. An imaging system comprising:
an unmanned flight vehicle;
an imager mounted to the unmanned flight vehicle, the imager capturing an image of a robot comprising a robot arm and an end effector, which performs work with respect to a target object;
a display structure located away from the unmanned flight vehicle, the display structure displaying the image taken by the imager; and
circuitry that controls, during an initial setting mode and a normal operating mode, operations of the imager and the unmanned flight vehicle, wherein the circuitry:
acquires operation related information related to an operation of the robot, the operation related information comprising a position and a posture of the end effector;
determining a predetermined relative relation to be maintained between the unmanned flight vehicle and the end effector by obtaining, during the initial setting mode, an initial position and an initial direction of the imager and calculating the predetermined relative relation based on the initial posture and the initial direction and the position and posture of the end effector, and terminating the initial setting mode;
calculating a target position and target direction of the imager that maintains the relative relation based on the operation related information; and
moving the unmanned flight vehicle such that a position and direction of the imager are changed so as to correspond to the target position and direction and maintain the relative relation based on the operation related information.
2. The imaging system according to claim 1 , further comprising an inputter that receives input of a command, wherein:
the circuitry receives, through the inputter, a correction command that is a command to correct the position and direction of the imager; and
the circuitry moves the unmanned flight vehicle such that the position and direction of the imager which correspond to the operation related information are changed to the position and direction of the imager in accordance with the correction command.
3. The imaging system according to claim 2 , wherein after the position and direction of the imager are changed in accordance with the correction command, the circuitry reflects result of the change of the position and direction of the imager in accordance with the correction command on the position and direction of the imager which correspond to the operation related information.
4. The imaging system according to claim 1 , further comprising a detector that detects a movement of a head of a user, wherein:
the circuitry acquires information of the movement of the head of the user from the detector; and
the circuitry moves the unmanned flight vehicle such that the position and direction of the imager are changed so as to follow the movement of the head of the user.
5. The imaging system according to claim 1 , wherein the circuitry controls the operation of the unmanned flight vehicle based on the information of the position and direction of the end effector such that the relative relation between the end effector and the unmanned flight vehicle becomes a first predetermined distance or more.
6. The imaging system according to claim 5 , wherein when the circuitry receives a command such that the relative relation between the end effector and the unmanned flight vehicle becomes less than the first predetermined distance, the circuitry performs such control that: the unmanned flight vehicle is located away from the end effector by the first predetermined distance or more; and the imager performs zoom-up imaging.
7. The imaging system according to claim 5 , wherein the circuitry increases or decreases the first predetermined distance in accordance with a movement speed of the end effector, the movement speed being based on the information of the position and direction of the end effector.
8. The imaging system according to claim 1 , wherein the circuitry controls the operation of the unmanned flight vehicle based on the information of the position and direction of the end effector such that a distance between the end effector and the unmanned flight vehicle becomes a second predetermined distance or less.
9. The imaging system according to claim 8 , wherein when the circuitry receives a command such the distance between the end effector and the unmanned flight vehicle exceeds the second predetermined distance, the circuitry performs such control that: the unmanned flight vehicle is located away from the end effector by the second predetermined distance or less; and the imager performs zoom-back imaging.
10. The imaging system according to claim 8 , wherein the circuitry increases or decreases the second predetermined distance in accordance with a movement speed of the end effector, the movement speed being based on the information of the position and direction of the end effector.
11. A robot system comprising:
the imaging system according to claim 1 ; and
the robot.