Device for guiding position of robot, method therefor, and system including the same
Proposed are a device for guiding the position of a robot, a method thereof, and a system including the same, the device including a surgical target matcher configured to derive a correlation of a position and a posture between a surgical target and a target marker attached to the surgical target, a robot matcher configured to derive a correlation of a position and a posture between a robot maker and a surgical robot based on an image including the robot marker mounted to the surgical robot and derive a correlation of a position and a posture between the robot marker and a preset work space, and a work space identifier configured to derive a correlation of a position and a posture between the surgical target and the work space based on information about the positions and postures of the target marker and the robot marker.
1. A device for guiding a position of a robot, comprising:
at least one processor configured to
derive a first correlation between a position and an orientation of a surgical target and a position and an orientation of a target marker attached to the surgical target by matching an image comprising the target marker attached to the surgical target with a surgical target image of the surgical target of before an operation,
derive a second correlation between a position and an orientation of a robot marker and a position and an orientation of a surgical robot based on an image including the robot marker mounted to a base of the surgical robot,
derive a third correlation between the position and the orientation of the robot marker and a position and an orientation of a work space, and
derive a fourth correlation between the position and the orientation of the surgical target and the position and the orientation of the work space based on tracking information about the positions and the orientations of the target marker and the robot marker, and the first, second and third correlations;
a graphic card configured to generate a graphic based on guide information about the fourth correlation; and
a display configured to display an image based on the guide information,
wherein the work space comprises a work orientation space and a work position space,
wherein the guide information comprises a first menu image showing whether the orientation of the surgical target is within the work orientation space, and a second menu image showing whether the position of the surgical target is within the work position space,
wherein the first menu image includes a first bar for indicating an X-angle, a second bar for indicating a Y-angle, and a third bar for indicating a Z-angle,
wherein the orientation of the surgical target is represented as points on corresponding angles on the first bar, the second bar, and the third bar, respectively, and
wherein the work orientation space is represented as a line in corresponding range on the first bar, the second bar, and the third bar.
2. The device of claim 1 , wherein the guide information comprises information about a separation distance between the position of the surgical target and the work space.
3. The device of claim 2 , wherein the position of the surgical target on the second menu image is represented with the surgical target comprising an area, which is within an operation path previously planned for the surgical target with respect to an origin of the operation path, based on the operation path.
4. The device of claim 3 , wherein
the work space is calculated based on information about the position and the orientation of the surgical robot, and
the work position space is formed to have a volume with respect to an origin of the work space, and the work orientation space is based on the orientation of the surgical robot.
5. A system for guiding a position of a robot, comprising:
a tracker configured to track positions and orientations of a robot marker mounted to a base of a surgical robot and a target marker attached to a surgical target;
a memory configured to store a surgical target image of the surgical target, obtained before an operation;
at least one processor configured to
derive a first correlation between a position and an orientation of the surgical target and a position and an orientation of the target marker attached to the surgical target based on the surgical target image,
derive a second correlation between a position and an orientation of the robot marker and a position and an orientation of the surgical robot,
derive a third correlation between the position and the orientation of the robot marker and a position and an orientation of a work space, and
derive a fourth correlation between the position and the orientation of the work space and the position and the orientation of the surgical target based on tracking information about the positions and the orientations of the target marker and the robot marker obtained by the tracker, and the first, second, and third correlations;
a graphic card configured to generate a graphic based on guide information about the fourth correlation; and
a display configured to display an image based on the guide information,
wherein the work space comprises a work orientation space and a work position space,
wherein the guide information comprises a first menu image showing whether the orientation of the surgical target is within the work orientation space, and a second menu image showing whether the position of the surgical target is within the work position space,
wherein the first menu image includes a first bar for indicating an X-angle, a second bar for indicating a Y-angle, and a third bar for indicating a Z-angle,
wherein the orientation of the surgical target is represented as points on corresponding angles on the first bar, the second bar, and the third bar, respectively, and
wherein the work orientation space is represented as a line in corresponding range on the first bar, the second bar, and the third bar.
6. A method of guiding a position of a robot, comprising:
deriving a first correlation between a position and an orientation of a surgical target and a position and an orientation of a target marker attached to the surgical target by matching an image comprising the target marker attached to the surgical target with a surgical target image of the surgical target of before an operation;
deriving a second correlation between a position and an orientation of a robot marker and a position and an orientation of a surgical robot based on an image including the robot marker mounted to a base of the surgical robot;
deriving a third correlation between the position and the orientation of the robot marker and a position and an orientation of a work space; and
deriving a fourth correlation between the position and the orientation of the surgical target and the position and the orientation of the work space based on tracking information about the positions and the orientations of the target marker and the robot marker, and the first, second, and third correlations; and
displaying an image by generating a graphic based on guide information about the fourth correlation,
wherein the work space comprises a work orientation space and a work position space,
wherein the guide information comprises a first menu image showing whether the orientation of the surgical target is within the work orientation space, and a second menu image showing whether the position of the surgical target is within the work position space,
wherein the first menu image includes a first bar for indicating an X-angle, a second bar for indicating a Y-angle, and a third bar for indicating a Z-angle,
wherein the orientation of the surgical target is represented as points on corresponding angles on the first bar, the second bar, and the third bar, respectively, and
wherein the work orientation space is represented as a line in corresponding range on the first bar, the second bar, and the third bar.
7. The method of claim 6 , wherein the position of the surgical target on the second menu image is represented with the surgical target comprising an area, which is within an operation path previously planned for the surgical target with respect to an origin of the operation path, based on the operation path.
8. The method of claim 6 , wherein
the work space is calculated based on information about the position and the orientation of the surgical robot, and
the work position space is formed to have a volume with respect to an origin of the work space, and the work orientation space is based on the orientation of the surgical robot.
9. A method of guiding a position of a robot, comprising:
deriving a first correlation between a position and an orientation of a robot marker and a position and an orientation of a surgical robot based on an image including the robot marker mounted to the surgical robot;
deriving a second correlation between the position and the orientation of the robot marker and a position and an orientation of a work space; and
deriving a third correlation between a position and an orientation of a surgical target and a position and an orientation of a target marker attached to the surgical target by matching an image comprising the target marker attached to a base of the surgical target with a surgical target image of the surgical target of before an operation;
deriving a fourth correlation between the position and the orientation of the surgical target and the position and the orientation of the work space based on tracking information about the positions and the orientations of the target marker and the robot marker, and the first, second, and third correlations; and
displaying an image by generating a graphic based on guide information about the fourth correlation,
wherein the work space comprises a work orientation space and a work position space,
wherein the guide information comprises a first menu image showing whether the orientation of the surgical target is within the work orientation space, and a second menu image showing whether the position of the surgical target is within the work position space,
wherein the first menu image includes a first bar for indicating an X-angle, a second bar for indicating a Y-angle, and a third bar for indicating a Z-angle,
wherein the orientation of the surgical target is represented as points on corresponding angles on the first bar, the second bar, and the third bar, respectively, and
wherein the work orientation space is represented as a line in corresponding range on the first bar, the second bar, and the third bar.
10. The method of claim 9 , wherein the position of the surgical target on the second menu image is represented with the surgical target comprising an area, which is within an operation path previously planned for the surgical target with respect to an origin of the operation path, based on the operation path.
11. The method of claim 9 , wherein the work space is calculated based on information about the position and the orientation of the surgical robot, and
the work position space is formed to have a volume with respect to an origin of the work space, and the work orientation space is based on the orientation of the surgical robot.