Medical information processing apparatus, information processing method, and medical information processing system
[Problem] A surgical apparatus of the related art controls only the cropping position of a captured image, and thus only executes a limited range of image control in laparoscopic surgery. [Solution] A medical information processing apparatus including: an image control section that controls processing of a captured image from a camera; and an arm control section that controls a motion of an arm that supports the camera. One of the image control section and the arm control section executes control on a basis of control information from another control section.
1. A medical information processing apparatus comprising:
image control circuitry configured to control processing of a captured image from a camera; and
arm control circuitry configured to control a motion of an arm that supports the camera, wherein
one of the image control circuitry and the arm control circuitry executes control on a basis of control information from another control circuitry, and
on condition that a first mode that prioritizes image quality is selected, the image control circuitry is configured to control an optical zoom and to send control information for controlling the arm to the arm control circuitry prior to the image control circuitry being configured to control an electronic zoom, or
on condition that a second mode that prioritizes speed is selected, the image control circuitry is configured to control the electronic zoom prior to the optical zoom, wherein the electronic zoom decreases as the optical zoom increases so that the electronic zoom is replaced by the optical zoom in the second mode.
2. The medical information processing apparatus according to claim 1 , wherein
the image control circuitry is configured to detect a treatment tool from a captured image captured by the camera, and
the image control circuitry is configured to change a cropping position of the captured image according to a motion of the detected treatment tool.
3. The medical information processing apparatus according to claim 2 , wherein
the image control circuitry sends control information to the arm control circuitry on a basis of a motion of the detected treatment tool, and
the arm control circuitry computes a movement amount by which to move the arm on a basis of the control information received from the image control circuitry.
4. The medical information processing apparatus according to claim 3 , wherein
the arm control circuitry is configured to send the computed movement amount of the arm to the image control circuitry, and
the image control circuitry changes the cropping position of the captured image on a basis of the movement amount of the arm received from the arm control circuitry.
5. The medical information processing apparatus according to claim 3 , wherein
in a case in which the motion of the treatment tool exceeds a predetermined standard, the image control circuitry sends control information for controlling the arm to the arm control circuitry.
6. The medical information processing apparatus according to claim 1 , wherein
the image control circuitry is configured to send an enlargement instruction to the camera, and
enlargement by the camera includes the optical zoom and enlargement by the image control circuitry and/or the camera includes the electronic zoom.
7. The medical information processing apparatus according to claim 1 , wherein, in the second mode,
the image control circuitry is configured to send the control information to the arm control circuitry before an enlargement magnification by the camera reaches a limit value.
8. The medical information processing apparatus according to claim 1 , wherein
the image control circuitry is configured to detect a plurality of treatment tools from a captured image captured by the camera, and
the image control circuitry is configured to send the control information to the arm control circuitry such that front ends of the detected plurality of treatment tools are all included in the captured image.
9. The medical information processing apparatus according to claim 8 , wherein
the image control circuitry is further configured to detect types of the treatment tools, and
the image control circuitry is configured to crop the captured image such that a treatment tool for use by a surgeon is included in a display image.
10. An information processing method comprising:
controlling processing of a captured image from a camera; and
controlling a motion of an arm that supports the camera, wherein
one of the controlling of the processing of the captured image and the controlling of the motion of the arm executes control on a basis of on control information from other control, and
on condition that a first mode that prioritizes image quality is selected, controlling an optical zoom and sending control information for controlling the arm to arm control circuitry prior to controlling an electronic zoom, or
on condition that a second mode that prioritizes speed is selected, controlling the electronic zoom prior to the optical ZOOM, wherein the electronic zoom decreases as the optical zoom increases so that the electronic zoom is replaced by the optical zoom in the second mode.
11. A medical information processing system comprising:
a camera that captures an image;
an image control circuitry configured to control processing of a captured image from the camera;
an arm that supports the camera; and
an arm control circuitry configured to control a motion of the arm that supports the camera, wherein
one of the image control circuitry and the arm control circuitry executes control on a basis of control information from another control circuitry, and
on condition that a first mode that prioritizes image quality is selected, the image control circuitry is configured to control an optical zoom and to send control information for controlling the arm to the arm control circuitry prior to the image control circuitry being configured to control an electronic zoom, or
on condition that a second mode that prioritizes speed is selected, the image control circuitry is configured to control the electronic zoom prior to the optical zoom, wherein the electronic zoom decreases as the optical zoom increases so that the electronic zoom is replaced by the optical zoom in the second mode.
12. The information processing method according to claim 10 , wherein, in the second mode,
sending the control information for controlling the motion of the arm before an enlargement magnification by the camera reaches a limit value.
13. The information processing method according to claim 10 , further comprising sending an enlargement instruction to the camera, enlargement by the camera including the optical zoom, wherein enlargement by the electronic zoom includes controlling processing of the captured image and/or the camera.
14. The medical information processing system according to claim 11 , wherein, in the second mode,
the image control circuitry is configured to send the control information to the arm control circuitry before an enlargement magnification by the camera reaches a limit value.
15. The medical information processing system according to claim 11 , wherein
the image control circuitry is configured to send an enlargement instruction to the camera, and
enlargement by the camera includes an optical zoom and enlargement by the image control circuitry and/or the camera includes an electronic zoom.
16. The medical information processing system according to claim 11 , wherein the camera is one of an endoscope and a microscope that captures an image of a site for a medical procedure.