Medical observation system, apparatus for controlling the same, and method for controlling the same

1. A medical observation system comprising:

circuitry configured to

control an arm and an oblique-viewing endoscope arranged at an end of the arm, the arm and the oblique-viewing endoscope being included in the medical observation system used for observing a diseased site;

receive an instruction from a user, via a user interface, to change a visual field of the oblique-viewing endoscope, the visual field of the oblique-viewing endoscope being adjusted to zoom in or out based on the instruction; and

control a motion of the arm such that a distance between the oblique-viewing endoscope and an object to be observed accords to a magnification instructed via the user interface under a constraint condition that the oblique-viewing endoscope is inserted into an abdominal cavity via a trocar and pivots on the trocar, without vending a point of the oblique-viewing endoscope between a contact point of the trocar and an end of the oblique-viewing endoscope in a longitude direction of the oblique-viewing endoscope;

wherein the circuitry is configured to select a trocar point setting mode among a plurality of operation modes to set a fulcrum position for the oblique-viewing endoscope inserted into the abdominal cavity, the plurality of operation modes including at least one of a stop mode, the trocar point setting mode, a manual operation mode, a remote controller operation mode, and a complex operation mode,

wherein the circuitry is configured to select at least one of the manual operation mode, the remote controller operation mode, and the complex operation mode, to control the motion of the arm, after setting the fulcrum position in the trocar point setting mode.

2. The medical observation system according to claim 1 ,

wherein the circuitry is configured to move the visual field of the oblique-viewing endoscope in any direction, and

the circuitry is configured to control the motion of the arm to move the visual field of the oblique-viewing endoscope in a direction corresponding to an instructed moving direction according to an operation received via the user interface.

3. The medical observation system according to claim 2 ,

wherein the circuitry is configured to receive an instruction to move in directions including at least vertically, horizontally, and obliquely.

4. The medical observation system according to claim 1 ,

wherein the circuitry is configured to control a rotation angle around a lens barrel axis of the oblique-viewing endoscope according to an operation received via the user interface.

5. The medical observation system according to claim 4 ,

wherein the instruction is to move the visual field direction of the oblique-viewing endoscope in any direction or to rotate the oblique-viewing endoscope clockwise or counterclockwise.

6. The medical observation system according to claim 4 ,

wherein the circuitry is configured to control a rotation angle of the oblique-viewing endoscope in a direction corresponding to a coordinate system on a screen on which an image shot by the oblique-viewing endoscope is displayed.

7. The medical observation system according to claim 4 ,

wherein the circuitry is configured to control a rotation angle of the oblique-viewing endoscope such that the vertical direction of a screen on which an image shot by the oblique-viewing endoscope is displayed is adjusted on a basis of the direction of gravity.

8. The medical observation system according to claim 1 , further comprising:

a camera configured to shoot an image in the visual field of the oblique-viewing endoscope.

9. The medical observation system according to claim 1 , further comprising:

a display configured to display an image in the visual field of the oblique-viewing endoscope.

10. The medical observation system according to claim 1 ,

wherein the circuitry is configured to receive the instruction as a voice input via the user interface, and

the circuitry is configured to control the arm or the oblique-viewing endoscope according to the voice input.

11. The medical observation system according to claim 10 ,

wherein the circuitry is configured to start controlling the arm by a voice command in response to an input of first activation phrase for instructing to start voice input, and end controlling the arm by the voice command in response to an input of second activation phrase for instructing to end the voice input.

12. The medical observation system according to claim 11 ,

wherein the circuitry is configured to give priority to an operation of the remote controller over the voice command input via the user interface and control the arm, under a condition that the complex operation mode is selected.

13. The medical observation system according to claim 12 ,

wherein when the voice input for overviewing or zooming the visual field of the oblique-viewing endoscope and an operation for zooming the visual field of the oblique-viewing endoscope on the remote controller are performed at the same time, the circuitry is configured to give priority to the operation on the remote controller and control the arm of the oblique-viewing endoscope, under a condition that the complex operation mode is selected.

14. The medical observation system according to claim 12 ,

wherein when the voice input for moving the visual field of the oblique-viewing endoscope or tracking a predetermined target and an operation for moving the visual field of the oblique-viewing endoscope on the remote controller are performed at the same time, the circuitry is configured to give priority to the operation on the remote controller, and control the arm, under a condition that the complex operation mode is selected.

15. The medical observation system according to claim 12 ,

wherein when an instruction to rotate the oblique-viewing endoscope from the voice input and another instruction to rotate the oblique-viewing endoscope from the remote controller are performed

at the same time, the circuitry is configured to give priority to the other operation from the remote controller and control rotating the oblique-viewing endoscope, under a condition that the complex operation mode is selected.

16. The medical observation system according to claim 10 ,

wherein the circuitry is configured to control the arm according to an operation of a remote controller only while a predetermined trigger button on the remote controller is being operated.

17. The medical observation system according to claim 1 , wherein the circuitry is configured to control the arm such that the oblique-viewing endoscope virtually moves forward or backward in an optical axis direction of an objective optical system by a combination of forward/backward movement of the oblique-viewing endoscope and rotation movement of the oblique-viewing endoscope on the fulcrum position on the trocar, to zoom in or out the medical observation apparatus.

18. The medical observation system according to claim 17 , wherein the circuitry is configured to calculate a torque instruction value of each joint of a plurality of joints of the arm by computations using generalized inverse kinematics for moving the oblique-viewing endoscope forward or backward in the optical axis direction of the objective optical system, under the constraint condition including the fact the oblique-viewing endoscope is inserted into the abdominal cavity via the trocar.

19. The medical observation system according to claim 17 , wherein the circuitry is configured to determine a position and a posture of the oblique-viewing endoscope at a distal end for moving the oblique-viewing endoscope forward or backward in the optical axis direction of the objective optical system, and calculate a position instruction value of each joint of a plurality of joints of the arm for realizing a desired position of the oblique-viewing endoscope on a basis of inverse kinematics computations, under the constraint condition including the fact the oblique-viewing endoscope is inserted into the abdominal cavity via the trocar.

20. A control method comprising:

controlling an arm and an oblique-viewing endoscope arranged at an end of the arm, the arm and the oblique-viewing endoscope being included in the medical observation system used for observing a diseased site;

receiving an instruction from a user, via a user interface, to change a visual field of the oblique-viewing endoscope, the visual field of the oblique-viewing endoscope being adjusted to zoom in or out based on the instruction; and

controlling a motion of the arm such that a distance between the oblique-viewing endoscope and an object to be observed accords to a magnification instructed via the user interface under a constraint condition that the oblique-viewing endoscope is inserted into an abdominal cavity via a trocar and pivots on the trocar, without vending a point of the oblique-viewing endoscope between a contact point of the trocar and an end of the oblique-viewing endoscope in a longitude direction of the oblique-viewing endoscope;

wherein a trocar point setting mode is selected among a plurality of operation modes to set a fulcrum position for the oblique-viewing endoscope inserted into the abdominal cavity, the plurality of operation modes including at least one of a stop mode, the trocar point setting mode, a manual operation mode, a remote controller operation mode, and a complex operation mode,

wherein at least one of the manual operation mode, the remote controller operation mode, and the complex operation mode, is selected to control the motion of the arm, after setting the fulcrum position in the trocar point setting mode.

21. A non-transitory computer-readable storage medium including computer executable instructions, wherein the instructions, when executed by a medical observation system, cause the medical observation system to perform a method, the method comprising:

controlling an arm and an oblique-viewing endoscope arranged at an end of the arm, the arm and the oblique-viewing endoscope being included in the medical observation system used for observing a diseased site;

receiving an instruction from a user, via a user interface, to change a visual field of the oblique-viewing endoscope, the visual field of the oblique-viewing endoscope being adjusted to zoom in or out based on the instruction; and

controlling a motion of the arm such that a distance between the oblique-viewing endoscope and an object to be observed accords to a magnification instructed via the user interface under a constraint condition that the oblique-viewing endoscope is inserted into an abdominal cavity via a trocar and pivots on the trocar, without vending a point of the oblique-viewing endoscope between a contact point of the trocar and an end of the oblique-viewing endoscope in a longitude direction of the oblique-viewing endoscope;

wherein a trocar point setting mode is selected among a plurality of operation modes to set a fulcrum position for the oblique-viewing endoscope inserted into the abdominal cavity, the plurality of operation modes including at least one of a stop mode, the trocar point setting mode, a manual operation mode, a remote controller operation mode, and a complex operation mode,

wherein at least one of the manual operation mode, the remote controller operation mode, and the complex operation mode, is selected to control the motion of the arm, after setting the fulcrum position in the trocar point setting mode.