Medical manipulator system

1. A medical manipulator system comprising:

a first manipulator configured to change a position of an imaging sensor that images a target portion in a body;

a second manipulator configured to change a position of an end effector that treats the target portion;

a display configured to display images from a view field area of the imaging sensor; and

a controller configured to:

generate an operation command for operating the first manipulator or the second manipulator;

select one of a plurality of control modes and control the first manipulator or the second manipulator based on the operation command,

acquire an image of a predetermined portion imaged by the imaging sensor to acquire the view field area including a center of field of view;

acquire a first position that is a position at a center of the view field area, and acquire a second position that is a position of a tip of the end effector within the view field area or outside the view field area as long as the second manipulator can move while imaging the predetermined portion; and

select one mode from the plurality of control modes based on the view field area, the first position, and the second position,

wherein the plurality of control modes include:

a first mode in which operation of the second manipulator is fully permitted;

a second mode in which a predetermined restriction is imposed on the operation command section and operation of the second manipulator is permitted within the restriction; and

a third mode in which operation of the second manipulator is inhibited, and

the controller is configured to:

select the first mode when the second position is within the view field area,

select the second mode when the second position is outside the view field area and a distance between the first position and the second position is equal to or less than a predetermined value, and

select the third mode when the second position is outside the view field area and the distance between the first position and the second position is more than the predetermined value.

2. The medical manipulator system according to claim 1 , wherein the display comprises:

a view field display configured to display the image imaged by the imaging sensor; and

an auxiliary display configured to display an index corresponding to a presence of the second manipulator.

3. The medical manipulator system according to claim 1 , wherein, in the second mode, an operating speed of the second manipulator is restricted so that the second manipulator is operated with a lower speed than an operating speed of the second manipulator in the first mode.

4. The medical manipulator system according to claim 1 , wherein, in the second mode, an operable direction of the second manipulator is restricted as compared with an operable direction of the second manipulator in the first mode.

5. The medical manipulator system according to claim 4 , wherein, in the second mode, the operable direction is restricted to only be a direction in which the second position is directed toward the view field area.

6. The medical manipulator system according to claim 1 , wherein the controller is further configured to set contents of the restriction in the second mode.

7. The medical manipulator system according to claim 1 , wherein the second manipulator further includes a contact sensor configured to detect that the second manipulator has touched an object, and in the second mode, when the contact sensor detects that the second manipulator and the object are in contact with each other, an operator is notified that the second manipulator and the object have come into contact with each other and the control mode shifts to the third mode.

8. A control apparatus of a medical manipulator system, comprising a controller configured to control a first manipulator having an imaging sensor configured to image a target portion in a body and a second manipulator configured to treat the target portion in the body, based on an operation command by selecting one mode from a plurality of control modes,

wherein the controller is configured to:

acquire an image of a predetermined portion imaged by the imaging sensor to acquire a view field area including a center of field of view;

acquire a first position that is a position at a center of the view field area, and acquire a second position that is a position of a tip of an end effector of the second manipulator within the view field area or outside the view field area as long as the second manipulator can move while imaging the predetermined portion; and

select one mode from the plurality of control modes based on the view field area, the first position, and the second position,

wherein the plurality of control modes include:

a first mode in which operation of the second manipulator is fully permitted;

a second mode in which a predetermined restriction is imposed on the operation command and operation of the second manipulator is permitted within the restriction; and

a third mode in which operation of the second manipulator is inhibited,

the controller is configured to:

select the first mode when the second position is within the view field area,

select the second mode when the second position is outside the view field area and a distance between the first position and the second position is equal to or less than a predetermined value, and

select the third mode when the second position is outside the view field area and the distance between the first position and the second position is more than the predetermined value.

9. A method of controlling a medical manipulator system, wherein the medical manipulator system includes a first manipulator having an imaging sensor, a second manipulator having an end effector, and a display for displaying an image from a view field area of the imaging sensor, the method comprising:

acquiring an image imaged by the imaging sensor to acquire the view field area including a center of field of view;

acquiring a first position that is a position at a center of the view field area and a second position that is a position of a tip of the second manipulator;

selecting one mode from a plurality of control modes based on the view field area, the first position, and the second position, the plurality of control modes including a first mode in which operation of the second manipulator is fully permitted, a second mode in which a predetermined restriction is imposed on the operation command and operation of the second manipulator is permitted within the restriction, and a third mode in which operation of the second manipulator is inhibited; and

selecting the first mode when the second position is within the view field area, the second mode when the second position is outside the view field area and a distance between the first position and the second position is equal to or less than a predetermined value, or the third mode when the second position is outside the view field area and the distance between the first position and the second position is more than the predetermined value.

10. The method of controlling a medical manipulator system according to claim 9 , further comprising:

displaying the image imaged by the imaging sensor; and

displaying an index corresponding to a presence of the second manipulator.

11. The method of controlling a medical manipulator system according to claim 9 , further comprising restricting, in the second mode, an operating speed of the second manipulator so that the second manipulator is operated with a lower speed than an operating speed of the second manipulator in the first mode.

12. The method of controlling a medical manipulator system according to claim 9 , further comprising restricting, in the second mode, an operable direction of the second manipulator as compared with an operable direction of the second manipulator in the first mode.

13. The method of controlling a medical manipulator system according to claim 12 , further comprising restricting, in the second mode, the operable direction to only be a direction in which the second position is directed toward the view field area.

14. The method of controlling a medical manipulator system according to claim 9 , further comprising setting contents of the restriction in the second mode.

15. The method of controlling a medical manipulator system according to claim 9 , further comprising:

detecting that the second manipulator has touched an object; and

when the second manipulator and the object are detected to be in contact with each other in the second mode, notifying an operator that the second manipulator and the object have come into contact with each other and prohibiting operation of the second manipulator.