Systems and methods for controlling tool with articulatable distal portion

1 . A system comprising:

a tool including a shaft having proximal and distal ends and an articulatable distal portion coupled to a distal end of the shaft;

a processing unit including one or more processors, the processing unit configured to:

providing a plurality of operation modes including a target tracking mode, a manual control mode, and an operator-steered mode;

in response to an enabled target tracking mode and a request for transition from a first view direction associated with a first target to a second view direction associated with a second target, control a pose of the articulatable distal portion to direct the articulatable distal portion toward the second target,

wherein orientations of images captured by an imaging device of the articulatable distal portion during the transition are maintained to be the same regarding a reference including a reference plane or a reference direction by controlling the pose of the articulatable distal portion,

wherein a left-to-right order of features in the images is aligned with a first left-to-right reference direction of the reference;

wherein the first left-to-right reference direction corresponds to a perspective of a first operator who is not controlling the shaft,

wherein the first left-to-right reference direction is different from a second left-to-right reference direction corresponding to a second operator who is controlling the shaft;

and

in response to a disabled target tracking mode, stop controlling the pose of the articulatable distal portion to direct the articulatable distal portion toward the second target in response to a shaft movement.

2 . The system of claim 1 , further comprising:

a teleoperational manipulator coupled to the tool and configured for control of shaft motion;

a sensor system in communication with the processing unit, the sensor system configured to determine a first motion of at least a portion of the shaft, wherein the sensor system includes a sensor included in the teleoperational manipulator.

3 . The system of claim 1 , further comprising:

a teleoperational manipulator coupled to the tool and configured for control of shaft motion,

wherein the processing unit is configured to:

based on a command issued for driving the teleoperational manipulator, determine a first motion of at least a portion of the shaft.

4 . The system of claim 1 ,

wherein the processing unit is further configured to display the images of the first target captured by the imaging device; and wherein the displayed images of the first target are oriented based on the reference.

5 . The system of claim 1 ,

wherein the orientations of images captured by the imaging device are level with the reference plane, and

wherein the reference plane is a horizontal plane or is based on a table top of an operating table.

6 . The system of claim 1 , wherein the processing unit is further configured to:

determine the reference based on a first image of the first target selected by an operator.

7 . The system of claim 1 , wherein the images of the first target are upright with respect to the reference direction.

8 . The system of claim 1 , wherein controlling the pose of the articulatable distal portion includes preserving a roll orientation of a view of the first target with respect to the reference plane.

9 . The system of claim 1 , further comprising:

a tracking system configured to track at least a portion of an operator's body;

wherein the processing unit is further configured to:

detect a second motion of the at least a portion of the operator's body; and

control the pose of the articulatable distal portion in response to the detected second motion of the at least a portion of the operator's body.

10 . The system of claim 1 , wherein the processing unit is further configured to: determine whether an operator has performed a distal orientation adjustment request, and

wherein controlling the pose of the articulatable distal portion is further based on a determination that the operator has performed the distal orientation adjustment request.

11 . The system of claim 1 , wherein controlling the pose of the articulatable distal portion includes controlling an orientation or a translation of the articulatable distal portion.

12 . The system of claim 1 , further comprising:

a sensor system coupled to the distal end of the shaft and in communication with the processing unit, the sensor system includes an imaging device for capturing images of the first target.

13 . The system of claim 1 , wherein the tool includes a proximal housing configured for manual control of shaft motion.

14 . The system of claim 1 , wherein the processing unit is further configured to:

determine the first target based on an input provided by an operator.

15 . The system of claim 1 , wherein the tool includes an imaging device for capturing images of the first target, and

wherein the processing unit is further configured to: process the images to determine a location of the first target.

16 . The system of claim 1 , wherein the processing unit is further configured to:

determine that the articulatable distal portion reaches a motion limit, and

provide, using a proximal housing located at a proximal end of the tool, an indication to an operator for moving the proximal housing in a direction corresponding to the motion limit.