Systems and methods for entering and exiting a teleoperational state
A teleoperational system comprises a teleoperational control system and a teleoperational manipulator configured for operating an instrument in an environment. The teleoperational system also comprises an operator controller in communication with the teleoperational control system. The teleoperational control system includes a processing unit including one or more processors. The processing unit is configured to determine whether an operator of the operator controller has a head portion directed toward a display region of a display device and based on a determination that the operator's head portion is directed toward the display region, initiate an operator following mode in which movement of the operator controller provides a corresponding movement to the teleoperational manipulator. The teleoperational system may be a teleoperational medical system.
1 . A teleoperational medical system comprising:
a teleoperational control system;
a teleoperational manipulator configured for operating a medical instrument in a medical environment; and
an operator controller in communication with the teleoperational control system, wherein the teleoperational control system includes a processing unit including one or more processors, and wherein the processing unit is configured to:
determine whether a head portion of an operator of the operator controller is directed toward or away from a display region of a display device;
determine whether the head portion of the operator is positioned in a predefined region in the medical environment, wherein the predefined region comprises an operating volume defining an acceptable position of the operator within the medical environment; and
based on a determination that the head portion is directed toward the display region and is positioned within the predefined region in the medical environment, initiate an operator following mode in which a movement of the operator controller provides a corresponding movement to the teleoperational manipulator.
2 . The teleoperational medical system of claim 1 , wherein the predefined region is located at a predefined position relative to the display device.
3 . The teleoperational medical system of claim 1 , wherein the processing unit is configured to prevent initiation of the operator following mode responsive to a determination that the head portion is directed away from the display region.
4 . The teleoperational medical system of claim 1 , wherein the processing unit is configured to determine whether the head portion of the operator is directed toward the display region based on a position and an orientation of a marker on the operator of the operator controller.
5 . The teleoperational medical system of claim 4 , wherein the marker is configured to remain substantially fixed relative to the head portion of the operator during a movement of the head portion.
6 . The teleoperational medical system of claim 4 , wherein the marker includes a natural landmark on a face of the operator.
7 . The teleoperational medical system of claim 4 , wherein the marker comprises an item worn by the operator, the item selected from the group consisting of: glasses, a headband, and an earpiece.
8 . The teleoperational medical system of claim 1 , wherein determining the head portion of the operator is directed away from the display region includes determining whether the head portion of the operator is directed away from the display region for at least a threshold time period.
9 . The teleoperational medical system of claim 8 , wherein the threshold time period is a first threshold time period for a first direction that the head portion is directed away from the display region and the threshold time period is a second threshold time period for a second direction that the head portion is directed away from the display region, wherein the first threshold time period differs from the second threshold time period and the first direction differs from the second direction.
10 . The teleoperational medical system of claim 8 , wherein the processing unit is further configured to:
determine that the head portion has been directed away from the display region of the display device for less than the threshold time period and has returned to be directed toward the display region; and
remain in the operator following mode based on the determination that the head portion has been directed away from the display region for less than the threshold time period.
11 . The teleoperational medical system of claim 1 , wherein determining whether the head portion of the operator is directed toward or away from the display region includes determining an operator viewing vector and determining whether the operator viewing vector intersects a display plane within the display region.
12 . The teleoperational medical system of claim 1 , wherein the processing unit is further configured to determine whether the operator has performed an activation gesture and wherein initiating the operator following mode is further based on a determination that the operator has performed the activation gesture.
13 . The teleoperational medical system of claim 12 , wherein the activation gesture is a matching hand grip, that matches a displayed configuration of the medical instrument on the display device, or a movement of a pedal device.
14 . The teleoperational medical system of claim 1 , wherein the processing unit is further configured to identify the operator, and wherein initiating the operator following mode is further based on a determination that the identified operator is permitted to operate the teleoperational medical system.
15 . A method for operating a teleoperational system including a teleoperational manipulator configured for operating a medical instrument in a medical environment and an operator controller, the method comprising:
determining whether a head portion of an operator of the operator controller is directed toward or away from a display region of a display device;
determining whether the head portion of the operator is positioned in a predefined region in the medical environment, wherein the predefined region comprises an operating volume defining an acceptable position of the operator within the medical environment; and
based on a determination that the head portion is directed toward the display region and is positioned within the predefined region in the medical environment, initiating an operator following mode in which a movement of the operator controller provides a corresponding movement to the teleoperational manipulator.
16 . The method of claim 15 , further comprising:
preventing initiation of the operator following mode responsive to a determination that the head portion is directed away from the display region.
17 . The method of claim 15 , wherein determining whether the head portion of the operator is directed toward or away from the display region includes determining a position and an orientation of a marker on the operator.
18 . The method of claim 15 , further comprising:
based on a determination that the head portion is directed away from the display region for a threshold time period, suspending the operator following mode.
19 . A non-transitory machine-readable medium comprising a plurality of machine-readable instructions which when executed by one or more processors associated with a medical device are adapted to cause the one or more processors to perform a method comprising:
determining whether a head portion of an operator of an operator controller is directed toward or away from a display region of a display device;
determining whether the head portion of the operator is positioned in a predefined region in a medical environment, wherein the predefined region comprises an operating volume defining an acceptable position of the operator within the medical environment; and
based on a determination that the head portion is directed toward the display region and is positioned within the predefined region in the medical environment, initiating an operator following mode in which a movement of the operator controller provides a corresponding movement to a teleoperational manipulator configured to operate a medical instrument in the medical environment.