Systems and methods for facilitating insertion of a surgical instrument into a surgical space
An exemplary system determines an insertion trajectory that a surgical instrument is positioned to follow when inserted into a surgical space. The system provides, for display by a display device, an image that depicts a portion of the surgical space captured by an imaging device and at least a portion of a representation of the insertion trajectory in the surgical space.
1 . A system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
determine, based on a surgical instrument coupled to a robotic manipulator arm of a computer-assisted surgical system, an insertion trajectory that the surgical instrument is positioned to follow when inserted into a surgical space;
provide, for display by a display device, an image that depicts a portion of the surgical space captured by an imaging device and at least a portion of a representation of the insertion trajectory in the surgical space;
determine, based on kinematics data indicative of at least one of a pose, a position, or an orientation of the robotic manipulator arm, that the insertion trajectory that the surgical instrument is predicted to follow would result in the surgical instrument contacting an object that is in the surgical space and that represents an obstruction to be avoided;
provide, for display by the display device and together with the representation of the insertion trajectory, an indication of the obstruction of the insertion trajectory by the object in the surgical space;
in response to at least one of the pose, the position, or the orientation of the robotic manipulator arm being changed, determine an updated insertion trajectory; and
control the robotic manipulator arm to move the surgical instrument along the updated insertion trajectory.
2 . The system according to claim 1 , wherein the representation of the insertion trajectory is a virtual representation of the surgical instrument, the virtual representation of the surgical instrument having a same visual appearance as the surgical instrument.
3 . The system according to claim 1 , wherein the representation of the insertion trajectory includes an animation depicting the representation of the insertion trajectory entering the surgical space within a field of view of the imaging device along the insertion trajectory.
4 . The system according to claim 1 , wherein the processor is further configured to execute instructions to:
determine an insertion depth that the surgical instrument is predicted to achieve when inserted into the surgical space; and
provide, for display by the display device, the representation of the insertion trajectory inserted into the surgical space at the determined insertion depth and along the insertion trajectory.
5 . The system according to claim 1 , wherein the processor is further configured to execute instructions to:
determine an insertion depth that the surgical instrument is predicted to achieve when inserted into the surgical space; and
provide, for display by the display device, the representation of the insertion trajectory inserted into the surgical space along the insertion trajectory and beyond the determined insertion depth.
6 . The system according to claim 1 , wherein the processor is further configured to execute instructions to:
provide, for display by the display device together with the representation of the insertion trajectory, an indicator that instructs a user to follow the insertion trajectory with the imaging device to view an opening through which the surgical instrument will be inserted into the surgical space.
7 . The system according to claim 1 , wherein the processor is further configured to execute instructions to:
determine, based on an additional surgical instrument, an additional insertion trajectory that the additional surgical instrument is positioned to follow when inserted into the surgical space; and
provide, for display by the display device together with the image that depicts the portion of the surgical space captured by the imaging device, at least a portion of an additional representation of the additional insertion trajectory in the surgical space.
8 . The system according to claim 7 , wherein the representation of the insertion trajectory is provided for display by the display device during a first time period and the additional representation of the additional insertion trajectory is provided for display by the display device during a second time period that does not overlap the first time period.
9 . The system according to claim 7 , wherein the representation of the insertion trajectory and the additional representation of the additional insertion trajectory are provided for concurrent display by the display device together with the image that depicts the portion of the surgical space.
10 . The system according to claim 7 , wherein the representation of the insertion trajectory is visually different from the additional representation of the additional insertion trajectory.
11 . The system according to claim 1 , wherein:
the object is an additional surgical instrument that is already inserted within the surgical space;
the processor is further configured to execute instructions to determine that the insertion trajectory that the surgical instrument is positioned to follow would result in the surgical instrument contacting the additional surgical instrument that is already inserted into the surgical space; and
the indication indicates that the surgical instrument is positioned to contact the additional surgical instrument if inserted along the insertion trajectory that the surgical instrument is positioned to follow.
12 . The system according to claim 11 , wherein the indication indicates that the surgical instrument is positioned to contact the additional surgical instrument is provided for display along the insertion trajectory.
13 . The system according to claim 1 , wherein the insertion trajectory is determined based on the kinematics data associated with the robotic manipulator arm to which the surgical instrument is coupled.
14 . The system according to claim 1 , wherein:
the display device comprises a stereoscopic image viewer configured to provide a three-dimensional (3D) image for display to a user; and
the representation of the insertion trajectory is provided for display within the 3D image when the insertion trajectory extends into a field of view of the imaging device.
15 . A system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
determine, based on a surgical instrument coupled to a robotic manipulator arm of a computer-assisted surgical system, an insertion trajectory that the surgical instrument is positioned to follow when inserted into a surgical space;
provide, for display by a display device, an image that depicts a portion of the surgical space captured by an imaging device and at least a portion of a representation of the insertion trajectory in the surgical space;
determine, based on kinematics data indicative of at least one of a pose, a position, or an orientation of the robotic manipulator arm, that the insertion trajectory that the surgical instrument is predicted to follow would result in the surgical instrument contacting an object that is in the surgical space and that represents an obstruction to be avoided;
prevent the surgical instrument from being inserted into the surgical space along the insertion trajectory until a determination has been made that the imaging device has been used to view an opening through which the surgical instrument is to be inserted;
provide, for display by the display device and together with the representation of the insertion trajectory, an indication of the obstruction of the insertion trajectory by the object in the surgical space;
in response to at least one of the pose, the position, or the orientation of the robotic manipulator arm being changed, determine an updated insertion trajectory; and
control the robotic manipulator arm to move the surgical instrument along the updated insertion trajectory.
16 . The system of claim 15 , wherein the processor is further configured to execute instructions to:
determine that the imaging device has been used to follow the representation of the insertion trajectory along the insertion trajectory and view the opening through which the surgical instrument is to be inserted; and
allow, in response to the determination that the imaging device has been used to view the opening, the surgical instrument to be inserted into the surgical space along the insertion trajectory.
17 . A method comprising:
determining, by an insertion trajectory visualization system and based on a surgical instrument coupled to a robotic manipulator arm of a computer-assisted surgical system, an insertion trajectory that the surgical instrument is positioned to follow when inserted into a surgical space;
providing, by the insertion trajectory visualization system and for display by a display device, an image that depicts a portion of the surgical space captured by an imaging device and at least a portion of a representation of the insertion trajectory in the surgical space;
determine, based on kinematics data indicative of at least one of a pose, a position, or an orientation of the robotic manipulator arm, that the insertion trajectory that the surgical instrument is predicted to follow would result in the surgical instrument contacting an object that is in the surgical space and that represents an obstruction to be avoided;
provide, by the insertion trajectory visualization system and for display by the display device and together with the representation of the insertion trajectory, an indication of the obstruction of the insertion trajectory by the object in the surgical space;
in response to at least one of the pose, the position, or the orientation of the robotic manipulator arm being changed, determine an updated insertion trajectory; and
control the robotic manipulator arm to move the surgical instrument along the updated insertion trajectory.
18 . The method according to claim 17 , further comprising:
determining, by the insertion trajectory visualization system, an insertion depth that the surgical instrument is predicted to achieve when inserted into the surgical space; and
providing, by the insertion trajectory visualization system and for display by the display device, the representation of the insertion trajectory inserted into the surgical space at the determined insertion depth and along the insertion trajectory.
19 . The method according to claim 17 , further comprising:
providing, for display by the display device together with the representation of the insertion trajectory, an indicator that instructs a user to follow the insertion trajectory with the imaging device to view an opening through which the surgical instrument will be inserted into the surgical space.
20 . The method according to claim 17 , wherein:
the object is an additional surgical instrument that is inserted into the surgical space;
the method further comprises determining, by the insertion trajectory visualization system, that the insertion trajectory that the surgical instrument is positioned to follow would result in the surgical instrument contacting the additional surgical instrument that is inserted into the surgical space; and
the indication indicates that the surgical instrument will contact the additional surgical instrument if inserted along the insertion trajectory that the surgical instrument is positioned to follow.