Method and system for assisting an operator in endoscopic navigation
Navigation guidance is provided to an operator of an endoscope by determining a current position and shape of the endoscope relative to a reference frame, generating an endoscope computer model according to the determined position and shape, and displaying the endoscope computer model along with a patient computer model referenced to the reference frame so as to be viewable by the operator while steering the endoscope within the patient.
1. A surgical system comprising:
an elongated flexible instrument including a camera, the camera being configured to capture real-time images of a visited anatomy;
a display screen configured to display a synthetic representation of the elongated flexible instrument and of the visited anatomy registered to a three-dimensional patient computer model, wherein the synthetic representation of the elongated flexible instrument is three-dimensional and is registered to the three-dimensional patient computer model so as to provide endoscopic navigation assistance to an operator, and wherein the display screen is configured to display the three-dimensional patient computer model; and
a display processor configured to:
display on the display screen at least one of the captured real-time images adjacent to the synthetic representation of the elongated flexible instrument, the captured image being displayed in a position based on the registration of the synthetic representation of the elongated flexible instrument to the three-dimensional patient computer model; and
display on the display screen, over the three-dimensional patient computer model, a representation of a view angle of the elongated flexible instrument, wherein the representation of the view angle is displayed so as to appear to project from a distal tip of the elongated flexible instrument.
2. The surgical system of claim 1 wherein the elongated flexible instrument includes at least one sensor for determining shape.
3. The surgical system of claim 2 wherein the at least one sensor includes an optical fiber extending along the elongated flexible instrument.
4. The surgical system of claim 2 wherein the synthetic representation of the elongated flexible instrument is generated based on shape information from the at least one sensor.
5. The surgical system of claim 1 wherein the three-dimensional patient computer model is generated from a computed tomography scan.
6. The surgical system of claim 1 wherein the three-dimensional patient computer model is recorded prior to inserting the elongated flexible instrument into a patient anatomy.
7. The surgical system of claim 1 wherein the three-dimensional patient computer model is registered to a patient anatomy within a fixed reference frame.
8. The surgical system of claim 1 wherein the elongated flexible instrument is teleoperatively steerable.
9. The surgical system of claim 1 wherein the display screen is further configured to display an indicator of a target site within a patient anatomy modeled by the three-dimensional patient computer model.
10. The surgical system of claim 1 wherein the synthetic representation of the elongated flexible instrument is selectable from a plurality of directional view synthetic representations of the elongated flexible instrument.
11. The surgical system of claim 1 wherein the display screen is further configured to display an image captured by the elongated flexible instrument.
12. The surgical system of claim 1 wherein the synthetic representation of the elongated flexible instrument represents a length of the elongated flexible instrument extending from a distal portion of the elongated flexible instrument to a portion of the elongated flexible instrument at an anatomic entry point of a patient anatomy registered to the three-dimensional patient computer model.
13. The surgical system of claim 1 wherein the synthetic representation of the elongated flexible instrument represents a length of the elongated flexible instrument extending from a distal portion of the elongated flexible instrument to a portion of the elongated flexible instrument at an organ entry point of an organ of a patient anatomy registered to the three-dimensional patient computer model.
14. A teleoperative surgical system comprising:
an elongated flexible instrument including a camera and a teleoperatively steerable portion for insertion within a patient anatomy, wherein the camera is configured to capture real-time images of a visited anatomy;
a display screen configured to display a synthetic representation of the elongated flexible instrument and of the visited anatomy within the patient anatomy registered to a three-dimensional patient computer model of the patient anatomy, wherein the synthetic representation of the elongated flexible instrument is registered to the three-dimensional patient computer model of the patient anatomy so as to provide endoscopic navigation assistance to an operator, and wherein the display screen is configured to display the three-dimensional patient computer model; and
a display processor configured to:
display on the display screen at least one of the captured real-time images adjacent to the synthetic representation of the elongated flexible instrument, the captured image being displayed in a position based on the registration of the synthetic representation of the elongated flexible instrument to the three-dimensional patient computer model of the patient anatomy; and
display on the display screen, over the three-dimensional patient computer model, a representation of a view angle of the elongated flexible instrument, wherein the representation of the view angle is displayed so as to appear to project from a distal tip of the elongated flexible instrument.
15. The teleoperative surgical system of claim 14 wherein the elongated flexible instrument includes at least one sensor for determining shape.
16. The teleoperative surgical system of claim 15 wherein the at least one sensor includes an optical fiber extending along the elongated flexible instrument.
17. The teleoperative surgical system of claim 15 wherein the synthetic representation of the elongated flexible instrument is generated based on shape information from the at least one sensor.
18. The teleoperative surgical system of claim 14 wherein the synthetic representation of the elongated flexible instrument is a three-dimensional synthetic representation.
19. The surgical system of claim 1 wherein the elongated flexible instrument comprises a distal tip, and wherein the displaying the captured image comprises displaying the captured image so as to appear to project from the distal tip of the synthetic representation of the elongated flexible instrument being displayed on the display screen.
20. The surgical system of claim 1 , wherein the three-dimensional patient computer model includes an exterior model including a torso of a patient.