Endoscope with inertial measurement units and/or haptic input controls
An endoscope having an insertion tube with a distal optical module and a releasable handle. In a semi-robotic embodiment, the handle comprises haptic controllers and a computer configured for steering and/or adjusting physical properties of the insertion tube in response to one or more command inputs from the haptic controllers. The computer may also convert image data received from the optical module into two-dimensional images displayable on a monitor. The endoscope may have inertial measurement units (IMUs) for providing data to the computer for creating a digital three-dimensional image representation of an anatomy model and/or for facilitating handling properties of the endoscope.
1. An endoscope system comprising:
a flexible elongate insertion tube having a deflectable distal end and a proximal end;
an optical module disposed at the distal end of the insertion tube and adapted to receive image data of a body cavity of a living body, wherein the image data comprises a plurality of image frames;
one or more inertial measurement units (IMUs) disposed within the insertion tube;
a plurality of cables extending proximally through the insertion tube from corresponding anchor points at the distal end of the insertion tube;
a handle releasably connected to the proximal end of the insertion tube, the handle including a plurality of electro-mechanical actuators, each actuator being operatively associated with a corresponding cable of the plurality of cables extending through the insertion tube, and one or more haptic devices for inputting commands for manipulating physical properties of the insertion tube; and
a computer configured to:
manipulate physical properties of the insertion tube by driving the plurality of electro-mechanical actuators in response to one or more command inputs from the one or more haptic devices,
convert the image data received from the optical module into two-dimensional images displayable on a monitor,
create a digital three-dimensional image representation of an anatomy model by combining position and orientation data received from the one or more IMUs, wherein the position and orientation data comprises discrete IMU pose data points sequentially arranged along a path traced through the living body by the distal end of the insertion tube, and the image data received from the optical module, and to further combine the position and orientation data received from the one or more IMUs into the creation of the digital three-dimensional image representation of the anatomy model;
wherein dynamic and automatic adjustment of the plurality of electro-mechanical actuators via the computer is achieved as a response to position and orientation data received from the one or more IMUs; and
wherein the computer is further configured to create the digital three-dimensional image representation by:
associating each image frame or a sampling of image frames with a discrete IMU pose data point to create a discrete image pose datum; and
storing each image pose datum as a) a new reference and b) relative to prior references.
2. The endoscope system of claim 1 , wherein the computer is further configured to provide the one or more haptic devices with kinesthetic haptic feedback relative to a tensile load applied by the plurality of electro-mechanical actuators to the corresponding cables.
3. The endoscope system of claim 1 , wherein the computer is further configured to drive one or more of the plurality of electro-mechanical actuators in response to the one or more command inputs from the one or more haptic devices to achieve a pre-defined ratio of measured haptic device input motions to insertion tube kinematic outputs.
4. The endoscope system of claim 1 , wherein the computer is further configured to create the digital three-dimensional image representation by, as the path is re-traced through the living body by the distal end of the insertion tube, replacing pose data previously received from the one or more IMUs and replacing the image data previously received from the optical module.
5. The endoscope system of claim 1 , wherein the computer is further configured to create the digital three-dimensional image representation by progressively stitching together each image frame or sampling of image frames using the associated pose data point to locate and orientate the image frames in a digital three-dimensional or spatial image map surrounding the path thereby creating the digital three-dimensional image representation displayable as an endoluminal rendering on the monitor.
6. The endoscope system of claim 1 , wherein the computer is further configured for portraying a current location and orientation of the distal end of the insertion tube superimposed on an endoluminal rendering of the digital three-dimensional image representation on the monitor.
7. An endoscope system comprising:
an elongate insertion tube having a distal end and a proximal end;
a handle releasably connected to the proximal end of the insertion tube, the handle including a plurality of electro-mechanical actuators;
one or more optical modules disposed at the distal end of the insertion tube and adapted to receive image data of a body cavity of a living body, wherein the image data comprises a plurality of image frames;
one or more inertial measurement units (IMUs) disposed in the insertion tube; and
a computer configured to:
provide dynamic and automatic adjustment of one or more of the plurality of electro-mechanical actuators, achieved as a response to position and orientation data received from the one or more IMUs, wherein the position and orientation data comprises discrete IMU pose data points sequentially arranged along a path traced through the living body by the distal end of the insertion tube;
combine the position and orientation data received from the one or more IMUs, and image data received from the one or more optical modules to create a digital three-dimensional image representation of an anatomy model displayable on a monitor; and
facilitate handling properties of the insertion tube body by driving one or more of the plurality of electro-mechanical actuators to dynamically and automatically adjust torsional and bending stiffness characteristics of the insertion tube to pre-defined specification ranges which correspond to a tortuosity of the anatomy model;
wherein the computer is further configured to create the digital three-dimensional image representation by:
associating each image frame or a sampling of image frames with a discrete IMU pose data point to create a discrete image pose datum; and
storing each image pose datum as a) a new reference and b) relative to prior references.
8. The endoscope system of claim 7 , wherein the computer is further configured to create the digital three-dimensional image representation by, as the path is re-traced through the living body by the distal end of the insertion tube, replacing pose data previously received from the one or more IMUs and replacing the image data previously received from the one or more optical modules.
9. The endoscope system of claim 7 , wherein the computer is further configured to create the digital three-dimensional image representation by progressively stitching together each image frame or sampling of image frames using the associated pose data point to locate and orientate the image frames in a digital three-dimensional or spatial image map surrounding the path thereby creating the digital three-dimensional image representation displayable as an endoluminal rendering on the monitor.
10. The endoscope system of claim 7 , wherein the computer is further configured for portraying a current location and orientation of the distal end of the insertion tube superimposed on an endoluminal rendering of the digital three-dimensional image representation on the monitor.
11. A system comprising:
a flexible elongate insertion tube;
an optical module disposed at a distal end of the insertion tube and adapted to receive image data of a body cavity of a living body along a path traced through the living body by the distal end of the insertion tube, wherein the image data comprises a plurality of image frames;
one or more inertial measurement units (IMUs) disposed within the insertion tube; and
a computer configured to create a digital three-dimensional image representation of an anatomy model by combining position and orientation data received from the one or more IMUs and image data received from the optical module, wherein the position and orientation data includes discrete IMU pose data points sequentially arranged along the path traced through the living body by the distal end of the insertion tube; and
the computer is further configured to:
create the digital three-dimensional image representation of the anatomy model by associating each image frame from the plurality of image frames with a discrete IMU pose data point to create a discrete image pose datum; and
store each image pose datum as a) a new reference and b) relative to prior references.
12. The system of claim 11 , wherein the one or more IMUs comprise:
one or more distal IMUs disposed at the distal end of the insertion tube;
one or more intermediate IMUs disposed along a length of the insertion tube; and
one or more proximal IMUs disposed in a handle and/or in a connector releasably connected to a proximal end of the insertion tube.
13. The system of claim 11 , wherein the computer is further configured to facilitate handling properties of the insertion tube by driving a plurality of electro-mechanical actuators to dynamically and automatically adjust torsional and bending stiffness characteristics of the insertion tube to pre-defined specification ranges which correspond to a tortuosity of the anatomy model.
14. The system of claim 11 , wherein the computer is further configured to portray a current location and orientation of the distal end of the insertion tube superimposed on an endoluminal rendering of the digital three-dimensional image representation on a monitor.
15. The system of claim 11 , wherein the computer is further configured to create the digital three-dimensional image representation by, as the path is re-traced through the living body by the distal end of the insertion tube, replacing pose data previously received from the one or more IMUs and replacing the image data previously received from the optical module.
16. The system of claim 11 , wherein the computer is further configured to create the digital three-dimensional image representation by progressively stitching together each image frame or sampling of image frames using the associated pose data point to locate and orientate the image frames in a digital three-dimensional or spatial image map surrounding the path thereby creating the digital three-dimensional image representation displayable as an endoluminal rendering on a monitor.