Systems, apparatuses, and methods for endoscopy
A portable endoscopic system comprising an imaging unit for an endoscopic procedure. The imaging unit has an imaging coupler for receiving imaging information from an imaging assembly of an endoscope; a display integrated into a housing of the imaging unit; an image processing unit for processing the received imaging information into images of a time series and to displaying the image in real-time; a motion sensor configured to detect a motion of the housing; and a detection processing unit. The detection processing unit is configured to classify at least one anatomical feature in each image of the time series based on an artificial intelligence classifier; determine a confidence metric of the classification; determine a motion vector based on the detected motion; and display, concurrently with the corresponding image, the classification of the at least one anatomical feature, the determined confidence metric, and the determined motion vector.
1. A method, comprising:
receiving, by a processor, an imagery from an endoscope imaging a cavity, wherein the imagery depicts an anatomical feature within the cavity;
performing, by the processor, a classification for the anatomical feature while the endoscope images the cavity;
determining, by the processor, a confidence metric for the classification while the endoscope images the cavity;
determining, by the processor, a motion vector for the endoscope imaging the cavity while the endoscope images the cavity; and
taking, by the processor, an action based on the classification, the confidence metric, and the motion vector,
wherein at least one of:
(a) the cavity is illuminated by an external light source tethered to a housing hosting the processor;
(b) the endoscope is disposed in tandem with a device having a handle, an actuator, an end effector, a enclosure, and a display, wherein the housing hosts the display; or
(c) the endoscope is disposed into a region of interest in tandem with an action device, wherein the action device includes an end effector.
2. The method of claim 1 , wherein the action includes deploying the end effector within the cavity being imaged by the endoscope.
3. The method of claim 1 , wherein the action includes causing, by the processor, the display to present the imagery simultaneous with at least two of the classification, the confidence metric, or the motion vector over the imagery while the endoscope images the cavity.
4. The method of claim 3 , wherein the processor is included in an imaging unit including the housing and the display integrated into the housing.
5. The method of claim 4 , wherein the display is a touchscreen.
6. The method of claim 1 , wherein the motion vector is determined based on a detection processing unit and a motion processing unit such that the detection processing unit receives a motion signal from the motion processing unit to determine the motion vector.
7. The method of claim 1 , wherein the imagery is compared to a trained model to determine the classification and the confidence metric.
8. The method of claim 1 , wherein the action includes causing a transmitter to be in communication with an external device such that the external device displays the imagery simultaneous with at least two of the classification, the confidence metric, or the motion vector over the imagery while the endoscope images the cavity.
9. The method of claim 1 , wherein the classification is performed based on a model selected from a set of models before the endoscope is inserted into the cavity.
10. The method of claim 1 , wherein (a) the cavity is illuminated by the external light source tethered to the housing hosting the processor.
11. The method of claim 1 , wherein (c) the endoscope is disposed into the region of interest in tandem with the action device, wherein the action device includes the end effector.
12. The method of claim 1 , wherein the display has a size and a resolution, and further comprising:
causing, by the processor, the imagery to be aligned such that the imagery is centered in the display independent of the size or the resolution.
13. The method of claim 1 , wherein the processor is a plurality of processors.
14. The method of claim 1 , wherein the imagery depicts at least a portion of the end effector deployed within the cavity while the endoscope images the cavity.
15. The method of claim 1 , wherein the motion vector is determined based on a motion signal of the housing associated with the endoscope.
16. The method of claim 1 , further comprising:
receiving, by the processor, a user input selecting a procedure identifier; and
retrieving, by the processor, a model corresponding to the procedure identifier, wherein the classification is based on the imagery being compared with the model.
17. The method of claim 1 , wherein (b) the endoscope is disposed in tandem with the device having the handle, the actuator, the end effector, the enclosure, and the display, wherein the enclosure hosts the display.
18. The method of claim 1 , wherein the action enables an output on a headset computer.
19. The method of claim 1 , wherein the endoscope images the cavity during at least one of a prevention, a diagnosis, a monitoring, an amelioration, or a treatment of at least one of a neurological condition, a neurodegenerative disease, an inflammatory disease or disorder, a gastrointestinal condition, a bronchial disorder, a coronary artery disease, a heart attack, an arrhythmia, a cardiomyopathy, a urinary disorder, a cancer, or a metabolic disorder.
20. The method of claim 1 , wherein the processor is a single processor.
21. The method of claim 1 , wherein the endoscope is a digital endoscope with a chip-on-a-tip arrangement.