Systems, apparatuses, and methods for endoscopy
A portable endoscopic system comprising an imaging unit for an endoscopic procedure. The imaging unit has an imaging coupler for receiving imaging information from an imaging assembly of an endoscope; a display integrated into a housing of the imaging unit; an image processing unit for processing the received imaging information into images of a time series and to displaying the image in real-time; a motion sensor configured to detect a motion of the housing; and a detection processing unit. The detection processing unit is configured to classify at least one anatomical feature in each image of the time series based on an artificial intelligence classifier; determine a confidence metric of the classification; determine a motion vector based on the detected motion; and display, concurrently with the corresponding image, the classification of the at least one anatomical feature, the determined confidence metric, and the determined motion vector.
1. A method, comprising:
receiving, by a processor, an imagery from an endoscope imaging a cavity having a feature, wherein the imagery depicts the feature;
performing, by the processor, a classification for the feature while the endoscope images the cavity;
determining, by the processor, a confidence metric for the classification while the endoscope images the cavity;
determining, by the processor, a motion vector for the endoscope imaging the cavity while the endoscope images the cavity; and
taking, by the processor, an action based on the classification, the confidence metric, and the motion vector,
wherein at least one of:
(a) wherein the action includes deploying an end effector within the cavity being imaged by the endoscope;
(b) wherein the motion vector is determined based on a motion signal of a housing associated with the endoscope, wherein the housing hosts a display simultaneously presenting the imagery and at least two of the classification, the confidence metric, or the motion vector over the imagery while the endoscope images the cavity;
(c) wherein the imagery depicts at least a portion of an end effector deployed within the cavity while the endoscope images the cavity; or
(d) further comprising:
receiving, by the processor, a user input selecting a procedure identifier; and
retrieving, by the processor, a model corresponding to the procedure identifier, wherein the classification is based on the imagery being compared with the model.
2. The method of claim 1 , wherein the action includes requesting, by the processor, a display to simultaneously present the imagery and at least two of the classification, the confidence metric, or the motion vector over the imagery while the endoscope images the cavity.
3. The method of claim 2 , wherein the processor requests the display to simultaneously present the classification, the confidence metric, and the motion vector over the imagery while the endoscope images the cavity.
4. The method of claim 1 , (a) wherein the action includes deploying the end effector within the cavity being imaged by the endoscope.
5. The method of claim 1 , (b) wherein the motion vector is determined based on the motion signal of the housing associated with the endoscope, wherein the housing hosts the display simultaneously presenting the imagery and at least two of the classification, the confidence metric, or the motion vector over the imagery while the endoscope images the cavity.
6. The method of claim 5 , wherein the display is a touchscreen.
7. The method of claim 1 , (c) wherein the imagery depicts at least the portion of the end effector deployed within the cavity while the endoscope images the cavity.
8. The method of claim 7 , wherein the motion vector is determined based on a motion signal of a housing associated with the endoscope.
9. The method of claim 1 , wherein the endoscope is disposed in tandem with a device having a handle, an actuator, an end effector, a housing, and a display, wherein the housing hosts the display.
10. The method of claim 9 , wherein the device has a light source tethered to the housing.
11. The method of claim 1 , (d) further comprising:
receiving, by the processor, the user input selecting the procedure identifier; and
retrieving, by the processor, the model corresponding to the procedure identifier, wherein the classification is based on the imagery being compared with the model.
12. The method of claim 1 , wherein the processor is a single processor.
13. The method of claim 1 , wherein the processor is a plurality of processors.
14. The method of claim 1 , wherein the display has a size and a resolution, and further comprising:
causing, by the processor, the imagery to be aligned such that the imagery is centered in a display independent of the size or the resolution.
15. The method of claim 1 , wherein the endoscope is a digital endoscope with a chip-on-a-tip arrangement.
16. The method of claim 1 , wherein the endoscope images the cavity during at least one of a prevention, a diagnosis, a monitoring, an amelioration, or a treatment of at least one of a neurological condition, a neurodegenerative disease, an inflammatory disease or disorder, a gastrointestinal condition, a bronchial disorder, a coronary artery disease, a heart attack, an arrhythmia, a cardiomyopathy, a urinary disorder, a cancer, or a metabolic disorder.
17. The method of claim 1 , wherein the cavity is within an inanimate object.
18. The method of claim 1 , wherein the motion vector is determined based on a detection processing unit and a motion processing unit such that the detection processing unit receives a motion signal from the motion processing unit to determine the motion vector.
19. The method of claim 1 , wherein the action includes causing a transmitter to be in communication with an external device such that the external device displays the imagery simultaneous with at least two of the classification, the confidence metric, or the motion vector over the imagery while the endoscope images the cavity.
20. The method of claim 1 , wherein the action enables an output on a headset computer.