Registered video endoscopy and virtual endoscopy
View Patent ↗An endo-robot can be tracked and a reconstructed 3D volume of data can be created for virtual endoscopy. The 3D position and orientation of each image captured by the endo-robot is determined. The longitudinal distance traveled inside the structure of interest is determined. The position, orientation and longitudinal distance are used to register the position of the endo-robot to a corresponding position inside the 3D volume of data. Virtual endoscopy can be used to locate areas of interest and correlate clinical findings with the images of the areas of interest.
1. A computer-implemented method for associating an image with an area of interest in a three-dimensional volume comprising:
modeling a volume as the three-dimensional volume;
tracking an image capturing device within the volume, storing position and orientation information of the image capturing device at a time when at least one image is captured;
determining a longitudinal distance traveled by the image capturing device at the time when the at least one image is captured;
registering the position, orientation and longitudinal distance of the image capturing device to a corresponding position within the three-dimensional volume;
determining an area of interest within the three-dimensional volume; and
determining the at least one image registered to correspond to the area of interest, wherein the at least one image is displayed and the area of interest is characterized.
2. The computer-implemented method of claim 1 , wherein registering further comprises:
determining a centerline of the three-dimensional volume;
determining a correspondence between a track of the image capturing device and the centerline of the three-dimensional volume, wherein the image capturing device is an endo-robot; and
registering the at least one image to a position within the three-dimensional volume according to the correspondence.
3. The computer-implemented method of claim 1 , wherein registering further comprises determining an initial position of the image capturing device and manually selecting a position corresponding to the initial position in the three-dimensional volume.
4. The computer-implemented method of claim 3 , wherein the longitudinal distance is a distance of the image capturing device from the initial position.
5. The computer-implemented method of claim 1 , wherein determining the at least one image comprises automatically displaying the at least one image in conjunction with the display of the corresponding position within the three-dimensional volume.
6. A non-transitory computer readable medium embodying instructions executed by a processor to perform method steps for associating an image with an area of interest in a three-dimensional volume, the method steps comprising:
modeling a volume as the three-dimensional volume;
tracking an image capturing device within the volume, storing position and orientation information of the image capturing device at a time when at least one image is captured;
determining a longitudinal distance traveled by the image capturing device at the time when the at least one image is captured;
registering the position, orientation and longitudinal distance of the image capturing device to a corresponding position within the three-dimensional volume;
determining an area of interest within the three-dimensional volume; and
determining the at least one image registered to correspond to the area of interest, wherein the at least one image is displayed.
7. The method of claim 6 , wherein registering further comprises:
determining a centerline of the three-dimensional volume;
determining a correspondence between a track of the image capturing device and the centerline of the three-dimensional volume, wherein the image capturing device is an endo-robot; and
registering the at least one image to a position within the three-dimensional volume according to the correspondence.
8. The method of claim 6 , wherein registering further comprises determining an initial position of the image capturing device and manually selecting a position corresponding to the initial position in the three-dimensional volume.
9. The method of claim 8 , wherein the longitudinal distance is a distance of the image capturing device from the initial position.
10. The method of claim 6 , wherein determining the at least one image comprises automatically displaying the at least one image in conjunction with the display of the corresponding position within the three-dimensional volume.