Robotic systems for determining a roll of a medical device in luminal networks
Certain aspects relate to systems and techniques for navigation-assisted medical devices. Some aspects relate to correlating features of depth information generated based on captured images of an anatomical luminal network with virtual features of depth information generated based on virtual images of a virtual representation of the anatomical luminal network in order to automatically determine aspects of a roll of a medical device within the luminal network.
1. A method of facilitating a localization of an instrument within an anatomical luminal network of a patient, the method, executed by a set of one or more computing devices, comprising:
accessing a virtual three-dimensional model of internal surfaces of the anatomical luminal network of the patient;
identifying a first virtual location within the virtual three-dimensional model;
generating a first virtual depth map representing virtual distances between a virtual imaging device positioned at the first virtual location and surfaces within a field of view of the virtual imaging device when positioned at the first virtual location;
deriving a first virtual feature from the first virtual depth map, wherein the first virtual feature represents a spatial relationship between at least a first depth criterion and a second depth criterion in the first virtual depth map; and
storing the first virtual feature in a database with an association between the first virtual location and the first virtual feature.
2. The method of claim 1 , further comprising:
identifying a second virtual location within the virtual three-dimensional model;
generating a second virtual depth map representing virtual distances between the virtual imaging device positioned at the second virtual location and surfaces within a field of view of the virtual imaging device when positioned at the second virtual location;
deriving a second virtual feature from the second virtual depth map, wherein the second virtual feature represents a spatial relationship between two or more depth criterion in the second virtual depth map; and
storing the first virtual feature in the database with an associating between the second virtual location and the second virtual feature.
3. The method of claim 1 , further comprising:
providing the database to a navigation system configured to localize the instrument relative to the anatomical luminal network during a medical procedure based on the association between the first virtual location and the first virtual feature.
4. The method of claim 1 , wherein the spatial relationship includes a distance between the first depth criterion and the second depth criterion.
5. The method of claim 1 , wherein the spatial relationship includes a shape connecting the first depth criterion, the second depth criterion, and a third depth criterion.
6. The method of claim 1 , further comprises:
generating a virtual image representing the field of view of the virtual imaging device when positioned at the first virtual location, wherein generating the first virtual depth map further comprises identifying (i) a first pixel within the virtual image corresponding to the first depth criterion in the first virtual depth map and (ii) a second pixel corresponding to the second depth criterion in the first virtual depth map.
7. The method of claim 1 , wherein the storing of the first virtual feature in the database occur preoperatively.
8. The method of claim 1 , further comprises:
identifying a set of parameters of an imaging device; and
generating a virtual image representing the field of view of the virtual imaging device when positioned at the first virtual location based on the set of parameters of the imaging device.
9. The method of claim 8 , wherein the imaging device corresponds to the instrument.
10. The method of claim 8 , wherein the set of parameters include at least one of: a field of view, a lens distortion, a focal length, or a brightness shading.
11. A system of facilitating a localization of an instrument within an anatomical luminal network of a patient, the system comprising:
at least one computer-readable memory having stored thereon executable instructions; and
one or more processors in communication with the at least one computer-readable memory and configured to execute the instructions to cause the one or more processors to:
access a virtual three-dimensional model of internal surfaces of the anatomical luminal network of the patient;
identify a first virtual location within the virtual three-dimensional model;
generate a first virtual depth map representing virtual distances between a virtual imaging device positioned at the first virtual location and surfaces within a field of view of the virtual imaging device when positioned at the first virtual location;
derive a first virtual feature from the first virtual depth map, wherein the first virtual feature represents a spatial relationship between at least a first depth criterion and a second depth criterion in the first virtual depth map; and
store the first virtual feature in a database with an association between the first virtual location and the first virtual feature.
12. The system of claim 11 , wherein the one or more processors are configured to execute the instructions to further cause the one or more processors to:
identify a second virtual location within the virtual three-dimensional model;
generate a second virtual depth map representing virtual distances between the virtual imaging device positioned at the second virtual location and surfaces within a field of view of the virtual imaging device when positioned at the second virtual location;
derive a second virtual feature from the second virtual depth map, wherein the second virtual feature represents a spatial relationship between two or more depth criterion in the second virtual depth map; and
store the first virtual feature in the database with an associating between the second virtual location and the second virtual feature.
13. The system of claim 11 , wherein the one or more processors are configured to execute the instructions to further cause the one or more processors to:
provide the database to a navigation system configured to localize the instrument relative to the anatomical luminal network during a medical procedure based on the association between the first virtual location and the first virtual feature.
14. The system of claim 11 , wherein the spatial relationship includes a distance between the first depth criterion and the second depth criterion.
15. The system of claim 11 , wherein the spatial relationship includes a shape connecting the first depth criterion, the second depth criterion, and a third depth criterion.
16. The system of claim 11 , wherein the one or more processors are configured to execute the instructions to further cause the one or more processors to:
generate a virtual image representing the field of view of the virtual imaging device when positioned at the first virtual location, wherein generating the first virtual depth map further comprises identifying (i) a first pixel within the virtual image corresponding to the first depth criterion in the first virtual depth map and (ii) a second pixel corresponding to the second depth criterion in the first virtual depth map.
17. The system of claim 11 , wherein the first virtual feature is stored in the database preoperatively.
18. The system of claim 11 , wherein the one or more processors are configured to execute the instructions to further cause the one or more processors to:
identify a set of parameters of an imaging device; and
generate a virtual image representing the field of view of the virtual imaging device when positioned at the first virtual location based on the set of parameters of the imaging device.
19. The system of claim 18 , wherein the imaging device corresponds to the instrument.
20. The system of claim 18 , wherein the set of parameters include at least one of: a field of view, a lens distortion, a focal length, or a brightness.