Systems and methods for non-rigid deformation of tissue for virtual navigation of interventional tools
A method of modeling anatomic deformation comprises receiving a reference three dimensional model of a branched anatomical formation in a reference state. The method further comprises detecting deflection of the branched anatomical fomation with a shape sensor to create a three dimensional deformation field. The method further comprises applying the three dimensional deformation field to the reference three dimensional model to create a deformed three dimensional model of a deformed state of the branched anatomical formation. The method further comprises dynamically displaying an image of the deformed three dimensional model of the deformed state of the branched anatomical formation. The method further comprises displaying a composite image including an image of an interventional instrument positioned within the branched anatomical formation and the dynamically displayed image of the deformed three dimensional model of the deformed state of the branched anatomical formation.
1. A method comprising:
receiving a reference three dimensional model of a branched anatomical formation in a reference state;
detecting deflection of the branched anatomical formation with a shape sensor to create a three dimensional deformation field;
applying the three dimensional deformation field to the reference three dimensional model to create a deformed three dimensional model of a deformed state of the branched anatomical formation;
dynamically displaying an image of the deformed three dimensional model of the deformed state of the branched anatomical formation; and
displaying a composite image including an image of an interventional instrument positioned within the branched anatomical formation and the dynamically displayed image of the deformed three dimensional model of the deformed state of the branched anatomical formation.
2. The method of claim 1 wherein applying the three dimensional deformation field to the reference three dimensional model includes interpolating the three dimensional deformation field for a point on the reference three dimensional model.
3. The method of claim 2 wherein applying the three dimensional deformation field to the reference three dimensional model further includes transforming the point on the reference three dimensional model to a point on the deformed three dimensional model of the deformed state of the branched anatomical formation.
4. The method of claim 3 wherein transforming the point on the reference three dimensional model to the point on the deformed three dimensional model further includes assigning a weight to the point on the reference three dimensional model for each linkage in a plurality of linkages that influences the point on the reference three dimensional model.
5. The method of claim 4 wherein the weight assigned for each linkage is determined by generating a plurality of linkage models and adjusting the weight assigned for each linkage that influences the point on the reference three dimensional model until the point on the reference three dimensional model is transformed to the point on the deformed three dimensional model.
6. The method of claim 1 wherein applying the three dimensional deformation field to the reference three dimensional model is performed on a graphical processing unit.
7. The method of claim 1 wherein the deformed state of the branched anatomical formation is caused, at least in part, by a periodic anatomical motion.
8. The method of claim 1 wherein the deformed state of the branched anatomical formation is caused, at least in part, by the interventional instrument positioned within the branched anatomical formation.
9. The method of claim 1 wherein receiving the reference three dimensional model includes receiving a three dimensional mesh model.
10. The method of claim 1 wherein the deformed three dimensional model includes a deformed three dimensional mesh model.
11. The method of claim 10 wherein applying the three dimensional deformation field to the reference three dimensional model to create a deformed three dimensional model of a deformed state of the branched anatomical formation includes creating a deformed set of vertices, wherein the deformed three dimensional mesh model comprises the deformed set of vertices.
12. The method of claim 1 further comprising generating the three dimensional deformation field by:
generating a reference skeletal tree for the reference state of the branched anatomical formation;
generating a deformed skeletal tree for the deformed state of the branched anatomical formation; and
generating a three dimensional array of field vectors describing a deformation from the reference state to the deformed state, wherein the three dimensional deformation field comprises the three dimensional array of field vectors.
13. The method of claim 1 wherein displaying the image of the deformed three dimensional model of the deformed state of the branched anatomical formation includes displaying a sequence of images of intermediate deformations of the branched anatomical formation at a rate of at least approximately 30 sequential deformation images per second.
14. The method of claim 1 wherein the composite image is displayed in real time.
15. The method of claim 1 wherein the deformed state of the branched anatomical formation is caused by a periodic anatomical motion and by the interventional instrument positioned within the branched anatomical formation.
16. A processing system comprising:
a processor; and
a memory having computer readable instructions stored thereon, the computer readable instructions, when executed by the processor, cause the system to:
receive a reference three dimensional model of a branched anatomical formation in a reference state;
detect deflection of the branched anatomical formation with a shape sensor to create a three dimensional deformation field;
apply the three dimensional deformation field to the reference three dimensional model to create a deformed three dimensional model of a deformed state of the branched anatomical formation;
dynamically display an image of the deformed three dimensional model of the deformed state of the branched anatomical formation; and
display a composite image including an image of an interventional instrument positioned within the branched anatomical formation and the dynamically displayed image of the deformed three dimensional model of the deformed state of the branched anatomical formation.
17. The processing system of claim 16 wherein applying the three dimensional deformation field to the reference three dimensional model includes interpolating the three dimensional deformation field for a point on the reference three dimensional model.
18. The processing system of claim 17 wherein applying the three dimensional deformation field to the reference three dimensional model further includes transforming the point on the reference three dimensional model to a point on the deformed three dimensional model of the deformed state of the branched anatomical formation.
19. The processing system of claim 16 wherein applying the three dimensional deformation field to the reference three dimensional model is performed on a graphical processing unit.
20. The processing system of claim 16 wherein the deformed state of the branched anatomical formation is caused, at least in part, by a periodic anatomical motion.
21. The processing system of claim 16 wherein the deformed state of the branched anatomical formation is caused, at least in part, by the interventional instrument positioned within the branched anatomical formation.
22. The processing system of claim 16 wherein receiving the reference three dimensional model includes receiving a three dimensional mesh model.
23. The processing system of claim 16 wherein the deformed three dimensional model includes a deformed three dimensional mesh model.
24. The processing system of claim 23 wherein applying the three dimensional deformation field to the reference three dimensional model to create a deformed three dimensional model of a deformed state of the branched anatomical formation includes creating a deformed set of vertices, wherein the deformed three dimensional mesh model comprises the deformed set of vertices.
25. The processing system of claim 16 wherein the computer readable instructions, when executed by the processor further cause the system to generate the three dimensional deformation field by:
generating a reference skeletal tree for the reference state of the branched anatomical formation;
generating a deformed skeletal tree for the deformed state of the branched anatomical formation; and
generating a three dimensional array of field vectors describing a deformation from the reference state to the deformed state, wherein the three dimensional deformation field comprises the three dimensional array of field vectors.
26. The processing system of claim 16 wherein displaying the image of the deformed three dimensional model of the deformed state of the branched anatomical formation includes displaying a sequence of images of intermediate deformations of the branched anatomical formation at a rate of at least approximately 30 sequential deformation images per second.