METHODS AND SYSTEMS FOR USING MULTI VIEW POSE ESTIMATION

1 . A method, comprising:

receiving a sequence of medical images captured by a medical imaging device while the medical imaging device is rotated through a rotation, wherein the sequence of medical images show an area of interest that includes a plurality of landmarks;

determining a pose of each of a subset of the sequence of medical images in which the plurality of landmarks are visible;

estimating a trajectory of movement of the medical imaging device based on the determined poses of the subset of the sequence of medical images and a trajectory constraint of the imaging device;

determining a pose of at least one of the medical images in which the plurality of landmarks are at least partially not visible by extrapolating based on an assumption of continuity of movement of the medical imaging device; and

determining a volumetric reconstruction for the area of interest based at least on (a) at least some of the poses of the subset of the sequence of medical images in which the plurality of landmarks are visible and (b) at least one of the poses of the at least one of the medical images in which the plurality of landmarks are at least partially not visible.

2 . The method of claim 1 , wherein the poses of each of the subset of the sequence of medical images are determined based on 2D-3D correspondences between 3D positions of the plurality of landmarks and 2D positions of the plurality of landmarks as viewed in the subset of the sequence of medical images.

3 . The method of claim 2 , wherein the 3D positions of the plurality of landmarks are determined based on at least one preoperative image.

4 . The method of claim 2 , wherein the 3D positions of the plurality of landmarks are determined by application of a structure from motion technique.

5 . A method, comprising:

receiving a plurality of medical images using an imaging device mounted to a C-arm while the medical imaging device is rotated through a motion of the C-arm having a constrained trajectory, wherein at least some of the plurality of medical images include an area of interest;

determining a pose of each of a subset of the plurality of medical images;

calculating locations of a plurality of 3D landmarks based on 2D locations of the 3D landmarks in the subset of the plurality of medical images and based on the determined poses of each of the subset of the plurality of medical images;

determining a pose of a further one of the plurality of medical images in which at least some of the 3D landmarks are visible by determining an imaging device position and an imaging device orientation based at least on a known 3D-2D correspondence of the 3D landmark; and

calculating a volumetric reconstruction of the area of interest based on at least the further one of the plurality of medical images and the pose of the further one of the plurality of medical images.

6 . The method of claim 5 , wherein the pose of each of the subset of the plurality of medical images is determined based at least on a pattern of radiopaque markers visible in the subset of the plurality of medical images.

7 . The method of claim 6 , wherein the pose is further determined based on the constrained traj ectory.

8 . A method, comprising:

receiving a sequence of medical images captured by a medical imaging device while the medical imaging device is rotated through a rotation, wherein the sequence of medical images show an area of interest including a landmark having a 3D shape;

calculating a pose of each of at least some of the medical images based on at least 3D-2D correspondence of a 2D projection of the landmark in each of the at least some of the medical images; and

calculating a volumetric reconstruction of the area of interest based on at least the at least some of the medical images and the calculated poses of the at least some of the medical images.

9 . The method of claim 8 , wherein the landmark is an anatomical landmark.

10 . The method of claim 9 , wherein the 3D shape of the anatomical landmark is determined based at least on at least one preoperative image.

11 . The method of claim 8 , wherein the 3D shape of the landmark is determined based at least on applying a structure from motion technique to at least some of the sequence of medical images.

12 . The method of claim 11 , wherein the structure from motion technique is applied to all of the sequence of medical images.

13 . The method of claim 8 , wherein the pose is calculated for all of the sequence of medical images.

14 . The method of claim 8 , wherein the sequence of images does not show a plurality of radiopaque markers.

15 . The method of claim 8 , wherein the calculating a pose of each of the at least some of the medical images is further based on a known trajectory of the rotation.

16 . The method of claim 8 , wherein the 3D shape of the landmark is determined based on at least one preoperative image and further based on applying a structure from motion technique to at least some of the sequence of medical images.

17 . The method of claim 8 , wherein the landmark is an instrument positioned within a body of a patient at the area of interest.

18 . The method of claim 8 , wherein the landmark is an object positioned proximate to a body of a patient and outside the body of the patient.

19 . The method of claim 18 , wherein the object is fixed to the body of the patient.