Granted Patent B2

US 12,657,702 · App. 18/184,192 · Granted Jun 16, 2026

Inventors: Norbert Johnson (North Andover, MA); Paden Troxell (Conshohocken, PA); Caroline Conrad (Emmaus, PA); Mert Erad (Malden, MA); Nicholas Maritato (Cambridge, MA); Michael Brauckmann (Woburn, MA); Neil R. Crawford (Chandler, AZ)

Assignee: Globus Medical, Inc.

G06T7/0012A61B6/4441A61B6/582A61B34/20A61B34/30A61B90/39G06F3/14G06T7/0014G06T7/30G06T7/344G06T7/70G06T7/75G06T15/08G06T15/205G06T17/00G06T19/00G16H30/20A61B2034/2055A61B2090/3966G06T2200/04G06T2207/10132G06T2207/30004G06T2207/30196G06T2207/30208G06T2207/30244G06T2210/41

Abstract

Claims (57)

1 . A method of registering a medical image of a patient in an imaging space to the patient in a physical space comprising:

receiving a pre-op 3D image of a patient anatomy, the pre-op 3D image representing a non-registered 3D volume of the patient anatomy;

receiving an intra-op 2D image of the patient anatomy which has been captured by an imaging device having imaging tracking markers trackable by a tracking device;

receiving a corresponding optical image of the patient from the tracking device at the time of image capture, the optical image containing the imaging tracking markers and a dynamic reference base (DRB) including patient tracking markers trackable by the tracking device;

matching the received 2D image to a corresponding simulated 2D image generated from the pre-op 3D image;

determining a registration of the received pre-op 3D image relative to the dynamic reference base based on the matched 2D image, and the patient tracking and imaging tracking markers contained in the received optical image, wherein

receiving the intra-op 2D image includes receiving a first 2D image and a second 2D image at a selected angle from the first 2D image;

matching the received intra-op 2D image includes:

synthetically generating a first digitally reconstructed radiograph (DRR) image from the pre-op 3D image and a second DRR image at the selected angle from the first 2D image;

comparing the first and second 2D images to the first and second DRR images of the pre-op 3D image at the same time;

repeating the steps of generating and comparing until a match is found between the first and second 2D images and the first and second DRR images of the pre-op 3D image.

2 . The method of claim 1 , wherein matching the received 2D image includes generating a plurality of 2D digitally reconstructed radiograph (DRR) images at different orientations to simulate a plurality of corresponding fluoroscopic images.

3 . The method of claim 1 , wherein matching the received 2D image includes:

synthetically generating a DRR image of the pre-op 3D image at a selected angle;

comparing the received 2D image to the generated DRR image;

repeating the steps of generating and comparing until a match is found between the received 2D image and the DRR image.

4 . The method of claim 3 , wherein:

receiving an intra-op 2D image includes receiving an intra-op ultrasound image; and

synthetically generating includes generating a simulated ultrasound image from the pre-op 3D image.

5 . The method of claim 3 , wherein comparing the received 2D image includes comparing a gradient in contrast of bony edges of the received 2D image to a corresponding DRR image.

6 . The method of claim 5 , wherein synthetically generating includes selecting a new angle and offset for a new DRR image based on whether the previous comparisons resulted in improving or worsening the match.

7 . The method of claim 1 , wherein determining a registration includes:

determining transform A representing the pose of the imaging device in the imaging space relative to the DRB in the physical space at the time the received 2D image is captured based on the received optical image.

8 . The method of claim 1 , wherein determining a registration includes:

determining transform B representing the pose of the received 2D image in the imaging space relative to the imaging device in the physical space based on the received optical image.

9 . The method of claim 8 , wherein determining transform B includes determining a spatial relationship between the received 2D image and the imaging tracking markers which has been adjusted with calibration data related to an amount of flex at different orientation of the imaging device.

10 . The method of claim 8 , wherein determining transform B includes determining a position of a detector panel relative to a position of the imaging tracking markers.

11 . The method of claim 1 , wherein determining a registration includes:

determining transform A representing the pose of the imaging device in the imaging space relative to the DRB in the physical space at the time the received 2D image is captured based on the received optical image;

determining transform B representing the pose of the received 2D image in the imaging space relative to the imaging device in the physical space based on the received optical image; and

determining transform C by multiplying transform A with transform B, transform C representing registration of the pose of the received 2D image relative to the DRB in the physical space.

12 . The method of claim 1 , further comprising displaying the 3D image on a display and superimposing a planned trajectory of a surgical instrument, and dynamically adjusting the displayed trajectory over the 3D image as the displayed trajectory is varied by a user based on registration information of the 3D image.

13 . The method of claim 1 , further comprising:

under control of the imaging device,

embedding by imaging device registration information in an image file of the received 2D image; and

transferring from the imaging device the image file containing the received 2D image and the imaging device registration information to a surgical robotic system; and

wherein the steps of matching and determining are performed by the surgical robotic system.

14 . A method of intra-operatively registering an unregistered pre-op 3D image of a patient in an imaging space to the patient in a physical space comprising:

receiving an unregistered pre-op 3D image of a patient anatomy;

receiving first and second intra-op 2D images of the patient anatomy at different orientations which have been captured by an imaging device having imaging tracking markers trackable by a tracking device;

receiving corresponding optical images of the patient from the tracking device at the time of image capture, the optical images containing patient tracking markers and the imaging tracking markers;

receiving the corresponding optical images of the patient from the tracking device at the time of image capture, each optical image containing the imaging tracking markers and a dynamic reference base (DRB) attached to the patient anatomy and including the patient tracking markers trackable by the tracking device;

without using any radiopaque fiducials, registering the received 2D images based on the patient tracking markers and the imaging tracking markers contained in the received optical images, registration of the 2D images representing the pose of the received 2D images in the imaging space relative to the patient anatomy in the physical space;

matching the received 2D images to corresponding simulated 2D images generated from the pre-op 3D image based on comparing the received 2D images to a plurality of simulated 2D images of the pre-op 3D image at different orientations;

determining a registration of the pose of the received pre-op 3D image relative to the dynamic reference base based on the matched 2D images, and registration information of the 2D images,

wherein registering the received 2D images includes:

determining transform A representing the pose of the imaging device in the imaging space relative to the DRB in the physical space at the time the intra-op 2D images are captured based on a spatial relationship between the tracking device and the imaging tracking markers, and between the tracking device and the DRB, the imaging tracking markers and the DRB being contained in the received optical images.

15 . The method of claim 14 , wherein:

receiving intra-op 2D images includes receiving intra-op ultrasound images at different orientations; and

simulated 2D images are simulated ultrasound images from the pre-op 3D image.

16 . The method of claim 14 , wherein registering the received 2D images includes:

determining transform B representing the pose of the received 2D images in the imaging space relative to the imaging device in the physical space based on a spatial relationship between the tracking device and the imaging tracking markers contained in the received optical images, and based on a position of a detector panel relative to the imaging tracking markers.

17 . The method of claim 16 , wherein determining transform B includes determining a spatial relationship between the received 2D images and the imaging tracking markers which has been adjusted with calibration data related to an amount of flex at different orientation of the imaging device.

18 . The method of claim 14 , wherein registering the received 2D images includes:

determining the transform A representing the pose of the imaging device in the imaging space relative to the DRB in the physical space at the time the received 2D images are captured based on the received optical images;

determining transform B representing the pose of the received 2D images in the imaging space relative to the imaging device in the physical space based on the received optical images; and

determining transform C by multiplying the transform A with transform B, transform C representing registration of the pose of the received 2D images relative to the DRB in the physical space.

Assignments (1)

Continuity (2)

References Cited (400)