Method and system for improving 2D-3D registration convergence
A method for registration of digital medical images is provided. The method includes the step of storing a 3D digital medical image having a 3D anatomical feature and a first coordinate system and storing a 2D digital medical image having a 2D anatomical feature and a second coordinate system. The method further includes the steps of storing a placement of a digital medical object on the 3D digital medical image and the 2D digital medical image and generating a simulated 2D digital medical image from the 3D digital medical image, wherein the simulated 2D digital medical image comprises a simulated 2D anatomical feature corresponding to the 3D anatomical feature. The 2D anatomical feature is compared with the simulated 2D anatomical feature until a match is reached and a registration of the first coordinate system with the second coordinate system based on the match is determined.
1. A surgical robot system comprising: a robot having a robot arm, a robot base and an image registration facility configured to receive a pre-op three-dimensional (3D) medical image of a patient and intra-op two-dimensional (2D) medical image of the patient; and
at least one camera configured to detect one or more tracking markers in an anatomical coordinate system;
wherein the image registration facility is configured to generate a simulated 2D digital medical image from the 3D medical image and perform a 2D-3D registration by matching the simulated 2D digital medical image to the received 2D medical image, wherein the image registration facility initially associates the simulated 2D digital medical image to the received 2D medical image as a starting point of the 2D-3D registration by corresponding a first digital medical object placed on the 3D medical image by a user with a second digital medical object placed on the received 2D medical image by the user,
wherein the position of the robot arm and a position of the patient, using the one or more tracking markers, in the anatomical coordinate system are represented on a display,
wherein the robot arm is coupled to an end effector, the end effector being configured with one or more tracking markers on the surface of the end effector to be monitored when the end effector is translated and rotated in the surgical field.
2. The system of claim 1 , wherein the 3D medical image is generated by at least one of a computed tomography (CT) system and magnetic resonance imaging (MRI) system.
3. The system of claim 1 , wherein the received 2D medical image is generated by an x-ray system.
4. The system of claim 1 , wherein the anatomical coordinate system is at least in part determined by an image tracking system that tracks the location of the patient.
5. The system of claim 1 , wherein the 3D medical image is pre-operatively obtained from one of a tomography (CT) system and magnetic resonance imaging (MRI) system, and the received 2D medical image is intra-operatively obtained from an x-ray system.
6. The system of claim 1 , wherein the first digital medical object is a surgical medical implant device.
7. The system of claim 1 , wherein the first digital medical object is at least one of a digitally-simulated bio-active implant device, electronics-based medical implant device, and artificial medical transplant material.
8. The system of claim 1 , wherein the placement of the first digital medical object appears as a shadow.
9. The system of claim 1 , wherein the placement of the first digital medical object provides a region of interest upon which the step of comparing begins.
10. The system of claim 1 , wherein the placement of the corresponding first digital medical object placed on the 3D digital image and the received 2D medical image is provided with a placement tolerance.
11. The system of claim 1 , wherein the match is determined within a matching tolerance.
12. The system of claim 1 , wherein the image registration facility associates the simulated 2D digital medical image to the received 2D medical image as a starting point of the 2D-3D registration to determine an area of interest in the 3D medical image.
13. The system of claim 12 , wherein the image registration facility determine the starting point for iteratively matching the received 2D medical image to the 3D medical image to perform the 2D-3D registration.
14. The system of claim 1 , wherein the image registration facility generates two simulated 2D digital medical images of two respective intra-op x-ray medical images including an anterior-posterior medical image and a lateral medical image.