IP Library › Granted Patent US 10,332,253
Granted Patent B2
US 10,332,253 · App. 15/633,858 · Granted Jun 25, 2019

Methods and devices for registration of image data sets of a target region of a patient

Inventors: Jonathan Behar (Barnet, GB); Alexander Brost (Erlangen, DE); Peter Mountney (London, GB); Maria Panayiotou (London, GB); Kawal Rhode (Croydon, GB); Aldo Rinaldi (London, GB); Daniel Toth (Twickenham, GB)
G06T7/0012A61B5/0035A61B6/037A61B2017/00243A61B2090/364A61B2090/367A61B2090/374A61B2090/376G06T7/344G06T2207/10088G06T2207/10116G06T2207/30004G06T2207/30048G06T2207/30101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,332,253
App. No.
15/633,858
Filed
Jun 27, 2017
Granted
Jun 25, 2019
Kind
B2
Art Unit
2662
USPC
382/128
Abstract

A method for registering image data sets of a target region of a patient includes selecting a first anatomical structure only or at least partially only visible in the first image data set, and a second anatomical structure only or at least partially only visible in the second image data set, such that there is a known geometrical relationship between extended segments of the anatomical structures; automatically determining a first geometry information describing the geometry of at least a part of the first anatomical structure and a second geometry information describing the geometry of at least a part of the second anatomical structure, neither information being sufficient to enable registration of the image data sets on its own; automatically optimizing transformation parameters describing a rigid transformation of one of the anatomical structures with respect to the other and geometrical correspondences; and determining registration information from the optimized transformation parameters.

Claims (45)

1. A method for registering a first image data set and a second image data set of a target region of a patient, the method comprising:

selecting a first anatomical structure only or at least partially only visible in the first image data set and a second anatomical structure only or at least partially only visible in the second image data set, wherein the first anatomical structure is different from the second anatomical structure, wherein the selection is based on a known geometrical relationship between the first and second anatomical structures, and wherein the first and the second image data sets have been acquired using different imaging modalities or using different imaging techniques on a same imaging modality;

automatically evaluating, by a processor, the first and second image data sets to determine first geometry information describing a geometry of at least a part of the first anatomical structure and second geometry information describing a geometry of at least a part of the second anatomical structure, wherein neither the first geometry information nor the second geometry information is independently able to register the first and second image data sets;

automatically optimizing, by the processor, transformation parameters by minimizing deviations from the known geometrical relationship, wherein the transformation parameters comprise a rigid transformation of one of the first or second anatomical structures with respect to the other anatomical structure and geometrical correspondences between features in the first and second geometry information;

determining registration information from the optimized transformation parameters;

registering the first image data set and the second image data set using the registration information to provide a fusion image; and

displaying the fusion image.

2. The method of claim 1 , wherein the known geometrical relationship describes as least partly parallel or touching or intersecting surfaces of the first and second anatomical structures.

3. The method of claim 1 , wherein the first anatomical structure is a tissue layer delimiting an organ or organ part, or adjacent to a secondary tissue layer delimiting an organ or organ part, and

wherein the second anatomical structure is a blood vessel structure on or parallel to a surface of the organ.

4. The method of claim 3 , wherein the first anatomical structure is an epicardium or a myocardium.

5. The method of claim 3 , wherein the first geometry information is determined using tissue segmentation, or

wherein the second geometry information is determined using vessel segmentation.

6. The method of claim 1 , wherein the first image data set has been acquired without a contrast agent, and

wherein the second image data set has been acquired using a contrast agent.

7. The method of claim 1 , wherein the first image data set is a magnetic resonance image data set and the second image data set is an x-ray image data set.

8. The method of claim 7 , wherein a blood vessel structure is reconstructed as the second anatomical structure from multiple two-dimensional x-ray images of the second image data set,

wherein a specific point identifiable in each of the x-ray images is detected in all x-ray images, and

wherein, using the specific point as a starting point, pixels corresponding to a same blood vessel are detected using a constraint that a blood vessel tree is interconnected.

9. The method of claim 8 , wherein the specific point is a specific point of a medical instrument used to temporally block a blood vessel or a specific point of a bifurcation.

10. The method of claim 1 , wherein the first geometry information, the second geometry information, or both the first and second geometry information comprise a point cloud representation, a surface representation, or both the point cloud representation and the surface representation.

11. The method of claim 10 , wherein the surface representation is a mesh.

12. The method of claim 1 , wherein a globally optimized iterative closest point algorithm, a globally optimized coherent point drift algorithm, or both the globally optimized iterative closest point algorithm and the globally optimized coherent point drift algorithm are used for optimizing the transformation parameters.

13. The method of claim 1 , wherein a boundary condition describing possible motion of the patient between acquisition of the first image data set and the second image data set is used to reduce a parameter space of the optimization of the transformation parameters.

14. The method of claim 1 , wherein at least one correlation information regarding the first image data set and the second image data set is used as a part of an optimization target function or as a boundary condition while optimizing the transformation parameters or for refining the registration information.

15. The method of claim 1 , wherein the fusion image is created for image guidance during a medical interventional procedure.

16. The method of claim 1 , further comprising:

reacquiring the second image data set at least once during an intervention in the target region; and updating the registration information with at least one reacquisition of the second image data set.

17. The method of claim 16 , wherein the registration information is updated in real time.

18. A registration device for registration of a first image data set and a second image data set of a target region of a patient, wherein the first and the second image data sets have been acquired using different imaging modalities or using different imaging techniques on a same imaging modality, the registration device comprising:

a processor configured to:

select a first anatomical structure only or at least partially only visible in the first image data set and a second anatomical structure only or at least partially only visible in the second image data set, wherein the first anatomical structure is different from the second anatomical structure, and wherein the selection is based on a known geometrical relationship between the first and second anatomical structures;

automatically evaluate the first and second image data sets to determine first geometry information describing a geometry of at least a part of the first anatomical structure and second geometry information describing a geometry of at least a part of the second anatomical structure, wherein neither the first geometry information nor the second geometry information is independently able to register the first and second image data sets;

automatically optimize transformation parameters by minimizing deviations from the known geometrical relationship, wherein the transformation parameters comprise a rigid transformation of one of the first or second anatomical structures with respect to the other anatomical structure and geometrical correspondences between features in the first and second geometry information;

determine registration information from the optimized transformation parameters;

register the first image data set and the second image data set using the registration information to provide a fusion image; and

display the fusion image.

19. A computer comprising:

a non-transitory electronically readable storage medium including a computer program that when executed, the non-transitory electronically readable storage medium and computer program configured to cause a computer to perform:

select a first anatomical structure only or at least partially only visible in a first image data set and a second anatomical structure only or at least partially only visible in a second image data set, wherein the first anatomical structure is different from the second anatomical structure, and wherein the selection is based on a known geometrical relationship between at least extended segments of the first and second anatomical structures;

automatically evaluate the first and second image data sets to determine first geometry information describing a geometry of at least a part of the first anatomical structure and second geometry information describing a geometry of at least a part of the second anatomical structure, wherein neither the first geometry information nor the second geometry information is independently able to register the first and second image data sets;

automatically optimize transformation parameters by minimizing deviations from the known geometrical relationship, wherein the transformation parameters comprise a rigid transformation of one of the first or second anatomical structures with respect to the other anatomical structure and geometrical correspondences between features in the first and second geometry information;

determine registration information from the optimized transformation parameters;

register the first image data set and the second image data set using the registration information to provide a fusion image; and

display the fusion image.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066267/0346 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2021
From: KING'S COLLEGE LONDON
To: SIEMENS HEALTHCARE LIMITED
Reel/Frame 057726/0894 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2021
From: SIEMENS HEALTHCARE LIMITED
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 057726/0905 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2019
From: BEHAR, JONATHAN; PANAYIOTOU, MARIA; RHODE, KAWAL; RINALDI, ALDO
To: KING'S COLLEGE LONDON
Reel/Frame 048927/0111 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2019
From: MOUNTNEY, PETER; TOTH, DANIEL
To: SIEMENS HEALTHCARE LIMITED
Reel/Frame 048893/0259 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2019
From: BROST, ALEXANDER
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 048893/0293 →
Priority Claims (1)
EP 16176653 · Jun 28, 2016 · regional
Continuity (1)
Related Publication 20170372474A1 · Dec 28, 2017