IP Library Granted Patent US 9,761,014
Granted Patent B2
US 9,761,014 · App. 14/078,002 · Granted Sep 12, 2017

System and method for registering pre-operative and intra-operative images using biomechanical model simulations

Inventors: Ozan Oktay (Monmouth Junction, NJ); Li Zhang (Skillman, NJ)
Assignee: Siemens Healthcare GmbH
G06T7/33G06T2207/10081G06T2207/30028G06T2207/30056
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,761,014
App. No.
14/078,002
Granted
Sep 12, 2017
Kind
B2
Abstract

A method and system for registering pre-operative images and intra-operative images using biomechanical simulations is disclosed. A pre-operative image is initially registered to an intra-operative image by estimating deformations of one or more segmented anatomical structures in the pre-operative image, such as the liver, surrounding tissue, and the abdominal wall, using biomechanical gas insufflation model constrained. The initially registered pre-operative image is then refined using diffeomorphic non-rigid refinement.

Claims (56)

1. A method for registering a pre-operative image of a patient to an intra-operative image of the patient, comprising:

generating an initially registered pre-operative image by estimating deformations of one or more segmented anatomical structures in the pre-operative image using biomechanical gas insufflation model constrained registration with the intra-operative image; and

refining the initially registered pre-operative image using diffeomorphic non-rigid refinement.

2. The method of claim 1 , further comprising:

segmenting the one or more anatomical structures in the pre-operative image.

3. The method of claim 1 , wherein the one or more segmented anatomical structures comprise a target organ and one or more surrounding anatomical structures.

4. The method of claim 1 , wherein the one or more segmented anatomical structures comprise an abdomen wall, a liver, and tissue surrounding the liver.

5. The method of claim 1 , wherein generating an initially registered pre-operative image by estimating deformations of one or more segmented anatomical structures in the pre-operative image using biomechanical gas insufflation model constrained registration with the intra-operative image comprises:

(a) calculating deformations of the one or more segmented anatomical structures using a biomechanical gas insufflation model;

(b) generating a warped pre-operative image based on the calculated deformations of the one or more segmented anatomical structures;

(c) calculating an intensity similarity measure between the intra-operative image and the warped pre-operative image;

(d) updating parameters of the biomechanical gas insufflation model based on a gradient of the intensity similarity measure; and

(e) repeating steps (a)-(d) until convergence of the intensity similarity measure or the parameters of the biomechanical gas insufflation model.

6. The method of claim 5 , wherein the one or more segmented anatomical structures comprise a tetrahedral mesh of the one or more segmented anatomical structures, and calculating deformations of the one or more segmented anatomical structures using a biomechanical gas insufflation model comprises:

calculating a deformation at each of a plurality of mesh points of the tetrahedral mesh.

7. The method of claim 5 , wherein the parameters of the biomechanical gas insufflation model include Young's modulus, Poisson's ratio, and a gas pressure at each of the mesh points of the tetrahedral mesh.

8. The method of claim 5 , wherein the intensity similarity measure is a local cross correlation intensity similarity measure.

9. The method of claim 1 , wherein refining the initially registered pre-operative image using diffeomorphic non-rigid refinement comprises:

warping the initially registered pre-operative image to the intra-operative image using diffeomorphic non-rigid refinement.

10. An apparatus for registering a pre-operative image of a patient to an intra-operative image of the patient, comprising:

means for generating an initially registered pre-operative image by estimating deformations of one or more segmented anatomical structures in the pre-operative image using biomechanical gas insufflation model constrained registration with the intra-operative image; and

means for refining the initially registered pre-operative image using diffeomorphic non-rigid refinement.

11. The apparatus of claim 10 , further comprising:

means for segmenting the one or more anatomical structures in the pre-operative image.

12. The apparatus of claim 10 , wherein the one or more segmented anatomical structures comprise a target organ and one or more surrounding anatomical structures.

13. The apparatus of claim 10 , wherein the one or more segmented anatomical structures comprise an abdomen wall, a liver, and tissue surrounding the liver.

14. The apparatus of claim 10 , wherein the means for generating an initially registered pre-operative image by estimating deformations of one or more segmented anatomical structures in the pre-operative image using biomechanical gas insufflation model constrained registration with the intra-operative image comprises:

means for calculating deformations of the one or more segmented anatomical structures using a biomechanical gas insufflation model;

means for generating a warped pre-operative image based on the calculated deformations of the one or more segmented anatomical structures;

means for calculating an intensity similarity measure between the intra-operative image and the warped pre-operative image; and

means for updating parameters of the biomechanical gas insufflation model based on a gradient of the intensity similarity measure.

15. The apparatus of claim 14 , wherein the one or more segmented anatomical structures comprise a tetrahedral mesh of the one or more segmented anatomical structures, and the means for calculating deformations of the one or more segmented anatomical structures using a biomechanical gas insufflation model comprises:

means for calculating a deformation at each of a plurality of mesh points of the tetrahedral mesh.

16. The apparatus of claim 15 , wherein the parameters of the biomechanical gas insufflation model include Young's modulus, Poisson's ratio, and a gas pressure at each of the mesh points of the tetrahedral mesh.

17. The apparatus of claim 14 , wherein the intensity similarity measure is a local cross correlation intensity similarity measure.

18. The apparatus of claim 10 , wherein the means for refining the initially registered pre-operative image using diffeomorphic non-rigid refinement comprises:

means for warping the initially registered pre-operative image to the intra-operative image using diffeomorphic non-rigid refinement.

19. A non-transitory computer readable medium storing computer program instructions for registering a pre-operative image of a patient to an intra-operative image of the patient, the computer program instructions when executed by a processor cause the processor to perform operations comprising:

generating an initially registered pre-operative image by estimating deformations of one or more segmented anatomical structures in the pre-operative image using biomechanical gas insufflation model constrained registration with the intra-operative image; and

refining the initially registered pre-operative image using diffeomorphic non-rigid refinement.

20. The non-transitory computer readable medium of claim 19 , the operations further comprising:

segmenting the one or more anatomical structures in the pre-operative image.

21. The non-transitory computer readable medium of claim 19 , wherein the one or more segmented anatomical structures comprise a target organ and one or more surrounding anatomical structures.

22. The non-transitory computer readable medium of claim 19 , wherein the one or more segmented anatomical structures comprise an abdomen wall, a liver, and tissue surrounding the liver.

23. The non-transitory computer readable medium of claim 19 , wherein generating an initially registered pre-operative image by estimating deformations of one or more segmented anatomical structures in the pre-operative image using biomechanical gas insufflation model constrained registration with the intra-operative image comprises:

(a) calculating deformations of the one or more segmented anatomical structures using a biomechanical gas insufflation model;

(b) generating a warped pre-operative image based on the calculated deformations of the one or more segmented anatomical structures;

(c) calculating an intensity similarity measure between the intra-operative image and the warped pre-operative image;

(d) updating parameters of the biomechanical gas insufflation model based on a gradient of the intensity similarity measure; and

(e) repeating steps (a)-(d) until convergence of the intensity similarity measure or the parameters of the biomechanical gas insufflation model.

24. The non-transitory computer readable medium of claim 23 , wherein the one or more segmented anatomical structures comprise a tetrahedral mesh of the one or more segmented anatomical structures, and calculating deformations of the one or more segmented anatomical structures using a biomechanical gas insufflation model comprises:

calculating a deformation at each of a plurality of mesh points of the tetrahedral mesh.

25. The non-transitory computer readable medium of claim 24 , wherein the parameters of the biomechanical gas insufflation model include Young's modulus, Poisson's ratio, and a gas pressure at each of the mesh points of the tetrahedral mesh.

26. The non-transitory computer readable medium of claim 23 , wherein the intensity similarity measure is a local cross correlation intensity similarity measure.

27. The non-transitory computer readable medium of claim 19 , wherein refining the initially registered pre-operative image using diffeomorphic non-rigid refinement comprises:

warping the initially registered pre-operative image to the intra-operative image using diffeomorphic non-rigid refinement.

Assignments (5)
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 066088 FRAME: 0256. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2024
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 071178/0246 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2023
From: SIEMENS HEALTHCARE GMBH
To: SIEMENS HEALTHINEERS AG
Reel/Frame 066088/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2017
From: SIEMENS AKTIENGESELLSCHAFT
To: SIEMENS HEALTHCARE GMBH
Reel/Frame 043226/0817 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2013
From: SIEMENS CORPORATION
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 031776/0929 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 11, 2013
From: OKTAY, OZAN; ZHANG, LI
To: SIEMENS CORPORATION
Reel/Frame 031756/0857 →
Continuity (2)
Provisional Application 61726687 · Nov 15, 2012
Related Publication 20140133727A1 · May 15, 2014