IP Library Granted Patent US 12,062,187
Granted Patent B2
US 12,062,187 · App. 16/865,145 · Granted Aug 13, 2024

Single- and multi-modality alignment of medical images in the presence of non-rigid deformations using phase correlation

Inventors: Georgi Gerganov (Sofia, BG); Iwan Kawrykow (Cleveland, OH)
Assignee: ViewRay Systems, Inc.
G06T7/20G06T7/30G06T7/32G06T2207/10072G06T2207/20016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,062,187
App. No.
16/865,145
Granted
Aug 13, 2024
Kind
B2
Abstract

A phase correlation method (PCM) can be used for translational and/or rotational alignment of 3D medical images even in the presence of non-rigid deformations between first and second images of a registered volume of a patient.

Claims (52)

1. A system comprising:

at least one programmable processor; and

a non-transitory machine-readable medium storing instructions which, when executed by the at least one programmable processor, cause the at least one programmable processor to perform operations comprising:

receiving a first medical image of a patient taken at a first time and at a first position and a second medical image of the patient taken at a second time and at a second position, the first medical image and the second medical image being different from each other due to a deformation;

identifying a skin surface of the patient in the first medical image or the second medical image;

zeroing at least one voxel in the first medical image or the second medical image that is outside the skin surface;

comparing, after the zeroing, the first medical image and the second medical image using a phase correlation method to determine a displacement, the comparing comprising:

calculating an inverse Fourier transform of a cross-power spectrum of the first medical image and the second medical image, the inverse Fourier transform having a peak spread around neighboring voxels due to the deformation; and

calculating the displacement based at least partially on the intensities of the neighboring voxels;

determining, based on the displacement, a change to a physical location of the patient; and

correcting, based on the determined change, the second position of the patient to more closely conform to a first position of the patient.

2. The system of claim 1 , wherein the skin surface is identified in the first medical image and the second medical image.

3. The system of claim 2 , the identifying further comprising applying a marching squares algorithm to a plurality of slices of the first medical image and the second medical image.

4. The system of claim 3 , wherein the slices are transverse slices.

5. The system of claim 3 , wherein an isosurface for the marching squares algorithm is 0.5 times an average intensity of the voxels in the first medical image and the second medical image.

6. The system of claim 1 , the calculating of the displacement further comprising:

finding a maximum intensity of the inverse Fourier transform of the cross-power spectrum; and

selecting as the peak, from a plurality of voxels having intensities greater than a threshold determined based on the maximum intensity, a voxel for which a sum of voxel intensities of the neighboring voxels around the voxel is highest, wherein the neighboring voxels are in a window sized as a fraction of a number of voxels along each dimension of a common registration grid.

7. The system of claim 6 , further comprising determining the displacement of the peak by calculating a centroid of the voxel intensities of the neighboring voxels inside the window.

8. The system of claim 1 , wherein the first medical image and the second medical image are obtained using different imaging modalities.

9. A non-transitory machine-readable medium storing instructions that, when executed by at least one programmable processor, cause the at least one programmable processor to perform operations comprising:

receiving a first medical image of a patient taken at a first time and at a first position and a second medical image of the patient taken at a second time and at a second position, the first medical image and the second medical image being different from each other due to a deformation;

identifying a skin surface of the patient in the first medical image or the second medical image;

zeroing at least one voxel in the first medical image or the second medical image that is outside the skin surface;

comparing, after the zeroing, the first medical image and the second medical image using a phase correlation method to determine a displacement, the comparing comprising:

calculating an inverse Fourier transform of a cross-power spectrum of the first medical image and the second medical image, the inverse Fourier transform having a peak spread around neighboring voxels due to the deformation; and

calculating the displacement based at least partially on the intensities of the neighboring voxels;

determining, based on the displacement, a change to a physical location of the patient; and

correcting, based on the determined change, the second position of the patient to more closely conform to a first position of the patient.

10. The machine-readable medium of claim 9 , wherein the skin surface is identified in the first medical image and the second medical image.

11. The machine-readable medium of claim 10 , the identifying further comprising applying a marching squares algorithm to a plurality of slices of the first medical image and the second medical image.

12. The machine-readable medium of claim 11 , wherein the slices are transverse slices.

13. The machine-readable medium of claim 11 , wherein an isosurface for the marching squares algorithm is 0.5 times an average intensity of the voxels in the first medical image and the second medical image.

14. The machine-readable medium of claim 9 , the calculating of the displacement further comprising:

finding a maximum intensity of the inverse Fourier transform of the cross-power spectrum; and

selecting as the peak, from a plurality of voxels having intensities greater than a threshold determined based on the maximum intensity, a voxel for which a sum of voxel intensities of the neighboring voxels around the voxel is highest, wherein the neighboring voxels are in a window sized as a fraction of a number of voxels along each dimension of a common registration grid.

15. The machine-readable medium of claim 14 , further comprising determining the displacement of the peak by calculating a centroid of the voxel intensities of the neighboring voxels inside the window.

16. The machine-readable medium of claim 9 , wherein the first medical image and the second medical image are obtained using different imaging modalities.

17. A system comprising:

at least one programmable processor; and

a non-transitory machine-readable medium storing instructions which, when executed by the at least one programmable processor, cause the at least one programmable processor to perform operations comprising:

receiving a first medical image of a patient taken at a first time and at a first position and a second medical image of the patient taken at a second time and at a second position, the first medical image and the second medical image being different from each other due to a deformation;

identifying a skin surface of the patient in the first medical image or the second medical image, wherein the skin surface is identified in the first medical image and the second medical image, the identifying further comprising applying a marching squares algorithm to a plurality of slices of the first medical image and the second medical image, wherein an isosurface for the marching squares algorithm is 0.5 times an average intensity of the voxels in the first medical image and the second medical image;

zeroing at least one voxel in the first medical image or the second medical image that is outside the skin surface;

comparing, after the zeroing, the first medical image and the second medical image using a phase correlation method to determine a displacement;

determining, based on the displacement, a change to a physical location of the patient; and

correcting, based on the determined change, the second position of the patient to more closely conform to a first position of the patient.

18. The system of claim 17 , wherein the skin surface is identified in the first medical image and the second medical image.

19. The system of claim 17 , wherein the slices are transverse slices.

20. The system of claim 17 , the comparing comprising:

calculating an inverse Fourier transform of a cross-power spectrum of the first medical image and the second medical image, the inverse Fourier transform having a peak spread around neighboring voxels due to the deformation; and

calculating the displacement based at least partially on the intensities of the neighboring voxels.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: VIEWRAY, INC.; VIEWRAY TECHNOLOGIES, INC.
To: VIEWRAY SYSTEMS, INC.
Reel/Frame 067096/0625 →
SECURITY INTEREST Recorded Mar 24, 2023
From: VIEWRAY TECHNOLOGIES, INC.; VIEWRAY, INC.
To: MIDCAP FUNDING IV TRUST
Reel/Frame 063157/0703 →
CHANGE OF NAME Recorded May 12, 2020
From: VIEWRAY INCORPORATED
To: VIEWRAY TECHNOLOGIES, INC.
Reel/Frame 052643/0941 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2020
From: GERGANOV, GEORGI; KAWRYKOW, IWAN
To: VIEWRAY INCORPORATED
Reel/Frame 052604/0265 →
Continuity (4)
Continuation 16036701 · Jul 16, 2018
Continuation 14559880 · Dec 3, 2014
Provisional Application 61911379 · Dec 3, 2013
Related Publication 20200258238A1 · Aug 13, 2020