IP Library Granted Patent US 11,185,249
Granted Patent B2
US 11,185,249 · App. 16/817,454 · Granted Nov 30, 2021

Self ensembling techniques for generating magnetic resonance images from spatial frequency data

Inventors: Jo Schlemper (Long Island City, NY); Seyed Sadegh Moshen Salehi (Bloomfield, NJ); Michal Sofka (Princeton, NJ)
Assignee: Hyperfine, Inc.
A61B5/055G01R33/36G01R33/383G01R33/445G01R33/5608G01R33/5611G06K9/6203G06K9/6245G06K9/741G06K9/748G06N3/0454G06N3/08G06N3/082G06T3/60G06T7/0012G06T7/262G06T7/38G06T11/006G06T11/008G16H30/40G06T2207/10088G06T2207/20056G06T2207/20081G06T2207/20084G06T2207/20182G06T2207/20216G06T2207/20224G06T2207/30016G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,185,249
App. No.
16/817,454
Granted
Nov 30, 2021
Kind
B2
Abstract

Techniques for generating magnetic resonance (MR) images of a subject from MR data obtained by a magnetic resonance imaging (MRI) system, the techniques including: obtaining input MR data obtained by imaging the subject using the MRI system; generating a plurality of transformed input MR data instances by applying a respective first plurality of transformations to the input MR data; generating a plurality of MR images from the plurality of transformed input MR data instances and the input MR data using a non-linear MR image reconstruction technique; generating an ensembled MR image from the plurality of MR images at least in part by: applying a second plurality of transformations to the plurality of MR images to obtain a plurality of transformed MR images; and combining the plurality of transformed MR images to obtain the ensembled MR image; and outputting the ensembled MR image.

Claims (73)

1. A method for generating magnetic resonance (MR) images of a subject from MR data obtained by a magnetic resonance imaging (MRI) system, the method comprising:

obtaining input MR data obtained by imaging the subject using the MRI system;

generating a plurality of transformed input MR data instances by applying a respective first plurality of transformations to the input MR data;

generating a plurality of MR images from the plurality of transformed input MR data instances and the input MR data using a non-linear MR image reconstruction technique;

generating an ensembled MR image from the plurality of MR images at least in part by:

applying a second plurality of transformations to the plurality of MR images to obtain a plurality of transformed MR images, wherein the second plurality of transformations are selected to reverse effects of applying the first plurality of transformations; and

combining the plurality of transformed MR images to obtain the ensembled MR image; and

outputting the ensembled MR image.

2. The method of claim 1 , wherein using the non-linear MR image reconstruction technique comprises applying a neural network model to the transformed input MR data instances to obtain the plurality of MR images.

3. The method of claim 1 , wherein using the non-linear MR image reconstruction technique comprises using a compressed sensing technique.

4. The method of claim 1 , wherein applying a first plurality of transformations to the input MR data comprises applying one or more of a constant phase shift transformation, a linear phase shift transformation, a complex conjugation transformation, a rotation transformation, a transpose transformation, and/or a reflection transformation.

5. The method of claim 1 , wherein:

applying the first plurality of transformations to the input MR data comprises applying the first plurality of transformations to the input MR data in a spatial frequency domain;

applying the second plurality of transformations to the plurality of MR images comprises applying the second plurality of transformations to the plurality of MR images in an image domain; and

the second plurality of transformations are selected to reverse effects of applying the first plurality of transformations in the spatial frequency domain.

6. The method of claim 1 , wherein the input MR data comprises first spatial frequency MR data (y i ) for generating an image for a first anatomy slice of a subject and second spatial frequency MR data (y i+1 ) for generating an image for a second anatomy slice of the subject, and wherein:

generating the plurality of transformed input MR data instances comprises generating a first transformed input MR data instance (y i +1 ) by adding the second spatial frequency MR data to the first spatial frequency MR data;

generating the plurality of MR images comprises:

generating a first MR image (x i +1 ) from the first transformed data instance (y i +1 ), and

generating a second MR image (x i+1 ) from the second MR spatial frequency data (y i+1 ); and

generating the ensembled MR image comprises:

subtracting the second MR image from the first MR image (x i +1 −x i+1 ).

7. The method of claim 1 , wherein the input MR data comprises first spatial frequency MR data for generating an image for a first anatomy slice of a subject and second spatial frequency MR data for generating one or more images for one or more other anatomy slices of the subject, and wherein:

generating the plurality of transformed input MR data instances comprises generating a first transformed input MR data instance by combining the first spatial frequency MR data and the second spatial frequency MR data;

generating the plurality of MR images comprises:

generating a first MR image from the first transformed input MR data instance, and

generating one or more second MR images from the second spatial frequency MR data; and

generating the ensembled MR image comprises:

subtracting the one or more second MR images from the first MR image.

8. The method of claim 1 , wherein the first plurality of transformations includes a complex conjugation transformation and the second plurality of transformations includes a reflection transformation.

9. The method of claim 1 , wherein combining the plurality of transformed MR images to obtain the ensembled MR image comprises computing the ensembled MR image as a weighted average of the plurality of transformed MR images.

10. At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform a method for generating magnetic resonance (MR) images of a subject from MR data obtained by a magnetic resonance imaging (MRI) system, the method comprising:

obtaining input MR data obtained by imaging the subject using the MRI system;

generating a plurality of transformed input MR data instances by applying a respective first plurality of transformations to the input MR data;

generating a plurality of MR images from the plurality of transformed input MR data instances and the input MR data using a non-linear MR image reconstruction technique;

generating an ensembled MR image from the plurality of MR images at least in part by:

applying a second plurality of transformations to the plurality of MR images to obtain a plurality of transformed MR images, wherein the second plurality of transformations are selected to reverse effects of applying the first plurality of transformations; and

combining the plurality of transformed MR images to obtain the ensembled MR image; and

outputting the ensembled MR image.

11. The at least one non-transitory computer readable storage medium of claim 10 , wherein using the non-linear MR image reconstruction technique comprises applying a neural network model to the transformed input MR data instances to obtain the plurality of MR images.

12. The at least one non-transitory computer readable storage medium of claim 10 , wherein using the non-linear MR image reconstruction technique comprises using a compressed sensing technique.

13. The at least one non-transitory computer readable storage medium of claim 10 , wherein applying a first plurality of transformations to the input MR data comprises applying one or more of a constant phase shift transformation, a linear phase shift transformation, a complex conjugation transformation, a rotation transformation, a transpose transformation, and/or a reflection transformation.

14. The at least one non-transitory computer readable storage medium of claim 10 , wherein:

applying the first plurality of transformations to the input MR data comprises applying the first plurality of transformations to the input MR data in a spatial frequency domain;

applying the second plurality of transformations to the plurality of MR images comprises applying the second plurality of transformations to the plurality of MR images in an image domain; and

the second plurality of transformations are selected to reverse effects of applying the first plurality of transformations in the spatial frequency domain.

15. The at least one non-transitory computer readable storage medium of claim 10 , wherein the input MR data comprises first spatial frequency MR data (y i ) for generating an image for a first anatomy slice of a subject and second spatial frequency MR data (y i+1 ) for generating an image for a second anatomy slice of the subject, and wherein:

generating the plurality of transformed input MR data instances comprises generating a first transformed input MR data instance (y i +1 ) by adding the second spatial frequency MR data to the first spatial frequency MR data;

generating the plurality of MR images comprises:

generating a first MR image (x i +1 ) from the first transformed data instance (y i +1 ), and

generating a second MR image (x i+1 ) from the second MR spatial frequency data (y i+1 ); and

generating the ensembled MR image comprises:

subtracting the second MR image from the first MR image (x i +1 −x i+1 ).

16. The at least one non-transitory computer readable storage medium of claim 10 , wherein the input MR data comprises first spatial frequency MR data for generating an image for a first anatomy slice of a subject and second spatial frequency MR data for generating one or more images for one or more other anatomy slices of the subject, and wherein:

generating the plurality of transformed input MR data instances comprises generating a first transformed input MR data instance by combining the first spatial frequency MR data and the second spatial frequency MR data;

generating the plurality of MR images comprises:

generating a first MR image from the first transformed input MR data instance, and

generating one or more second MR images from the second spatial frequency MR data; and

generating the ensembled MR image comprises:

subtracting the one or more second MR images from the first MR image.

17. The at least one non-transitory computer readable storage medium of claim 10 , wherein the first plurality of transformations includes a complex conjugation transformation and the second plurality of transformations includes a reflection transformation.

18. The at least one non-transitory computer readable storage medium of claim 10 , wherein combining the plurality of transformed MR images to obtain the ensembled MR image comprises computing the ensembled MR image as a weighted average of the plurality of transformed MR images.

19. A magnetic resonance imaging (MRI) system configured to capture a magnetic resonance (MR) image, the MRI system comprising:

a magnetics system having a plurality of magnetics components to produce magnetic fields for performing MRI; and

at least one processor configured to perform:

obtaining input MR data obtained by imaging a subject using the MRI system;

generating a plurality of transformed input MR data instances by applying a respective first plurality of transformations to the input MR data;

generating a plurality of MR images from the plurality of transformed input MR data instances and the input MR data using a non-linear MR image reconstruction technique;

generating an ensembled MR image from the plurality of MR images at least in part by:

applying a second plurality of transformations to the plurality of MR images to obtain a plurality of transformed MR images, wherein the second plurality of transformations are selected to reverse effects of applying the first plurality of transformations; and

combining the plurality of transformed MR images to obtain the ensembled MR image; and

outputting the ensembled MR image.

20. The MRI system of claim 19 , wherein the plurality of magnetics components comprises at least one permanent B 0 magnet configured to generate a B 0 magnetic field, the at least one permanent B 0 magnet comprising a plurality of permanent magnet rings.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE THIRD INVENTOR NAME SHOULD BE CORRECTED TO READ SEYED SADEGH MONSENI SALEHI PREVIOUSLY RECORDED AT REEL: 056675 FRAME: 0040. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 19, 2022
From: SCHLEMPER, JO; SOFKA, MICHAL; SALEHI, SEYED SADEGH MOHSENI
To: HYPERFINE RESEARCH, INC.
Reel/Frame 060728/0796 →
CHANGE OF NAME Recorded Mar 7, 2022
From: HYPERFINE, INC.
To: HYPERFINE OPERATIONS, INC.
Reel/Frame 059332/0615 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 24, 2021
From: SCHLEMPER, JO; SOFKA, MICHAL; MOSHEN SALEHI, SEYED SADEGH
To: HYPERFINE RESEARCH, INC.
Reel/Frame 056675/0040 →
CHANGE OF NAME Recorded Jun 24, 2021
From: HYPERFINE RESEARCH, INC.
To: HYPERFINE, INC.
Reel/Frame 056675/0186 →
Continuity (4)
Provisional Application 62926890 · Oct 28, 2019
Provisional Application 62820119 · Mar 18, 2019
Provisional Application 62818148 · Mar 14, 2019
Related Publication 20200294229A1 · Sep 17, 2020