IP Library Granted Patent US 10,565,477
Granted Patent B2
US 10,565,477 · App. 16/511,972 · Granted Feb 18, 2020

Deep learning medical systems and methods for image reconstruction and quality evaluation

Inventors: Jiang Hsieh (Waukesha, WI); Gopal Avinash (San Ramon, CA); Saad Sirohey (Pewaukee, WI); Xin Wang (Clifton Park, NY); Zhye Yin (Schenectady, NY); Bruno De Man (Niskayuna, NY)
Assignee: General Electric Company
G06K9/6265G06K9/036G06K9/4604G06K9/4628G06N3/04G06N3/0454G06N3/08G06N3/084G06T7/0002G06T7/0012G06T2207/10081G06T2207/10088G06T2207/10104G06T2207/10108G06T2207/10116G06T2207/10132G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,565,477
App. No.
16/511,972
Granted
Feb 18, 2020
Kind
B2
Abstract

Methods and apparatus to automatically generate an image quality metric for an image are provided. An example method includes automatically processing a first medical image using a deployed learning network model to generate an image quality metric for the first medical image, the deployed learning network model generated from a digital learning and improvement factory including a training network, wherein the training network is tuned using a set of labeled reference medical images of a plurality of image types, and wherein a label associated with each of the labeled reference medical images indicates a central tendency metric associated with image quality of the image. The example method includes computing the image quality metric associated with the first medical image using the deployed learning network model by leveraging labels and associated central tendency metrics to determine the associated image quality metric for the first medical image.

Claims (34)

1. An apparatus comprising:

memory including instructions; and

at least one processor to execute the instructions to:

extract features from a registered image using anatomical markers and an image grid;

train an image quality learning network in which nodes represent features and weights are associated with at least a portion of the nodes in the image quality learning network, the image quality learning network trained to generate an image quality index;

process the registered image using a deployed model of the trained image quality learning network to generate the image quality index for the registered image; and

trigger a change in at least one of image acquisition or image reconstruction when the image quality index is less than a threshold.

2. The apparatus of claim 1 , wherein the at least one processor is to process the registered image by processing a portion of the registered image to generate the image quality index for the portion of the registered image.

3. The apparatus of claim 1 , wherein the image quality index includes at least one metric associated with spatial resolution, noise level, or detectability extracted from the registered image.

4. The apparatus of claim 1 , wherein the image quality learning network is trained using second features extracted from a set of labeled reference medical images, and wherein a label associated with each of the labeled reference medical images indicates an image quality index for the respective reference medical image, the second features associated with a target value for the image quality index.

5. The apparatus of claim 4 , wherein the at least one processor is to compare the image quality metric to the target value to determine a reliability of the deployed model.

6. The apparatus of claim 4 , wherein the wherein the trained image quality learning network is tested using one or more unlabeled images before the deployed model is generated from the trained image quality learning network.

7. The apparatus of claim 1 , wherein the image quality index is defined on a 5-point scale, wherein a low score on the 5-point scale indicates a low confidence to make a decision based on the registered image and wherein a high score on the 5-point scale indicates a high confidence to make the decision based on the registered image.

8. The apparatus of claim 1 , wherein the features are calculated from image intensity values including at least one of mean, standard deviation, skewness, kurtosis, energy, contract, moment, or entropy.

9. The apparatus of claim 1 , wherein the image quality learning network is trained using a reference medical image and at least one blurred variant of the reference medical image.

10. At least one tangible computer-readable storage medium comprising instructions that, when executed, cause at least one processor to:

extract features from a registered image using anatomical markers and an image grid;

train an image quality learning network in which nodes represent features and weights are associated with at least a portion of the nodes in the image quality learning network, the image quality learning network trained to generate an image quality index;

process the registered image using a deployed model of the trained image quality learning network to generate the image quality index for the registered image; and

trigger a change in at least one of image acquisition or image reconstruction when the image quality index is less than a threshold.

11. The at least one computer-readable storage medium of claim 10 , wherein the instructions, when executed, cause the at least one processor to process the registered image by processing a portion of the registered image to generate the image quality index for the portion of the registered image.

12. The at least one computer-readable storage medium of claim 10 , wherein the image quality index includes at least one metric associated with spatial resolution, noise level, or detectability extracted from the registered image.

13. The at least one computer-readable storage medium of claim 10 , wherein the instructions, when executed, cause the at least one processor to train the image quality learning network using second features extracted from a set of labeled reference medical images, and wherein a label associated with each of the labeled reference medical images indicates an image quality index for the respective reference medical image, the second features associated with a target value for the image quality index.

14. The at least one computer-readable storage medium of claim 13 , wherein the instructions, when executed, cause the at least one processor to compare the image quality metric to the target value to determine a reliability of the deployed model.

15. The at least one computer-readable storage medium of claim 13 , wherein the instructions, when executed, cause the at least one processor to test the trained image quality learning network using one or more unlabeled images before the deployed model is generated from the trained image quality learning network.

16. A method to extract an image quality index from an image, the method comprising:

extracting features from a registered image using anatomical markers and an image grid;

training an image quality learning network in which nodes represent features and weights are associated with at least a portion of the nodes in the image quality learning network, the image quality learning network trained to generate an image quality index;

processing the registered image using a deployed model of the trained image quality learning network to generate the image quality index for the registered image; and

triggering a change in at least one of image acquisition or image reconstruction when the image quality index is less than a threshold.

17. The method of claim 16 , wherein processing the registered image includes processing a portion of the registered image to generate the image quality index for the portion of the registered image.

18. The method of claim 16 , wherein training the image quality learning network includes training the image quality learning network using second features extracted from a set of labeled reference medical images, wherein a label associated with each of the labeled reference medical images indicates an image quality index for the respective reference medical image, the second features associated with a target value for the image quality index.

19. The method of claim 18 , further including comparing the image quality metric to the target value to determine a reliability of the deployed model.

20. The method of claim 16 , further including testing the trained image quality learning network using one or more unlabeled images before the deployed model is generated from the trained image quality learning network.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded May 8, 2025
From: GENERAL ELECTRIC COMPANY
To: GE PRECISION HEALTHCARE LLC
Reel/Frame 071225/0218 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2019
From: HSIEH, JIANG; AVINASH, GOPAL; SIROHEY, SAAD; WANG, XIN; YIN, ZHYE; DE MAN, BRUNO
To: GENERAL ELECTRIC COMPANY
Reel/Frame 049756/0095 →
Continuity (3)
Continuation 16126762 · Sep 10, 2018
Continuation 15360742 · Nov 23, 2016
Related Publication 20190340470A1 · Nov 7, 2019
Cited By (1)
US 12,524,932