IP Library Granted Patent US 12,217,852
Granted Patent B2
US 12,217,852 · App. 17/699,190 · Granted Feb 4, 2025

Image processing device, image processing method, image processing program, learning device, learning method, learning program, and derivation model

Inventor: Atsushi Tachibana (Tokyo, JP)
Assignee: FUJIFILM Corporation
G16H30/40G06F17/12G06T7/0012G06T2207/10081G06T2207/30088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,852
App. No.
17/699,190
Granted
Feb 4, 2025
Kind
B2
Abstract

An image acquisition unit acquires at least one target medical image having a representation format different from an MRI image. A tissue eigenvalue derivation unit has a derivation model constructed by machine learning using a plurality of teacher data to, in a case in which at least one medical image having the representation format different from the MRI image is input, output a tissue eigenvalue of MRI for the input medical image, and inputs the target medical image to the derivation model to derive the tissue eigenvalue for the target medical image.

Claims (32)

1. An image processing device comprising at least one processor, wherein the processor is configured to:

acquire at least one target medical image having a representation format different from an MRI image; and

input the target medical image to a derivation model to derive the tissue eigenvalue for the target medical image, wherein the derivation model being constructed by machine learning using a plurality of teacher data to, in a case in which at least one medical image having the representation format different from the MRI image is input, output a plurality of tissue eigenvalues of MRI for the input medical image, wherein the plurality of tissue eigenvalues represents different representation formats of MRI; and

generate a derived MRI image based on the tissue eigenvalue of MRI derived by the derivation model through the target medical image having the representation format different from the MRI image.

2. The image processing device according to claim 1 ,

wherein the target medical image and the medical image are CT images.

3. The image processing device according to claim 1 ,

wherein the target medical image and the medical image are a plurality of CT images for the same subject, which are acquired by using radiation having different energy distributions, respectively.

4. The image processing device according to claim 1 ,

wherein the derivation model is constructed by performing machine learning using the plurality of teacher data including a medical image for learning including a specific structure of a subject, and a tissue eigenvalue for learning for the same subject as the subject.

5. The image processing device according to claim 1 ,

wherein the tissue eigenvalue is a T1 value, a T2 value, and a proton density (PD) value.

6. The image processing device according to claim 1 , wherein the processor is further configured to derive a predetermined type of MRI image by using the tissue eigenvalue.

7. The image processing device according to claim 6 , wherein the processor is further configured to display the MRI image on a display.

8. The image processing device according to claim 7 ,

wherein the processor is configured to display the target medical image on the display.

9. A learning device comprising: at least one processor, wherein the processor is configured to construct a derivation model by performing machine learning using a plurality of teacher data to, in a case in which at least one medical image having a representation format different from an MRI image is input, output a plurality of tissue eigenvalues of MRI for the medical image, wherein the plurality of tissue eigenvalues represent different representation formats of MRI.

10. The learning device according to claim 9 ,

wherein the teacher data includes a medical image for learning including a specific structure of a subject, and a tissue eigenvalue for learning for the same subject as the subject, and

the processor is configured to perform the machine learning by inputting the medical image for learning to the derivation model, outputting the tissue eigenvalue from the derivation model, and using a difference between the output tissue eigenvalue and the tissue eigenvalue for learning as a loss.

11. An image processing method comprising:

acquiring at least one target medical image having a representation format different from an MRI image; and

inputting the target medical image to a derivation model to derive the tissue eigenvalue for the target medical image, wherein the derivation model being constructed by machine learning using a plurality of teacher data to, in a case in which at least one medical image having the representation format different from the MRI image is input, output a plurality of tissue eigenvalues of MRI for the input medical image, wherein the plurality of tissue eigenvalues represents different representation formats of MRI; and

generating a derived MRI image based on the tissue eigenvalue of MRI derived by the derivation model through the target medical image having the representation format different from the MRI image.

12. A learning method comprising:

constructing a derivation model by performing machine learning using a plurality of teacher data to, in a case in which at least one medical image having a representation format different from an MRI image is input, output a plurality of tissue eigenvalues of MRI for the medical image, wherein the plurality of tissue eigenvalues represent different representation formats of MRI.

13. A non-transitory computer-readable storage medium that stores an image processing program causing a computer to execute:

a procedure of acquiring at least one target medical image having a representation format different from an MRI image; and

a procedure of inputting the target medical image to a derivation model to derive the tissue eigenvalue for the target medical image, wherein the derivation model being constructed by machine learning using a plurality of teacher data to, in a case in which at least one medical image having the representation format different from the MRI image is input, output plurality of tissue eigenvalues of MRI for the input medical image, wherein the plurality of tissue eigenvalues represents different representation formats of MRI; and

a procedure of generating a derived MRI image based on the tissue eigenvalue of MRI derived by the derivation model through the target medical image having the representation format different from the MRI image.

14. A non-transitory computer-readable storage medium that stores a learning program causing a computer to execute:

a procedure of constructing a derivation model by performing machine learning using a plurality of teacher data to, in a case in which at least one medical image having a representation format different from an MRI image is input, output a plurality of tissue eigenvalues of MRI for the medical image, wherein the plurality of tissue eigenvalues represent different representation formats of MRI.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2022
From: TACHIBANA, ATSUSHI
To: FUJIFILM CORPORATION
Reel/Frame 059330/0784 →
Priority Claims (1)
JP 2019-177220 · Sep 27, 2019 · national
Continuity (2)
Continuation PCTJP2020036255 · Sep 25, 2020
Related Publication 20220215936A1 · Jul 7, 2022
References Cited (32)
US 20140002076A1 · Warntjes · 2014 [cited by applicant]
US 20150177350A1 · Warntjes · 2015 [cited by applicant]
US 20170131373A1 · Takeshima et al. · 2017 [cited by applicant]
US 20170372497A1 · Hu · 2017 [cited by examiner]
US 20180336677A1 · Sloan et al. · 2018 [cited by applicant]
US 20180374246A1 · Igarashi et al. · 2018 [cited by applicant]
US 20190282192A1 · Goshen · 2019 [cited by examiner]
US 20190362522A1 · Han · 2019 [cited by examiner]
US 20210225491A1 · Jin · 2021 [cited by examiner]
US 20210257094A1 · Takemoto · 2021 [cited by examiner]
US 20210295108A1 · Bar · 2021 [cited by examiner]
JP 2015525604 · 2015 [cited by applicant]
JP 2017086337 · 2017 [cited by applicant]
JP 2018505705 · 2018 [cited by applicant]
JP 2018192264 · 2018 [cited by applicant]
JP 2018198682 · 2018 [cited by applicant]
JP 2019005557 · 2019 [cited by applicant]
WO 2019098780 · 2019 [cited by applicant]
Qing Lyu et al., Quantitave MRI- absolute T1, T2 and proton density parameters from deep learning (Year: 2018). [cited by examiner]
“Office Action of Japan Counterpart Application” with English translation thereof, issued on Jun. 6, 2023, p. 1-p. 6. [cited by applicant]
“Office Action of Japan Counterpart Application” with English translation thereof, issued on Apr. 4, 2023, p. 1-p. 5. [cited by applicant]
Cheng-Bin Jin et al., “Deep CT to MR Synthesis Using Paired and Unpaired Data,” Sensors 2019, May 2019, pp. 1-19. [cited by applicant]
J.B.M. Warntjes et al., “Rapid Magnetic Resonance Quantification on the Brain: Optimization for Clinical Usage,” Magnetic Resonance in Medicine, Aug. 2008, pp. 320-329. [cited by applicant]
Yicheng Chen et al., “MR-based PET Attenuation Correction for Brain PET-MR Using Support Vector Machines,” Proc. Intl. Soc. Mag. Reson. Med. 23, 2015, pp. 1-1. [cited by applicant]
Andrew Palmera Leynes et al., “Direct Pseudo-CT Image Synthesis Using Deep Learning for Pelvis PET/MR Attenuation Correction,” Proc. Intl. Soc. Mag. Reson. Med. 25, 2017, pp. 1-4. [cited by applicant]
“International Search Report (Form PCT/ISA/210) of PCT/JP2020/036255,” mailed on Nov. 24, 2020, with English translation thereof, pp. 1-5. [cited by applicant]
“Written Opinion of the International Searching Authority (Form PCT/ISA/237)” of PCT/JP2020/036255, mailed on Nov. 24, 2020, with English translation thereof, pp. 1-6. [cited by applicant]
“Search Report of Europe Counterpart Application”, issued on Oct. 24, 2022, p. 1-p. 6. [cited by applicant]
“Notice of Reasons for Refusal of Japan Counterpart Application”, issued on Oct. 18, 2022, with English translation thereof, p. 1-p. 6. [cited by applicant]
Can Zhao et al., “Whole Brain Segmentation and Labeling from CT Using Synthetic MR Images,” Conference: International Workshop on Machine Learning in Medical Imaging, Sep. 2017, pp. 291-298. [cited by applicant]
Philippe Meyer et al., “Survey on deep learning for radiotherapy,” Comput Biol Med., vol. 98, May 2018, pp. 126-146. [cited by applicant]
Kiaohuan Cao et al., “Dual-core Steered Non-rigid Registration for Multi-modal Images via Bi-directional Image Synthesis,” Medical Image Analysis, vol. 41, May 2017, pp. 18-31. [cited by applicant]