IP Library › Granted Patent US 12,749,246
Granted Patent B2
US 12,749,246 · App. 17/701,826 · Granted Sep 29, 2026

Medical image processing apparatus and medical image processing method

Inventors: Keisuke Yamakawa (Kashiwa, JP); Taiga Goto (Kashiwa, JP)
Assignee: FUJIFILM Corporation
G06T12/30G06T5/50G06T7/0012G06T2207/10081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,749,246
App. No.
17/701,826
Granted
Sep 29, 2026
Kind
B2
Abstract

A medical image processing apparatus and a medical image processing method are provided which are capable of reducing metal artifacts and preserving the image quality even in a region less affected by metal artifacts. The medical image processing apparatus includes an arithmetic section that reconstructs a tomographic image from projection data of an object under examination including a metal. The arithmetic section acquires a machine learning output image that is output when the tomographic image is input to a machine learning engine that machine-learns to reduce metal artifacts, and the arithmetic section composites the machine learning output image and the tomographic image to generate a composite image.

Claims (37)

1 . A medical image processing apparatus comprising a processor and a non-transitory storage medium storing one or more programs and data for executing the programs, the programs being instructions executable by the processor to configure said medical image processing apparatus to perform a method comprising:

obtaining tomographic image data by reconstructing a tomographic image from projection data of an object under examination including a metal, the reconstructed tomographic image including metal artifacts;

obtaining machine learning output image data by acquiring a machine learning output image that includes reduced metal artifacts and is output when the tomographic image data is input to a machine learning engine that has machine-learned to reduce the metal artifacts in the tomographic image of the object under examination;

acquiring a weight map based on a beam hardening correction image obtained by applying beam hardening correction to the tomographic image, weight coefficients of the weight map being mapped, and the weight map indicating a probability distribution of a presence of metal artifacts; and

generating a composite image, by using the weight map based on the beam hardening correction image, to composite (i) the machine learning output image data and (ii) the tomographic image data of the tomographic image of the object under examination,

wherein for the machine learning output image data and the tomographic image data that are composited, an image quality of a region of the machine learning output image that is less affected by the metal artifacts than a corresponding region of the tomographic image that includes the metal artifacts is degraded relative to an image quality of a corresponding region in the tomographic image less affected by the metal artifacts, and an image quality of a counterpart region of the composite image corresponding to the region of the machine learning output image and the corresponding region in the tomographic image is preserved relative to an image quality of the corresponding region in the tomographic image which is composited with the machine learning output image, and

wherein the machine learning output image and the tomographic image are composited together by using a value obtained by multiplying the weight coefficient by an adjustment coefficient set in an adjustment coefficient setting portion,

the composite image is displayed in a same window as the adjustment coefficient setting portion and is updated every time the adjustment coefficient is set in the adjustment coefficient setting portion, and

the same window includes an input image display portion displaying the tomographic image and the machine learning output image.

2 . The medical image processing apparatus according to claim 1 , wherein the weight map indicates a distribution of absolute values of differences between the tomographic image and a linear interpolation image that is obtained by applying a linear interpolation technique to the tomographic image.

3 . The medical image processing apparatus according to claim 1 , wherein the weight coefficients become smaller with an increasing distance from a metal pixel extracted from the tomographic image.

4 . The medical image processing apparatus according to claim 3 , wherein the weight coefficient becomes larger as the metal pixel has a larger pixel value.

5 . The medical image processing apparatus according to claim 1 , wherein

each weight coefficient w is a real number between 0 and 1, and

for each pixel of the composite image,

(a) a pixel value of the machine learning output image is weighted by w,

(b) a pixel value of the tomographic image is weighted by (1−w), and

(c) the weighted pixel value of the machine learning output image and the weighted pixel value of the tomographic image are combined to obtain a pixel value of the composite image.

6 . The medical image processing apparatus according to claim 1 , wherein the weight map reflects a distribution of absolute values of differences between the tomographic image and the beam hardening correction image.

7 . A medical image processing method comprising the steps of:

obtaining tomographic image data by reconstructing a tomographic image from projection data of an object under examination including a metal;

obtaining machine learning output image data by acquiring a machine learning output image that includes reduced metal artifacts and is output when the tomographic image data of the object under examination and additionally including metal artifacts is input to a machine learning engine that has machine-learned to reduce metal artifacts;

acquiring a weight map in which weight coefficients are mapped, the weight map indicating a probability distribution of presence of metal artifacts;

generating a composite image, by using the weight map indicating the probability distribution of the presence of metal artifacts, to composite the machine learning output image data and the tomographic image data,

wherein for the machine learning output image data and the tomographic image data that are composited, an image quality of a region of the machine learning output image that is less affected by the metal artifacts than a corresponding region of the tomographic image that includes the metal artifacts is degraded relative to an image quality of a corresponding region in the tomographic image less affected by the metal artifacts, and an image quality of a counterpart region of the composite image corresponding to the region of the machine learning output image and the corresponding region in the tomographic image is preserved relative to an image quality of the corresponding region in the tomographic image which is composited with the machine learning output image, and

wherein the machine learning output image and the tomographic image are composited together by using a value obtained by multiplying the weight coefficient by an adjustment coefficient set in an adjustment coefficient setting portion;

displaying the composite image in a same window as the adjustment coefficient setting portion;

updating the composite image every time the adjustment coefficient is set in the adjustment coefficient setting portion; and

displaying the tomographic image and the machine learning output image in the same window.

8 . The medical image processing method according to claim 7 , wherein the weight map indicates a distribution of absolute values of differences between the tomographic image and a linear interpolation image that is obtained by applying a linear interpolation technique to the tomographic image.

9 . The medical image processing method according to claim 7 , wherein the weight coefficients become smaller with an increasing distance from a metal pixel extracted from the tomographic image.

10 . The medical image processing method according to claim 9 , wherein the weight coefficient becomes larger as the metal pixel has a larger pixel value.

11 . The medical image processing method according to claim 7 , wherein

each weight coefficient w is a real number between 0 and 1, and

the composite image is generated by compositing the machine learning output image data and the tomographic image data, by applying per-pixel weighting by w and (1−w) and combining weighted values.

12 . The medical image processing method according to claim 7 , wherein the weight map is acquired based on a beam hardening correction image that is obtained by applying a beam hardening correction to the tomographic image.

13 . The medical image processing method according to claim 7 , wherein the weight map reflects a distribution of absolute values of differences between the tomographic image and a beam hardening correction image that is obtained by applying a beam hardening correction to the tomographic image.

Assignments (2)
MERGER Recorded Aug 9, 2024
From: FUJIFILM HEALTHCARE CORPORATION
To: FUJIFILM CORPORATION
Reel/Frame 068242/0301 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2022
From: YAMAKAWA, KEISUKE; GOTO, TAIGA
To: FUJIFILM HEALTHCARE CORPORATION
Reel/Frame 059372/0772 →
Priority Claims (1)
JP 2021-064617 · Apr 6, 2021 · national
Continuity (1)
Related Publication 20220319072A1 · Oct 6, 2022
References Cited (14)
US 20200205769A1 · Kotian · 2020 [cited by examiner]
US 20200305806A1 · Tang et al. · 2020 [cited by applicant]
US 20210035338A1 · Zhou et al. · 2021 [cited by applicant]
US 20240135603A1 · Favazza · 2024 [cited by examiner]
CN 105225208 · 2016 [cited by applicant]
CN 08937995 · 2018 [cited by applicant]
CN 112308788 · 2021 [cited by applicant]
JP 2017131307A · 2017 [cited by applicant]
JP 2020163124A · 2020 [cited by applicant]
WO WO2017063569A1 · 2017 [cited by examiner]
Y. Zhang and H. Yu, “Convolutional Neural Network Based Metal Artifact Reduction in X-Ray Computed Tomography,” in IEEE Transactions on Medical Imaging, vol. 37, No. 6, pp. 1370-1381, Jun. 2018. [cited by applicant]
Jan. 9, 2024 Japanese official action (machine translation) in connection with Japanese Patent Application No. 2021-064617. [cited by applicant]
Nov. 28, 2025 Chinese official action (and English-language translation thereof) in connection with Patent Application No. 2022103281891. [cited by applicant]
Mar. 5, 2026 Chinese official action (and English-language translation thereof) in connection with Chinese Patent Application No. 2022103281891. [cited by applicant]