IP Library › Granted Patent US 12,315,147
Granted Patent B2
US 12,315,147 · App. 17/772,881 · Granted May 27, 2025

Automated pattern recognition and scoring method of fibrosis from non invasive radiology imaging

Inventors: Elton Rexhepaj (Antibes, FR); Corinne Ramos (Montreuil, FR); Nozha Boujemaa (Chaville, FR); Jean-Christophe Brisset (Valbonne-Sophia Antipolis, FR); Pierre Baudot (Marseilles, FR); Sébastien Poullot (Pantin, FR); Benjamin Renoust (Antibes, FR); Benoit Huet (Roquefort-les-Pins, FR)
Assignee: MEDIAN TECHNOLOGIES
G06T7/0012G06T7/11G06T2207/10081G06T2207/20081G06T2207/30056
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,147
App. No.
17/772,881
Granted
May 27, 2025
Kind
B2
Abstract

A method for performing classification of the severity of at least one liver disease from non-invasive radiographic images is disclosed. The method includes: providing radiographic images of slices of the abdomen of a patient; pre-processing the radiographic images by: segmenting liver and spleen, thus achieving a spleen binary mask and a liver binary mask per slice, and normalizing the images with each other, thus achieving normalized radiographic images per slice; for each slice, from the liver binary mask and the normalized radiographic images, extracting a liver parameter; from at least one spleen binary mask, extracting a spleen parameter; and classifying, in function of both parameters and by help of a trained Machine Learning model, the severity of liver disease between one among a group of liver disease at early stage and a group of liver disease at advanced stage.

Claims (52)

1. A method for performing classification of the severity of at least one liver disease from non-invasive radiographic images acquired during a scan, the method comprising:

providing radiographic images of slices of at least the abdomen of a patient, with at least two radiographic images being provided for each slice; and

pre-processing said radiographic images at least by:

for each slice, segmenting liver and spleen from at least one of said at least two radiographic images, thus achieving a spleen binary mask and a liver binary mask per slice, and

normalizing said radiographic images with each other, thus achieving at least two normalized radiographic images per slice;

the method further comprising:

for each slice, at least from the liver binary mask and said at least two normalized radiographic images, extracting at least one parameter characterizing the liver;

computing a parameter characterizing the liver, called HPI map, the number of which being any integer equal to or larger than zero; and

from at least one spleen binary mask, extracting at least one parameter characterizing the spleen; and

inputting said at least one parameter characterizing the liver and said at least one parameter characterizing the spleen into a trained Machine Learning (ML) model, with this latter being designed to classify the severity of the at least one liver disease between one among a group of liver disease at early stage and a group of liver disease at advanced stage in function of both of said at least one parameter characterizing the liver and said at least one parameter characterizing the spleen,

wherein

said at least two radiographic images comprise at least three Computed Tomography (CT) images among which a CT image of the non-contrasted phase, a CT image of the arterial phase and a CT image of the portal venous phase,

the pre-processing step further comprises, after the segmenting substep of said pre-processing step: for at least two of the non-contrasted phase, the arterial phase and the portal venous phase, registering said radiographic images by using the spleen binary masks and the liver binary masks, thus achieving aligned radiographic images across said at least two phases,

the pre-processing step consisting in extracting at least one parameter characterizing the liver comprises, for each slice, extracting a map of hepatic perfusion index (HPI) from said at least two CT images, the liver binary mask and the aligned radiographic images corresponding to at least two of said at least two CT images, thus achieving a map of HPI per slice as said at least one parameter characterizing the liver, and

the HPI is computed as the proportion of the luminance attenuation of the arterial phase to the luminance attenuation of the portal venous and arterial phases, and more particularly by solving the following equation:

HPI=[(HUA)/(HUP+HUA)]×100, where HU is the luminance attenuation, A is the arterial phase, P is the portal venous phase.

2. The method according to claim 1 , further comprising inputting patient clinical information into said trained ML model, with this latter being designed to classify the severity of the at least one liver disease between one among a group of liver disease at early stage and a group of liver disease at advanced stage not only in function of both of said at least one parameter characterizing the liver and said at least one parameter characterizing the spleen, but also in function of the patient clinical information.

3. The method according to claim 1 , wherein said trained ML model is designed to classify the severity of the at least one liver disease by implementing class prediction method.

4. The method according to claim 1 , wherein the ML model is based on one among regression analysis software, Support-Vector Machine (SVM) and Random Forest (RF) classifier.

5. The method according to claim 1 , wherein said at least two radiographic images further comprise a CT image of a delayed phase.

6. The method according to claim 1 , wherein the registering substep of said pre-processing step comprises alignment of spleen masks and of liver masks across said at least two phases.

7. The method according to claim 1 , wherein said at least one parameter characterizing the spleen comprises at least one among spleen volume, spleen elongation ratio, spleen minimal size and spleen maximum size.

8. The method according to claim 1 , wherein the at least one liver disease is comprised of fibrosis and said trained ML model is designed to classify fibrosis severity level between one among an early stage fibrosis group and an advanced stage fibrosis group.

9. The method according to claim 1 , wherein said radiographic images are provided as DICOM (Digital Imaging and Communications in Medicine) image files.

10. The method according to claim 1 , further comprising, before the pre-processing step:

controlling quality of said radiographic images, thus retaining radiographic images having a quality value superior to a determined threshold.

11. The method according to claim 1 , wherein the normalizing substep of said pre-processing step comprises an automatic pixel luminance range adaptation of said radiographic images with each other.

12. The method according to claim 1 , wherein the segmenting substep of said pre-processing step comprises an automatic contouring of spleen and liver for each slice.

13. The method according to claim 12 , wherein the segmenting substep of said pre-processing step consists in implementing a Region Of Interest (ROI) segmentation algorithm.

14. The method according to claim 1 , further comprising, after classifying the fibrosis level:

outputting, by displaying it, the fibrosis level as classified.

15. A computer program product comprising instructions which, when implemented by at least one digital processing device, performs at least the steps of the method according to claim 1 .

16. A method for performing classification of the severity of at least one liver disease from non-invasive radiographic images acquired during a scan, the method comprising:

providing radiographic images of slices of at least the abdomen of a patient, with at least two radiographic images being provided for each slice; and

pre-processing said radiographic images at least by:

for each slice, segmenting liver and spleen from at least one of said at least two radiographic images, thus achieving a spleen binary mask and a liver binary mask per slice, and

normalizing said radiographic images with each other, thus achieving at least two normalized radiographic images per slice;

the method further comprising:

for each slice, at least from the liver binary mask and said at least two normalized radiographic images, extracting at least one parameter characterizing the liver;

from at least one spleen binary mask, extracting at least one parameter characterizing the spleen; and

inputting said at least one parameter characterizing the liver and said at least one parameter characterizing the spleen into a trained Machine Learning (ML) model, with this latter being designed to classify the severity of the at least one liver disease between one among a group of liver disease at early stage and a group of liver disease at advanced stage in function of both of said at least one parameter characterizing the liver and said at least one parameter characterizing the spleen,

wherein

said at least two radiographic images comprise at least:

a radiographic image, called MRI image, acquired by magnetic resonance imaging (MRI), and

a radiographic image, called MRE image, acquired by magnetic resonance elastography (MRE), and

the at least one liver disease is comprised of Non Alcoholic Steatohepatitis (NASH) and said trained ML model is designed to classify NASH severity level between one among an early stage NASH group and an advanced stage NASH group.

17. The method according to claim 16 , wherein

the segmenting substep of said pre-processing step is implemented, for each slice, by using the MRI image as said at least one of said at least two radiographic images, and

the step consisting in extracting at least one parameter characterizing the liver comprises, for each slice, extracting elastography information from the MRE image by using the liver binary mask.

18. The method according to claim 16 , wherein said at least one parameter characterizing the spleen comprises at least one among spleen area, spleen shape, spleen form factor, spleen compactness, spleen eccentricity and spleen solidity.

19. The method according to claim 16 , wherein the at least one liver disease is comprised of Non Alcoholic Steatohepatitis (NASH) and said trained ML model is designed to classify NASH severity level between one among an early stage NASH group and an advanced stage NASH group.

20. A computer program product comprising instructions which, when implemented by at least one digital processing device, performs at least the steps of the method according to claim 16 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2023
From: REXHEPAJ, ELTON; RAMOS, CORINNE; BOUJEMAA, NOZHA; BRISSET, JEAN-CHRISTOPHE; BAUDOT, PIERRE; POULLOT, SÉBASTIEN; RENOUST, BENJAMIN; HUET, BENOIT
To: MEDIAN TECHNOLOGIES
Reel/Frame 065722/0094 →
Continuity (2)
Provisional Application 62931286 · Nov 6, 2019
Related Publication 20220414870A1 · Dec 29, 2022
References Cited (16)
US 20140205541A1 · James · 2014 [cited by examiner]
US 20200349674A1 · Ramanujam · 2020 [cited by examiner]
WO WO2014011925A2 · 2014 [cited by examiner]
Ting-Yu Su, Wei-Tse Yang, Tsu-Chi Cheng, Yi Fei He, Ching-Juei Yang, Yu-Hua Fang, (2019) “Computer-aided liver cirrhosis diagnosis via automatic liver segmentation and machine learning algorithm,” Proc. SPIE 11050, Inte… [cited by examiner]
Rexhepaj et al, 2084: “Automated Quantification of Computed Tomography Hepatosplenic [ . . . ],” Hepatology; 70th Annual Meeting of the American-Association-for-the-Study-of-Liver-Diseases (AASLD) / Liver Meeting, Wiley… [cited by examiner]
Chen, Y. W., Luo, J., Dong, C., Han, X., Tateyama, T., Furukawa, A., & Kanasaki, S. (2013). Computer-aided diagnosis and quantification of cirrhotic livers based on morphological analysis and machine learning. Computati… [cited by examiner]
Yu, Y., Wang, J., Ng, C. W., Ma, Y., Mo, S., Fong, E. L. S., Xing, J., Song, Z., Xie, Y., Si, K., Wee, A., Welsch, R. E., So, P. T. C., & Yu, H. (2018). Deep learning enables automated scoring of liver fibrosis stages. … [cited by examiner]
Rexhepaj et al., “Automatic high-risk fibrosis score prediction using computed tomography imaging”, Journal of Hepatology, Nov. 8, 2019, p. S777. [cited by applicant]
Rexhepaj et al., “2084: Automated Quantification of Computed Tomography Hepatosplenic Radiomics Correlates With Liver Fibrosis”, Hepatology, 70th Annual Meeting of the American-Association-for-the-Study-of-Live-R-Diseas… [cited by applicant]
Ting-Yu et al., “Computer-aided liver cirrhosis diagnosis via automatic liver segmentation and machine learning algorithm”, Proceedings of SPIE, vol. 11050, Mar. 27, 2019, pp. 1105011-1-1105011-6. [cited by applicant]
Erickson et al., “Machine Learning for Medical Imaging”, Radiographics, vol. 37, No. 2, Mar. 1, 2017, pp. 505-515. [cited by applicant]
Bonekamp et al., “Can imaging modalities diagnose and stage hepatic fibrosis and cirrhosis accurately?”, Journal of Hepatology, vol. 50, No. 1, Jan. 1, 2009, pp. 17-35. [cited by applicant]
Yin et al., “Prediction of nonalcoholic fatty liver disease (NAFLD) activity score (NAS) with multiparametric hepatic magnetic resonance imaging and elastography”, European Radiology, vol. 29, No. 11, Mar. 18, 2019, pp.… [cited by applicant]
Rohe et al., Feasibility of Using Deep Learning Techniques to Assess Hepatic Fibrosis Directly from Magnetic Resonance Elastography Source Images, AASLD, The Liver Meeting, Nov. 7, 2018. [cited by applicant]
International Search Report issued in corresponding International Application No. PCT/EP2020/081207, dated Feb. 3, 2021, pp. 1-4, European Patent Office, Rijswijk, Netherlands. [cited by applicant]
Written Opinion issued in corresponding International Application No. PCT/EP2020/081207, dated Feb. 3, 2021, pp. 1-5, European Patent Office, Rijswijk, Netherlands. [cited by applicant]
Cited By (1)
US 12,530,770