IP Library › Granted Patent US 12,274,542
Granted Patent B2
US 12,274,542 · App. 17/654,598 · Granted Apr 15, 2025

Methods and systems for extracting blood vessel

Inventors: Xiaodong Wang (Shanghai, CN); Wenjun Yu (Shanghai, CN); Yufei Mao (Shanghai, CN); Xu Wang (Shanghai, CN); Ke Wu (Shanghai, CN); Ce Wang (Shanghai, CN); Peng Zhao (Shanghai, CN); Chuanfeng Lv (Shanghai, CN)
Assignee: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
A61B5/055A61B5/0037A61B5/004A61B5/489A61B6/504A61B6/5294G06F18/214G06F18/2148G06F18/24G06T5/30G06T7/0014G06T7/11G06T7/136G06V10/34G06V10/755G06V10/7747A61B6/037A61B6/469A61B6/481G06T2200/04G06T2207/10081G06T2207/10088G06T2207/10104G06T2207/10108G06T2207/10116G06T2207/20021G06T2207/20081G06T2207/30101G06T2207/30172G06V2201/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,274,542
App. No.
17/654,598
Granted
Apr 15, 2025
Kind
B2
Abstract

A method for determining a centerline of a blood vessel in an image associated with a subject is provided. The method includes obtaining a centerline model used for identifying a centerline of a blood vessel and identifying the centerline of the blood vessel based on the centerline model.

Claims (80)

1. A method for determining a centerline of a blood vessel in an image associated with a subject implemented on at least one machine each of which has at least one processor and at least one storage, the method comprising:

obtaining a centerline model used for identifying a centerline of a blood vessel; and

identifying the centerline of the blood vessel based on the centerline model, wherein

the centerline model includes a centerline average model; and

the centerline model is generated by a process including:

registering a plurality of sample images;

extracting a reference centerline of a reference blood vessel in each of the plurality of registered sample images; and

determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images.

2. The method of claim 1 , wherein the determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images includes:

determining a plurality of centerline shape vectors corresponding the plurality of reference centerlines respectively;

performing an alignment operation on the plurality of centerline shape vectors; and

determining the centerline average model based on the plurality of aligned centerline shape vectors.

3. The method of claim 2 , wherein the determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images includes:

performing a principal component analysis (PCA) method after the alignment operation.

4. The method of claim 1 , wherein

identifying the centerline of the blood vessel based on the centerline model includes:

determining a candidate centerline of the blood vessel in the image by mapping the centerline average model to the image;

determining a distance field in the image; and

determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the distance field.

5. The method of claim 4 , wherein the determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the distance field includes:

for points on the candidate center line, assigning high weights to points satisfying a predetermined distance field value of the distance field and low weights to points not satisfying the predetermined distance field value; and

determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the weights of the points.

6. The method of claim 1 , wherein the registering a plurality of sample images includes:

determining one of the plurality of sample images as a template image;

registering residual other images of the plurality of sample images based on the template image.

7. The method of claim 1 , wherein the extracting a reference centerline of a reference blood vessel in each of the plurality of registered sample images includes:

sampling pixels on each reference centerline of the reference blood vessel in each of the plurality of registered sample images to obtain a plurality of centerline sample points.

8. The method of claim 7 , wherein the determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images includes:

extracting the centerline average model from the plurality of centerline sample points by using an active shape model (ASM) algorithm.

9. A system for determining a centerline of a blood vessel in an image associated with a subject, comprising:

at least one storage device including a set of instructions; and

at least one processor in communication with the at least one storage device, wherein when executing the set of instructions, the at least one processor is directed to cause the system to perform operations including:

obtaining a centerline model used for identifying a centerline of a blood vessel; and

identifying the centerline of the blood vessel based on the centerline model, wherein

the centerline model includes a centerline average model; and

the centerline model is generated by a process including:

registering a plurality of sample images;

extracting a reference centerline of a reference blood vessel in each of the plurality of registered sample images; and

determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images.

10. The system of claim 9 , wherein the determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images includes:

determining a plurality of centerline shape vectors corresponding the plurality of reference centerlines respectively;

performing an alignment operation on the plurality of centerline shape vectors; and

determining the centerline average model based on the plurality of aligned centerline shape vectors.

11. The system of claim 10 , wherein the determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images includes:

performing a principal component analysis (PCA) method after the alignment operation.

12. The system of claim 9 , wherein

identifying the centerline of the blood vessel based on the centerline model includes:

determining a candidate centerline of the blood vessel in the image by mapping the centerline average model to the image;

determining a distance field in the image; and

determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the distance field.

13. The system of claim 12 , wherein the determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the distance field includes:

for points on the candidate center line, assigning high weights to points satisfying a predetermined distance field value of the distance field and low weights to points not satisfying the predetermined distance field value; and

determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the weights of the points.

14. The system of claim 9 , wherein the registering a plurality of sample images includes:

determining one of the plurality of sample images as a template image;

registering residual other images of the plurality of sample images based on the template image.

15. The system of claim 9 , wherein the extracting a reference centerline of a reference blood vessel in each of the plurality of registered sample images includes:

sampling pixels on each reference centerline of the reference blood vessel in each of the plurality of registered sample images to obtain a plurality of centerline sample points.

16. The system of claim 15 , wherein the determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images includes:

extracting the centerline average model from the plurality of centerline sample points by using an active shape model (ASM) algorithm.

17. A non-transitory computer readable medium, comprising a set of instructions for determining a centerline of a blood vessel, wherein when executed by at least one processor, the set of instructions direct the at least one processor to effectuate a method, the method comprising:

obtaining a centerline model used for identifying a centerline of a blood vessel; and

identifying the centerline of the blood vessel based on the centerline model, wherein

the centerline model includes a centerline average model; and

the centerline model is generated by a process including:

registering a plurality of sample images;

extracting a reference centerline of a reference blood vessel in each of the plurality of registered sample images; and

determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images.

18. The non-transitory computer readable medium of claim 17 , wherein the determining the centerline average model based on a plurality of reference centerlines of the reference blood vessel in the plurality of registered sample images includes:

determining a plurality of centerline shape vectors corresponding the plurality of reference centerlines respectively;

performing an alignment operation on the plurality of centerline shape vectors; and

determining the centerline average model based on the plurality of aligned centerline shape vectors.

19. The non-transitory computer readable medium of claim 17 , wherein

the identifying the centerline of the blood vessel based on the centerline model includes:

determining a candidate centerline of the blood vessel in the image by mapping the centerline average model to the image;

determining a distance field in the image; and

determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the distance field.

20. The non-transitory computer readable medium of claim 19 , wherein the determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the distance field includes:

for points on the candidate center line, assigning high weights to points satisfying a predetermined distance field value of the distance field and low weights to points not satisfying the predetermined distance field value; and

determining the centerline of the blood vessel by adjusting the candidate centerline of the blood vessel based on the weights of the points.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2022
From: WANG, XIAODONG; YU, WENJUN; MAO, YUFEI; WANG, XU; WU, KE; WANG, CE; ZHAO, PENG; LV, CHUANFENG
To: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
Reel/Frame 061461/0856 →
Priority Claims (7)
CN 201610503562.7 · Jun 30, 2016 · national
CN 201610608532.2 · Jul 29, 2016 · national
CN 201610609053.2 · Jul 29, 2016 · national
CN 201610686885.4 · Aug 18, 2016 · national
CN 201611163876.3 · Dec 15, 2016 · national
CN 201710297072.0 · Apr 28, 2017 · national
CN 201710303879.0 · May 3, 2017 · national
Continuity (4)
Continuation 16517961 · Jul 22, 2019
Continuation 15663909 · Jul 31, 2017
Continuation PCTCN2017088276 · Jun 14, 2017
Related Publication 20220192617A1 · Jun 23, 2022
References Cited (139)
US 7177453B2 · Suryanarayanan et al. · 2007 [cited by applicant]
US 7602970B2 · Florin et al. · 2009 [cited by applicant]
US 7953266B2 · Gulsun et al. · 2011 [cited by applicant]
US 8126232B2 · Dikici et al. · 2012 [cited by applicant]
US 8135195B2 · Mahesh et al. · 2012 [cited by applicant]
US 8285011B2 · Chen · 2012 [cited by examiner]
US 8352174B2 · Milstein · 2013 [cited by examiner]
US 8676300B2 · Strommer · 2014 [cited by examiner]
US 8824755B2 · Beck · 2014 [cited by examiner]
US 8837800B1 · Bammer et al. · 2014 [cited by applicant]
US 9504435B2 · Bernhardt · 2016 [cited by examiner]
US 9805463B2 · Choi et al. · 2017 [cited by applicant]
US 10304197B2 · Goel · 2019 [cited by examiner]
US 10357218B2 · Wang et al. · 2019 [cited by applicant]
US 10487757B2 · Wang et al. · 2019 [cited by applicant]
US 10825180B2 · Chen et al. · 2020 [cited by applicant]
US 20050148877A1 · Guo et al. · 2005 [cited by applicant]
US 20060251325A1 · Florin et al. · 2006 [cited by applicant]
US 20060280351A1 · Luping et al. · 2006 [cited by applicant]
US 20070019846A1 · Bullitt et al. · 2007 [cited by applicant]
US 20070081702A1 · Porat et al. · 2007 [cited by applicant]
US 20070081706A1 · Zhou et al. · 2007 [cited by applicant]
US 20070165952A1 · Goto · 2007 [cited by applicant]
US 20070249912A1 · Tek · 2007 [cited by examiner]
US 20070260135A1 · Rousson et al. · 2007 [cited by applicant]
US 20080094389A1 · Rouet et al. · 2008 [cited by applicant]
US 20080132774A1 · Milstein · 2008 [cited by examiner]
US 20080187199A1 · Gulsun · 2008 [cited by examiner]
US 20080292194A1 · Schmidt et al. · 2008 [cited by applicant]
US 20090202122A1 · Wang · 2009 [cited by examiner]
US 20100014740A1 · Movassaghi et al. · 2010 [cited by applicant]
US 20100074493A1 · Wiemker et al. · 2010 [cited by applicant]
US 20100189320A1 · Dewaele · 2010 [cited by applicant]
US 20100239147A1 · Vitanovski · 2010 [cited by examiner]
US 20100266170A1 · Khamene · 2010 [cited by applicant]
US 20100296718A1 · Ostrovsky-Berman et al. · 2010 [cited by applicant]
US 20110158495A1 · Bernhardt · 2011 [cited by examiner]
US 20110263973A1 · Bernhardt et al. · 2011 [cited by applicant]
US 20120014573A1 · Lautenschläger et al. · 2012 [cited by applicant]
US 20120201442A1 · Beck et al. · 2012 [cited by applicant]
US 20120207366A1 · Liu · 2012 [cited by applicant]
US 20130064435A1 · Taerum et al. · 2013 [cited by applicant]
US 20130216110A1 · Zheng · 2013 [cited by examiner]
US 20140307936A1 · Dore et al. · 2014 [cited by applicant]
US 20150003697A1 · Beymer et al. · 2015 [cited by applicant]
US 20150049932A1 · Moulis et al. · 2015 [cited by applicant]
US 20150141818A1 · Zhao et al. · 2015 [cited by applicant]
US 20160133015A1 · Taylor · 2016 [cited by applicant]
US 20160140313A1 · Taylor · 2016 [cited by applicant]
US 20170091574A1 · Udupa et al. · 2017 [cited by applicant]
US 20170311916A1 · Yagi et al. · 2017 [cited by applicant]
US 20180000441A1 · Wang et al. · 2018 [cited by applicant]
US 20180276828A1 · Freiman · 2018 [cited by examiner]
US 20190012520A1 · Li et al. · 2019 [cited by applicant]
US 20190139238A1 · Wyeth · 2019 [cited by applicant]
US 20190244363A1 · Tan · 2019 [cited by examiner]
US 20190343477A1 · Wang et al. · 2019 [cited by applicant]
CN 1430185A · 2003 [cited by applicant]
CN 1700254A · 2005 [cited by applicant]
CN 1779718A · 2006 [cited by applicant]
CN 101013503A · 2007 [cited by applicant]
CN 101425186A · 2009 [cited by applicant]
CN 101523437A · 2009 [cited by examiner]
CN 101551906A · 2009 [cited by applicant]
CN 101706843A · 2010 [cited by applicant]
CN 101393644B · 2010 [cited by applicant]
CN 101996329A · 2011 [cited by applicant]
CN 102332054A · 2012 [cited by applicant]
CN 102402796A · 2012 [cited by applicant]
CN 102567734A · 2012 [cited by applicant]
CN 102819823A · 2012 [cited by applicant]
CN 102930552A · 2013 [cited by applicant]
CN 103164859A · 2013 [cited by applicant]
CN 103247073A · 2013 [cited by applicant]
CN 103279741A · 2013 [cited by applicant]
CN 103284780A · 2013 [cited by applicant]
CN 103295200A · 2013 [cited by applicant]
CN 103593829A · 2014 [cited by applicant]
CN 103679801A · 2014 [cited by applicant]
CN 103810363A · 2014 [cited by applicant]
CN 103810709A · 2014 [cited by applicant]
CN 103871036A · 2014 [cited by applicant]
CN 103985123A · 2014 [cited by applicant]
CN 104091346A · 2014 [cited by applicant]
CN 104166979A · 2014 [cited by applicant]
CN 104240220A · 2014 [cited by applicant]
CN 104361554A · 2015 [cited by applicant]
CN 104463830A · 2015 [cited by applicant]
CN 104463860A · 2015 [cited by applicant]
CN 104766293A · 2015 [cited by applicant]
CN 104809480A · 2015 [cited by applicant]
CN 105069803A · 2015 [cited by applicant]
CN 105118056A · 2015 [cited by applicant]
CN 105427277A · 2016 [cited by applicant]
CN 105640583A · 2016 [cited by applicant]
CN 105741251A · 2016 [cited by applicant]
CN 105956587A · 2016 [cited by applicant]
CN 106023165A · 2016 [cited by applicant]
CN 106157320A · 2016 [cited by examiner]
CN 106228561A · 2016 [cited by applicant]
EP 1901232B1 · 2011 [cited by applicant]
EP 2357609B1 · 2012 [cited by applicant]
JP 2008521461A · 2008 [cited by examiner]
WO 03042921A · 2003 [cited by applicant]
Zhao, P , “an image for vascular segmentation method and device”, (CN 106157320), p. 1-8. (Year: 2016). [cited by examiner]
M. Freiman et al., Nearly Automatic Vessels Segmentation Using Graph-based Energy Minimization, The Midas Journal, 2009. [cited by applicant]
Hackjoon Shim et al., Partition-Based Extraction of Cerebral Arteries from CT Angiography with Emphasis on Adaptive Tracking, IPMI, 3565: 357-368, 2005. [cited by applicant]
Pedro T Vieco et al., Detection of circle of Willis Aneurysms in Patients with Acute Subarachnoid Hemorrhage: A Comparison of CT Angiography and Digital Subtraction Angiography, AJR, 165(2): 425-430, 1995. [cited by applicant]
Lyu, Jinfa et al., Atlas of Clinical Application of VCTDSA in Cerebral Vessels, People's Military Medical Press, 2010. [cited by applicant]
Cemil Kirbas et al., A Review of Vessel Extraction Techniques and Algorithms, ACM Computing Surveys, 36(2): 81-121, 2004. [cited by applicant]
Onno Wink et al., Fast Delineation and Visualization of Vessels in 3-D Angiographic Images, IEEE Transactions On Medical Imaging, 19(4): 337-346, 2000. [cited by applicant]
Onno Wink et al., Multiscale Vessel Tracking, IEEE Transactions On Medical Imaging, 23(1): 130-133, 2004. [cited by applicant]
Rashindra Manniesing et al., Vessel Axis Tracking Using Topology Constrained Surface Evolution, IEEE Transactions On Medical Imaging, 26(3): 309-316, 2007. [cited by applicant]
Cuisenaire Olivier et al., Fully Automated Segmentation of Carotid and Vertebral Arteries From Contrast Enhanced CTA, SPIE Medical Imaging, 6914(69143R): 1-8, 2008. [cited by applicant]
Shang, Qingyang et al., Adaptive Directional Region Growing Segmentation of the Hepatic Vasculature, SPIE Medical Imaging, 6914(69141F): 1-10, 2008. [cited by applicant]
Tan, Yongqiang et al., Segmentation of Lung Lesions on CT Scans Using Watershed, Active Contours, and Markov Random Field, Medical Physics, 40(4): 043502-1 to 043502-10, 2013. [cited by applicant]
Dirk Selle et al., Analysis of Vasculature for Liver Surgical Planning, IEEE Transactions On Medical Imaging, 21(11): 1344-1357, 2002. [cited by applicant]
Suguru Kawajiri et al., Automated Segmentation of Hepatic Vessels in Non-contrast X-ray CT images, Radiological Physics and Technology, 1(2): 214-222, 2007. [cited by applicant]
Simon Esneault et al., Liver Vessels Segmentation Using a Hybrid Geometrical Moments/Graph Cuts Method, IEEE Transactions On Biomedicall Engineering, 57(2): 276-283, 2010. [cited by applicant]
Jens N. Kaftan et al., A Two-Stage Approach for Fully Automatic Segmentation of Venous Vascular Structures in Liver CT Images, SPIE Medical Imaging, 7259(725911): 1-12, 2009. [cited by applicant]
R. Manniesing et al., Level Set Based Cerebral Vasculature Segmentation and Diameter Quantification in CT Angiography, Medical Imaging Analysis, 10(2): 200-214, 2006. [cited by applicant]
Marleen De Bruijne et al., Adapting Active Shape Models for 3D Segmentation of Tubular Structures in Medical Images. [cited by applicant]
Marleen De Bruijne et al., Interactive segmentation of abdominal aortic aneurysms in CTA images, Medical Imaging Analysis, 8(2): 127-138 (2004). [cited by applicant]
Michiel Schaap et al., Bayesian Tracking of Tubular Structures and Its Application to Carotid Arteries in CTA, MICCAI, 10(2): 562-570, 2007. [cited by applicant]
N. Passat et al., Watershed and Multimodal Data for Brain Vessel Segmentation: Application to The Superior Sagittal Sinus, Image and Vision Computing, 25: 512-521, 2007. [cited by applicant]
N. Passat et al., Region-Growing Segmentation of Brain Vessels: An Atlas-Based Automatic Approach, Journal of Magnetic Resonance Imaging, 21: 715-725, 2005. [cited by applicant]
Carmen Alina Lupascu et al., FABC: Retinal Vessel Segmentation Using AdaBoost, IEEE Transactions On Information Technology in Biomedicine, 14(5): 1267-1274, 2010. [cited by applicant]
Zhou, Lin et al., Segmentation of Retinal Blood Vessels Based on Centerline Extraction, Journal of Biomedical Engineering, 29(1): 1-6, 2012. [cited by applicant]
First Office Action for Chinese Application No. 201610686885.4 mailed on Aug. 3, 2018, 21 pages. [cited by applicant]
First Office Action for Chinese Application No. 201611163876.3 mailed on May 28, 2019, 13 pages. [cited by applicant]
Sohini, Roychowdhury et al., Blood Vessel Segmentation of Fundus Images by Major Vessel Extraction and Sub-Image Classification, IEEE Journal of Biomedical and Health Informatics, 2015, 11 pages. [cited by applicant]
Liu, Yanli et al., Research On Liver Vessel Tree Segmentation Algorithm Using Hessian Matrix and Region Growing, Jisuanji Yu Xiandaihua, 113-116, 2011. [cited by applicant]
Bernard, Gosselin et al., Pulmonary Arteries Segmentation and Feature Extraction Through Slice Marching, 2014, 5 pages. [cited by applicant]
Wei, Liao et al., Automatic Human Brain Vessel Segmentation from 3D 7 Tesla MRA Images Using Fast Marching with Anisotropic Directional Prior, 2012 9th IEEE International Symposium on Biomedical Imaging, 1140-1143, 2012. [cited by applicant]
Zhao, Jie et al., 3D Segmentation of Coronary Arteries in Dual Source CT Images, Journal of Biomedical Engineering Research, 35(3): 197-201, 2016. [cited by applicant]
The Third Office Action in Chinese Application No. 201610686885.4 mailed on May 15, 2020, 9 pages. [cited by applicant]
First Office Action in Chinese Application No. 201710297072.0 mailed on Feb. 3, 2020, 15 pages. [cited by applicant]
First Office Action in Chinese Application No. 201710303879.0 mailed on Nov. 22, 2019, 14 pages. [cited by applicant]
The Second Office Action in Chinese Application No. 201710303879.0 mailed on Nov. 13, 2020, 9 pages. [cited by applicant]