IP Library › Granted Patent US 50,608
Granted Patent E1
US 50,608 · App. 18/235,680 · Granted Sep 30, 2025

Enhancing the visibility of blood vessels in colour images

Inventors: Andreas Härstedt Jørgensen (Rødovre, DK); Finn Sonnenborg (Frederikssund, DK)
Assignee: AMBU A/S
G06T5/90A61B1/000094A61B1/00045A61B1/044A61B5/489G06T1/20G06T5/50G06T7/0012G06T2200/24G06T2207/10016G06T2207/10024G06T2207/20024G06T2207/20081G06T2207/20084G06T2207/20172G06T2207/20224G06T2207/30101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 50,608
App. No.
18/235,680
Granted
Sep 30, 2025
Kind
E1
Abstract

A method of enhancing the visibility of blood vessels in a colour image captured by an image capturing device of a medical device, the colour image having a plurality of colour channels and a plurality of pixels, the method including for at least some of said plurality of pixels the steps of: (a) processing data obtained from a first colour channel together with data obtained from a second colour channel to determine a value of a first parameter indicative of the intensity in the red spectrum relative to the total intensity of said pixel; and (b) using said value of said first parameter to alter said pixel, wherein said first parameter has at least three possible values, and wherein the strength of the alteration is dependent on the value of said first parameter.

Claims (69)

1. A method of operating an image processing device for enhancing the visibility of blood vessels in a colour image captured by an image capturing device of a medical device, said colour image having a plurality of colour channels including a red colour channel, a green colour channel, and a blue colour channel and having a plurality of pixels, wherein said method comprises, for at least some of said plurality of pixels, the steps of:

(a) processing data obtained from the red colour channel together with data obtained from the green colour channel to create a value of a first sub parameter, and processing data obtained from the red colour channel together with data obtained from the blue colour channel to create a value of a second sub parameter, wherein said processing comprises subtracting said data obtained from the green colour channel from said data obtained from the red colour channel;

processing said value of said first sub parameter together with said value of said second sub parameter to create a value of a first parameter indicative of the intensity in a red spectrum relative to a total intensity of said pixel; and

(b) using said value of said first parameter to alter said pixel,

wherein said first parameter has at least three possible values, and wherein the strength of the alteration is dependent on the value of said first parameter.

2. The method according to claim 1 , wherein step (a) comprises: processing data obtained from the blue colour channel to determine the value of said first parameter.

3. The method according to claim 1 , wherein both said value of said first sub parameter and said value of said second sub parameter are indicative of the intensity in the red spectrum relative to the total intensity of said pixel.

4. The method according to claim 1 , wherein parts of the colour image having no blood vessels are substantially unaltered and displayed with normal colours.

5. The method according to claim 1 , wherein said method further comprises:

determining a value of a second parameter indicative of the intensity of said pixel and wherein said value of said first parameter together with said value of said second parameter are used to alter said pixel.

6. The method according to claim 1 , wherein said plurality of colour channels are normalized prior to being processed together.

7. The method according to claim 6 , wherein a low pass filtered image is created for each of said plurality of colour channels indicating a local average for each pixel, and wherein each colour channel is normalized using its low pass filtered image.

8. The method according to claim 7 , wherein a value of a third parameter is created based on user input, and wherein the alteration is dependent on both said value of said first parameter and said value of said third parameter, whereby the user may control the strength of the alteration.

9. The method according to claim 1 , wherein a high value of the first parameter indicates a high intensity in the red spectrum relative to the total intensity of said pixel and a low value of the first parameter indicates a low intensity in the red spectrum relative to the total intensity of said pixel, wherein values of the first parameter that are among the 50% highest of all possible values results in alterations that are more significant than the alterations that result from values of the first parameter that are among the 50% lowest of all possible values.

10. The method according to claim 9 , wherein for at least 50% of the possible values of said first parameter an increase in the value of the first parameter results in an increase in the strength of the alteration.

11. An image processing device for enhancing the visibility of blood vessels in a colour image, said image processing device comprising a processing unit operationally connectable to an image capturing device of a medical device, wherein said processing unit is configured to receive a colour image having a plurality of colour channels including a red colour channel, a green colour channel, and a blue colour channel from said image capturing device, said colour image has a plurality of pixels and said processing unit further is configured to, for at least some of said plurality of pixels, perform the steps of:

(a) process data obtained from the red colour channel together with data obtained from the green colour channel to create a value of a first sub parameter, and process data obtained from the red colour channel together with data obtained from the blue colour channel to create a value of a second sub parameter, wherein said process data comprises subtracting said data obtained from the green colour channel from said data obtained from the red colour channel;

process said value of said first sub parameter together with said value of said second sub parameter to create a value of a first parameter indicative of the intensity in a red spectrum relative to a total intensity of said pixel; and

(b) using said value of said first parameter to alter said pixel,

wherein said first parameter has at least three possible values, and wherein the strength of the alteration is dependent on the value of said first parameter.

12. The image processing device according to claim 11 , wherein step (a) comprises: processing data obtained from the blue colour channel to determine the value of said first parameter.

13. The image processing device according to claim 11 , wherein both said value of said first sub parameter and said value of said second sub parameter are indicative of the intensity in the red spectrum relative to the total intensity of said pixel.

14. The image processing device according to claim 11 , wherein parts of the colour image having no blood vessels are substantially unaltered and displayed with normal colours.

15. The image processing device according to claim 11 , wherein said image processing device is operationally connectable to an input unit for receiving user input and further configured to receive a user selected value of a third parameter from said input unit and wherein the alteration is dependent on both said value of said first parameter and said value of said third parameter, whereby the user may control the strength of the alteration.

16. A display unit for displaying images obtained by an image capturing device of a medical device, wherein said display unit comprises:

the image processing device according to claim 11 .

17. An endoscope system comprising:

an endoscope; and

the image processing device according to claim 11 ,

wherein said endoscope has an image capturing device and said processing unit of said image processing device is operationally connectable to said image capturing device of said endoscope.

18. The endoscope system according to claim 17 , wherein the endoscope system further comprises a display unit, wherein said display unit is operationally connectable to said image capturing device of said endoscope and configured display said captured images.

19. A method of operating an image processing device for enhancing the visibility of blood vessels in a colour image captured by an image capturing device of a medical device, said colour image having a plurality of colour channels including a red colour channel, a green colour channel, and a blue colour channel and having a plurality of pixels, wherein said method comprises, for at least some of said plurality of pixels, the steps of:

(a) processing data obtained from the red colour channel together with data obtained from the green colour channel to create a value of a first sub parameter, and processing data obtained from the red colour channel together with data obtained from the blue colour channel to create a value of a second sub parameter;

processing said value of said first sub parameter together with said value of said second sub parameter to create a value of a first parameter indicative of the intensity in a red spectrum relative to a total intensity of said pixel; and

(b) using said value of said first parameter to alter said pixel,

wherein said first parameter has at least three possible values, and wherein the strength of the alteration is dependent on the value of said first parameter, and

wherein prior to step (a):

a low pass filtered image is created for each of said plurality of colour channels indicating a local average for each pixel, and each colour channel of said plurality of colour channels is normalized using its low pass filtered image.

20. The method according to claim 19 , wherein step (a) comprises: processing data obtained from the blue colour channel to determine the value of said first parameter.

21. The method according to claim 19 , wherein step (a) comprises subtracting said data obtained from the green colour channel from said data obtained from the red colour channel.

22. The method according to claim 19 , wherein said method further comprises:

determining a value of a second parameter indicative of the intensity of said pixel and wherein said value of said first parameter together with said value of said second parameter are used to alter said pixel.

23. The method according to claim 19 , wherein a value of a third parameter is created based on user input, and wherein the alteration is dependent on both said value of said first parameter and said value of said third parameter, whereby the user may control the strength of the alteration.

24. The method according to claim 19 , wherein a high value of the first parameter indicates a high intensity in the red spectrum relative to the total intensity of said pixel and a low value of the first parameter indicates a low intensity in the red spectrum relative to the total intensity of said pixel, wherein values of the first parameter that are among the 50% highest of all possible values results in alterations that are more significant than the alterations that result from values of the first parameter that are among the 50% lowest of all possible values.

25. A method of operating an image processing device for enhancing the visibility of blood vessels in a colour image captured by an image capturing device of a medical device, said colour image having a plurality of colour channels including a red colour channel, a green colour channel, and a blue colour channel and having a plurality of pixels, wherein said method comprises, for at least some of said plurality of pixels, the steps of:

(a) processing data obtained from the red colour channel together with data obtained from the green colour channel to create a value of a first sub parameter, and processing data obtained from the red colour channel together with data obtained from the blue colour channel to create a value of a second sub parameter;

processing said value of said first sub parameter together with said value of said second sub parameter to create a value of a first parameter indicative of the intensity in a red spectrum relative to a total intensity of said pixel; and

(b) using said value of said first parameter to alter said pixel,

wherein said first parameter has at least three possible values, and wherein the strength of the alteration is dependent on the value of said first parameter, and

wherein a high value of the first parameter indicates a high intensity in the red spectrum relative to the total intensity of said pixel and a low value of the first parameter indicates a low intensity in the red spectrum relative to the total intensity of said pixel, wherein values of the first parameter that are among the 50% highest of all possible values results in alterations that are more significant than the alterations that result from values of the first parameter that are among the 50% lowest of all possible values.

26. The method according to claim 25 , wherein step (a) comprises: processing data obtained from the blue colour channel to determine the value of said first parameter.

27. The method according to claim 25 , wherein step (a) comprises subtracting said data obtained from the green colour channel from said data obtained from the red colour channel.

28. The method according to claim 25 , wherein said method further comprises:

determining a value of a second parameter indicative of the intensity of said pixel and wherein said value of said first parameter together with said value of said second parameter are used to alter said pixel.

29. The method according to claim 25 , wherein a low pass filtered image is created for each of said plurality of colour channels indicating a local average for each pixel, and wherein each colour channel is normalized using its low pass filtered image.

30. The method according to claim 25 , wherein a value of a third parameter is created based on user input, and wherein the alteration is dependent on both said value of said first parameter and said value of said third parameter, whereby the user may control the strength of the alteration.

31. An image processing device for enhancing the visibility of blood vessels in a colour image, said image processing device comprising a processing unit operationally connectable to an image capturing device of a medical device, wherein said processing unit is configured to receive a colour image having a plurality of colour channels including a red colour channel, a green colour channel, and a blue colour channel from said image capturing device, said colour image has a plurality of pixels and said processing unit further is configured to, for at least some of said plurality of pixels, perform the steps of:

(a) process data obtained from the red colour channel together with data obtained from the green colour channel to create a value of a first sub parameter, process data obtained from the red colour channel together with data obtained from the blue colour channel to create a value of a second sub parameter;

process said value of said first sub parameter together with said value of said second sub parameter to create a value of a first parameter indicative of the intensity in a red spectrum relative to a total intensity of said pixel;

(b) using said value of said first parameter to alter said pixel,

wherein said first parameter has at least three possible values, and wherein the strength of the alteration is dependent on the value of said first parameter,

wherein said image processing device is operable to receive a user selected value of a third parameter, and wherein the alteration is dependent on both said value of said first parameter and said value of said third parameter, whereby the user may control the strength of the alteration with the user selected value.

32. The image processing device according to claim 31 , wherein step (a) comprises: processing data obtained from the blue colour channel to determine the value of said first parameter.

33. The image processing device according to claim 31 , wherein both said value of said first sub parameter and said value of said second sub parameter are indicative of the intensity in the red spectrum relative to the total intensity of said pixel.

34. The image processing device according to claim 31 , wherein step (a) comprises subtracting said data obtained from the green colour channel from said data obtained from the red colour channel.

35. The image processing device according to claim 31 , wherein step (a) comprises

subtracting said data obtained from the green colour channel from said data obtained from the red colour channel to create the value of the first sub parameter;

subtracting said data obtained from the blue colour channel from said data obtained from the red colour channel to create the value of the second sub parameter;

averaging the value of the first sub parameter and the value of the second sub parameter to create the value of the first parameter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2024
From: JØRGENSEN, ANDREAS HÄRSTEDT; SONNENBORG, FINN
To: AMBU A/S
Reel/Frame 066322/0042 →
Priority Claims (1)
EP 18193186 · Sep 7, 2018 · regional
Continuity (1)
Reissue 17273116 · Sep 3, 2019
References Cited (70)
US 4583027A · Parker · 1986 [cited by applicant]
US 5942817A · Chitayat · 1999 [cited by applicant]
US 6956602B2 · Higuchi et al. · 2005 [cited by applicant]
US 9443321B2 · Minai et al. · 2016 [cited by applicant]
US 9854962B2 · McGrail et al. · 2018 [cited by applicant]
US 9913568B2 · Kuramoto · 2018 [cited by applicant]
US 10321804B2 · Jacobsen et al. · 2019 [cited by applicant]
US 10406309B2 · Daher · 2019 [cited by applicant]
US 10478054B2 · Nave et al. · 2019 [cited by applicant]
US 11074690B2 · Jørgensen et al. · 2021 [cited by applicant]
US 11205253B2 · Jørgensen et al. · 2021 [cited by applicant]
US 20030063398A1 · Abe · 2003 [cited by examiner]
US 20030071895A1 · Higuchi et al. · 2003 [cited by applicant]
US 20100027863A1 · Venkataraman et al. · 2010 [cited by applicant]
US 20100265322A1 · Minai et al. · 2010 [cited by applicant]
US 20100305189A1 · Al Mahmood · 2010 [cited by examiner]
US 20120179050A1 · Saito · 2012 [cited by applicant]
US 20120253122A1 · Minetoma et al. · 2012 [cited by applicant]
US 20140187881A1 · Saito et al. · 2014 [cited by applicant]
US 20140316283A1 · Kaku et al. · 2014 [cited by applicant]
US 20150363932A1 · Hirota et al. · 2015 [cited by applicant]
US 20160239965A1 · Kuramoto · 2016 [cited by applicant]
US 20160270643A1 · Sasaki · 2016 [cited by examiner]
US 20170014021A1 · Kuramoto · 2017 [cited by applicant]
US 20170034496A1 · Ishimaru · 2017 [cited by examiner]
US 20170280986A1 · Sekowski et al. · 2017 [cited by applicant]
US 20170330320A1 · Lynch et al. · 2017 [cited by applicant]
US 20180068437A1 · Bronkalla et al. · 2018 [cited by applicant]
US 20180158180A1 · Yokouchi · 2018 [cited by applicant]
US 20180303351A1 · Mestha · 2018 [cited by examiner]
US 20190139221A1 · Castro-Gonzalez · 2019 [cited by examiner]
US 20200121175A1 · Morita · 2020 [cited by applicant]
US 20200211190A1 · Jrgensen et al. · 2020 [cited by applicant]
US 20200402238A1 · Aoyama · 2020 [cited by applicant]
US 20210342985A1 · Jørgensen et al. · 2021 [cited by applicant]
US 20220058799A1 · Jørgensen et al. · 2022 [cited by applicant]
CN 102186401A · 2011 [cited by applicant]
CN 102727158A · 2012 [cited by applicant]
CN 103654686A · 2014 [cited by applicant]
CN 104023618A · 2014 [cited by applicant]
CN 104899876A · 2015 [cited by applicant]
CN 105705075A · 2016 [cited by applicant]
CN 106388756A · 2017 [cited by applicant]
CN 108109134A · 2018 [cited by applicant]
EP 2474265A2 · 2012 [cited by applicant]
EP 3123927A1 · 2017 [cited by applicant]
EP 3127469 · 2017 [cited by applicant]
EP 3127469A1 · 2017 [cited by applicant]
JP 2016174836A · 2016 [cited by examiner]
WO 2018235178A1 · 2018 [cited by applicant]
WO 2018235179A1 · 2018 [cited by applicant]
WO 2019198576A1 · 2019 [cited by applicant]
Tache et al., “Supervised classification of cerebral blood vessels,” 2nd International Conference on Systems and Computer Science, Villeneuve d'Ascq, France, 2013, pp. 38-43, doi: 10.1109/lcConSCS.2013.6632020. (Year: 2… [cited by examiner]
Tache et al., “Enhanced visualization of cerebral blood vessels for X-ray angiograms,” 2013 E-Health and Bioengineering Conference (EHB), Iasi, Romania, 2013, pp. 1-4, doi: 10.1109/EHB.2013.6707406. (Year: 2013). [cited by examiner]
Zhao et al., “Retinal vessel segmentation: an efficient graph cut approach with retinex and local phase.” PLoS One. Apr. 1, 2015;10(4):e0122332. doi: 10.1371/journal.pone.0122332. Erratum in: PLoS One. Apr. 24, 2015;10(… [cited by examiner]
Subbaraya et al., “Novel approach for extraction of blood vessels using morphology and filtering techniques,” 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT), Chennai, Indi… [cited by examiner]
Memari et al., “Supervised retinal vessel segmentation from color fundus images based on matched filtering and AdaBoost classifier.” PLoS One. Dec. 11, 2017;12(12):e0188939. doi: 10.1371/journal.pone.0188939. PMID: 2922… [cited by examiner]
Sdiri et al., “Comparative study of endoscopic image enhancement techniques,” 2015 Colour and Visual Computing Symposium (CVCS), Gjovik, Norway, 2015, pp. 1-5, doi: 10.1109/CVCS.2015.7274898. (Year: 2015). [cited by examiner]
Bandara, A. M. R. R., and P. W. G. R. M. P. B. Giragama. “A retinal image enhancement technique for blood vessel segmentation algorithm.” 2017 IEEE international conference on industrial and information systems (ICIIS).… [cited by applicant]
International Search Report and Written Opinion received for PCT Patent Application No. PCT/EP2019/073483, mailed on Nov. 28, 2019, 10 pages. [cited by applicant]
Communication under Rule 71(3), Intention to Grant, issued in EP 18 193 186.6, dated May 27, 2021, 33 pages. [cited by applicant]
Extended search report in European Application No. 21160957.3, dated Aug. 5, 2021, 8 pages. [cited by applicant]
First examination report, and English translation, of Chinese application No. 201980064180.0, dated Oct. 18, 2021. [cited by applicant]
Communication under Rule 71(3), Intention to Grant, issued in EP 18 193 186.6, dated May 27, 2021, 9 pages. [cited by applicant]
Notice of allowance in CIP U.S. Appl. No. 16/811,927, dated Jun. 14, 2021, 5 pages. [cited by applicant]
Extended search report issued in EP 18 193 186.6, dated Nov. 19, 2020, 5 pages. [cited by applicant]
European search report issued in EP 18 193 186.6, dated Mar. 26, 2019, 6 pages. [cited by applicant]
Golhar, Mayank et al. “Blood Vessel Delineation in Endoscopic Images with Deep Learning Based Scene Classification,” Intelligent Virtual Agent, Berlin, pp. 147-168, Jun. 16, 2018. [cited by applicant]
International Search Report and Written opinion in related International Application No. PCT/EP2019/073483, dated Nov. 28, 2019; 5 pages. [cited by applicant]
Search Report issued by the European Patent Office dated Nov. 19, 2020 in related European Application No. 18193186.6; 5 pages. [cited by applicant]