IP Library Granted Patent US 9,924,867
Granted Patent B2
US 9,924,867 · App. 13/355,386 · Granted Mar 27, 2018

Automated determination of arteriovenous ratio in images of blood vessels

Inventors: Michael D. Abramoff (University Heights, IA); Melndert Niemeijer (Iowa City, IA); Xiayu Xu (Iowa City, IA); Milan Sonka (Coralville, IA); Joseph M. Reinhardt (Iowa City, IA)
Assignees: University of Iowa Research Foundation; The United States of America, as represented by the Secretary of the Department of Veterans Affairs
A61B3/12A61B3/0016A61B3/0058A61B3/1225
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,924,867
App. No.
13/355,386
Granted
Mar 27, 2018
Kind
B2
Abstract

The methods and systems provided can automatically determine an Arteriolar-to-Venular diameter Ratio, AVR, in blood vessels, such as retinal blood vessels and other blood vessels in vertebrates. The AVR is an important predictor of increases in the risk for stroke, cerebral atrophy, cognitive decline, and myocardial infarct.

Claims (68)

1. A method comprising:

receiving, by a computing device, an image, wherein the image comprises a digital color fundus image comprising a border around a field of view;

mirroring one or more pixel values in the image from within the border to outside the field of view;

blurring the image with a filter and subtracting the blurred image from the image to remove slow background variations, resulting in a preprocessed image;

identifying one or more vessel pixels in the preprocessed image as representing arteries and one or more other vessel pixels in the preprocessed image as representing veins in the field of view, by performing vessel segmentation on the preprocessed image and utilizing a trained classifier to disambiguate arterial vessel pixels from venous vessel pixels, wherein the trained classifier is trained based on a set of training images, resulting in a vessel likelihood map comprising a plurality of vessels;

applying a tobogganing method to the preprocessed image, resulting in a splat map;

determining, for each splat of the slap map, based on the vessel likelihood map, whether a splat is inside or outside a vessel, resulting in a processed vessel likelihood map;

applying a skeletonization method to the processed vessel likelihood map to reduce each of the plurality of vessels to a single respective centerline comprised of centerline pixels;

removing cross-over points and bifurcation points of the respective centerlines the processed vessel likelihood map to subdivide the processed vessel likelihood map into a plurality of vessel segments, each labeled as an artery vessel segment or a vein vessel segment;

defining a region of interest in the processed vessel likelihood map centered on a centerpoint of an optic disc;

removing vessels segments from the plurality of vessel segments that are outside the region of interest;

determining, by the computing device, vessel width measurements for the plurality of vessel segments, wherein the vessel width measurement is measured by, for each centerline pixel, determining a left vessel edge and a right vessel edges in the processed vessel likelihood map and calculating the distance between the left vessel edge and the right vessel edge; and

estimating, by the computing device, from the vessel width measurements an arteriovenous ratio (AVR).

2. The method of claim 1 , wherein the trained classifier uses a feature vector comprising one or more of, derivatives, texture, and color properties to disambiguate arterial vessel pixels from venous vessel pixels or arterial vessel segments from venous vessel segments.

3. The method of claim 1 , wherein vessel tree analysis and globally optimal graph search are used to disambiguate arterial vessel pixels from venous vessel pixels or arterial vessel segments from venous vessel segments.

4. The method of claim 1 , wherein blood flow is used to disambiguate arterial vessel pixels from venous vessel pixels or arterial vessel segments from venous vessel segments.

5. The method of claim 1 , wherein a higher propensity for a disease is indicated by a decreased AVR.

6. The method of claim 1 , wherein the image is one or more of, a color image, a multispectral image, an Optical Coherence Tomography image.

7. The method of claim 1 , wherein the image is of the retina, iris, skin, brain surface, or any tissue with visible blood vessels imaged using any two different wavelength imaging processes.

8. The method of claim 1 , wherein determining vessel width measurements for the identified arteries and veins comprises using one or more of, a graph search or profile fitting.

9. The method of claim 8 , wherein determining vessel width measurements for the identified arteries and veins comprises a graph search, wherein the graph search uses a multiscale cost function.

10. The method of claim 9 , wherein the multiscale cost function is derived from wavelet kernel lifting.

11. The method of claim 1 , wherein estimating, from the vessel width measurements, an AVR comprises:

estimating, by the computing device, a plurality of central retinal artery equivalent (CRAE) diameters and a plurality of central retinal vein equivalent (CRVE) diameters at a plurality of distances from an optic disc;

interpolating, by the computing device, a single CRAE and a single CRVE from the estimated plurality of diameters; and

calculating, by the computing device, the AVR from the single CRAE and the single CRVE.

12. A system comprising:

a memory; and

a processor, coupled to the memory, wherein the processor is configured for performing steps comprising,

receiving an image, wherein the image comprises a digital color fundus image comprising a border around a field of view;

mirroring one or more pixel values in the image from within the border to outside the field of view;

blurring the image with a filter and subtracting the blurred image from the image to remove slow background variations, resulting in a preprocessed image;

identifying one or more vessel pixels in the preprocessed image as representing arteries and one or more other vessel pixels in the preprocessed image as representing veins in the field of view, by performing vessel segmentation on the preprocessed image and utilizing a trained classifier to disambiguate arterial vessel pixels from venous vessel pixels, wherein the trained classifier is trained based on a set of training images, resulting in a vessel likelihood map comprising a plurality of vessels;

applying a tobogganing method to the preprocessed image, resulting in a splat map;

determining, for each splat of the slap map, based on the vessel likelihood map, whether a splat is inside or outside a vessel, resulting in a processed vessel likelihood map;

applying a skeletonization method to the processed vessel likelihood map to reduce each of the plurality of vessels to a single respective centerline comprised of centerline pixels;

removing cross-over points and bifurcation points of the respective centerlines the processed vessel likelihood map to subdivide the processed vessel likelihood map into a plurality of vessel segments, each labeled as an artery vessel segment or a vein vessel segment;

defining a region of interest in the processed vessel likelihood map centered on a centerpoint of an optic disc;

removing vessels segments from the plurality of vessel segments that are outside the region of interest;

determining, by the computing device, vessel width measurements for the plurality of vessel segments, wherein the vessel width measurement is measured by, for each centerline pixel, determining a left vessel edge and a right vessel edges in the processed vessel likelihood map and calculating the distance between the left vessel edge and the right vessel edge; and

estimating, by the computing device, from the vessel width measurements an arteriovenous ratio (AVR).

13. The system of claim 12 , wherein higher propensity for a disease is indicated by a decreased AVR.

14. The system of claim 12 , wherein the image is of the retina, iris, skin, brain surface, or any tissue with visible blood vessels imaged using any two different wavelength imaging processes.

15. The system of claim 12 , wherein determining vessel width measurements for the identified arteries and veins comprises a graph search.

16. The system of claim 15 , wherein the graph search uses a multiscale cost function.

17. The system of claim 16 , wherein the multi scale cost function is derived from wavelet kernel lifting comprising Gabor, Gaussian derivative, or difference of Gaussians kernels.

18. The system of claim 12 , wherein estimating, from the vessel width measurements, an AVR comprises:

estimating a plurality of central retinal artery equivalent (CRAE) diameters and a plurality of central retinal vein equivalent (CRVE) diameters at a plurality of distances from an optic disc;

interpolating a single CRAE and a single CRVE from the estimated plurality of diameters; and

calculating the AVR from the single CRAE and the single CRVE.

19. A non-transitory computer readable medium having computer executable instructions embodied thereon for performing steps comprising:

receiving an image, wherein the image comprises a digital color fundus image comprising a border around a field of view;

mirroring one or more pixel values in the image from within the border to outside the field of view;

blurring the image with a filter and subtracting the blurred image from the image to remove slow background variations, resulting in a preprocessed image;

identifying one or more vessel pixels in the preprocessed image as representing arteries and one or more other vessel pixels in the preprocessed image as representing veins in the field of view, by performing vessel segmentation on the preprocessed image and utilizing a trained classifier to disambiguate arterial vessel pixels from venous vessel pixels, wherein the trained classifier is trained based on a set of training images, resulting in a vessel likelihood map comprising a plurality of vessels;

applying a tobogganing method to the preprocessed image, resulting in a splat map;

determining, for each splat of the slap map, based on the vessel likelihood map, whether a splat is inside or outside a vessel, resulting in a processed vessel likelihood map;

applying a skeletonization method to the processed vessel likelihood map to reduce each of the plurality of vessels to a single respective centerline comprised of centerline pixels;

removing cross-over points and bifurcation points of the respective centerlines the processed vessel likelihood map to subdivide the processed vessel likelihood map into a plurality of vessel segments, each labeled as an artery vessel segment or a vein vessel segment;

defining a region of interest in the processed vessel likelihood map centered on a centerpoint of an optic disc;

removing vessels segments from the plurality of vessel segments that are outside the region of interest;

determining, by the computing device, vessel width measurements for the plurality of vessel segments, wherein the vessel width measurement is measured by, for each centerline pixel, determining a left vessel edge and a right vessel edges in the processed vessel likelihood map and calculating the distance between the left vessel edge and the right vessel edge; and

estimating, by the computing device, from the vessel width measurements an arteriovenous ratio (AVR).

20. The non-transitory computer readable medium of claim 19 , wherein determining vessel width measurements for the identified arteries and veins comprises a graph search.

21. The non-transitory computer readable medium of claim 19 , wherein estimating, from the vessel width measurements, an AVR comprises:

estimating a plurality of central retinal artery equivalent (CRAE) diameters and a plurality of central retinal vein equivalent (CRVE) diameters at a plurality of distances from an optic disc;

interpolating a single CRAE and a single CRVE from the estimated plurality of diameters; and

calculating the AVR from the single CRAE and the single CRVE.

Assignments (7)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 13355306 PREVIOUSLY RECORDED AT REEL: 062882 FRAME: 0485. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Mar 8, 2023
From: REINHARDT, JOSEPH; NIEMEIJER, MEINDERT; SONKA, MILAN; XU, XIAYU
To: UNVERSITY OF IOWA RESEARCH FOUNDATION
Reel/Frame 063010/0117 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2023
From: REINHARDT, JOSEPH; NIEMEIJER, MEINDERT; SONKA, MILAN; XU, XIAYU
To: UNIVERSITY OF IOWA RESEARCH FOUNDATION
Reel/Frame 062882/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2023
From: ABRAMOFF, MICHAEL
To: UNIVERSITY OF IOWA RESEARCH FOUNDATION; UNITED STATES GOVERNMENT AS REPRESENTED BY THE DEPARTMENT OF VETERANS AFFAIRS
Reel/Frame 062882/0516 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2023
From: UNIVERSITY OF IOWA RESEARCH FOUNDATION
To: ABRAMOFF, MICHAEL; NIEMEIJER, MEINDERT; XU, XIAYU; SONKA, MILAN; REINHARDT, JOSEPH M.
Reel/Frame 062882/0478 →
CONFIRMATORY LICENSE Recorded Jan 16, 2014
From: UNIVERSITY OF IOWA
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 032040/0388 →
CONFIRMATORY LICENSE Recorded Jan 16, 2014
From: UNIVERSITY OF IOWA
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 032040/0407 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2013
From: ABRAMOFF, MICHAEL D; NIEMEIJER, MEINDERT; XU, XIAYU; SONKA, MILAN; REINHARDT, JOSEPH M
To: UNIVERSITY OF IOWA RESEARCH FOUNDATION
Reel/Frame 030064/0169 →
Continuity (2)
Provisional Application 61434551 · Jan 20, 2011
Related Publication 20120236259A1 · Sep 20, 2012