IP Library Granted Patent US 12,367,578
Granted Patent B2
US 12,367,578 · App. 18/435,214 · Granted Jul 22, 2025

Diagnosis of a disease condition using an automated diagnostic model

Inventors: Michael Abramoff (Iowa City, IA); Gwenole Quellec (Brest, FR)
Assignees: University of Iowa Research Foundation; United States Government as Represented by the Department of Veterans Affairs
G06T7/0012G06F18/00G06T7/75G06V40/193G06T2207/10024G06T2207/20081G06T2207/30041G06T2207/30096G06V2201/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,578
App. No.
18/435,214
Granted
Jul 22, 2025
Kind
B2
Abstract

A method of identifying an object of interest can comprise obtaining first samples of an intensity distribution of one or more object of interest, obtaining second samples of an intensity distribution of confounder objects, transforming the first and second samples into an appropriate first space, performing dimension reduction on the transformed first and second samples, whereby the dimension reduction of the transformed first and second samples generates an object detector, transforming one or more of the digital images into the first space, performing dimension reduction on the transformed digital images, whereby the dimension reduction of the transformed digital images generates one or more reduced images, classifying one or more pixels of the one or more reduced images based on a comparison with the object detector, and identifying one or more objects of interest from the classified pixels.

Claims (51)

1. A system for diagnosing a disease condition in a patient, the system comprising:

one or more computer processors on one or more computers;

a computer readable medium on the one or more computers;

an object detection model stored on the computer readable medium, the object detection model comprising a set of parameters of a supervised procedure, wherein the object detection model is configured to output, based on an image, a probability that the image contains an object of interest at each of one or more locations within the image;

an automated diagnostic model stored on the computer readable medium, the automated diagnostic model comprising a set of parameters of a diagnostic model, wherein the automated diagnostic model is configured to output, based on the probability that the image contains the object of interest at each of one or more locations within the image, a probabilistic diagnosis of a disease condition depicted in the image; and

a diagnostic system stored on the computer readable medium, the diagnostic system containing instructions configured to cause the one or more computer processors to perform steps comprising:

receiving the image, the image containing a portion of a body of the patient,

passing the image to the object detection model,

receiving, from the object detection model, the probability that the image contains the object of interest at each of the one or more locations within the image,

passing, to the automated diagnostic model, the probability that the image contains the object of interest at each of the one or more locations within the image,

receiving, from the automated diagnostic model, the probabilistic diagnosis of the disease condition for the image, and

outputting the probabilistic diagnosis of the disease condition.

2. The system of claim 1 , wherein passing the image to the object detection model comprises:

obtaining one or more samples for each of a set of different regions of the image; and

applying each of the one or more samples to the supervised procedure to output a probability that each of the one or more samples contains one or more objects of interest, where the one or more objects of interest are indicative of the disease condition.

3. The system of claim 1 , wherein the supervised procedure comprises a plurality of trained filters, each trained filter configured to identify the probability that the image contains the object of interest.

4. The system of claim 1 , wherein the image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in the eye.

5. The system of claim 1 , wherein the image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in a retina of the patient.

6. The system of claim 1 , wherein the object of interest at one of the one or more locations within the image comprises an object that has a similar appearance to another object that indicates a disease condition in a patient but that does not itself indicate a disease condition in a patient.

7. The system of claim 1 , wherein the object of interest comprises an object selected from a group consisting of: a microaneurysm, a dot hemorrhage, a flame-shaped hemorrhage, a sub-intimal hemorrhage, a sub-retinal hemorrhage, a pre-retinal hemorrhage, a micro-infarction, a cotton-wool spot, a yellow exudate, and a drusen.

8. The system of claim 1 , wherein the supervised procedure is trained by a method comprising:

receiving a plurality of training examples, each training example comprising a training image and a label indicating whether the training image contains an object of interest at each of one or more locations within the training image; and

fitting the supervised procedure to the plurality of training examples.

9. The system of claim 8 , wherein the training image of at least one of the plurality of training examples is annotated to indicate one or more reference points that correspond to a center of a feature of interest in the training image.

10. The system of claim 1 , wherein the diagnostic model is trained by a method comprising:

receiving a plurality of training examples, each training example comprising a probability that a training image contains an object of interest at each of one or more locations within the training image and a label indicating whether the training image depicts a disease condition; and

fitting the diagnostic model to the plurality of training examples.

11. A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by one or more computer processors on one or more computers, cause the one or more computer processors to perform steps comprising:

receiving an image of a portion of a body of a patient;

accessing an object detection model, the object detection model comprising a set of parameters of a supervised procedure, wherein the object detection model is configured to output, based on the image, a probability that the image contains an object of interest at each of one or more locations within the image;

passing the image to the object detection model;

receiving, from the object detection model, the probability that the image contains the object of interest at each of the one or more locations within the image;

accessing an automated diagnostic model, the automated diagnostic model comprising a set of parameters of a diagnostic model, wherein the automated diagnostic model is configured to output, based on the probability that the image contains the object of interest at each of one or more locations within the image, a probabilistic diagnosis of a disease condition depicted in the image;

passing, to the automated diagnostic model, the probability that the image contains the object of interest at each of the one or more locations within the image;

receiving, from the automated diagnostic model, the probabilistic diagnosis of the disease condition for the image; and

outputting the probabilistic diagnosis of the disease condition.

12. The computer program product of claim 11 , wherein passing the image to the object detection model comprises:

obtaining one or more samples for each of a set of different regions of the image; and

applying each of the one or more samples to the supervised procedure to output a probability that each of the one or more samples contains one or more objects of interest, where the one or more objects of interest are indicative of the disease condition.

13. The computer program product of claim 11 , wherein the supervised procedure comprises a plurality of trained filters, each trained filter configured to identify the probability that the image contains the object of interest.

14. The computer program product of claim 11 , wherein the image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in the eye.

15. The computer program product of claim 11 , wherein the image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in a retina of the patient.

16. The computer program product of claim 11 , wherein the object of interest at one of the one or more locations within the image comprises an object that has a similar appearance to another object that indicates a disease condition in a patient but that does not itself indicate a disease condition in a patient.

17. The computer program product of claim 11 , wherein the object of interest comprises an object selected from a group consisting of: a microaneurysm, a dot hemorrhage, a flame-shaped hemorrhage, a sub-intimal hemorrhage, a sub-retinal hemorrhage, a pre-retinal hemorrhage, a micro-infarction, a cotton-wool spot, a yellow exudate, and a drusen.

18. The computer program product of claim 11 , wherein the supervised procedure is trained by a method comprising:

receiving a plurality of training examples, each training example comprising a training image and a label indicating whether the training image contains an object of interest at each of one or more locations within the training image; and

fitting the supervised procedure to the plurality of training examples.

19. The computer program product of claim 18 , wherein the training image of at least one of the plurality of training examples is annotated to indicate one or more reference points that correspond to a center of a feature of interest in the training image.

20. The computer program product of claim 11 , wherein the diagnostic model is trained by a method comprising:

receiving a plurality of training examples, each training example comprising a probability that a training image contains an object of interest at each of one or more locations within the training image and a label indicating whether the training image depicts a disease condition; and

fitting the diagnostic model to the plurality of training examples.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2025
From: QUELLEC, GWENOLE
To: UNIVERSITY OF IOWA RESEARCH FOUNDATION
Reel/Frame 069734/0406 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2025
From: ABRAMOFF, MICHAEL D.
To: UNIVERSITY OF IOWA RESEARCH FOUNDATION; UNITED STATES GOVERNMENT AS REPRESENTED BY THE DEPARTMENT OF VETERANS AFFAIRS
Reel/Frame 069734/0575 →
Continuity (5)
Continuation 17901582 · Sep 1, 2022
Continuation 16158093 · Oct 11, 2018
Continuation 13992552
Provisional Application 61420497 · Dec 7, 2010
Related Publication 20240177305A1 · May 30, 2024
References Cited (267)
US 4883061A · Zeimer · 1989 [cited by applicant]
US 4998533A · Winkelman · 1991 [cited by applicant]
US 5153923A · Matsuba · 1992 [cited by applicant]
US 5233517A · Jindra · 1993 [cited by applicant]
US 5270924A · Hideshima · 1993 [cited by applicant]
US 5303709A · Dreher et al. · 1994 [cited by applicant]
US 5557686A · Brown · 1996 [cited by applicant]
US 5857030A · Gaborski et al. · 1999 [cited by applicant]
US 5868134A · Sugiyama et al. · 1999 [cited by applicant]
US 6000799A · Van de Velde · 1999 [cited by applicant]
US 6003993A · Webb · 1999 [cited by applicant]
US 6044181A · Szeliski et al. · 2000 [cited by applicant]
US 6053865A · Sugiyama et al. · 2000 [cited by applicant]
US 6104828A · Shioiri · 2000 [cited by applicant]
US 6179421B1 · Pang · 2001 [cited by applicant]
US 6276798B1 · Gil et al. · 2001 [cited by applicant]
US 6453057B1 · Marshall et al. · 2002 [cited by applicant]
US 6549646B1 · Yeh · 2003 [cited by applicant]
US 6556853B1 · Cabib et al. · 2003 [cited by applicant]
US 6567682B1 · Osterweil et al. · 2003 [cited by applicant]
US 6674894B1 · Parker et al. · 2004 [cited by applicant]
US 6712469B2 · Ando · 2004 [cited by applicant]
US 6714672B1 · Berestov et al. · 2004 [cited by applicant]
US 6728561B2 · Smith et al. · 2004 [cited by applicant]
US 6731782B2 · Ashton · 2004 [cited by applicant]
US 6757409B2 · Marshall et al. · 2004 [cited by applicant]
US 6830336B2 · Fransen · 2004 [cited by applicant]
US 6845260B2 · Liu et al. · 2005 [cited by applicant]
US 6996260B1 · Skands et al. · 2006 [cited by applicant]
US 7104958B2 · Crutchfield et al. · 2006 [cited by applicant]
US 7206435B2 · Fujimura et al. · 2007 [cited by applicant]
US 7232240B2 · Kosnik et al. · 2007 [cited by applicant]
US 7242810B2 · Chang · 2007 [cited by applicant]
US 7343032B2 · Oakley et al. · 2008 [cited by applicant]
US 7474775B2 · Abramoff et al. · 2009 [cited by applicant]
US 7524061B2 · Yan et al. · 2009 [cited by applicant]
US 7574028B2 · Luo et al. · 2009 [cited by applicant]
US 7578028B2 · Sellars · 2009 [cited by applicant]
US 7620501B2 · Tek et al. · 2009 [cited by applicant]
US 7712898B2 · Abramoff et al. · 2010 [cited by applicant]
US 7715597B2 · Costache et al. · 2010 [cited by applicant]
US 8140329B2 · Zhang et al. · 2012 [cited by applicant]
US 8180134B2 · Wang · 2012 [cited by applicant]
US 8194936B2 · Abramoff et al. · 2012 [cited by applicant]
US 8340437B2 · Abramoff et al. · 2012 [cited by applicant]
US 8463065B2 · Sun et al. · 2013 [cited by applicant]
US 8611623B2 · Kurihara et al. · 2013 [cited by applicant]
US 8616702B2 · Abramoff · 2013 [cited by applicant]
US 8634628B2 · Inoue · 2014 [cited by applicant]
US 8639002B2 · Tanaka et al. · 2014 [cited by applicant]
US 8687862B2 · Hsu · 2014 [cited by applicant]
US 8761473B2 · Ihara · 2014 [cited by applicant]
US 8842894B2 · Ihara · 2014 [cited by applicant]
US 8965112B1 · Ibarz · 2015 [cited by applicant]
US 9307926B2 · Begin et al. · 2016 [cited by applicant]
US 9355458B2 · Ihara · 2016 [cited by applicant]
US 9679389B2 · Ostrovsky-Berman et al. · 2017 [cited by applicant]
US 9881234B2 · Huang · 2018 [cited by applicant]
US 9924867B2 · Abramoff · 2018 [cited by applicant]
US 10223610B1 · Akselrod-Ballin · 2019 [cited by applicant]
US 20020024516A1 · Chen et al. · 2002 [cited by applicant]
US 20020126915A1 · Lai et al. · 2002 [cited by applicant]
US 20020165837A1 · Zhang et al. · 2002 [cited by applicant]
US 20030071970A1 · Donnerhacke et al. · 2003 [cited by applicant]
US 20030133605A1 · Tannhof · 2003 [cited by applicant]
US 20030166999A1 · Liu et al. · 2003 [cited by applicant]
US 20030215119A1 · Uppaluri et al. · 2003 [cited by applicant]
US 20040032488A1 · Harman · 2004 [cited by applicant]
US 20040037453A1 · Marshall et al. · 2004 [cited by applicant]
US 20040064057A1 · Siegel · 2004 [cited by applicant]
US 20040085542A1 · Soliz et al. · 2004 [cited by applicant]
US 20040105074A1 · Soliz et al. · 2004 [cited by applicant]
US 20050100208A1 · Suzuki · 2005 [cited by applicant]
US 20050129306A1 · Wang · 2005 [cited by applicant]
US 20060023990A1 · Shih et al. · 2006 [cited by applicant]
US 20060056727A1 · Jones et al. · 2006 [cited by applicant]
US 20060119858A1 · Knighton et al. · 2006 [cited by applicant]
US 20060140446A1 · Luo et al. · 2006 [cited by applicant]
US 20060251293A1 · Piirainen · 2006 [cited by applicant]
US 20070002275A1 · Yan et al. · 2007 [cited by applicant]
US 20070020795A1 · Mori et al. · 2007 [cited by applicant]
US 20070058865A1 · Li et al. · 2007 [cited by applicant]
US 20070083492A1 · Hohimer et al. · 2007 [cited by applicant]
US 20070092864A1 · Reinhardt et al. · 2007 [cited by applicant]
US 20070110298A1 · Graepel et al. · 2007 [cited by applicant]
US 20070122007A1 · Austin et al. · 2007 [cited by applicant]
US 20070183661A1 · El-Maleh et al. · 2007 [cited by applicant]
US 20070230795A1 · Abramoff et al. · 2007 [cited by applicant]
US 20070244396A1 · Vilser et al. · 2007 [cited by applicant]
US 20070253171A1 · Cheng et al. · 2007 [cited by applicant]
US 20080205717A1 · Reeves et al. · 2008 [cited by applicant]
US 20080240547A1 · Cho et al. · 2008 [cited by applicant]
US 20080267483A1 · Zhan · 2008 [cited by applicant]
US 20080309881A1 · Huang et al. · 2008 [cited by applicant]
US 20090148024A1 · Park · 2009 [cited by applicant]
US 20090257024A1 · Luther et al. · 2009 [cited by applicant]
US 20100002929A1 · Sammak et al. · 2010 [cited by applicant]
US 20100034457A1 · Berliner et al. · 2010 [cited by applicant]
US 20100061601A1 · Abramoff et al. · 2010 [cited by applicant]
US 20100074532A1 · Gordon et al. · 2010 [cited by applicant]
US 20100082692A1 · Akinyemi et al. · 2010 [cited by applicant]
US 20100103249A1 · Lipton et al. · 2010 [cited by applicant]
US 20100104150A1 · Saint Felix et al. · 2010 [cited by applicant]
US 20100118161A1 · Tsurumi · 2010 [cited by applicant]
US 20100142767A1 · Fleming · 2010 [cited by applicant]
US 20100142824A1 · Lu · 2010 [cited by applicant]
US 20100177943A1 · Zhao et al. · 2010 [cited by applicant]
US 20100182406A1 · Benitez · 2010 [cited by applicant]
US 20100271511A1 · Ma et al. · 2010 [cited by applicant]
US 20100278420A1 · Shet · 2010 [cited by applicant]
US 20100284180A1 · Popovich et al. · 2010 [cited by applicant]
US 20110026794A1 · Sundar et al. · 2011 [cited by applicant]
US 20110091083A1 · Liu · 2011 [cited by applicant]
US 20110134221A1 · Lee et al. · 2011 [cited by applicant]
US 20110135172A1 · Kitamura · 2011 [cited by applicant]
US 20120155726A1 · Li · 2012 [cited by applicant]
US 20120236259A1 · Abramoff et al. · 2012 [cited by applicant]
US 20120237094A1 · Kurihara et al. · 2012 [cited by applicant]
US 20130208960A1 · Reisman · 2013 [cited by applicant]
US 20140016832A1 · Kong · 2014 [cited by applicant]
US 20140035901A1 · Chen et al. · 2014 [cited by applicant]
US 20140355861A1 · Nirenberg · 2014 [cited by applicant]
US 20150289822A1 · Dugan · 2015 [cited by applicant]
US 20150379708A1 · Abramoff et al. · 2015 [cited by applicant]
US 20160071266A1 · Srivastava · 2016 [cited by applicant]
US 20160100766A1 · Yoshioka · 2016 [cited by applicant]
US 20160104058A1 · He · 2016 [cited by applicant]
US 20160217586A1 · Dickrell, III · 2016 [cited by applicant]
US 20160292856A1 · Niemeijer · 2016 [cited by applicant]
US 20170014089A1 · Murakami · 2017 [cited by applicant]
US 20170147905A1 · Huang · 2017 [cited by applicant]
US 20170169567A1 · Chefd'hotel · 2017 [cited by applicant]
US 20170209096A1 · Ishii · 2017 [cited by applicant]
US 20170215812A1 · Yamaji · 2017 [cited by applicant]
US 20190130566A1 · Niemeijer · 2019 [cited by applicant]
AU 2012207076 · 2012 [cited by applicant]
CA 2610345 · 2006 [cited by applicant]
CA 2825169 · 2012 [cited by applicant]
EP 0905509A1 · 1999 [cited by applicant]
EP 2665406 · 2012 [cited by applicant]
JP 2007097634A · 2007 [cited by applicant]
JP 2010500081A · 2010 [cited by applicant]
JP 6005663B2 · 2016 [cited by applicant]
WO WO8905493 · 1989 [cited by applicant]
WO WO2005076198 · 2005 [cited by applicant]
WO WO2006023990A2 · 2006 [cited by applicant]
WO WO20060105473 · 2006 [cited by applicant]
WO WO2007031818 · 2007 [cited by applicant]
WO WO2007118079 · 2007 [cited by applicant]
WO WO2008150840 · 2008 [cited by applicant]
WO WO2009126112A1 · 2009 [cited by applicant]
WO WO2010099289A1 · 2010 [cited by applicant]
WO WO2012078636 · 2012 [cited by applicant]
WO WO2012100221 · 2012 [cited by applicant]
WO WO2012100225A1 · 2012 [cited by applicant]
WO WO2012106677A2 · 2012 [cited by applicant]
WO WO2013110668A1 · 2013 [cited by applicant]
WO WO2014143891A1 · 2014 [cited by applicant]
Abramoff, M. et al., Image Processing with Image. J Biophotonics Int. 2004; 11(7):36-42. [cited by applicant]
Adelson, E. et al., Pyramid Methods in Image Processing. RCA Engineer. 1984; 29(6):33-41. [cited by applicant]
Agurto et al., Detection and phenotyping of retinal disease using AM-FM processing for feature extraction. Signals, Systems and Computers, 2008 42nd Asilomar Conference on. IEEE, 2008. [cited by applicant]
Agurto et al., Multiscale AM-FM Methods for Diabetic Retinopathy Lesion Detection. Feb. 2010, Medical Imaging, IEEE Trans. 29(2):502-12. [cited by applicant]
Barriga et al., Automatic system for diabetic retinopathy screening based on AM-FM, partial least squares, and support vector machines. Apr. 2010, Biomedical Imaging: From Nano to Macro, 2010 IEEE International Symposiu… [cited by applicant]
Barriga et al., Multi-scale AM-FM for lesion phenotyping on age-related macular degeneration. Computer-Based Medical Systems, 2009. CBMS 2009. 22nd IEEE International Symposium on. IEEE, 2009. [cited by applicant]
Boroujeni et al., Coronary Artery Center-line Extraction Using Second Order Local Features. Comput Math Methods Med. 2012 (20 pages). [cited by applicant]
Can, A. et al., A Feature-Based Robust, Hierarchical, Algorithm for Registering Pairs of Images of the Curved Human Retina. IEEE Trans on Pattern analysis and Machine Intelligence. 2002; 24:347-64. [cited by applicant]
Can, A. et al., A Feature-Based Technique for Joint, Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina. IEEE Trans on Pattern Analysis and Machine Intelligence. 2002; 24(… [cited by applicant]
Can, A. et al., Rapid Automated Tracing and Feature Extraction from Retinal Fundus Images Using Direct Exploratory Algorithms. IEEE Trans on Information Technology in Biomedicine. 1999; 3:125-38. [cited by applicant]
Chanwimaluang, T., Hybrid Retinal Image Registration. IEEE Trans on Information Technology in Biomedicine. 2006; 10:129-42. [cited by applicant]
Choe, T. et al., Optimal Global Mosaic Generation from Retinal Images. Int Conf on Pattern Recognition. 2006; 3:681-4. [cited by applicant]
Chrástek et al., Automated Calculation of Retinal Arteriovenous Ratio for Detection and Monitoring of Cerebrovascular Disease Based on Assessment of Morphological Changes of Retinal Vascular System. MVA 2002 Proc IAPR W… [cited by applicant]
Chrástek et al., Automated Segmentation of the Optic Nerve Head for Diagnosis of Glaucoma. Med Image Anal. 2005; 9:297-314. [cited by applicant]
Deng, K. et al., Retinal Fundus Image Registration via Vascular Structure Graph Matching. Int J Biomed Imag. 2010. (19 pages). [cited by applicant]
Eye Conditions Encyclopedia, “Optic Nerve Imaging”; EyeMDLink.com; Dec. 3, 2005; pp. 1-2. [cited by applicant]
Frangi et al., Multiscale Vessel Enhancement Filtering. Medical Image Computing and Computer-Assisted Intervention—MICCAI'98 Lecture Notes in Computer Sci. 1998; 1496:130-7. [cited by applicant]
Van Ginneken et al., IOP Image Processing Project Proposal: Computer-aided Diagnosis for Diabetic Retinopathy Detection in Fundus Images. Apr. 5, 2002; pp. 1-23. [cited by applicant]
Goatman, K., Automated Detection of Microaneurysms. Abstracts Reports. Biomed Phys Bioeng, University of Aberdeen. Retrieved from: <www.biomed.abdn.ac.uk/Abstracts/A07890/>. Jul. 10, 1997 (8 pages). [cited by applicant]
Ter Haar Romeny, B.M., Front-End Vision and Multi-Scale Image Analysis. Springer: 2003, pp. xiii-xviii. [cited by applicant]
Hackel, R. and Saine, P., Creating Retinal Fundus Maps. J Ophthalmic Photography. 2005; 27(1):10-8. [cited by applicant]
Huang et al., Development and Comparison of Automated Classifiers for Glaucoma Diagnosis Using Stratus Optical Coherence Tomography. Invest Ophthalmol Visual Sci. 2005; 46(11):4121-9. [cited by applicant]
Hyvärinen, A. and Oja, E., Independent Component Analysis: Algorithms and Applications. Neural Netw. 2000; 13(4-5):411-30. [cited by applicant]
Johnson et al., Structure and Function Evaluation (SAFE): II. Comparison of Optic Disk and Visual Field Characteristics. Am J Ophthalmol. 2003; 135(2):148-54. [cited by applicant]
Klein, B.E. et al., Cardiovascular Disease, Mortality, and Retinal Microvascular Characteristics in Type 1 Diabetes. Arch Intern Med. 2004; 164(17):1917-24. [cited by applicant]
Kondermann et al., Blood Vessel Classification into Arteries and Veins in Retinal Images. Proc SPIE. 2007; 6512:651247-1 to -9. [cited by applicant]
Lee et al., Retinal atlas statistics from color fundus images. Med Imaging: Image Processing. 2010 (10 pages). [cited by applicant]
Light Shaping Diffusers Including a Rear Projection System. Physical Optics Corp. 2003. Reprinted from the Aug. 1996 issue of Photonics Spectra © Laurin Publishing Co., Inc. [Retrieved on Apr. 15, 2010]. Retrieved from … [cited by applicant]
Lliev et al., Morphometric Assessment of Normal, Suspect and Glaucomatous Optic Discs with Stratus OCT and HRT II. Eye. 2005; pp. 1-12. [cited by applicant]
Maintz, J. and Viergever, M., A Survey of Medical Image Registration. Medical Image Analysis. 1998; 2(1):1-36. [cited by applicant]
Martus et al., Multivariate Approach for Quantification of Morphologic and Functional Damage in Glaucoma. Invest Ophthalmol Visual Sci. 41(5):1099-110. [cited by applicant]
Muramatsu et al., Automated selection of major arteries and veins for measurement of arteriolar-to-venular diameter ratio on retinal fundus images. Comp Med Imaging Graphics. 2011; 35(6):472-80. [cited by applicant]
Niemeijer, M. et al., Automatic determination of the artery-vein ratio in retinal images. Proc SPIE—The Int Soc Optic Eng. 2010; 7624: 762401-1 to -10. [cited by applicant]
Quellec et al., Optimal Filter Framework for Automated, Instantaneous Detection of Lesions in Retinal Images. Oct. 21, 2010, Medical Imaging, IEEE Transactions on, 30(2): 523-33. [cited by applicant]
Quellec et al., Optimal wavelet transform for the detection of microaneurysms in retina photographs. IEEE Trans Med Imaging 27.9. 2008; 1230-41. [cited by applicant]
Ritter, N. et al., Registration of Stereo and Temporal Images of the Retina. IEEE Trans on Medical Imaging. 1999; 18:404-18. [cited by applicant]
“Segmentation”; Image Processing Fundamentals—Segmentation; Website: www.ph.tn.tudelft.nl/Courses/FIP/frames/fip-Segmenta.html; pp. 1-9. [cited by applicant]
Sharrett, A.R et al., Retinal Arteriolar Diameters and Elevated Blood Pressure. Am J Epidemiol. 1999; 150(3):263-70. [cited by applicant]
Staal, J. et al., Ridge-based Vessel Segmentation in Color Images of the Retina. IEEE Trans on Medical Imaging. 2004; 23(4):501-9. [cited by applicant]
Swindale et al., Automated Analysis of Normal and Glaucomatous Optic Nerve Head Topography Images. Invest Ophthalmol Visual Sci. 2000; 41(7):1730-42. [cited by applicant]
Szymczak et al., Coronary Vessel Trees from 3D Imagery: a Topographical Approach. Med Image Anal. 2006; 10(4):548-59. [cited by applicant]
Toderici, G. et al., Evaluation of Variability and Significance of Fundus Camera Lens Distortion. Proc 26th Annual Int Conf of the IEEE Eng in Med and Bo Soc. pp. 1-5 (San Francisco, CA; Sep. 2004). [cited by applicant]
Tuytelaars et al., Matching widely separated views based on affine invariant regions. Int J Comp Vision 59.1. 2004; pp. 61-85. [cited by applicant]
Vincent, L., Morphological Grayscale Reconstruction in Image Analysis: Applications and Efficient Algorithms. IEEE Trans on Image Processing. 1993; 2:176-201. [cited by applicant]
Weng, J. et al., Camera Calibration with Distortion Models and Accuracy Evaluation. IEEE Trans on Pattern Analysis and Machine Intelligence. 1992; 14(10):965-80. [cited by applicant]
Wong et al., Computer-Assisted Measurement of Retinal Vessel Diameters in the Beaver Dam Eye Study Methodology: Correlation Between Eyes and Effect of Refractive Errors. Ophthalmology. 2004; 111(6):1183-90. [cited by applicant]
Xu, J. and Chutatape, O., Comparative Study of Two Calibration Methods on Fundus Camera. Proc 26th Annual Int Conf of the IEEE Eng in Med and Bio Soc. pp. 576-579 (Cancun, Mexico; 2003). [cited by applicant]
Yale Medicine Winter/Spring 1998, Imaging the Eye. Medicine's New Eyes. pp. 1-3. [cited by applicant]
Zomet, A., Seamless Image Stitching by Minimizing False Edges. IEEE Trans on Image Processing. 2006; 15:969-77. [cited by applicant]
International Search Report and Written Opinion issued on Jan. 3, 2008 by the International Searching Authority for Patent Application No. PCT/US2006/012191, which was filed on Mar. 31, 2006 and published as WO 2006/105… [cited by applicant]
International Preliminary Report on Patentability issued on Mar. 10, 2009 by the International Searching Authority for Patent Application No. PCT/US2006/012191, which was filed on Mar. 31, 2006 and published as WO 2006/… [cited by applicant]
International Search Report and Written Opinion mailed on Sep. 17, 2008 by the International Searching Authority for Patent Application No. PCT/US2007/065862, which was filed on Apr. 3, 2007 and published as WO 2007/118… [cited by applicant]
International Preliminary Report on Patentability issued on Nov. 4, 2008 by the International Searching Authority for Patent Application No. PCT/US2007/065862, which was filed on Apr. 3, 2007 and published as WO 2007/11… [cited by applicant]
International Search Report and Written Opinion mailed on Oct. 15, 2008 by the International Searching Authority for Patent Application No. PCT/US2008/065043, which was filed on May 29, 2008 and published as WO 2008/150… [cited by applicant]
International Preliminary Report on Patentability issued Dec. 1, 2009 by the International Searching Authority for Patent Application No. PCT/US2008/065043, which was filed on May 29, 2008 and published as WO 2008/15084… [cited by applicant]
International Search Report and Written Opinion mailed on May 3, 2010 by the International Searching Authority for Patent Application No. PCT/US2010/025369, which was filed on Feb. 25, 2010 and published as WO 2010/0992… [cited by applicant]
International Preliminary Report on Patentability issued on Aug. 30, 2011 by the International Searching Authority for Patent Application No. PCT/US2010/025369, which was filed on Feb. 25, 2010 and published as WO 2010/… [cited by applicant]
International Search Report and Written Opinion was mailed on Apr. 3, 2012 by the International Searching Authority for Application No. PCT/US2011/63537 , which was filed on Dec. 6, 2011 and published as WO 2012/078636 … [cited by applicant]
International Preliminary Report on Patentability was mailed on Jun. 12, 2013 by the International Searching Authority for Application No. PCT/US2011/63537 , which was filed on Dec. 6, 2011 and published as WO 2012/0786… [cited by applicant]
Preliminary Amendment was mailed on Jun. 7, 2013 to the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2013/0301889 on Nov. 4, 2013 (Inventor—Abramoff et al.; App… [cited by applicant]
Non Final Rejection was issued on May 11, 2015 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2013/0301889 on Nov. 4, 2013 (Applicant—University of Iowa Re… [cited by applicant]
Response to Non Final Rejection was mailed on Oct. 12, 2015 to the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, which was filed on Jul. 25, 2013 and published as US 2013/0301889 on Nov. 4, 2013 (Appli… [cited by applicant]
Final Rejection was issued on Nov. 13, 2015 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2013/0301889 on Nov. 4, 2013 (Applicant—University of Iowa Resea… [cited by applicant]
Non Final Rejection was issued on Jul. 11, 2016 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2013/0301889 on Nov. 4, 2013 (Applicant—University of Iowa R… [cited by applicant]
Final Rejection was issued on Mar. 28, 2017 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2015/0379708 on Dec. 31, 2015 (Inventor—Abramoff et al.; Applica… [cited by applicant]
Non-Final Office Action issued on Dec. 11, 2017 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2015/0379708 on Dec. 31, 2015 (Inventor—Abramoff et al.; App… [cited by applicant]
Notice of Allowance issued on Jul. 11, 2018 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2015/0379708 on Dec. 31, 2015 (Inventor—Abramoff et al.; Applica… [cited by applicant]
International Search Report and Written Opinion mailed on May 8, 2012 by the International Searching Authority for Patent Application No. PCT/US2012/022115, which was filed on Jan. 20, 2012 and published as WO 2012/1002… [cited by applicant]
International Preliminary Report on Patentability issued on Jul. 23, 2013 by the International Searching Authority for Patent Application No. PCT/US2012/022115, which was filed on Jan. 20, 2012 and published as WO 2012/… [cited by applicant]
European Search Report issued on Mar. 16, 2016 by the European Patent Office for Application No. 12736290.3, which was filed on Jan. 20, 2011, and published as 2665406, on Nov. 27, 2013 (Inventor—Abramoff et al.; Applic… [cited by applicant]
International Search Report and Written Opinion mailed on May 25, 2012 by the International Searching Authority for Application No. PCT/US2012/022111, which was filed on Jan. 20, 2012 and published as WO 2012/100221 on … [cited by applicant]
International Preliminary Report on Patentability was mailed on Jul. 23, 2013 by the International Searching Authority for Application No. PCT/US2012/022111, which was filed on Jan. 20, 2012 and published as WO 2012/100… [cited by applicant]
Preliminary Amendment was mailed on Jun. 19, 2012 to the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of Iow… [cited by applicant]
Non Final Rejection was issued on Sep. 19, 2013 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, which was filed on Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—Univer… [cited by applicant]
Response to Non Final Rejection was mailed on Dec. 19, 2013 to the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—Univers… [cited by applicant]
Final Rejection was issued on Mar. 11, 2014 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012(Applicant—University of Iowa Resea… [cited by applicant]
Non Final Rejection was issued on Feb. 6, 2015 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of Iowa R… [cited by applicant]
Response to Non Final Rejection was mailed on May 6, 2015 to the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—Universit… [cited by applicant]
Final Rejection issued on Jun. 23, 2015 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of Iowa Research… [cited by applicant]
Response to Final Rejection mailed on Aug. 24, 2015 to the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of I… [cited by applicant]
Non Final Rejection issued on Mar. 30, 2016 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of Iowa Rese… [cited by applicant]
Response to Non Final Rejection mailed on Sep. 30, 2016 to the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University … [cited by applicant]
Final Rejection issued on Nov. 9, 2016 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of Iowa Research … [cited by applicant]
Notice of Allowance issued on Nov. 8, 2017 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of lowa Resea… [cited by applicant]
Issue Notification issued on Mar. 7, 2018 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/355,386, filed Jan. 20, 2012 and published as US 2012/0236259 on Sep. 20, 2012 (Applicant—University of Iowa Resear… [cited by applicant]
International Search Report and Written Opinion mailed on Sep. 4, 2014 by the International Searching Authority for Application No. PCT/US2014/014298, which was filed on Jan. 31, 2014 and published as WO/2014/158345 on … [cited by applicant]
International Preliminary Report on Patentability mailed on Aug. 4, 2015 by the International Searching Authority for Application No. PCT/US2014/014298, which was filed on Jan. 31, 2014 and published as WO/2014/158345 o… [cited by applicant]
Preliminary Amendment mailed on Jul. 30, 2015 to the U.S. Patent and Trademark Office for U.S. Appl. No. 14/764,926, filed Jul. 30, 2015 and published as US 2015/0379708 on Dec. 31, 2015 (Applicant—University of Iowa Re… [cited by applicant]
Non Final Rejection issued on Jan. 27, 2017 by the U.S. Patent and Trademark Office for U.S. Appl. No. 14/764,926, filed Jul. 30, 2015 and published as US 2015/0379708 on Dec. 31, 2015 (Applicant—University of Iowa Rese… [cited by applicant]
International Search Report and Written Opinion mailed on Aug. 15, 2014 by the International Searching Authority for Application No. PCT/US2014/28055, which was filed on Mar. 14, 2014 and published as WO 2014/143891 on … [cited by applicant]
International Preliminary Report on Patentability was mailed on Sep. 15, 2015 by the International Searching Authority for Application No. PCT/US2014/28055, which was filed on Mar. 14, 2014 and published as WO 2014/1438… [cited by applicant]
Non Final Rejection was issued on Nov. 4, 2016 by the U.S. Patent and Trademark Office for U.S. Appl. No. 14/774,801, filed Sep. 11, 2015 and published as US 2016/0035088 on Feb. 4, 2016 (Applicant—University of Iowa Re… [cited by applicant]
Preliminary Amendment was mailed on Sep. 11, 2015 to the U.S. Patent and Trademark Office for U.S. Appl. No. 14/774,801, filed Sep. 11, 2015 and published as US 2016/0035088 on Feb. 4, 2016 (Applicant—University of Iowa… [cited by applicant]
Final Office Action issued on May 12, 2017 by the U.S. Patent and Trademark Office for U.S. Appl. No. 14/774,801, filed Sep. 21, 2015 and published as US 2016/0035088 on Feb. 4, 2016 (Applicant—University of Iowa Resear… [cited by applicant]
Non-Final Office Action issued on Nov. 17, 2017 by the U.S. Patent and Trademark Office for U.S. Appl. No. 14/774,801, filed Sep. 21, 2015 and published as US 2016/0035088 on Feb. 4, 2016 (Applicant—University of Iowa R… [cited by applicant]
Final Office Action issued on Jul. 23, 2018 by the U.S. Patent and Trademark Office for U.S. Appl. No. 14/774,801, filed Sep. 21, 2015 and published as US 2016/0035088 on Feb. 4, 2016 (Applicant—University of Iowa Resea… [cited by applicant]
International Search Report and Written Opinion was mailed on Aug. 5, 2015 by the International Searching Authority for Application No. PCT/US2015/022021, which was filed on Mar. 23, 2015 and published as WO 2015/143435… [cited by applicant]
International Preliminary Report on Patentability was mailed on Sep. 21, 2016 by the International Searching Authority for Application No. PCT/US2015/022021, which was filed on Mar. 23, 2015 and published as WO 2015/143… [cited by applicant]
Non Final Rejection issued on Dec. 22, 2017 by the U.S. Patent and Trademark Office for U.S. Appl. No. 15/128,035, filed Sep. 21, 2016 and published as US 2017/0098311 on Apr. 6, 2017 (Inventor—Abramoff et al.; Applican… [cited by applicant]
Final Office Action issued on Aug. 28, 2018 by the U.S. Patent and Trademark Office for U.S. Appl. No. 15/128,035, filed Sep. 21, 2016 and published as US 2017/0098311 on Apr. 6, 2017 (Inventor—Abramoff et al.; Applican… [cited by applicant]
Non-Final Office Action issued on Dec. 18, 2015 by the U.S. Patent and Trademark Office for U.S. Appl. No. 14/397,756, filed Oct. 29, 2014 now U.S. Pat. No. 9,545,196 on Jan. 17, 2017 (Inventor—Abramoff et al.; Applican… [cited by applicant]
Notice of Allowance issued on Aug. 29, 2016 by the U.S. Patent and Trademark Office for U.S. Appl. No. 14/397,756, filed Oct. 29, 2014 now u.s. Pat. No. 9,545,196 on Jan. 17, 2017 (Inventor—Abramoff et al.; Applicant—Un… [cited by applicant]
Non-Final Office Action issued on May 18, 2018 by the U.S. Patent and Trademark Office for U.S. Appl. No. 15/371,925, filed Dec. 7, 2016 and published as US 2017/0236282 on Aug. 17, 2017 (Inventor—Abramoff et al.; Appli… [cited by applicant]
Notice of Allowance issued on Sep. 5, 2018 by the U.S. Patent and Trademark Office for U.S. Appl. No. 13/992,552, filed Jul. 25, 2013 and published as US 2013/0301889 on Nov. 4, 2013 (Inventor—Abramoff et al.; Applicant… [cited by applicant]
C. Nieuwenhuis and M. Yan, “Knowledge based image enhancement using neural networks,” 18th International Conference on Pattern Recognition (ICPR) , pp. 814-817, 2006 (Year: 2006). [cited by applicant]
Niemeijer, Meindert, et al. “Automatic Classification of Retinal Vessels into Arteries and Veins.” Medical Imaging 2009: Computer-Aided Diagnosis, vol. 7260, Feb. 17, 2009, pp. 72601F-1-72601F-8., doi:10.1117/12.813826 … [cited by applicant]
Hubbard, et al., Methods for evaluation of retinal microvascular abnormalities associated with hypertension/sclerosis in the atherosclerosis risk in communities study; Ophthalmology; vol. 106, Issue 12, 1999, pp. 2269-2… [cited by applicant]
Knudtson MD, Lee KE, Hubbard LD, Wong TY, Klein R, Klein BE. Revised formulas for summarizing retinal vessel diameters. Curr Eye Res. Sep. 2003;27(3):143-9. doi:10.1076/ceyr.27.3.143.16049 (Year: 2003). [cited by applicant]
Leung, Harry & Wang, Jie & Rochtchina, Elena & Tan, Ava & Wong, T-Y & Klein, Ronald & Hubbard, Larry & Mitchell, Paul. (2003). Relationships between Age, Blood Pressure, and Retinal Vessel Diameters in an Older Populati… [cited by applicant]