IP Library Granted Patent US 9,819,864
Granted Patent B2
US 9,819,864 · App. 15/038,319 · Granted Nov 14, 2017

Wide field retinal image capture system and method

Inventor: David Henriksen (Fort Collins, CO)
Assignee: RSVB, LLC
H04N5/23238A61B3/0025A61B3/12A61B3/14G06K9/6202G06T3/4038G06T7/13G06T7/136G06T7/33G06T2207/20164G06T2207/20221G06T2207/30041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,819,864
App. No.
15/038,319
Granted
Nov 14, 2017
Kind
B2
Abstract

A method, system or apparatus for generating a wide field retinal image. System embodiments comprise a camera, which may be a smartphone camera and associated optics to capturing a digital video stream of individual retinal images and store the video stream of individual retinal images in a memory associated with the camera. The system or method then implements the steps of processing each retinal image and combining selected retinal images into a panorama in real time, during an ocular examination.

Claims (80)

1. A method of generating a wide field retinal image comprising:

controlling a camera to capture a video stream of individual retinal images;

storing the individual retinal images in a memory associated with the camera;

downsizing a plurality of the individual retinal images to create a plurality of downsized images;

performing edge detection on a plurality of the downsized images to yield a plurality of binary images;

identifying points of interest corresponding to vascular structures in a plurality of the binary images;

determining a coordinate position array of the identified points of interest in the binary images;

populating a data structure with the coordinate position arrays of multiple binary images;

comparing the coordinate position arrays of multiple binary images to determine an overlapping image alignment among the multiple binary images; and

combining the individual retinal images corresponding to the multiple binary images into a panorama in accordance with the determined overlapping image alignment.

2. The method of claim 1 further comprising:

determining a location on a sensor of the camera where an individual image is located;

determining a region of interest in the individual image; and

cropping the individual image to preserve the region of interest.

3. The method of claim 2 further comprising:

measuring one or more image attributes of the downsized images; and

discarding unsuitable images based upon the measured image attributes of the downsized images.

4. The method of claim 3 further comprising:

determining whether a downsized retinal image is of a higher quality than another downsized retinal image showing an overlapping retinal structure; and

discarding the lower quality image.

5. The method of claim 1 further comprising:

measuring the field of view of the combined full resolution retinal image; and

terminating the process upon achievement of a designated field of view.

6. The method of claim 5 wherein all steps are completed during an ocular examination.

7. A retinal imaging system comprising:

a smartphone comprising a camera lens, and illumination source, and imaging chip and imaging electronics;

a supplemental optic configured to mate with the smartphone lens and provide for the focusing of an image of a retina on the smartphone imaging chip;

and one or more processors within the smartphone;

one or more non-transitory computer readable media located within the smartphone having stored thereon software comprising a set of instructions that, when executed by the one or more processors, causes the system to perform one or more functions, the set of instructions comprising:

instructions to control the smartphone to capture a video stream of individual retinal images with the smartphone camera lens, illumination source, imaging chip and imaging electronics;

instructions to store the individual retinal image in a memory;

instructions to downsize a plurality of the individual retinal images to create downsized images;

instructions to perform edge detection on a plurality of the downsized images to yield a plurality of binary images;

instructions to identify points of interest corresponding to vascular structures in a plurality of the binary images;

instructions to determine a coordinate position array of the identified points of interest in the binary images;

instructions to populate a data structure with the coordinate position arrays of multiple binary images;

instructions to compare the coordinate position arrays of multiple binary images to determine an overlapping image alignment among the multiple binary images;

instructions to combine the individual retinal images corresponding to the multiple binary images into a panorama in accordance with the determined overlapping image alignment.

8. The system of claim 7 wherein the set of instructions further comprise:

instructions to determine a location on the imaging chip of the smartphone where an individual image is located;

instructions to determine a region of interest in the individual image; and

instructions to crop the individual image to preserve the region of interest.

9. The system of claim 8 wherein the set of instructions further comprise:

instructions to measure one or more image attributes of the downsized images; and

instructions to discard unsuitable images based upon the measured image attributes of the downsized images.

10. The system of claim 9 wherein the set of instructions further comprise:

instructions to determine whether a downsized retinal image is of a higher quality than another downsized retinal image showing an overlapping retinal structure; and

instructions to discard the lower quality image.

11. The system of claim 7 wherein the set of instructions further comprise:

instructions to measure the field of view of the combined full resolution retinal image; and

instructions to terminate the process upon achievement of a designated field of view.

12. The system of claim 11 wherein the set of instructions further cause all instructions to be completed during an ocular examination.

13. A retinal imaging system comprising:

an ophthalmoscope;

a digital imaging device incorporated within, or attached to the ophthalmoscope;

and one or more processors in digital communication with the digital imaging device;

one or more non-transitory computer readable media in digital communication with the one or more processors having stored thereon software comprising a set of instructions that, when executed by the one or more processors, causes the system to perform one or more functions, the set of instructions comprising:

instructions to capture a video stream of individual retinal images;

instructions to store the individual retinal images in a memory;

instructions to downsize a plurality of the individual retinal images to create downsize images;

instructions to perform edge detection on a plurality of the downsized images to yield a plurality of binary images;

instructions to identify points of interest corresponding to vascular structures in a plurality of the binary images;

instructions to determine a coordinate position array of the identified points of interest in the binary images;

instructions to populate a data structure with the coordinate position arrays of multiple binary images;

instructions to compare the coordinate position arrays of multiple binary images to determine an overlapping image alignment among the multiple binary images;

instructions to combine the individual retinal images corresponding to the multiple binary images into a panorama in accordance with the determined overlapping image alignment.

14. The system of claim 13 wherein the set of instructions further comprise:

instructions to determine a location on the imaging chip of the smartphone where an individual image is located;

instructions to determine a region of interest in the individual image; and

instructions to crop the individual image to preserve the region of interest.

15. The system of claim 14 wherein the set of instructions further comprise:

instructions to measure one or more image attributes of the downsized images; and

instructions to discard unsuitable images based upon the measured image attributes of the downsized images.

16. The system of claim 15 wherein the set of instructions further comprise:

instructions to determine whether a downsized retinal image is of a higher quality than another downsized retinal image showing an overlapping retinal structure; and

instructions to discard the lower quality image.

17. The system of claim 13 wherein the set of instructions further comprise:

instructions to measure the field of view of the combined full resolution retinal image; and

instructions to terminate the process upon achievement of a designated field of view.

18. The system of claim 17 wherein the set of instructions further cause all instructions to be completed during an ocular examination.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2017
From: HENRIKSEN, DAVID
To: OPTIBRAND LTD, A COLORADO LIMITED LIABILITY COMPANY
Reel/Frame 043408/0258 →
CHANGE OF NAME Recorded Aug 25, 2017
From: OPTIBRAND LTD, A COLORADO LIMITED LIABILITY COOMPANY
To: RSBV, LLC, A COLORADO LIMITED LIABILITY COMPANY
Reel/Frame 043408/0290 →
Continuity (2)
Provisional Application 61919941 · Dec 23, 2013
Related Publication 20160295109A1 · Oct 6, 2016