IP Library Granted Patent US 10,226,173
Granted Patent B2
US 10,226,173 · App. 15/324,467 · Granted Mar 12, 2019

System and method for real-time montaging from live moving retina

Inventors: Ethan A. Rossi (Pittsburgh, PA); Qiang Yang (Rochester, NY)
Assignee: University of Rochester
A61B3/1025A61B3/0025A61B3/0058A61B3/12A61B3/13A61B3/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,226,173
App. No.
15/324,467
Granted
Mar 12, 2019
Kind
B2
Abstract

A scanning LASER ophthalmoscope (SLO) system for real-time montaging includes an adaptive optics scanning light ophthalmoscope (AOSLO) and a wide field scanning light ophthalmoscope (WFSLO). At least one stabilization mirror is controlled by a computer to optically stabilize the AOSLO based at least in part on feedback from the WFSLO. The SLO system also includes a steering means. The SLO system continues to acquire and combine a plurality of AOSLO image frames forming a combined AOSLO image at each of a plurality of narrow field of view (FOV) sites until a predetermined number of images or a predetermined image quality metric (IQM) at each of the combined AOSLO images is achieved. A plurality of the combined AOSLO images is combined to form a SLO montaged image of a wide FOV. A method to montage a plurality of scanning LASER ophthalmoscope (SLO) narrow field of view (FOV) images is also described.

Claims (32)

1. A method to montage a plurality of scanning LASER ophthalmoscope (SLO) narrow field of view (FOV) images comprising the steps of:

providing an optically stabilized SLO having a substantially real-time optical imaging stabilization system and a steering means, said SLO communicatively coupled to a computer;

imaging a narrow FOV of a surface of an eye by computer by acquiring one or more image strips of said narrow FOV, followed by:

acquiring a successive one or more image strips of at least a part of said narrow FOV;

combining by computer said successive one or more image strips of at least a part of said narrow FOV with one or more previously acquired one or more image strips of said at least a part of said narrow FOV to generate a combined image of at least part of said at least a part of said narrow FOV;

repeating said step of acquiring a successive one or more image strips of said at least a part of said narrow FOV until a predetermined number of strips is reached;

repeating said step of acquiring a successive one or more image strips of at least a part of said narrow FOV to repeating said step of acquiring a successive one or more image strips of said narrow FOV until a predetermined number of strips is reached, until said imaging a narrow FOV of a surface of an eye is complete; and

shifting by use of said steering means to another overlapping narrow FOV of said surface of an eye by computer and repeating said step of imaging a narrow FOV of said surface of an eye;

repeating said step of shifting to another overlapping narrow FOV of said surface of an eye until a pre-determined wide FOV of said surface of an eye has been imaged by a plurality of combined overlapping images; and

stitching together by computer either incrementally after each of said narrow FOV is imaged or after said predetermined wide FOV is imaged, each of said plurality of combined overlapping images together to generate a montage wide FOV image of said surface of said eye.

2. The method of claim 1 , wherein said one or more image strips comprise an entire frame.

3. A method to montage a plurality of scanning LASER ophthalmoscope (SLO) narrow field of view (FOV) images comprising the steps of:

providing an optically stabilized SLO having a substantially real-time optical imaging stabilization system and a steering means, said SLO communicatively coupled to a computer;

imaging a narrow FOV of a surface of an eye by computer by acquiring one or more image strips of said narrow FOV, followed by:

acquiring a successive one or more image strips of at least a part of said narrow FOV;

combining by computer said successive one or more image strips of said at least a part of said narrow FOV with one or more previously acquired one or more image strips of said at least a part of said narrow FOV to generate a combined image of said at least a part of said narrow FOV;

calculating by computer an image quality metric (IQM) of said combined image using at least a portion of said narrow FOV;

comparing by computer said IQM to a pre-determined IQM threshold;

repeating said step of acquiring a successive one or more image strips of said narrow FOV until said predetermined IQM threshold is reached;

repeating said step of acquiring a successive one or more image strips of at least a part of said narrow FOV to repeating said step of acquiring a successive one or more image strips of said narrow FOV, until said imaging a narrow FOV of a surface of an eye is complete; and

shifting by use of said steering means to another overlapping narrow FOV of said surface of an eye by computer and repeating said step of imaging a narrow FOV of said surface of an eye;

repeating said step of shifting to another overlapping narrow FOV of said surface of an eye until a predetermined wide FOV of said surface of an eye has been imaged by a plurality of combined overlapping images; and

stitching together by computer either incrementally after each of said narrow FOV is imaged or after said predetermined wide FOV is imaged, each of said plurality of combined overlapping images together to generate a montage wide FOV image of said surface of said eye.

4. The method of claim 3 , wherein said one or more image strips comprises an entire frame.

5. The method of claim 3 , wherein said step of providing an optically stabilized SLO comprises the step of providing an adaptive optics scanning light ophthalmoscope (AOSLO) having a substantially real-time optical imaging stabilization system.

6. The method of claim 3 , wherein said step of shifting by said steering means to another overlapping narrow FOV of said surface of an eye comprises shifting to another overlapping narrow FOV of said surface of an eye with about a 20% or less overlap.

7. The method of claim 3 , wherein said step of comparing by computer said IQM comprises comparing by computer said IQM based on a power measurement.

8. The method of claim 3 , wherein said step of comparing by computer said IQM comprises comparing by computer said IQM based on a spatial frequency content measurement.

9. The method of claim 3 , wherein said step of comparing by computer said IQM comprises comparing by computer an IQM based on a contrast or sharpness measurement.

10. The method of claim 3 , wherein said step of comparing by computer said IQM comprises comparing by computer said IQM by use of a texture based measurement.

11. The method of claim 3 , wherein said step of comparing by computer said IQM comprises comparing by computer said IQM based on a probability density function measurement.

12. The method of claim 3 , further including before said step of repeating said step of shifting to another overlapping narrow FOV of said surface of an eye until a predetermined wide FOV of said surface of an eye has been imaged, the step of selecting said pre-determined wide FOV by use of a Fundus wide field camera communicatively coupled to said computer.

Assignments (2)
CONFIRMATORY LICENSE Recorded Oct 16, 2017
From: UNIVERSITY OF ROCHESTER
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 044209/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2017
From: ROSSI, ETHAN A.; YANG, QIANG
To: UNIVERSITY OF ROCHESTER
Reel/Frame 040874/0249 →
Continuity (2)
Provisional Application 62021510 · Jul 7, 2014
Related Publication 20170196449A1 · Jul 13, 2017