IP Library Granted Patent US 12,239,372
Granted Patent B2
US 12,239,372 · App. 18/230,073 · Granted Mar 4, 2025

Focus stacking for retinal imaging

Inventors: Dhruv Lamba (Mountain View, CA); Sam Kavusi (Menlo Park, CA)
Assignee: Verily Life Sciences LLC
A61B3/0025A61B3/0008A61B3/10A61B3/112G06T5/50G06T5/73G06T2207/10152G06T2207/20216G06T2207/30041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,239,372
App. No.
18/230,073
Granted
Mar 4, 2025
Kind
B2
Abstract

A system for imaging a retina of an eye includes a first lens for positioning proximate to the eye; a light source positioned to illuminate the eye when the system is aligned with the eye; an image sensor adapted to capture a retinal image of the retina through the first lens; an aperture disposed along an optical path extending from the image sensor and passing through the first lens; and a processing apparatus communicatively coupled to the image sensor and the light source, wherein the processing apparatus includes logic that when executed by the processing apparatus causes the system to perform operations including: illuminating the eye with the light source and capturing the retinal image with the image sensor.

Claims (73)

1. A system for imaging a retina, the system comprising:

a first lens adapted for positioning proximate to an eye;

an image sensor positioned to capture a retinal image of the retina through the first lens;

a light source for generating illumination of the eye;

a display to output a fixation target;

a beam splitter disposed in an optical path extending from the image sensor through the first lens, the beam splitter positioned between the image sensor and the first lens and adapted to redirect the fixation target output from the display along the optical path out through the first lens for viewing by the eye, wherein the light source comprises a plurality of light emitting diodes (LEDs) disposed on either side of the optical path for illuminating different portions of the retina; and

a processing apparatus communicatively coupled to the image sensor, the light source, and the display, wherein the processing apparatus includes logic that when executed by the processing apparatus causes the system to perform operations including:

generating the fixation target;

illuminating the retina of the eye with the light source; and

capturing the retinal image with the image sensor while illuminating the eye.

2. The system of claim 1 , further comprising:

a first aperture disposed between the image sensor and the first lens along the optical path, the first aperture surrounding the optical path and adapted to block off-axis reflections from the eye.

3. The system of claim 1 , wherein the processing apparatus includes further logic that when executed by the processing apparatus causes the system to perform further operations including:

capturing a sequence of images of the retina while a diameter of a pupil of the eye is changing in response to the illumination from the light source, wherein at least some images of the retina in the sequence of images are acquired with different f-stops due to the diameter of the pupil changing in size during the illuminating; and

combining the at least some images in the sequence of images to form a composite image having a larger depth of field than any individual image in the sequence of images.

4. A system for imaging a retina, the system comprising:

a first lens for positioning proximate to an eye;

a plurality of light emitting diodes (LEDs) positioned to illuminate the eye, wherein the LEDs are positioned relative to the first lens such that light output from the LEDs does not pass through the first lens to illuminate the eye;

an image sensor positioned to capture a retinal image of the retina through the first lens;

an aperture disposed along an optical path extending from the image sensor and out through the first lens, the aperture surrounding the optical path and adapted to block off-axis reflections from the eye; and

a processing apparatus communicatively coupled to the image sensor and the LEDs, wherein the processing apparatus includes logic that when executed by the processing apparatus causes the system to perform operations including:

illuminating the eye with the LEDs; and

capturing the retinal image with the image sensor.

5. A system for imaging a retina of an eye, the system comprising:

a first lens for positioning proximate to the eye;

a light source positioned to illuminate the eye when the system is aligned with the eye, wherein the light source comprises a plurality of light emitting diodes (LEDs) each located in a different location to illuminate a different portion of the retina of the eye;

an image sensor adapted to capture a retinal image of the retina through the first lens;

an aperture disposed along an optical path extending from the image sensor and passing through the first lens, wherein the aperture surrounds the optical path; and

a processing apparatus communicatively coupled to the image sensor and the light source, wherein the processing apparatus includes logic that when executed by the processing apparatus causes the system to perform operations including:

illuminating the eye with the light source; and

capturing the retinal image with the image sensor.

6. The system of claim 5 , wherein the LEDs are positioned relative to the first lens such that light output from the LEDs does not pass through the first lens prior to illuminating the eye.

7. The system of claim 6 , wherein the LEDs are positioned laterally to the first lens.

8. The system of claim 5 , wherein the light source comprises a plurality of light emitting diodes (LEDs) disposed on either side of the optical path.

9. The system of claim 5 , wherein the aperture is positioned along the optical path between the image sensor and the first lens and adapted to block off-axis reflections from the eye.

10. The system of claim 5 , further comprising:

an iris camera positioned to track movements of at least one of an iris or a pupil of the eye using infrared light.

11. The system of claim 5 , further comprising:

a display coupled to the processing apparatus to output a display image in response to the processing apparatus.

12. A system for imaging a retina of an eye, the system comprising:

a first lens for positioning proximate to the eye;

a light source positioned to illuminate the eye when the system is aligned with the eye;

an image sensor adapted to capture a retinal image of the retina through the first lens;

an aperture disposed along an optical path extending from the image sensor and passing through the first lens, wherein the aperture surrounds the optical path;

a display adapted to output a display image;

a beam splitter disposed in the optical path between the first lens and the image sensor, the beam splitter adapted to redirect the display image output from the display along the optical path through the first lens for viewing by the eye, wherein the display image comprises visual stimuli to aid alignment of the retina to the image sensor; and

a processing apparatus communicatively coupled to the image sensor, the display, and the light source, wherein the processing apparatus includes logic that when executed by the processing apparatus causes the system to perform operations including:

illuminating the eye with the light source; and

capturing the retinal image with the image sensor.

13. The system of claim 12 , wherein the display image comprise a fixation target for the eye.

14. The system of claim 12 , wherein the beam splitter is disposed along the optical path between image sensor and the aperture.

15. The system of claim 12 , further comprising:

a second lens disposed between the beam splitter and the image sensor; and

a third lens disposed between the display and the beam splitter.

16. The system of claim 5 , wherein the processing apparatus includes further logic that when executed by the processing apparatus causes the system to perform further operations including:

capturing a sequence of images of the retina while a diameter of a pupil of the eye is changing in response to illumination from the light source, wherein at least some images of the retina in the sequence of images are acquired with different f-stops due to the diameter of the pupil changing in size during the illuminating; and

combining the at least some images in the sequence of images to form a composite image having a larger depth of field than any individual image in the sequence of images.

17. The system of claim 16 , wherein the processing apparatus includes further logic that when executed by the processing apparatus causes the system to perform further operations including:

changing a level of illumination output from the light source and directed toward the retina, wherein the sequence of images are captured as the level of illumination output from the light source changes.

18. The system of claim 17 , wherein the different f-stops are achieved in response to the diameter of the pupil in the eye increasing or decreasing in size from changing the level of illumination from the light source.

19. A system for imaging a retina of an eye, the system comprising:

a first lens for positioning proximate to the eye;

a light source adapted for illuminating the eye;

an image sensor aligned to image the retina through the first lens;

an aperture disposed along an optical path extending from the image sensor and out through the first lens, the aperture surrounding the optical path and adapted to block off-axis reflections from the eye; and

a processing apparatus communicatively coupled to the image sensor and the light source, wherein the processing apparatus includes logic that when executed by the processing apparatus causes the system to perform operations including:

illuminating the eye with the light source;

burst capturing a plurality of retinal images of the retina with the image sensor;

registering the retinal images to each other; and

stacking the retinal images into a composite retinal image having a higher quality than an individual one of the retinal images.

20. The system of claim 19 , wherein the higher quality comprises fewer defect regions or fewer image artifacts than the individual one of the retinal images.

21. The system of claim 19 , wherein the burst capturing comprises capturing the retinal images at a rate of 24 frames per second or greater.

22. The system of claim 19 , wherein the processing apparatus includes a memory buffer to buffer the retinal images and an integrated signal processor (ISP) adapted to analyze the retinal images buffered in the memory buffer to perform the registering and the stacking to generate the composite retinal image.

Assignments (1)
CHANGE OF NAME Recorded Apr 1, 2026
From: VERILY LIFE SCIENCES LLC
To: VERILY HEALTH INC.
Reel/Frame 075367/0775 →
Continuity (4)
Continuation 17489670 · Sep 29, 2021
Continuation 16046265 · Jul 26, 2018
Provisional Application 62551708 · Aug 29, 2017
Related Publication 20230389789A1 · Dec 7, 2023
References Cited (34)
US 7290882B2 · Collins et al. · 2007 [cited by applicant]
US 7506982B2 · Yahagi et al. · 2009 [cited by applicant]
US 20010041884A1 · Frey · 2001 [cited by examiner]
US 20040207811A1 · Elsner · 2004 [cited by applicant]
US 20120188356A1 · Jolma et al. · 2012 [cited by applicant]
US 20130285885A1 · Nowatzyk et al. · 2013 [cited by applicant]
US 20160249804A1 · Wang · 2016 [cited by applicant]
US 20170082858A1 · Klug et al. · 2017 [cited by applicant]
US 20170098117A1 · Stoker · 2017 [cited by applicant]
CN 101172035 · 2008 [cited by applicant]
JP 2005137584A · 2005 [cited by applicant]
JP 2009294719A · 2009 [cited by applicant]
JP 2012213555 · 2012 [cited by applicant]
JP 20124653 · 2013 [cited by applicant]
JP 2013144579 · 2013 [cited by applicant]
WO 2015132775A1 · 2015 [cited by applicant]
WO 2017079333A1 · 2017 [cited by applicant]
WO 2017123702A1 · 2017 [cited by applicant]
Motto et al., “All-in-Focus Imaging Technique Used to Improve 3D Retinal Fundus Image Reconstruction,” SAC'15, Proceedings of the 30th Annual ACM Symposium on Applied Computing, 2015 ACM, 6 pages. [cited by applicant]
Saine, “Focusing The Fundus Camera: A Clinical Approach,” Journal of Ophthalmic Photography, vol. 14, No. 1, Sep. 1992, pp. 7-24. [cited by applicant]
Tong et al., “Simulation of Light Field Fundus Photography,” stanford.edu/class/ee367/Winter2017/Tong_Melanson_ee367_win17_report.pdf, 6 pages. [cited by applicant]
Winn et al., “Factors affecting light-adapted pupil size in normal human subjects,” Investigative Ophthalmology and Visual Science, Mar. 1994, vol. 35, No. 3, pp. 1132-1137. [cited by applicant]
International Search Report and Written Opinion from the International Searching Authority mailed Dec. 6, 2018 for International Application No. PCT/US2018/047605, filed Aug. 22, 2018, 8 pages. [cited by applicant]
Extended European Search Report, mailed Apr. 13, 2021, in corresponding European Patent Application No. 18851279.2, 6 pages. [cited by applicant]
Japanese Decision of Grant in corresponding Japanese Patent Application No. 2020-506329, mailed Feb. 15, 2021, 3 pages. [cited by applicant]
Chinese Office Action, mailed Nov. 25, 2021, in corresponding Chinese Patent Application No. 201880056822.8, 7 pages. [cited by applicant]
Chinese Office Action, mailed Apr. 19, 2022, in corresponding Chinese Patent Application No. 201880056822.8, 7 pages. [cited by applicant]
Chinese Decision of Rejection, mailed Aug. 2, 2022, in corresponding Chinese Patent Application No. 201880056822.8, 5 pages. [cited by applicant]
Office Action mailed Jul. 2, 2020, issued in corresponding U.S. Appl. No. 16/046,265, filed Jul. 26, 2018, now U.S. Pat. No. 11,160,449, 27 pages. [cited by applicant]
Final Office Action mailed Jan. 11, 2021, issued in corresponding U.S. Appl. No. 16/046,265, filed Jul. 26, 2018, now U.S. Pat. No. 11,160,449, 22 pages. [cited by applicant]
Notice of Allowance mailed Jun. 30, 2021, issued in corresponding U.S. Appl. No. 16/046,265, filed Jul. 26, 2018, now U.S. Pat. No. 11,160,449, 32 pages. [cited by applicant]
Office Action mailed Mar. 30, 2023, issued in corresponding U.S. Appl. No. 17/489,670, filed Sep. 29, 2021, 44 pages. [cited by applicant]
Notice of Allowance mailed May 5, 2023, issued in corresponding U.S. Appl. No. 17/489,670, filed Sep. 29, 2021, 40 pages. [cited by applicant]
Supplemental Notice of Allowability mailed May 24, 2023, issued in corresponding U.S. Appl. No. 17/489,670, filed Sep. 29, 2021, 6 pages. [cited by applicant]