IP Library Granted Patent US 12,433,483
Granted Patent B2
US 12,433,483 · App. 17/344,838 · Granted Oct 7, 2025

Vision screening systems and methods

Inventors: Yaolong Lou (Singapore, SG); Yuan Ing Chow (Singapore, SG); Shadakshari Devarajaiah Chikkanaravangala (Singapore, SG)
Assignee: Welch Allyn, Inc.
A61B3/103A61B3/0025A61B3/14G16H30/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,433,483
App. No.
17/344,838
Granted
Oct 7, 2025
Kind
B2
Abstract

A system includes system housing, an eccentric radiation source, and a radiation sensor. The radiation produced by the eccentric radiation source can be collected by the radiation sensor to generate images of retinas for a patient. The system also includes a vision screening device connected with the eccentric radiation source and the radiation sensor via the system house that can control and synchronize actions for the eccentric radiation source and the radiation sensor. The vision screening device further analyzes the images generated by the radiation sensor via neural network algorithms to determine spherical error slopes, refractive errors, and recommendations for the patient.

Claims (96)

1. A system, comprising:

memory;

one or more processors; and

computer-executable instructions stored in the memory and executable by the one or more processors to perform operations comprising:

causing an eccentric radiation source to generate one or more beams of near infrared (NIR) radiation that are directed onto a retina of a patient;

causing a radiation sensor to collect information indicative of reflected NIR radiation from the retina, and to generate an analysis image based at least in part on the information;

identifying, based at least in part on the analysis image, a pupil of the patient;

determining a focus state of the analysis image;

determining that the focus state of the analysis image satisfies a set of image state thresholds;

based at least in part on determining that the focus state of the analysis image satisfies the set of image state thresholds, causing an image capture device to capture a plurality of images of the pupil;

identifying a subset of the plurality of images that satisfy the set of image state thresholds;

determining, based at least in part on the subset of the plurality of images,

a plurality of pupil positions, and

one or more radiation intensity profiles associated with the reflected NIR radiation detected by the radiation sensor; and

determining a refractive error of the patient based at least in part on the plurality of pupil positions and the one or more radiation intensity profiles.

2. The system of claim 1 , the operations further comprising:

causing the eccentric radiation source to generate one or more beams of visible light that are directed onto the retina of the patient; and

causing the radiation sensor to collect additional information indicative of reflected visible light from the retina.

3. The system of claim 1 , the operations further comprising:

causing the eccentric radiation source to activate a first set of radiation point sources, wherein the first set of radiation point sources is comprised of one or more first radiation point sources disposed at a first radial distance from the radiation sensor;

causing the image capture device to capture a first image of the plurality of images, wherein the first image depicts the retina illuminated by the first set of radiation point sources;

causing the eccentric radiation source to activate a second set of radiation point sources, wherein the second set of radiation point sources is comprised of one or more second radiation point sources disposed at a second radial distance, greater than the first radial distance; and

causing the image capture device to capture a second image of the plurality of images, wherein the second image depicts the retina illuminated by the second set of radiation point sources.

4. The system of claim 3 , the operations further comprising:

causing the image capture device to capture a third image of the plurality of images, wherein the third image depicts the retina illuminated by a third set of radiation point sources disposed at a third radial distance from the radiation sensor;

causing the image capture device to capture a fourth image of the plurality of images, wherein the fourth image depicts the retina illuminated by a fourth set of radiation point sources disposed at a fourth radial distance from the radiation sensor, and

wherein:

the third radial distance is less than the first radial distance, and

the fourth radial distance is greater than the first radial distance and less than the second radial distance.

5. The system of claim 1 , the operations further comprising:

causing the eccentric radiation source to activate one or more first radiation point sources linearly extending from the radiation sensor at a first rotational offset;

causing the image capture device to capture a first image of the plurality of images, wherein the first image depicts the retina illuminated by the one or more first radiation point sources;

causing the eccentric radiation source to activate one or more second radiation point sources linearly extending from the radiation sensor at a second rotational offset; and

causing the image capture device to capture a second image of the plurality of images, wherein the second image depicts the retina illuminated by the one or more second radiation point sources.

6. The system of claim 5 , the operations further comprising:

causing the eccentric radiation source to activate one or more third radiation point sources of a first meridian;

causing the image capture device to capture a third image of the plurality of images, wherein the third image depicts the retina illuminated by the one or more third radiation point sources;

causing the eccentric radiation source to activate one or more fourth radiation point sources of a second meridian; and

causing the image capture device to capture a fourth image of the plurality of images, wherein the fourth image depicts the retina illuminated by the one or more fourth radiation point sources.

7. The system of claim 1 , wherein determining a refractive error of the patient further comprises:

generating, based at least on the one or more radiation intensity profiles, a linear function fitted to the one or more radiation intensity profiles; and

determining, based at least on the linear function, at least one of a sphere (Ds), a cylinder (Dc), or an axis (Ax) of the cylinder for the patient.

8. The system of claim 7 , wherein determining the refractive error of the patient further comprises:

determining, based at least on the linear function, a spherical error (SE) slope associated with the linear function; and

determining, based at least on the SE slope, the refractive error of the patient, wherein the refractive error is determined by a neural network algorithm trained to identify correlations between one or more active radiation point sources and the one or more radiation intensity profiles to determine the refractive error for the patient.

9. The system of claim 1 , wherein identifying the pupil of the patient further comprises:

determining at least a pupil position, a pupil diameter, and an inner pupil distance for one or more detected pupils; and

determining at least a glint position, a glint intensity, and an image contrast for the one or more detected pupils.

10. The system of claim 9 , wherein

determining that the focus state of the analysis image satisfies the set of image state thresholds comprises:

determining the pupil diameter satisfies a pupil diameter threshold,

determining the inner pupil distance satisfies a pupil distance threshold,

determining the glint intensity satisfies a glint intensity threshold, and

determining the image contrast satisfies an image contrast threshold; and

identifying the subset of the plurality of images comprises determining that each image in the subset of the plurality of images satisfies the pupil diameter threshold, the pupil distance threshold, the glint intensity threshold, and the image contrast threshold.

11. The system of claim 9 , the operations further comprising:

generating a recommendation to increase the distance between the patient and the radiation sensor based at least in part on the pupil diameter or the pupil inner distance exceeding an image state threshold of the set of image state thresholds; and

displaying the recommendation via a user interface.

12. The system of claim 1 , wherein identifying the plurality of pupil positions further comprises:

determining, for a first image of the plurality of images, a first pupil position associated with the first image;

identifying, for a second image of the plurality of images, a region of interest for the second images based at least on the first pupil position determined for the first image; and

determining, based at least on the region of interest, a second pupil position associated with the second image,

wherein, a preceding pupil position from a preceding image is utilized to determine a successive region of interest associated with a successive image of the plurality of images such that a success pupil position is determined from the successive region of interest.

13. A system, comprising:

memory;

one or more processors; and

computer-executable instructions stored in the memory and executable by the one or more processors to perform operations comprising:

causing an eccentric radiation source, operably connected to the processor, to generate radiation that illuminates a pupil and a retina of a patient;

causing a radiation sensor, operably connected to the processor, to collect reflected radiation from the pupil and the retina of the patient, and to generate an analysis image based at least in part on the collected radiation;

determining a focus state of the analysis image;

determining that the focus state of the analysis image satisfies a set of image state thresholds;

based at least in part on determining that focus state of the analysis image satisfies the set of image state thresholds, causing the radiation sensor to capture a series of images;

identifying a subset of the series of images that satisfy the set of image state thresholds;

determining, based at least in part on the subset of the series of images, one or more parameters associated with a detected pupil;

generating a series of normalized images based at least in part on the subset of the series of images and the one or more parameters; and

determine a refractive error for the patient based at least in part on the series of normalized images.

14. The system of claim 13 , wherein the one or more parameters associated with the detected pupil comprise at least one of:

a gaze deviation associated with an offset of the detected pupil associated with a direction of view for the patient;

a glint position associated with the detected pupil;

a Gaussian filter configured to smooth a plurality of intensity readings associated with the detected pupil; or

a rotational correction associated with at least the eccentric radiation source.

15. The system of claim 13 , wherein determining the refractive error further comprises:

extracting, for each normalized image of the series of normalized images, an intensity profile;

determining, based at least in part on the intensity profile, spherical error data for the patient; and

determining, based at least in part on the spherical error data, the refractive error for the patient.

16. The system of claim 15 , wherein determining refractive error further comprises determining, based at least in part on the spherical error data, refractive error parameters associated with one or more meridians of the eccentric radiation source.

17. The system of claim 1 , wherein:

the eccentric radiation source comprises a first plurality of radiation sources and a second plurality of radiation sources,

a lens of the radiation sensor is disposed substantially centrally between the first plurality of radiation sources and the second plurality of radiation sources, and

causing the image capture device to capture the plurality of images comprises maintaining the lens at a substantially stationary position, relative to the patient, while the plurality of images is captured.

18. The system of claim 1 , wherein the one or more processors comprises a first processor operably connected to the eccentric radiation source, and a second processor of a handheld user device,

the second processor being configured to synchronize capture of the plurality of images by the image capture device with illumination of the pupil by the eccentric radiations source.

19. The system of claim 1 , wherein:

the image capture device, the eccentric radiation source, and the radiation sensor are supported by a housing of the system;

a first image included in the plurality of images is captured using illumination emitted by a first radiation source of the system disposed at a first location on the housing, and

a second image included in the plurality of images is captured using illumination emitted by a second radiation source of the system different from the first radiation source, the second radiation source being disposed at a second location on the housing different from the first location.

Assignments (2)
RELEASE OF SECURITY INTEREST AT REEL/FRAME 050260/0644 Recorded Dec 14, 2021
From: JPMORGAN CHASE BANK, N.A.
To: BREATHE TECHNOLOGIES, INC.; HILL-ROM SERVICES, INC.; ALLEN MEDICAL SYSTEMS, INC.; WELCH ALLYN, INC.; HILL-ROM, INC.; VOALTE, INC.; BARDY DIAGNOSTICS, INC.; HILL-ROM HOLDINGS, INC.
Reel/Frame 058517/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2021
From: LOU, YAOLONG; CHOW, YUAN ING; CHIKKANARAVANGALA, SHADAKSHARI DEVARAJAIAH
To: WELCH ALLYN, INC.
Reel/Frame 056506/0208 →
Continuity (2)
Provisional Application 63041550 · Jun 19, 2020
Related Publication 20210393120A1 · Dec 23, 2021
References Cited (63)
US 4740072A · Griffin et al. · 1988 [cited by applicant]
US 7331669B2 · Elsner · 2008 [cited by applicant]
US 7618143B2 · Clark et al. · 2009 [cited by applicant]
US 8317325B2 · Raguin et al. · 2012 [cited by applicant]
US 8403480B2 · Chen et al. · 2013 [cited by applicant]
US 9336439B2 · Savvides et al. · 2016 [cited by applicant]
US 9427152B2 · Lewis · 2016 [cited by applicant]
US 9517008B1 · Berme et al. · 2016 [cited by applicant]
US 10051208B2 · Dainty et al. · 2018 [cited by applicant]
US 10368743B2 · Gerrans et al. · 2019 [cited by applicant]
US 10451895B2 · Macnamara et al. · 2019 [cited by applicant]
US 10602926B2 · Wang · 2020 [cited by applicant]
US 20060227302A1 · Harbers · 2006 [cited by applicant]
US 20060244915A1 · Clemons et al. · 2006 [cited by applicant]
US 20070052924A1 · Nozawa et al. · 2007 [cited by applicant]
US 20070171372A1 · Seal et al. · 2007 [cited by applicant]
US 20080030984A1 · Harbers · 2008 [cited by applicant]
US 20100193705A1 · Rasnow · 2010 [cited by applicant]
US 20110157550A1 · Chen et al. · 2011 [cited by applicant]
US 20110270596A1 · Weeber · 2011 [cited by applicant]
US 20120212598A1 · Mowrey · 2012 [cited by applicant]
US 20150272438A1 · Yao et al. · 2015 [cited by applicant]
US 20160081543A1 · Mowrey · 2016 [cited by applicant]
US 20160089021A1 · Mowrey · 2016 [cited by applicant]
US 20160262617A1 · Gerrans · 2016 [cited by applicant]
US 20170027440A1 · Mowrey · 2017 [cited by applicant]
US 20170344107A1 · Aghara · 2017 [cited by examiner]
US 20180041679A1 · Dalke · 2018 [cited by examiner]
US 20180084996A1 · Su et al. · 2018 [cited by applicant]
US 20180332205A1 · Hawthorne et al. · 2018 [cited by applicant]
US 20190117064A1 · Fletcher et al. · 2019 [cited by applicant]
US 20190133435A1 · Browne et al. · 2019 [cited by applicant]
US 20190294858A1 · Creedon · 2019 [cited by examiner]
US 20200084430A1 · Kalarn et al. · 2020 [cited by applicant]
US 20200113433A1 · Neal · 2020 [cited by applicant]
US 20200129063A1 · McGrath et al. · 2020 [cited by applicant]
US 20200225706A1 · Jung et al. · 2020 [cited by applicant]
US 20210330185A1 · Krukowski et al. · 2021 [cited by applicant]
US 20210345872A1 · Wiggermann et al. · 2021 [cited by applicant]
US 20210386287A1 · Lou et al. · 2021 [cited by applicant]
US 20220076417A1 · Bremer et al. · 2022 [cited by applicant]
CN 101991404A · 2011 [cited by applicant]
CN 110575134A · 2019 [cited by applicant]
EP 3381350A1 · 2018 [cited by applicant]
IN 202041007419 · 2020 [cited by applicant]
KR 100796355 · 2008 [cited by applicant]
KR 100869998 · 2008 [cited by applicant]
KR 100904254 · 2009 [cited by applicant]
KR 20140111157A · 2014 [cited by applicant]
KR 101999225 · 2019 [cited by applicant]
MX 2017012316A · 2019 [cited by applicant]
WO WO2009089509 · 2009 [cited by applicant]
WO WO2014167491 · 2014 [cited by examiner]
WO WO2020010138A1 · 2020 [cited by applicant]
WO WO2020145697A1 · 2020 [cited by applicant]
The PCT Search Report and Written Opinion mailed Feb. 23, 2023 for PCT Application No. PCT/US2022/050390, 18 pages. [cited by applicant]
Office Action for U.S. Appl. No. 17/347,079, mailed on Dec. 12, 2023, Yaolong Lou, “Determining Refraction Using Eccentricity in a Vision Screening System”, 19 pages. [cited by applicant]
Extended European Search Report mailed Nov. 22, 2021 for European Patent Application No. 21180364.8, 8 pages. [cited by applicant]
Brousseau, et al., “Hybrid Eye-Tracking on a Smartphone with CNN Feature Extraction and an Infrared 3D Model,” Sensors, vol. 20, No. 2, 2020, 21 pages. [cited by applicant]
Chen et al., “Infrared Retinoscopy”, Photonics 2014, Published Oct. 3, 2014, pp. 303-pp. 322. [cited by applicant]
Office Action for U.S. Appl. No. 17/531,320, dated Mar. 27, 2025, 12 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 17/347,079, mailed on Apr. 8, 2024, Lou et al., “Determining Refraction Using Eccentricity in a Vision Screening System”, 21 pages. [cited by applicant]
Search Report for European Application No. 22896520.8, Dated Feb. 14, 2025, 9 pages. [cited by applicant]