Automated vision care diagnostics and digitally compensated smart eyewear
Systems and methods for implementing digital vision diagnostics are described and can include: (1) projecting images onto an individual's retina; (2) modelling the optics of the retina; (3) collecting user input/feedback in response to the projected image(s); (4) collecting other known vision-related data or contextual metadata; (5) diagnosing at least one vision-related or diagnostic parameter of the individual based on a combination of (1)-(4). Systems and methods for implementing digital vision compensation are further described and can include: (1) digitally capturing image(s) of an individual's field-of-view or portion thereof, or retrieving pre-recorded image(s); (2) determining or retrieving at least one vision-related or diagnostic parameter of the individual (e.g., using digital vision diagnostic technique(s)); (3) process the captured or pre-recorded digital image(s) to create compensated digital image(s); and (4) display or project the compensated digital image(s) to the individual.
1. An electronic eyewear system for compensating for an individual's vision problem, the system comprising:
a screen configured to display from a first image plane a reference image within a field of view of an individual, the reference image moving from the first optical plane to the individual's retina along a first optical path having a first optical path length, and having a first angle of incidence at the retina relative to the central axis of the individual's field of view;
a sensor configured to record at a second image plane a recorded image based on said reference image as processed by the individual's retina, the recorded image moving from the individuals' retina to the second optical plane along a second optical path having a second optical path length, and having a second angle of incidence at the retina relative to the central axis of the individual's field of view;
at least one processor communicatively coupled to the screen and the sensor, said processor configured to:
calculate an inverse optical transfer function by comparing the reference image at the first optical plane to the recorded image at the second optical plane;
wherein the inverse optical transfer function is based in part on at least one of a difference between the first optical path length and the second optical path length and a difference between the first angle of incidence and the second angle of incidence;
create a pre-compensated reference image by using the inverse optical transfer function; and
cause the screen to display the pre-compensated reference image.
2. The electronic eyewear system of claim 1 , wherein the processor is additionally configured to receive a captured image, create a pre-compensated captured image by using the inverse optical transfer function, and cause the screen to display the pre-compensated captured image.
3. The electronic eyewear system of claim 2 , wherein the screen is a backlit digital display.
4. The electronic eyewear system of claim 2 , wherein the screen further comprises an image projector configured to project the pre-compensated captured image onto the first image plane.
5. The electronic eyewear system of claim 2 , wherein the screen further comprises an image projector configured to project the pre-compensated captured image directly onto the retina.
6. The electronic eyewear system of claim 2 , wherein the pre-compensated captured image is displayed in real-time or near real-time following the capture of the reference image.
7. The electronic eyewear system of claim 1 , wherein the recorded image is based at least in part on a reflected retinal image of the individual.
8. A handheld integrated electronic device for passively determining an error value of an optical parameter of an individual's vision, comprising:
(A) a screen for displaying at a first image plane digital reference images to an individual's retina;
(B) a sensor for capturing at a second image plane recorded images of the individual's retina as the retina is processing said digital reference images;
(C) a processor configured to
(A) obtain the digital reference images,
(B) project the digital reference images from the first image plane on to a retina via a first optical path having a first length and a first angle of incidence relative to the central axis of the individual's field of view,
(C) receive a reflected image from the retina at a second image plane via a second optical path having a second length and a second angle of incidence relative to the central axis of the individual's field of view,
(D) model, by comparing the digital reference image to the reflected image, an optical transfer function comprising one or more optical parameters, the optics between the first image plane and the retina along the first optical path, the optics associated with absorption or reflection of light at the retina, and the optics between the retina and the second image plane along the second optical path, the difference between the first length and the second length, and the difference between the first angle and the second angle; and
(E) calculate at least in part based on the optical transfer function an error value for one of the optical parameters; and,
(D) a memory for storing the error value for communication from or display on the integrated device.
9. The device of claim 8 , wherein the processor is further configured to transmit to the screen a signal that causes an adjustment of a displayed image, wherein said adjustment is based at least in part on the error value of the one of the optical parameters.
10. The device of claim 8 , wherein the processor is further configured to determine a value of a prescription parameter, for correction of a vision error, based at least in part on the calculated error value of the one of the optical parameters.
11. The device of claim 10 , wherein the processor is further configured to transmit to the screen, a signal that causes an adjustment of a displayed image, wherein said adjustment is based at least in part on the determined value of the prescription parameter.
12. The device of claim 8 , wherein the processor is further configured to:
(F) generate a pre-compensated digital reference image based on the calculated error value of the one of the optical parameters; and
(G) repeat steps (A) through (F) iteratively, using the pre-compensated digital reference image from step (F) in place of the digital reference image in steps (A) and (B), until the calculated error value of the one of the optical parameters is below a threshold.
13. The device of claim 12 , wherein the processor is further configured to determine a value of a prescription parameter, for correction of a vision error, based at least in part on the calculated error value of the one of the optical parameters after said calculated error value is below said threshold.
14. The device of claim 13 , wherein the processor is further configured to transmit to the screen a signal that causes an adjustment of a displayed image, wherein said adjustment is based at least in part on the calculated error value of the one of the optical parameters after said calculated error value is below said threshold.
15. The device of claim 14 , wherein the adjustment is any one of brightness, contrast, or color associated with at least one pixel in the displayed image.
16. The device of claim 8 , wherein the second optical path is the same as the first optical path.
17. The device of claim 9, 11 or 14 wherein the display is integrated in an eyewear device.
18. The device of claim 9, 11 or 14 wherein the display is integrated in a smartphone.
19. A method for passively determining optical information associated with the vision of a person, comprising:
(A) obtaining a digital reference image;
(B) projecting the digital reference image from a first image plane via a first optical axis, on to a retina;
(C) recording a digital representation of the neurological image sensed by the person via at least one brain-computer interface, wherein the neurological image is associated with one or more nerve signals received by the light-sensing nerve cells when that person's retina detects the digital reference image;
(D) modeling using an optical transfer function comprising one or more optical parameters, the optics between the first image plane and the retina along the first optical axis; and
(E) comparing the digital reference image to the digital representation of the neurological image to calculate an error value for one of the optical parameters.
20. The method of claim 19 , further comprising transmitting to a display, a signal that causes an adjustment of a displayed image generated by the display, wherein said adjustment is based at least in part on the calculated error value of the one of the optical parameters.
21. The method of claim 19 , further comprising determining a value of a prescription parameter, for correction of a vision error, based at least in part on the calculated error value of the one of the optical parameters.
22. The method of claim 21 , further comprising transmitting to a display a signal that causes an adjustment of a displayed image generated by the display, wherein said adjustment is based at least in part on the determined value of the prescription parameter.
23. The method of claim 19 , further comprising:
(G) generating a pre-compensated digital reference image based on the calculated error value of the one of the optical parameters; and
(H) repeating steps (A) through (F) iteratively, using the pre-compensated digital reference image from step (G) in place of the digital reference image in steps (A) and (B), until the calculated error value of the one of the optical parameters is below a threshold.
24. The method of claim 23 , further comprising determining a value of a prescription parameter, for correction of a vision error, based at least in part on the calculated error value of the one of the optical parameters after said calculated error value is below said threshold.
25. The method of claim 24 , further comprising transmitting to a display a signal that causes an adjustment of a displayed image generated by the display, wherein said adjustment is based at least in part on the calculated error value of the one of the optical parameters after said calculated error value is below said threshold.
26. The method of claim 25 , wherein the adjustment is any one of brightness, contrast, or color associated with at least one pixel in the displayed image.
27. The method of claim 19 , wherein the second optical axis is the same as the first optical axis.
28. The method of claim 20, 22 or 25 wherein the display is integrated in an eyewear device.
29. The method of claim 20, 22 or 25 wherein the display is integrated in a smartphone.