Vision defect determination and enhancement using a prediction model
In certain embodiments, enhancement of a vision of a user may be facilitated. In some embodiments, a visual test presentation including a set of stimuli may be provided to a user. Feedback related to the set of stimuli may be obtained during the visual test presentation. The feedback may be provided to a prediction model, and the prediction model may be configured based on the feedback. Subsequent to the configuring of the prediction model, live video stream data, eye characteristic information, or other information may be provided to the prediction model to obtain a set of modification parameters. A modified version of the live video stream data may be generated and displayed to the user based on the live video stream and the set of modification parameters.
1. A system for facilitating enhancement related to a vision of a user, the system comprising:
a computer system that comprises one or more processors executing computer program instructions that, when executed, cause the computer system to:
obtain feedback related to a set of stimuli displayed to a user, the feedback comprising an eye image captured during a visual test presentation, a user modification of one or more stimuli of the set during the visual test presentation, or an indication of a lack of response of the user to one or more stimuli of the set during the visual test presentation;
provide the feedback related to the set of stimuli to a neural network to train the neural network, the neural network being updated based on the feedback related to the set of stimuli;
obtain live video stream data via a wearable device and obtain one or more modification parameters via the neural network; and
cause, via the wearable device, based on the one or more modification parameters, a modified version of the live video stream data to be displayed to the user within less than one second of the live video stream data being captured via one or more cameras.
2. The system of claim 1 , wherein obtaining the feedback related to the set of stimuli comprises obtaining the eye image captured during the visual test presentation, and
wherein providing the feedback related to the set of stimuli comprises providing, during the visual test presentation, the eye image to the neural network to train the neural network.
3. The system of claim 2 , wherein the eye image is an image of a retina of an eye of the user or an image of a cornea of the eye.
4. The system of claim 1 , wherein obtaining the feedback related to the set of stimuli comprises obtaining, via the wearable device, the indication of the lack of response of the user to one or more stimuli of the set of stimuli, and
wherein providing the feedback related to the set of stimuli comprises providing, via the wearable device during a visual test presentation, the indication of the lack of response to the neural network to train the neural network.
5. The system of claim 1 , wherein obtaining the feedback related to the set of stimuli comprises obtaining, via the wearable device, the user modification of one or more stimuli of the set of stimuli via user input of the user, and
wherein providing the feedback related to the set of stimuli comprises providing, via the wearable device during a visual test presentation, the user modification to the neural network to train the neural network.
6. The system of claim 1 , wherein the computer system is caused to:
monitor one or more changes related to one or more eyes of the user; and
cause, based on the monitoring, an adjustment of one or more shapes or sizes of first or second display portions on one or more transparent displays of the wearable device,
wherein causing the modified version of the live video stream data to be displayed comprises causing, based on the one or more modification parameters, the modified version of the live video stream data to be displayed on the first or second display portions.
7. A method being implemented by one or more processors executing computer program instructions that, when executed, perform the method, the method comprising:
obtaining feedback related to a set of stimuli displayed to a user, the feedback comprising an eye image captured during a visual test presentation, a user modification of one or more stimuli of the set during the visual test presentation, or an indication of a lack of response of the user to one or more stimuli of the set during the visual test presentation;
providing the feedback related to the set of stimuli to a neural network to train the neural network, the neural network being updated based on the feedback related to the set of stimuli;
obtaining live video stream data via a wearable device and obtaining one or more modification parameters via the neural network; and
causing, via the wearable device, based on the one or more modification parameters, a modified version of the live video stream data to be displayed to the user.
8. The method of claim 7 , wherein obtaining the feedback related to the set of stimuli comprises obtaining the eye image captured during the visual test presentation, and
wherein providing the feedback related to the set of stimuli comprises providing, during the visual test presentation, the eye image to the neural network to train the neural network.
9. The method of claim 8 , wherein the eye image is an image of a retina of an eye of the user or an image of a cornea of the eye.
10. The method of claim 7 , wherein obtaining the feedback related to the set of stimuli comprises obtaining, via the wearable device, the indication of the lack of response of the user to one or more stimuli of the set of stimuli, and
wherein providing the feedback related to the set of stimuli comprises providing, via the wearable device during a visual test presentation, the indication of the lack of response to the neural network to train the neural network.
11. The method of claim 7 , wherein obtaining the feedback related to the set of stimuli comprises obtaining, via the wearable device, the user modification of one or more stimuli of the set of stimuli via user input of the user, and
wherein providing the feedback related to the set of stimuli comprises providing, via the wearable device during a visual test presentation, the user modification to the neural network to train the neural network.
12. The method of claim 7 , further comprising:
monitoring one or more changes related to one or more eyes of the user; and
causing, based on the monitoring, an adjustment of one or more shapes or sizes of first or second display portions on one or more transparent displays of the wearable device,
wherein causing the modified version of the live video stream data to be displayed comprises causing, based on the one or more modification parameters, the modified version of the live video stream data to be displayed on the first or second display portions.
13. The method of claim 7 , wherein causing the modified version of the live video stream data to be displayed to the user comprises causing the modified version of the live video stream data to be displayed to the user within less than one second of the live video stream data being captured via one or more cameras.
14. One or more non-transitory computer-readable media comprising instructions that, when executed by one or more processors, cause operations comprising:
obtaining feedback related to a set of stimuli displayed to a user, the feedback comprising an eye image captured during a visual test presentation, a user modification of one or more stimuli of the set during the visual test presentation, or an indication of a lack of response of the user to one or more stimuli of the set during the visual test presentation;
providing the feedback related to the set of stimuli to a neural network to train the neural network, the neural network being updated based on the feedback related to the set of stimuli;
obtaining live video stream data via a wearable device and obtaining one or more modification parameters via the neural network; and
causing, via the wearable device, based on the one or more modification parameters, a modified version of the live video stream data to be displayed to the user.
15. The media of claim 14 , wherein obtaining the feedback related to the set of stimuli comprises obtaining the eye image captured during the visual test presentation, and
wherein providing the feedback related to the set of stimuli comprises providing, during the visual test presentation, the eye image to the neural network to train the neural network.
16. The media of claim 15 , wherein the eye image is an image of a retina of an eye of the user or an image of a cornea of the eye.
17. The media of claim 14 , wherein obtaining the feedback related to the set of stimuli comprises obtaining, via the wearable device, the indication of the lack of response of the user to one or more stimuli of the set of stimuli, and
wherein providing the feedback related to the set of stimuli comprises providing, via the wearable device during a visual test presentation, the indication of the lack of response to the neural network to train the neural network.
18. The media of claim 14 , wherein obtaining the feedback related to the set of stimuli comprises obtaining, via the wearable device, the user modification of one or more stimuli of the set of stimuli via user input of the user, and
wherein providing the feedback related to the set of stimuli comprises providing, via the wearable device during a visual test presentation, the user modification to the neural network to train the neural network.
19. The media of claim 14 , the operations further comprising:
monitoring one or more changes related to one or more eyes of the user; and
causing, based on the monitoring, an adjustment of one or more shapes or sizes of first or second display portions on one or more transparent displays of the wearable device,
wherein causing the modified version of the live video stream data to be displayed comprises causing, based on the one or more modification parameters, the modified version of the live video stream data to be displayed on the first or second display portions.
20. The media of claim 14 , wherein causing the modified version of the live video stream data to be displayed to the user comprises causing the modified version of the live video stream data to be displayed to the user within less than one second of the live video stream data being captured via one or more cameras.