Metaverse system
View Patent ↗Systems and methods are disclosed to inspect an eye includes capturing an eye image using a mobile device camera; extracting features of the eye; applying a deep learning neural network to detect the eye for identification.
1. A method to analyze an eye with a mobile device, comprising:
capturing an eye image using a mobile device camera coupled to a processor;
capturing gyroscope or accelerometer readings as image metadata to aid in orientation normalization and image registration by the processor;
extracting features of the eye using the image corrected with image metadata and clinical information from a population including medical history by the processor; and
applying the extracted features to a deep learning neural network to detect hypertension or diabetic condition from the eye.
2. The method of claim 1 , comprising providing an adapter to couple the mobile device to the eye.
3. The method of claim 1 , comprising positioning one or more light emitters or light pipes to carry light from the mobile device in an adapter.
4. The method of claim 1 , comprising capturing stereo images of the eye, wherein the adapter enables two or more cameras in the mobile device to image the eye.
5. The method of claim 1 , comprising applying a conditional GAN to learn image patterns.
6. The method of claim 1 , comprising generating features and applying the features to detect similar eye conditions.
7. The method of claim 6 , comprising retrieving treatment or diagnosis information from the detected similar eye conditions.
8. The method of claim 1 , comprising generating historical feature vectors from one or more eye examinations of a patient, training the deep learning neural network with the historical feature vectors along with eye images, and applying the trained deep learning neural network to diagnose the eye.
9. The method of claim 1 , comprising detecting laser damage on the eye using the deep learning network.
10. The method of claim 1 , comprising providing a similarity search for the eye image.
11. The method of claim 1 , comprising displaying from a database eye images similar to the eye image captured by the mobile device camera.
12. The method of claim 1 , wherein the mobile device camera comprises an optical zoom lens.
13. The method of claim 12 , comprising controlling the optical zoom lens to focus on a posterior of the eye; providing a neural network trained to focus on structures on the posterior of the eye; and imaging the posterior of the eye.
14. The method of claim 1 , comprising providing background lighting for imaging cataract in the eye with retroillumination.
15. The method of claim 1 , comprising determining intraocular pressure (IOP) with the deep learning neural network trained on mapping lens curvature to IOP.
16. The method of claim 15 , comprising calibrating the IOP with a tonometer in an adapter.
17. The method of claim 1 , comprising imaging a posterior of the eye with solid state lighting units and light conditioning optics, further comprising emitting light with narrow spectral bandwidth, broad spectral bandwidth, visible spectrum, or invisible spectrum.
18. The method of claim 1 , comprising placing light sources and sensors in an adapter positioned between the mobile device camera and the eye.
19. The method of claim 1 , wherein the eye condition comprises myopia, hyperopia, astigmatism, or presbyopia.
20. The method of claim 1 , wherein the mobile device compensates for the eye condition during usage.