Medical analysis system
View Patent ↗Systems and methods are disclosed to inspect an eye includes capturing an eye image using a mobile device camera; extracting features of the eye; applying a deep learning neural network to detect potential eye damage; and reporting the potential eye damage for treatment, such as those from laser pointers, among others.
1. A method to inspect an eye with a mobile device, comprising:
capturing an eye image using a mobile device camera coupled to a processor;
capturing gyroscope or accelerometer readings as image metadata to aid in orientation normalization and image registration by the processor;
extracting features of the eye using the image corrected with image metadata and clinical information from a population including medical history by the processor;
applying the extracted features to a deep learning neural network to detect potential eye damage by the processor;
reporting the potential eye damage for treatment.
2. The method of claim 1 , comprising providing an adapter to couple the mobile device to the eye.
3. The method of claim 1 , comprising positioning one or more light emitters or light pipes to carry light from the mobile device in an adapter.
4. The method of claim 1 , comprising capturing stereo images of the eye with a second camera on the mobile device and using data from sensors on an adapter for image processing.
5. The method of claim 1 , comprising applying a conditional GAN to learn image patterns.
6. The method of claim 1 , comprising generating features and applying the features to detect similar eye conditions.
7. The method of claim 6 , comprising retrieving treatment or diagnosis information from the detected similar eye conditions.
8. The method of claim 1 , comprising generating historical feature vectors from one or more eye examinations of a patient, training the deep learning neural network with the historical feature vectors along with eye images, and applying the trained deep learning neural network to diagnose the eye.
9. A method to inspect an eye with a mobile device with a gyroscope or an accelerometer, comprising:
capturing an eye image using a mobile device camera coupled to a processor;
capturing gyroscope or accelerometer readings as image metadata to aid in orientation normalization and image registration by the processor;
extracting features of the eye using the image corrected with image metadata and clinical information including medical history by the processor; and
detecting third party intentional laser damage on the eye using the deep learning network.
10. The method of claim 1 , comprising providing a similarity search for the eye image and retrieving historical treatment information from similar cases as precedential treatment data.
11. The method of claim 1 , comprising displaying from a database eye images similar to the eye image captured by the mobile device camera to provide treatment information from similar cases.
12. The method of claim 1 , wherein the mobile device camera comprises an optical zoom lens with focusing adjustment capability to image internal eye targets at different distances from the lens.
13. The method of claim 12 , comprising controlling the optical zoom lens to focus on a posterior of the eye; providing a neural network trained to focus on structures on the posterior of the eye; and imaging the posterior of the eye.
14. The method of claim 1 , wherein the mobile device provides background lighting for imaging cataract in the eye with retro illumination.
15. The method of claim 1 , wherein the mobile device determines intraocular pressure (IOP) with the deep learning neural network trained on mapping lens curvature to IOP.
16. The method of claim 15 , comprising calibrating the IOP with a tonometer in an adapter.
17. The method of claim 1 , wherein the mobile device images a posterior of the eye with solid state lighting units and light conditioning optics.
18. The method of claim 17 , wherein the mobile device emits light with narrow spectral bandwidth, broad spectral bandwidth, visible spectrum, or invisible spectrum.
19. The method of claim 1 , comprising placing light sources and sensors in an adapter positioned between the mobile device camera and the eye.
20. A method to inspect an eye with a mobile device with a gyroscope or an accelerometer, comprising:
capturing an eye image using a mobile device camera coupled to a processor;
capturing gyroscope or accelerometer readings as image metadata to aid in orientation normalization and image registration by the processor;
extracting features of the eye using the image corrected with image metadata and clinical information including medical history by the processor; applying the extracted features to a deep learning neural network to detect potential eye damage by the processor; reporting the potential eye damage for treatment; and
wherein the adapter enables two or more cameras in the mobile device to image the eye.