Wearable image manipulation and control system with correction for vision defects and augmentation of vision and sensing
A wearable image manipulation system is described herein. The wearable image manipulation system includes a camera input system, an image projection system, where the image projection system is capable of being worn by a user, and a processor in communication with the camera input system and the image projection system such that the processor is capable of receiving an image from the camera input system, modifying the image to produce a modified image, and displaying the modified image on the image projection system. The camera input system may comprise a contact lens with a camera mounted thereon. Additionally or alternately, the system may be capable of tracking a user's eye movement to accurately capture where the user is looking with the camera input system.
1. A wearable image manipulation system comprising:
a smart contact lens including:
a contact lens to be worn by a user;
a camera input system including a camera positioned on the contact lens; and
an image projection system including a display positioned around a perimeter of the camera;
a database capable of receiving, storing, and transmitting a retinal map; and
a processor in communication with the camera input system, the database, and the image projection system such that the processor performs an algorithm including the steps of:
receiving an image from the camera input system;
modifying the image according to the retinal map to produce a modified image; and
displaying the modified image on the image projection system whereby displaying the modified image comprises correcting eye defects of the user.
2. The wearable image manipulation system of claim 1 , further comprising a wearable headset housing the database and the processor, the processor is coupled in wireless communication with the smart contact lens.
3. The wearable image manipulation system of claim 1 , wherein the camera is positioned in a central portion of the contact lens.
4. The wearable image manipulation system of claim 3 , wherein the camera is positioned in the most central 15% of the user's eye.
5. The wearable image manipulation system of claim 1 , wherein the processor performs the algorithm including the steps of:
generating the retinal map including a boundary indicating an area to be modified within the patient's vision.
6. The wearable image manipulation system of claim 5 , wherein the processor performs the algorithm including the steps of:
generating an image distortion map including shifting image data located within the boundary outwardly along a plurality of rays starting at an estimated center point of the boundary to outside the boundary such that the image data from the center point to an edge of the image is compressed from the boundary to the edge of the image; and
modifying the image based on the image distortion map.
7. The wearable image manipulation system of claim 6 , wherein the processor performs the algorithm including the steps of:
generating a plurality of retinal maps stored in the database, each retinal map including a different boundary indicating a different area to be modified within the patient's vision.
8. The wearable image manipulation system of claim 7 , wherein the processor performs the algorithm including the steps of:
selecting the retinal map from the plurality of retinal maps based on a user's input.
9. A method of operating a wearable image manipulation system including a smart contact lens including a contact lens to be worn by a user, a camera input system including a camera positioned on the contact lens, and an image projection system including a display positioned around a perimeter of the camera, a database capable of receiving, storing, and transmitting a retinal map, and a processor in communication with the camera input system, the database, and the image projection system, the method including the processor performing an algorithm including the steps of:
receiving an image from the camera input system;
modifying the image according to the retinal map to produce a modified image; and
displaying the modified image on the image projection system whereby displaying the modified image comprises correcting eye defects of the user.
10. The method of claim 9 , wherein the camera is positioned in a central portion of the contact lens.
11. The method of claim 10 , wherein the camera is positioned in the most central 15% of the user's eye.
12. The method of claim 9 , including the processor performing the algorithm including the steps of:
generating the retinal map including a boundary indicating an area to be modified within the patient's vision.
13. The method of claim 12 , including the processor performing the algorithm including the steps of:
generating an image distortion map including shifting image data located within the boundary outwardly along a plurality of rays starting at an estimated center point of the boundary to outside the boundary such that the image data from the center point to an edge of the image is compressed from the boundary to the edge of the image; and
modifying the image based on the image distortion map.
14. The method of claim 13 , including the processor performing the algorithm including the steps of:
generating a plurality of retinal maps stored in the database, each retinal map including a different boundary indicating a different area to be modified within the patient's vision.
15. The method of claim 14 , including the processor performing the algorithm including the steps of:
selecting the retinal map from the plurality of retinal maps based on a user's input.
16. A non-transitory computer-readable storage media having computer-executable instructions embodied thereon to operate a wearable image manipulation system including a smart contact lens including a contact lens to be worn by a user, a camera input system including a camera positioned on the contact lens, and an image projection system including a display positioned around a perimeter of the camera, a database capable of receiving, storing, and transmitting a retinal map, and a processor in communication with the camera input system, the database, and the image projection system, when executed by the processor the computer-executable instructions cause the processor to perform an algorithm including the steps of:
receiving an image from the camera input system;
modifying the image according to the retinal map to produce a modified image; and
displaying the modified image on the image projection system whereby displaying the modified image comprises correcting eye defects of the user.
17. The non-transitory computer-readable storage media of claim 16 , wherein the computer-executable instructions cause the one or more processors to execute the algorithm including the steps of:
generating the retinal map including a boundary indicating an area to be modified within the patient's vision.
18. The non-transitory computer-readable storage media of claim 17 , wherein the computer-executable instructions cause the one or more processors to execute the algorithm including the steps of:
generating an image distortion map including shifting image data located within the boundary outwardly along a plurality of rays starting at an estimated center point of the boundary to outside the boundary such that the image data from the center point to an edge of the image is compressed from the boundary to the edge of the image; and
modifying the image based on the image distortion map.
19. The non-transitory computer-readable storage media of claim 18 , wherein the computer-executable instructions cause the one or more processors to execute the algorithm including the steps of:
generating a plurality of retinal maps stored in the database, each retinal map including a different boundary indicating a different area to be modified within the patient's vision.
20. The non-transitory computer-readable storage media of claim 19 , wherein the computer-executable instructions cause the one or more processors to execute the algorithm including the steps of:
selecting the retinal map from the plurality of retinal maps based on a user's input.