Hybrid see through augmented reality systems and methods for low vision users
Provided herein are augmented reality visual aid systems, software, and methods which enhance vision, to simulate natural vision, by utilizing hybrid see through occlusion enabled hardware, and software through image manipulation, reprocessing, blending, for presentation and display to the eyes thus enabling a range of tasks previously lost or impacted.
1. A hybrid see-through augmented reality device, comprising:
a frame configured to be worn on the head of a user;
a camera disposed on the frame and configured to generate unprocessed real-time video images;
a processor disposed on or in the frame and configured to apply image processing to the real-time video images from the camera to produce an enhanced video stream, the processor being further configured to gradually reduce the imaging processing towards the edges of the enhanced video stream; and
a first display disposed within the frame and including a first barrier configured to substantially prevent external light corresponding to a central portion of the user's field of view from entering a first eye of the user while allowing external light corresponding to a peripheral portion of the user's field of view to enter the first eye of the user, the first display being configured to present the enhanced video stream to the central portion of the user's field of view while allowing the enhanced video stream to blend smoothly into the peripheral portion of the user's field of view that comprises the user's natural peripheral vision.
2. The device of claim 1 , further comprising a second display disposed within the frame and including a second barrier configured to substantially prevent external light corresponding to the central portion of the user's field of view from entering a second eye of the user while allowing external light corresponding to the peripheral portion of the user's field of view to enter the second eye of the user.
3. The device of claim 2 , wherein the processor is also configured to display the video stream on the second display.
4. The device of claim 1 , wherein the enhanced video stream is at least partially magnified when compared to the unprocessed real-time video images.
5. The device of claim 4 , wherein the enhanced video stream is magnified in a central portion of the enhanced video stream.
6. The device of claim 5 , wherein a portion of the enhanced video stream outside of the central portion is magnified less than the central portion but more than the unprocessed real-time video images.
7. The device of claim 1 , wherein the processor is configured to process the unprocessed real-time video images to blend a top edge, a bottom edge, a left edge, and a right edge of the video stream with the peripheral portion of the user's field of view.
8. The device of claim 1 , wherein the processor is configured to process the unprocessed real-time video images to blend only a left edge and a right edge of the video stream with the peripheral portion of the user's field of view.
9. The device of claim 1 , wherein the processor is configured to process the unprocessed real-time video with image coordinate remapping to blend the video stream with the peripheral portion of the user's field of view.
10. The device of claim 9 , wherein the image coordinate remapping comprises radial mapping.
11. The device of claim 1 , further comprising an input device configured to receive an input from the user regarding a type and/or an amount of enhancement to apply to the unprocessed real-time video images.
12. The device of claim 11 , wherein the input device comprises a physical mechanism.
13. The device of claim 11 , wherein the input device comprises a microphone disposed on or in the housing configured to receive voice commands from the user.
14. The device of claim 1 , wherein the first barrier is a physical barrier.
15. The device of claim 1 , wherein the first barrier is electronically controlled.
16. A method of providing enhanced vision for a low-vision user, comprising: generating unprocessed real-time video images with a head mounted camera; preventing light corresponding to a central portion of the user's field of view from entering a first eye of the user; applying image processing to the unprocessed real-time video images to produce an enhanced video stream; wherein the image processing is gradually reduced towards the edges of the enhanced video stream so as to blend smoothly into peripheral areas of vision of the user; displaying the enhanced video stream on a display positioned within the central portion of the user's field of view that substantially prevents external light corresponding to the central portion of the user's field of view from entering the first eye of the user while allowing external light corresponding to the peripheral portion of the user's field of view to enter the first eye of the user.
17. The method of claim 16 , further comprising displaying the video stream on a second display positioned within the central portion of the user's field of view.
18. The method of claim 17 , wherein the display is positioned in front of the first eye of the user and the second display is positioned in front of a second eye of the user.
19. The method of claim 16 , wherein the enhanced video stream is at least partially magnified when compared to the unprocessed real-time video images.
20. The method of claim 19 , wherein the enhanced video stream is magnified in a central portion of the video stream.
21. The method of claim 20 , wherein a portion of the video stream outside of the central portion is magnified less than the central portion but more than the unprocessed real-time video images.
22. The method of claim 16 , further comprising processing the unprocessed real-time video images to blend a top edge, a bottom edge, a left edge, and a right edge of the video stream with the peripheral portion of the user's field of view.
23. The method of claim 16 , further comprising processing the unprocessed real-time video images to blend only a left edge and a right edge of the video stream with the peripheral portion of the user's field of view.
24. The method of claim 16 , further comprising processing the unprocessed real-time video with image coordinate remapping to blend the video stream with the peripheral portion of the user's field of view.
25. The method of claim 24 , wherein the image coordinate remapping comprises radial mapping.
26. A non-transitory computing device readable medium having instructions stored thereon that are executable by a processor to cause a computing device to: generate unprocessed real-time video images; apply image processing to the unprocessed real-time video images to produce an enhanced video stream wherein the image processing is gradually reduced towards the edges of the enhanced video stream so as to blend smoothly into peripheral areas of vision of the user; display the enhanced video stream on a display positioned within the central portion of the user's field of view that substantially prevents external light corresponding to the central portion of the user's field of view from entering a first eye of the user while allowing external light corresponding to the peripheral portion of the user's field of view to enter the first eye of the user.
27. The device readable medium of claim 26 , wherein the instructions further cause the computing device to display the video stream on a second display positioned within the central portion of the user's field of view.
28. The device readable medium of claim 27 , wherein the display is positioned in front of the first eye of the user and the second display is positioned in front of a second eye of the user.
29. The device readable medium of claim 26 , wherein the instructions further cause the computing device to process the unprocessed real-time video images such that the video stream is enhanced when compared to the unprocessed real-time video images.
30. The device readable medium of claim 29 , wherein the enhanced video stream is at least partially magnified when compared to the unprocessed real-time video images.
31. The device readable medium of claim 30 , wherein the enhanced video stream is magnified in a central portion of the enhanced video stream.
32. The device readable medium of claim 31 , wherein a portion of the enhanced video stream outside of the central portion is magnified less than the central portion but more than the unprocessed real-time video images.
33. The device readable medium of claim 26 , wherein the instructions further cause the computing device to process the unprocessed real-time video images to blend a top edge, a bottom edge, a left edge, and a right edge of the video stream with the peripheral portion of the user's field of view.
34. The device readable medium of claim 26 , wherein the instructions further cause the computing device to process the unprocessed real-time video images to blend only a left edge and a right edge of the video stream with the peripheral portion of the user's field of view.
35. The device readable medium of claim 26 , wherein the instructions further cause the computing device to process the unprocessed real-time video with image coordinate remapping to blend the video stream with the peripheral portion of the user's field of view.
36. The device readable medium of claim 35 , wherein the image coordinate remapping comprises radial mapping.