Wearable image manipulation and control system with high resolution micro-displays and dynamic opacity augmentation in augmented reality glasses
A mixed reality display comprising: at least one lens, where the at least one lens has a reflective element, the at least one lens comprising a plurality of pixels; at least one display capable of projecting one or more images onto at least a portion of the at least one lens; and a dynamic opacity system, where the dynamic opacity system is capable of making at least one pixel opaque in the portion of the at least one lens onto which the one or more images are projected, while any portion of the at least one lens onto which no image is projected remains see-through.
1. A mixed reality display comprising:
at least one lens subsystem comprising at least one reflective lens with a reflective element on a first side, at least one alpha matte lens, where the at least one alpha matte lens is a layer of cholesteric liquid crystal comprising a plurality, of pixels where each pixel is capable of independently becoming opaque, at least one anti-reflective element, and at least one collimator;
multiple displays capable of projecting one or more images onto at least a portion of the at least one reflective lens, where the at least one collimator is located between the multiple displays and the reflective lens such that the at least one collimator is capable of concentrating rays from the multiple displays in an eye-box while utilizing less resolution in a periphery; and
a dynamic opacity system, where the dynamic opacity system is capable of making at least one pixel opaque in the portion of the at least one alpha matte lens aligning with the portion of the reflective ens onto which the one or more images are projected, while any portion of the at least one reflective lens onto which no image is projected remains see-through.
2. The mixed reality display of claim 1 where the mixed reality display is a wearable device.
3. The mixed reality display of claim 2 where the wearable device is a head mounted display and glasses.
4. The mixed reality display of claim 2 where the wearable device is a head mounted display.
5. The mixed reality display of claim 1 further comprising an eye tracking subsystem capable of tracking a user's eye gaze such that the portion of the at least one reflective lens onto which the one or more images is projected, and resultantly the portion of the one or more alpha matte lens in which is located the at least one pixel that the dynamic opacity system makes opaque, is determined at any given time based on the user's eye gaze.
6. The mixed reality display of claim 1 where the dynamic opacity system is capable of being enabled automatically under pre-set conditions or on command by a user.
7. The mixed reality display of claim 1 where the at least one display is capable of projecting the one or more image at a brightness level determined by the brightness of ambient light.
8. The mixed reality display of claim 1 where the at least one display is capable of projecting the one or more image at an occlusion gradient level determined by the projected virtual image.
9. The mixed reality display of claim 1 where the dynamic opacity system is operating on a silhouette equal to, larger, or smaller than a displayed virtual image.
10. The mixed reality display of claim 1 where the alpha matte lens is capable of becoming opaque as a still or moving silhouette of a virtual reality image projected onto the reflective lens.
11. The mixed reality display of claim 1 where each pixel of the alpha matte lens is capable of independently becoming opaque upon direction of the dynamic opacity system.
12. The mixed reality display of claim 1 where the alpha matte lens is a photochromic layer, where the photochromic layer is clear in a static state but is capable of darkening upon exposure to activating light waves.
13. The mixed reality display of claim 1 where the anti-reflective element of each of the at least one lens subsystems is a clear lens such that the alpha matte lens is sandwiched between the reflective lens and the clear lens.
14. The mixed reality display of claim 1 where the at least one alpha matte lens is capable of exhibiting an opacity on any pixel anywhere between and including 0% and 100%.
15. A method of providing a mixed reality experience to a user, the method comprising:
providing the user with a mixed reality display comprising at least one lens subsystem comprising at least one reflective lens, where the at least one reflective lens is reflective on at least one side, at least one alpha matte lens where the at least one alpha matte lens is a layer of cholesteric liquid crystal comprising a plurality of pixels where each pixel is capable of independently becoming opaque, at least one anti-reflective element, and at least one collimator;
projecting one or more images from multiple displays through a collimator and onto at least a portion of the at least one reflective lens, where the collimator concentrates rays from the multiple displays in an eye-box while utilizing less resolution in a periphery;
making the at least one alpha matte lens opaque in the portion of the at least one reflective lens onto which the one or more images are projected; and
leaving or making any portion of the at least one alpha matte lens aligning with the portion of the reflective lens onto which no image is projected see-through.
16. The method of claim 15 further comprising:
acquiring the one or more images with a camera; and
manipulating the one or more images prior to projecting the one or more images onto the at least one lens subsystem with a correspondent alpha matte opaqueness on at least one lens subsystem.
17. The method of claim 16 where manipulating the one or more images comprises pixel mapping and replacement.
18. The method of claim 15 where the mixed reality display is a wearable device.
19. The method of claim 18 where the wearable device is a head mounted display.
20. The method of claim 15 further comprising:
tracking the user's eye gaze; and
determining the portion of the at least one lens subsystem on which to project the one or more virtual and alpha matte images based on the user's eye gaze.
21. The method of claim 15 where making the portion of the at least one alpha matte lens opaque is enabled automatically or on command by the user.
22. The method of claim 15 further comprising detecting ambient light brightness where projecting the one or more images occurs at a brightness level determined by the ambient light brightness.
23. The method of claim 15 where each pixel of the alpha matte lens is capable of independently becoming opaque upon direction of the dynamic opacity system.
24. The method of claim 15 where the alpha matte lens is a photochromic layer, where the photochromic layer is clear in a static state but is capable of darkening upon exposure to activating light waves.
25. The method of claim 15 where the anti-reflective element of each of the at least one lens subsystem is a clear lens such that the alpha matte lens is sandwiched between the reflective lens and the clear lens.
26. The method of claim 15 where the at least one lens subsystem is capable of exhibiting an opacity anywhere between and including 0% and 100%.
27. The mixed reality display of claim 1 where the anti-reflective element is on a second side of the reflective lens.
28. The mixed reality display of claim 1 where the anti-reflective element is on the alpha matte lens.
29. The method of claim 15 where the anti-reflective element is on the reflective lens, such that the reflective lens is reflective on one side and anti-reflective on an opposed side.
30. The method of claim 15 where the anti-reflective element is on the alpha matte lens.
31. The method of claim 21 the command by the user is via hand gesturing enabled by one or more cameras and inertial measurement unit sensors, via voice control, via eye-tracking control, or via a combination thereof.
32. A mixed reality display comprising: at least one lens subsystem comprising
at least one reflective lens and at least two alpha matte lenses; where the at least one reflective lens comprises a reflective element and the at least two alpha matte lenses comprise a plurality of pixels where each pixel is capable of independently becoming opaque;
multiple displays capable of projecting one or more images onto at least a portion of the at least one lens; and
at least one collimator;
where the at least one collimator is located between the multiple displays and reflective lens such that the at least one collimator is capable of concentrating rays from the multiple displays in an eye-box while utilizing less resolution in a periphery;
a dynamic opacity system, where the dynamic opacity system is capable of making at least one pixel opaque in the portion of the at least one alpha matte lens aligning with the portion of the reflective lens onto which the one or more images are projected, while any portion of the at least one reflective lens onto which no image is projected remains see-through.
33. A method of providing a mixed reality experience to a user, the method comprising:
providing the user with a mixed reality display comprising at least one lens subsystem comprising at least one reflective lens and at least two alpha matte lenses, where the at least one reflective lens is reflective;
providing multiple displays capable of projecting one or more images onto at least a portion of the at least one reflective lens;
making the at least one alpha matte lens opaque in the portion of the at least one reflective lens onto which the one or more images are projected; and
leaving or making any portion of the at least one alpha matte lens aligning with the portion of the reflective lens onto which no image is projected see-through; and
providing at least one collimator;
where the at least one collimator is located between the multiple displays and the reflective lens such that the at least one collimator is capable of concentrating rays from the multiple displays in an eye-box while utilizing less resolution in a periphery.
34. A mixed reality display comprising: at least one lens subsystem comprising
at least one reflective lens and at least one alpha matte lens, where the at least one reflective lens comprises a reflective element and the at least one alpha matte lens is a layer of cholesteric liquid crystal comprising a plurality of pixels where each pixel is capable of independently becoming opaque;
multiple displays capable of projecting one or more images onto at least a portion of the at least one reflective lens; and
at least one collimator;
where the at least one collimator is located between the multiple displays and the reflective lens such that the at least one collimator is capable of concentrating rays from the multiple displays in an eye-box while utilizing less resolution in a periphery;
a dynamic opacity system, where the dynamic opacity system is capable of making at least one pixel opaque in the portion of the at least one alpha matte lens aligning with the portion of the reflective lens onto which the one or more images are projected, while any portion of the at least one reflective lens onto which no image is projected remains see-through.
35. The mixed reality display of claim 34 where the at least one alpha matte lens is capable of exhibiting an opacity on any pixel anywhere between and including 0% and 100%.
36. The mixed reality display of claim 34 where the dynamic opacity system is capable of making the alpha matte lens opaque on a silhouette equal to, larger than, or smaller than a displayed virtual image.
37. The mixed reality display of claim 34 further comprising a second alpha matte layer comprising at least one pixel capable of being controlled by exposure to ambient light.
38. The mixed reality display of claim 34 where the alpha matte lens is capable of becoming opaque as s still or moving silhouette of a virtual reality image projected onto the reflective lens.
39. The mixed reality display of claim 34 further comprising an eye tracking subsystem capable of tracking a user's eye gaze such that the portion of the at least one reflective lens onto which the one or more images is projected, and resultantly the portion of the one or more alpha matte lens in which is located the at least one pixel that the dynamic opacity system makes opaque, is determined at any given time based on the user's eye gaze.
40. The mixed reality display of claim 39 where the mixed reality display is capable of manipulating a real-world image for display and where the lens subsystem is capable of making the portion of the one or more alpha matte lens located in the area of the real-world image opaque, as determined at any given time based on the user's eye gaze.