Pixel opacity for augmented reality
In embodiments of pixel opacity for augmented reality, a display lens system includes a first display panel that displays a virtual image generated to appear as part of an environment viewed through optical lenses. A second display panel displays an environment image of the environment as viewed through the optical lenses, and the environment image includes opaque pixels that form a black silhouette of the virtual image. The display lens system also includes a beam-splitter panel to transmit light of the environment image and reflect light of the virtual image to form a composite image that appears as the virtual image displayed over the opaque pixels of the environment image.
1. A wearable display device, comprising:
a left display lens system configured to form a composite image for viewing;
a right display lens system configured to form the composite image for viewing;
the left and right display lens systems each comprising:
a display panel configured to display an environment image of an environment, the environment image including opaque pixels that form a black silhouette of a virtual image;
a first freeform prism inverted relative to a second freeform prism, the first freeform prism configured to project the environment image onto the display panel and the second freeform prism configured to reflect the composite image for viewing; and
the composite image formed with the virtual image displayed over the opaque pixels of the environment image to augment reality of the environment that is viewed through the left and right display lens systems.
2. A wearable display device as recited in claim 1 , wherein each of the left and right display lens systems further comprise:
a second display panel configured to display the virtual image.
3. A wearable display device as recited in claim 2 , further comprising a computer processing system to implement an imaging application that is configured to spatially modulate the display panel of the left and right display lens systems to correlate a location of the opaque pixels with a display position of the virtual image on the second display panel of the left and right display lens systems.
4. A wearable display device as recited in claim 2 , further comprising a controller that includes a computer processing system to implement an imaging application configured to:
correlate a location of the opaque pixels on the display panel of the left and right display lens systems with a display position of the virtual image on the second display panel of the left and right display lens systems; and
control pixel illumination of the display panel of the left and right display lens systems to turn-off the opaque pixels.
5. A wearable display device as recited in claim 1 , further comprising a camera configured to capture the environment image for pixelated display on the display panel.
6. An imaging system, comprising:
a first display panel configured to display an environment image of the environment, the environment image including opaque pixels that form a black silhouette of a virtual image;
a first freeform prism configured to project the environment image onto the first display panel;
a second display panel configured to display the virtual image; and
a second freeform prism inverted relative to the first freeform prism configured to reflect a composite image that appears as the virtual image displayed over the opaque pixels of the environment image.
7. An imaging system as recited in claim 6 , wherein the virtual image appears with a high contrast relative to the environment image in the composite image.
8. An imaging system as recited in claim 6 , further comprising a camera configured to capture the environment image for pixelated display on the first display panel.
9. An imaging system as recited in claim 6 , wherein the first display panel is one of a transparent LCD or a reflective LCOS, the first display panel comprised of pixels configured for on-off control, and wherein the opaque pixels are turned off.
10. An imaging system as recited in claim 6 , further comprising an imaging application configured to spatially modulate the first display panel to correlate a location of the opaque pixels with a display position of the virtual image on the second display panel.
11. An imaging system as recited in claim 6 , further comprising:
a mirror panel configured to reflect the environmental image received from the first freeform prism to a beam-splitter that is configured to reflect the environmental image to the first display panel.
12. An imaging system as recited in claim 11 , wherein the beam splitter is further configured to transmit light of the environmental image and reflect light of the virtual image to the second freeform prism.
13. A imaging system as recited in claim 6 , wherein the first display panel, the first freeform prism, the second display panel, and the second freeform prism are integrated into or mounted on the side of the frame of a wearable display device.
14. A imaging system as recited in claim 6 , wherein the first display panel, the first freeform prism, the second display panel, and the second freeform prism are integrated into or mounted on top of a display lens of a wearable display device.
15. An imaging system as recited in claim 6 , further comprising an imaging application configured to:
generate the virtual image from virtual image data for display on the second display panel;
correlate a location of the opaque pixels on the first display panel with a display position of the virtual image on the second display panel; and
control pixel illumination of the first display panel to turn-off the opaque pixels.
16. A method comprising:
projecting an environment image of an environment onto a first display panel using a first freeform prism;
displaying the environment image on the first display panel, the environment image configured to include opaque pixels that form a black silhouette of a virtual image;
displaying the virtual image on a second display panel; and
forming a composite image with the virtual image displayed over the opaque pixels of the environment image, the composite image configured to be reflected for viewing via a second freeform prism that is inverted relative to the first freeform prism.
17. A method as recited in claim 16 , wherein the virtual image appears with a high contrast relative to the environment image in the composite image.
18. A method as recited in claim 16 , further comprising capturing the environment image with a camera for pixelated display on the first display panel.
19. A method as recited in claim 16 , further comprising correlating a location of the opaque pixels on the first display panel with a display position of the virtual image on the second display panel.
20. A method as recited in claim 16 , further comprising controlling pixel illumination of the first display panel to turn-off the opaque pixels.