Method and apparatus for securely displaying private information using an augmented reality headset
View Patent ↗An information handling system operating an augmented reality assisted display security system may comprise a head mounted display device, a three-dimensional camera co-located with the head mounted display device capturing a three-dimensional image of a host display device displaying digital content, and a processor executing code instructions to determine a position and orientation of the head mounted display device with respect to a placeholder displayed by the host display device based on the three-dimensional image, generate a three-dimensional primitive of the head mounted display device and the placeholder based on the determined position and orientation, receive secure content, and render a three-dimensional image of the secure content within the placeholder primitive. The head mounted display device may display the three-dimensional image of secure content according to the three-dimensional primitive such that the rendered three-dimensional image of the secure content appears within the placeholder displayed on the host display device.
1. An information handling system operating an augmented reality assisted display security system comprising:
a head mounted display within a head mounted display device;
a three-dimensional camera co-located with the head mounted display capturing a three-dimensional image of a host display device displaying a placeholder for the display of a secure content and other digital content;
a processor executing code instructions of the augmented reality assisted display security system to:
determine a position and orientation of the head mounted display with respect to the placeholder of the host display device based on the three-dimensional image captured by the three-dimensional camera;
generate a three-dimensional primitive of the head mounted display and the placeholder of the host display device based on the determined position and orientation;
receive the secure content;
render a three-dimensional image of the secure content within the three-dimensional primitive at the location within the three-dimensional primitive of the placeholder; and
the head mounted display displaying the three-dimensional image of the secure content according to the three-dimensional primitive such that the rendered three-dimensional image of the secure content appears to be within the placeholder displayed on the host display device and appears to be coplanar with the host display device.
2. The information handling system of claim 1 further comprising:
the processor executing code instructions to:
identify a plurality of physical boundaries of the host video display within the three-dimensional image captured by the three-dimensional camera; and
determine the position and orientation of the head mounted display with respect to the placeholder further based on the identification of the plurality of physical boundaries and an indication received from the host display device of a location of the placeholder with respect to the plurality of physical boundaries.
3. The information handling system of claim 1 further comprising:
the three-dimensional image including a watermark displayed on the host display device;
the processor executing code instructions to:
identify the watermark within the three-dimensional image captured by the three-dimensional camera; and
determine the position and orientation of the head mounted display with respect to the placeholder further based on the identification of the watermark and an indication received from the host display device of a location of the placeholder with respect to the watermark.
4. The information handling system of claim 3 , wherein the location of the watermark displayed on the host display device matches the location of the placeholder displayed on the host display device.
5. The information handling system of claim 1 , wherein the secure content includes text information.
6. The information handling system of claim 1 , wherein the secure content includes a digital image.
7. The information handling system of claim 1 , wherein the placeholder for the display of the secure content and the digital content are displayed within the same software application of the host display device.
8. A method of routing the display of secure content to a head mounted display device via a host information handling system comprising:
capturing a three-dimensional image of a head-mounted display via a host three-dimensional camera co-located with a host video display;
receiving an identification of a secure content;
receiving an instruction to display digital content including the secure content via the host video display;
disallowing the display of the secure content via the host video display;
displaying via the host video display a placeholder for the display of the secure content and other digital content;
determining, via the processor, a position and orientation of the head mounted display device with respect to the host video display based on the three-dimensional image;
generating a primitive of the placeholder of the host display device from the perspective of the head mounted display based on the determined position and orientation of the head mounted display with respect to the host video display and a position of the placeholder with respect to the host video display; and
rendering a three-dimensional image of the secure content such that the three-dimensional image of the secure content appears to be within the primitive of the placeholder.
9. The method of claim 8 comprising:
transmitting the rendered three-dimensional image of the secure content to a head mounted display device for display via the head mounted display.
10. The method of claim 8 comprising:
displaying a watermark via the display device; and
transmitting to the head mounted display device an indication of a location of the placeholder with respect to the watermark, for placement of the primitive of the placeholder within a three-dimensional primitive at the head mounted display device and display of the rendered three-dimensional image of the secure content.
11. The method of claim 10 , wherein the location of the watermark displayed on the host display device matches the location of the placeholder displayed on the host display device.
12. The method of claim 8 , wherein the secure content includes text information.
13. The method of claim 8 , wherein the secure content includes a digital image.
14. The method of claim 8 , wherein the placeholder for the display of the secure content and the digital content are not displayed within the same software application of the host display device.
15. An information handling system operating an augmented reality assisted display security system comprising:
a head mounted display;
a three-dimensional camera co-located with the head mounted display capturing a three-dimensional image of a host display device displaying a placeholder for the display of a secure digital content item and other digital content;
a processor executing code instructions of the augmented reality assisted display security system to:
receive a rendered three-dimensional image of a secure content item;
determine a position and orientation of the head mounted display with respect to the placeholder based on an identification of the plurality of physical boundaries of the host display within the three-dimensional image captured by the three-dimensional camera, and an identification of the position and orientation of the placeholder with respect to the plurality of physical boundaries of the host display received from the host display;
generate a three-dimensional primitive of the head mounted display and the placeholder of the host display device based on the determined position and orientation;
place the received rendered three-dimensional image of the secure content item within the three-dimensional primitive of the placeholder; and
the head mounted display displaying the three-dimensional image of the secure content according to the three-dimensional primitive such that the rendered three-dimensional image of the secure content appears to be within the placeholder.
16. The information handling system of claim 15 , wherein the placeholder indicates a location within the host video display where the secure content item has been removed from display.
17. The information handling system of claim 16 , wherein the placeholder indicates a location within the host video display where the secure content item has been covered such that the secure content item is not viewable via the host video display.
18. The information handling system of claim 15 , wherein the secure content includes text information.
19. The information handling system of claim 15 , wherein the secure digital content includes a digital image.
20. The information handling system of claim 15 , wherein the placeholder for the display of the secure content and the digital content are displayed within the same software application of the host display device.