Processing secure content on a virtual reality system
Described herein are techniques and technologies to identify an encrypted content within a field of view of a user of a VR/AR system and process the encrypted content appropriately. The user of the VR/AR technology may have protected content in a field of view of the user. Encrypted content is mapped to one or more protected surfaces on a display device. Contents mapped to a protected surface may be rendered on the display device but prevented from being replicated from the display device.
1 . A head-mounted display system configured to display augmented reality image content, the head-mounted display system comprising:
a display comprising a protected surface:
one or more processors; and
one or more memory storing instructions that, upon execution by the one or more processors, configure the head-mounted display system to:
receive, from a source, a plurality of content components that includes an encrypted content component;
transmit, to a compositor, the plurality of content components;
receive, from the compositor, the encrypted content component mapped to the protected surface within a field of view associated with the head-mounted display system at least based on the content component being encrypted; and
display the encrypted content component on the protected surface of the display, wherein the encrypted content component is simultaneously viewable on the protected surface of the display and the source.
2 . The head-mounted display system of claim 1 , wherein the display comprises at least two protected surfaces.
3 . The head-mounted display system of claim 2 , wherein at least one of the two protected surfaces comprises at least one of: (i) the encrypted content component or (ii) an unencrypted content component.
4 . The head-mounted display system of claim 2 , wherein the plurality of content components includes an unencrypted content component, and wherein the instructions further configure the head-mounted display system to:
receive, from the compositor, the unencrypted content component mapped to an unprotected surface of the display and within the field of view associated with the head-mounted display system; and
display the encrypted content component on the unprotected surface of the display, wherein the unencrypted content component is simultaneously viewable on the display and the source.
5 . The head-mounted display system of claim 4 , wherein the encrypted content component and the unencrypted content component are rendered on the display and are prevented from being replicated from the display.
6 . The head-mounted display system of claim 5 , wherein replication is prevented through at least one of: scrambling, distorting, redacting, or using an alternative content.
7 . The head-mounted display system of claim 4 , wherein at least a portion of the encrypted content component and the unencrypted content component is rendered on the display, wherein the unencrypted content component is configured to be replicated from the display, and wherein the encrypted content component is prevented from being replicated from the display.
8 . The head-mounted display system of claim 7 , wherein replicating content includes at least one of: (i) recording the content or (ii) storing the content.
9 . The head-mounted display system of claim 1 , wherein the plurality of content components received from the source include at least one of: (i) audio content, (ii) video content, (iii) textual content, or (iv) image content.
10 . The head-mounted display system of claim 1 , wherein the instructions further configure the head-mounted display system to:
receive a single output frame from the compositor, wherein the single output frame is mapped to one or more protected surfaces on the display.
11 . The head-mounted display system of claim 1 , wherein the instructions further configure the head-mounted display system to:
receive the protected surface from the compositor, wherein the encrypted content component is configured to be rendered only on the protected surface; and
render the encrypted content component on the protected surface.
12 . The head-mounted display system of claim 1 , wherein the instructions further configure the head-mounted display system to:
upon receiving the plurality of content components,
create a plurality of frame loops, wherein each frame loop corresponds to one of the plurality of content components; and
queue the plurality of frame loops into a frame loop pipeline.
13 . A method for displaying content components on a head-mounted display, the method comprising:
receiving, from at least one source, a plurality of content components, the plurality of content components including at least one protected content component;
transmitting, to a compositor, the plurality of content components;
receiving, from the compositor, a protected surface within a field of view associated with the head-mounted display at least based on being the compositor mapping the protected content component to the protected surface; and
displaying the protected content component on the protected surface of the display, wherein the protected content component is simultaneously viewable on the protected surface of the display and the source.
14 . The method of claim 13 , further comprising:
receiving a single output frame from the compositor, wherein the single output frame is mapped to one or more protected surfaces on the head-mounted display.
15 . The method of claim 13 , further comprising:
receiving the protected surface from the compositor, wherein the protected content component is configured to be rendered only on the protected surface; and
rendering the protected content component on the protected surface.
16 . The method of claim 13 , further comprising:
upon receiving the plurality of content components,
creating a plurality of frame loops, wherein each frame loop corresponds to one of the plurality of content components; and
queuing the plurality of frame loops into a frame loop pipeline.
17 . The method of claim 13 , wherein the protected surface and an unprotected surface map to mutually exclusive fields of view on the head-mounted display.
18 . The method of claim 13 , wherein the protected surface and an unprotected surface map to two fields of view that overlap on the head-mounted display, wherein the overlap between the fields of view is within the field of view associated with the head-mounted display and is displayed as protected content on the head-mounted display such that while the protected content component is rendered on the head-mounted display, the protected content component is prevented from being replicated from the head-mounted display.
19 . The method of claim 13 , wherein protected content mapped to the protected surface is rendered on the head-mounted display and is prevented from being replicated from the head-mounted display.
20 . A non-transitory computer-readable medium storing a set of instructions, the set of instructions when executed by one or more processors of a head-mounted display system cause processing to be performed comprising:
receiving, from a source, a plurality of content components that includes an encrypted content component;
transmitting, to a compositor, the plurality of content components;
receiving, from the compositor, the encrypted content component mapped to a protected surface within a field of view associated with a head-mounted display system at least based on the content component being encrypted, wherein the protected surface is provided on a display of the head-mounted display system; and
displaying the encrypted content component on the protected surface of the display, wherein the encrypted content component is simultaneously viewable on the protected surface of the display and the source.