IP Library Granted Patent US 11,829,497
Granted Patent B2
US 11,829,497 · App. 17/238,716 · Granted Nov 28, 2023

Processing secure content on a virtual reality system

Inventors: Robert Blake Taylor (Porter Ranch, CA); Dmitry Pastouchenko (Folsom, CA); Frederic Plourde (Saint-Eustache, CA)
Assignee: Magic Leap, Inc.
G06F21/6209G06F3/14G06F21/602G06F21/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,829,497
App. No.
17/238,716
Granted
Nov 28, 2023
Kind
B2
Abstract

Described herein are techniques and technologies to identify an encrypted content within a field of view of a user of a VR/AR system and process the encrypted content appropriately. The user of the VR/AR technology may have protected content in a field of view of the user. Encrypted content is mapped to one or more protected surfaces on a display device. Contents mapped to a protected surface may be rendered on the display device but prevented from being replicated from the display device.

Claims (62)

1. A method for displaying content components on a display device, the method comprising:

receiving, by a processing platform from a source, a plurality of content components including an encrypted content component, wherein the encrypted content component is decrypted into a decrypted content component and output by the source;

identifying, by the processing platform, the decrypted content component among the plurality of content components as being previously encrypted, wherein at least the decrypted content component received from the source is mapped to a protected surface within a field of view of a viewer at least based on being previously encrypted; and

transmitting, by the processing platform, the decrypted content component to the protected surface of the display device of the viewer, wherein the decrypted content component is simultaneously viewable on the protected surface of the display device and the source.

2. The method of claim 1 , further comprising:

identifying, by the processing platform, an unencrypted content component among the plurality of content components; and

merging, by the processing platform, the decrypted content component and the unencrypted content component into a single output frame; and

transmitting, by the processing platform, the single output frame to the display device, wherein the single output frame is mapped to one or more protected surfaces on the display device.

3. The method of claim 1 , further comprising:

generating the protected surface, wherein the decrypted content component is configured to be rendered only on the protected surface; and

transmitting the protected surface to the display device, wherein the decrypted content component is rendered on the protected surface on the display device.

4. The method of claim 1 , further comprising:

upon receiving the plurality of content components,

creating a plurality of frame loops, wherein each frame loop corresponds to one of the plurality of content components;

queuing the plurality of frame loops into a frame loop pipeline;

obtaining a frame loop from the frame loop pipeline; and

determining whether the frame loop corresponds to the encrypted content component or an unencrypted content component based on the source of the plurality of content components.

5. The method of claim 1 , wherein decrypted content mapped to the protected surface is rendered on the display device but cannot be replicated from the display device.

6. The method of claim 1 , further comprising:

disabling recording or storing features of the processing platform with respect to the protected surface.

7. The method of claim 1 , wherein the protected surface includes a texture having a predetermined dimension that maps to a field of view on the display device.

8. The method of claim 1 , further comprising:

identifying, by the processing platform, an unencrypted content component among the plurality of content components; and

merging, by the processing platform, the decrypted content component and the unencrypted content component into a single output frame; and

transmitting, by the processing platform, the single output frame to the display device, wherein the unencrypted content component is mapped to an unprotected surface on the display device.

9. The method of claim 8 , further comprising:

prior to transmitting the single output frame to the display device,

allocating the encrypted content component to the protected surface on the display device and the unencrypted content component to the unprotected surface on the display device.

10. The method of claim 8 , wherein the protected surface and the unprotected surface map to mutually exclusive fields of view on the display device.

11. The method of claim 8 , wherein the protected surface and the unprotected surface map to two fields of view that overlap on the display device, wherein the overlap between the fields of view is within the field of view of the viewer and is displayed as decrypted content on the display device such that while the decrypted content is rendered on the display device, the decrypted content is prevented from being replicated from the display device.

12. A processing platform comprising:

one or more processors; and

one or more storage devices storing instructions that, when executed on the one or more processors, cause the one or more processors to:

receive, from a source, a plurality of content components including an encrypted content component, wherein the encrypted content component is decrypted into a decrypted content component and output by the source;

identify the decrypted content component among the plurality of content components as being previously encrypted, wherein at least the decrypted content component received from the source is mapped to a protected surface within a field of view of a viewer at least based on being previously encrypted; and

transmit the decrypted content component to the protected surface of a display device of the viewer, wherein the decrypted content component is simultaneously viewable on the protected surface of the display device and the source.

13. The processing platform of claim 12 , wherein the instructions, when executed on the one or more processors, further cause the one or more processors to:

identify an unencrypted content component among the plurality of content components; and

merge the decrypted content component and the unencrypted content component into a single output frame; and

transmit the single output frame to the display device, wherein the single output frame is mapped to one or more protected surfaces on the display device.

14. The processing platform of claim 12 , wherein the instructions, when executed on the one or more processors, further cause the one or more processors to:

generate the protected surface, wherein the decrypted content component is configured to be rendered only on the protected surface; and

transmit the protected surface to the display device, wherein the decrypted content component is rendered on the protected surface on the display device.

15. The processing platform of claim 12 , wherein the instructions, when executed on the one or more processors, further cause the one or more processors to:

upon receiving the plurality of content components,

create a plurality of frame loops, wherein each frame loop corresponds to one of the plurality of content components;

queue the plurality of frame loops into a frame loop pipeline;

obtain a frame loop from the frame loop pipeline; and

determine whether the frame loop corresponds to the encrypted content component or an unencrypted content component based on the source of the plurality of content components.

16. The processing platform of claim 12 , wherein content mapped to the protected surface is rendered on the display device but cannot be replicated from the display device, wherein the instructions, when executed on the one or more processors, further cause the one or more processors to:

disable recording or storing features of the processing platform with respect to the protected surface.

17. The processing platform of claim 12 , wherein the protected surface includes a texture having a predetermined dimension that maps to a field of view on the display device.

18. The processing platform of claim 12 , wherein the instructions, when executed on the one or more processors, further cause the one or more processors to:

identify an unencrypted content component among the plurality of content components; and

merge the decrypted content component and the unencrypted content component into a single output frame; and

transmit the single output frame to the display device, wherein the unencrypted content component is mapped to an unprotected surface on the display device.

19. The processing platform of claim 18 , wherein the instructions, when executed on the one or more processors, further cause the one or more processors to:

prior to transmitting the single output frame to the display device,

allocate the encrypted content component to the protected surface on the display device and the unencrypted content component to the unprotected surface on the display device, wherein the protected surface and the unprotected surface map to mutually exclusive fields of view on the display device.

20. The processing platform of claim 18 , wherein the instructions, when executed on the one or more processors, further cause the one or more processors to:

prior to transmitting the single output frame to the display device,

allocate the encrypted content component to the protected surface on the display device and the unencrypted content component to the unprotected surface on the display device, wherein the protected surface and the unprotected surface map to two fields of view that overlap on the display device, wherein the overlap between the fields of view is within the field of view of the viewer and is displayed as decrypted content on the display device, while the decrypted content is rendered on the display device, the decrypted content is prevented from being replicated from the display device.

Assignments (2)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2022
From: TAYLOR, ROBERT BLAKE; PASTOUCHENKO, DMITRY; PLOURDE, FREDERIC
To: MAGIC LEAP, INC.
Reel/Frame 061420/0035 →
Continuity (2)
Provisional Application 63014645 · Apr 23, 2020
Related Publication 20210334397A1 · Oct 28, 2021
Cited By (2)
US 12,242,580 US 12,518,035