IP Library Granted Patent US 12,093,500
Granted Patent B2
US 12,093,500 · App. 17/902,651 · Granted Sep 17, 2024

Dynamic browser stage

Inventors: Genevieve Mak (Fort Lauderdale, FL); Aleksei Marchenko (Sunnyvale, CA); Alfred Yu-Chih Tarng (Plantation, FL); Damian Franco (Miami, FL)
Assignee: Magic Leap, Inc.
G06F3/04815G06F16/954H04N13/332
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,500
App. No.
17/902,651
Granted
Sep 17, 2024
Kind
B2
Abstract

The disclosure relates to systems and methods for displaying three-dimensional (3D) content in a spatial 3D environment. The systems and methods can include receiving a request from web domain to display 3D content of certain dimensions at a location within the spatial 3D environment, identifying whether the placement is within an authorized portion of the spatial 3D environment, expanding the authorized portion of the 3D spatial environment to display the 3D content based on a user authorization to resize the authorized portion, and displaying the 3D content.

Claims (46)

1. A head-mounted display (HMD) system comprising:

a hardware computer processor;

a non-transitory computer readable medium having software instructions stored thereon, the software instructions executable by the hardware computer processor to cause the computing system to perform operations comprising:

receive a request to display network-accessible content in a three-dimensional (3D) spatial environment depicted on a display of the HMD system, wherein the network-accessible content includes at least one two-dimensional (2D) web page;

identify parameters associated with the content comprising at least one of: an initial location in the 3D spatial environment to display the content, an initial orientation of the content, or initial dimensions of the content;

render the content within a bounded volume in the 3D spatial environment according to the identified parameters, including rendering the at least one 2D web page on at least one first surface of the bounded volume;

receive a user selection, by a user of the HMD system, of at least a portion of the content that includes the at least one 2D web page;

receive a request, originated by the user, to change the orientation of the selected at least a portion of the content from the initial orientation to an updated orientation that includes a mapping to display the at least one 2D web page on at least one second surface of the bounded volume that is different than the at least one first surface;

determine whether a threshold amount of the content is displayable in the bounded volume of the 3D spatial environment at the updated orientation;

in response to determining that the threshold amount of the content is not displayable in the bounded volume of the 3D spatial environment at the updated orientation, determine whether a resizing of the bounded volume is authorized by the user;

in response to determining that the resizing of the bounded volume is authorized by the user, automatically resize the bounded volume to display at least the threshold amount of the content at the updated orientation;

reorient the selected at least a portion of the content to the updated orientation according to the user request; and

render the at least a portion of the content at the updated orientation, including rendering the at least one 2D web page on the at least one second surface of the bounded volume.

2. The display system of claim 1 , wherein the initial orientation is vertical and the updated orientation is horizontal.

3. The display system of claim 1 , wherein the initial orientation is horizontal and the updated orientation is vertical.

4. The display system of claim 1 , wherein the updated orientation is based on a pose of the user.

5. The display system of claim 4 , wherein the pose of the user comprises one or more of a head pose or an eye pose.

6. The display system of claim 4 , wherein the operations further comprise:

tracking the pose of the user; and

in response to a change of the pose of the user, automatically reorienting the at least a portion of the content.

7. The display system of claim 1 , wherein determining that the resizing of the bounded volume is authorized includes prompting the user, through the display of the HMD system, to authorize the resizing.

8. The display system of claim 1 , wherein determining that the resizing of the bounded volume is authorized includes determining that the user authorized all resizing requests during a current interaction session with the HMD system.

9. The display system of claim 1 , wherein determining that the resizing of the bounded volume is authorized includes determining that the resizing is within bounds of a previous authorization of the user for resizing of the bounded volume.

10. The display system of claim 1 , wherein an initial size of the bounded volume is a predetermined proportion of the user's field of view within the display.

11. A computerized method, performed by a computing system having one or more hardware computer processors and one or more non-transitory computer readable storage device storing software instructions executable by the computing system to perform the computerized method comprising:

receiving a request to display network-accessible content in a three-dimensional (3D) spatial environment depicted on a display of a head-mounted display (HMD) system, wherein the network-accessible content includes at least one two-dimensional (2D) web page;

identifying parameters associated with the content comprising at least an initial orientation of the content;

rendering the content within a bounded volume in the 3D spatial environment at the initial orientation, including rendering the at least one 2D web page on at least one first surface of the bounded volume;

receiving user selection, by a user of the HMD system, of at least a portion of the content that includes the at least one 2D web page;

receiving a request, originated by the user, to change the orientation of the selected at least a portion of the content from the initial orientation to an updated orientation that includes a mapping to display the at least one 2D web page on at least one second surface of the bounded volume that is different than the at least one first surface;

determining whether a threshold amount of the content is displayable in the bounded volume of the 3D spatial environment at the updated orientation;

in response to determining that the threshold amount of the content is not displayable in the bounded volume of the 3D spatial environment at the updated orientation, determining whether a resizing of the bounded volume is authorized by the user;

in response to determining that the resizing of the bounded volume is authorized by the user, automatically resizing the bounded volume to display at least the threshold amount of the content at the updated orientation;

reorienting the selected at least a portion of the content to the updated orientation; and

rendering the at least a portion of the content at the updated orientation, including rendering the at least one 2D web page on the at least one second surface of the bounded volume.

12. The computerized method of claim 11 , wherein the initial orientation is vertical and the updated orientation is horizontal.

13. The computerized method of claim 11 , wherein the initial orientation is horizontal and the updated orientation is vertical.

14. The computerized method of claim 11 , wherein the updated orientation is automatically calculated based on a pose of the user.

15. The computerized method of claim 14 , wherein the pose of the user comprises one or more of a head pose or an eye pose.

16. The computerized method of claim 14 , wherein the operations further comprise:

tracking the pose of the user; and

in response to a change of the pose of the user, automatically reorienting the at least a portion of the content.

17. The computerized method of claim 11 , wherein determining that the resizing of the bounded volume is authorized includes prompting the user, through the display of the HMD system, to authorize the resizing.

18. The computerized method of claim 11 , wherein determining that the resizing of the bounded volume is authorized includes determining that the user authorized all resizing requests during a current interaction session with the HMD system.

19. The computerized method of claim 11 , wherein determining that the resizing of the bounded volume is authorized includes determining that the resizing is within bounds of a previous authorization of the user for resizing of the bounded volume.

20. The computerized method of claim 11 , wherein an initial size of the bounded volume is a predetermined proportion of the user's field of view within the display.

Assignments (4)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073430/0225 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073387/0487 →
SECURITY INTEREST Recorded Feb 7, 2023
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 062681/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2022
From: MAK, GENEVIEVE; FRANCO, DAMIAN; MARCHENKO, ALEKSEI; TARNG, ALFRED YU-CHIH
To: MAGIC LEAP, INC.
Reel/Frame 061963/0937 →
Continuity (3)
Continuation 17110175 · Dec 2, 2020
Provisional Application 62944921 · Dec 6, 2019
Related Publication 20220413681A1 · Dec 29, 2022