IP Library Granted Patent US 11,568,594
Granted Patent B1
US 11,568,594 · App. 17/150,401 · Granted Jan 31, 2023

Systems and methods for providing immersive graphical interfaces

Inventors: Agatha Yick Jun Yu (Oakland, CA); Matthew Alan Scott (Snoqualmie, WA)
Assignee: Meta Platforms Technologies, LLC
G06T15/20G06F3/04815G06F3/04845G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,568,594
App. No.
17/150,401
Granted
Jan 31, 2023
Kind
B1
Abstract

The disclosed computer-implemented method may include (i) associating a planar element within a virtual environment with an alternate virtual environment and (ii) rendering the virtual environment such that (A) the alternate virtual environment is framed within the planar element, (B) at least one rendered element of the alternate virtual environment renders at a distal depth beyond a proximal depth of the planar element within the virtual environment, and (C) altering a viewpoint within the virtual environment relative to a position of the planar element within the virtual environment produces a parallax effect between the virtual environment and the rendered element of the alternate virtual environment due at least in part to the rendered element of the alternate virtual environment being rendered at the distal depth beyond the proximal depth of the planar element within the virtual environment. Various other methods, systems, and computer-readable media are also disclosed.

Claims (53)

1. A computer-implemented method comprising:

associating a virtual planar element within a virtual environment, the virtual environment comprising a three-dimensional model and a graphical user interface, with an alternate virtual environment comprising a different three-dimensional model, wherein the virtual planar element represents a virtual interface element of the virtual environment and comprises an element of the graphical user interface;

rendering, relative to a viewpoint of a user, a view of the virtual environment and a view of the alternate virtual environment such that:

the view of the alternate virtual environment is framed within the virtual planar element within the view of the virtual environment such that the virtual planar element within the virtual environment displays the view of the alternate virtual environment;

at least one rendered element of the alternate virtual environment renders at a distal depth beyond a proximal depth of the virtual planar element within the virtual environment; and

altering the viewpoint of the user within the virtual environment relative to the view of the alternate virtual environment produces a parallax effect between the virtual environment and the rendered element of the alternate virtual environment;

identifying an association between the virtual planar element and the alternate virtual environment;

receiving, via the graphical user interface, an input directed to the virtual planar element; and

performing, in response to identifying the association between the virtual planar element and receiving of the input, an action relating to a virtual reality application that comprises the alternate virtual environment.

2. The computer-implemented method of claim 1 , wherein rendering the virtual environment comprises rendering the virtual environment within a virtual reality system.

3. The computer-implemented method of claim 1 , wherein performing the action comprises replacing the virtual environment with the alternate virtual environment.

4. The computer-implemented method of claim 1 , wherein rendering the virtual environment further comprises rendering the virtual environment such that altering the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment reveals a portion of the virtual environment otherwise obscured by the virtual planar element.

5. The computer-implemented method of claim 1 , wherein altering the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment comprises altering the viewpoint within the virtual environment.

6. The computer-implemented method of claim 1 , wherein altering the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment comprises altering the position of the virtual planar element within the virtual environment.

7. The computer-implemented method of claim 1 , further comprising:

receiving, via a virtual reality interface, an input to manipulate the virtual planar element; and

altering the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment by manipulating the virtual planar element in response to the input.

8. The computer-implemented method of claim 7 , wherein receiving the input to manipulate the virtual planar element comprises at least one of:

an input to manually grasp the virtual planar element; or

a hand movement after manually grasping the virtual planar element.

9. The computer-implemented method of claim 1 , wherein receiving, via the graphical user interface, the input directed to the virtual planar element comprises receiving a user hand movement as the user interacts with at least one of the virtual environment or the alternate virtual environment.

10. The computer-implemented method of claim 1 , wherein rendering, relative to the viewpoint of the user, the view of the virtual environment and the view of the alternate virtual environment further comprises rendering a virtual hand controlled by hand movements of the user.

11. A system comprising:

an association module, stored in memory, that associates a virtual planar element within a virtual environment, the virtual environment comprising a three-dimensional model and a graphical user interface, with an alternate virtual environment comprising a different three-dimensional model, wherein the virtual planar element represents a virtual interface element of the virtual environment and comprises an element of the graphical user interface;

a rendering module, stored in memory, that renders, relative to a viewpoint of a user, a view of the virtual environment and a view of the alternate virtual environment such that:

the view of the alternate virtual environment is framed within the virtual planar element within the view of the virtual environment such that the virtual planar element within the virtual environment displays the view of the alternate virtual environment; and

at least one rendered element of the alternate virtual environment renders at a distal depth beyond a proximal depth of the virtual planar element within the virtual environment; and

altering the viewpoint of the user within the virtual environment relative to the view of the alternate virtual environment produces a parallax effect between the virtual environment and the rendered element of the alternate virtual environment;

an input module, stored in memory, that:

identifies an association between the virtual planar element and the alternate virtual environment;

receives, via the graphical user interface, an input directed to the virtual planar element; and

performs, in response to identifying the association between the virtual planar element and receiving of the input, an action relating to a virtual reality application that comprises the alternate virtual environment;

at least one physical processor that executes the association module, the rendering module, and the input module.

12. The system of claim 11 , wherein the rendering module renders the virtual environment within a virtual reality system.

13. The system of claim 11 , wherein the interface module performs the action by replacing the virtual environment with the alternate virtual environment.

14. The system of claim 11 , wherein the rendering module further renders the virtual environment such that altering the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment reveals a portion of the virtual environment otherwise obscured by the virtual planar element.

15. The system of claim 11 , wherein altering the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment comprises altering the viewpoint within the virtual environment.

16. The system of claim 11 , wherein altering the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment comprises altering the position of the virtual planar element within the virtual environment.

17. The system of claim 11 , further comprising an interface module that:

receives, via a virtual reality interface, an input to manipulate the virtual planar element; and

alters the viewpoint within the virtual environment relative to a position of the virtual planar element within the virtual environment by manipulating the virtual planar element in response to the input.

18. The system of claim 11 , wherein the input module receives, via the graphical user interface, the input directed to the virtual planar element by receiving a user hand movement as the user interacts with at least one of the virtual environment or the alternate virtual environment.

19. The system of claim 11 , wherein the rendering module renders, relative to the viewpoint of the user, the view of the virtual environment and the view of the alternate virtual environment by further rendering a virtual hand controlled by hand movements of the user.

20. A non-transitory computer-readable medium comprising:

computer-readable instructions that, when executed by at least one processor of a computing device, cause the computing device to:

associate a virtual planar element within a virtual environment, the virtual environment comprising a three-dimensional model and a graphical user interface, with an alternate virtual environment comprising a different three-dimensional model, wherein the virtual planar element represents a virtual interface element of the virtual environment and comprises an element of the graphical user interface;

render, relative to a viewpoint of a user, a view of the virtual environment and a view of the alternate virtual environment such that:

the view of the alternate virtual environment is framed within the virtual planar element within the view of the virtual environment such that the virtual planar element within the virtual environment displays the view of the alternate virtual environment;

at least one rendered element of the alternate virtual environment renders at a distal depth beyond a proximal depth of the virtual planar element within the virtual environment; and

altering the viewpoint of the user within the virtual environment relative to the view of the alternate virtual environment produces a parallax effect between the virtual environment and the rendered element of the alternate virtual environment;

identify an association between the virtual planar element and the alternate virtual environment;

receive, via the graphical user interface, an input directed to the virtual planar element; and

perform, in response to identifying the association between the virtual planar element and receiving of the input, an action relating to a virtual reality application that comprises the alternate virtual environment.

Assignments (3)
CHANGE OF NAME Recorded May 27, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060203/0228 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2021
From: YU, AGATHA YICK JUN; SCOTT, MATTHEW ALAN
To: OCULUS VR, LLC
Reel/Frame 056694/0946 →
CHANGE OF NAME Recorded Jun 29, 2021
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056701/0997 →