IP Library Granted Patent US 12,093,447
Granted Patent B2
US 12,093,447 · App. 17/575,297 · Granted Sep 17, 2024

Ephemeral artificial reality experiences

Inventors: Alexander Michael Louie (Milpitas, CA); Bernhard Poess (Redmond, WA); Jossie E. Tirado Arroyo (Kenmore, WA); Michal Hlavac (Seattle, WA)
Assignee: META PLATFORMS TECHNOLOGIES, LLC
G06F3/013G06F8/61G06F21/629
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,093,447
App. No.
17/575,297
Granted
Sep 17, 2024
Kind
B2
Abstract

In one embodiment, a method includes instructing sensors on an AR headset to capture data of a real-world environment, discovering a 3D location where a native application configured to run natively on an operating system is downloadable, generating and displaying a virtual object representing the native application at the 3D location, detecting a user of the AR system interacting with the virtual object, downloading a first executable portion of the native application, executing the first executable portion within a sandbox process having a predetermined set of access permissions, progressively downloading a remaining executable portion of the native application while the user is interacting with the executed first executable portion, and in response to a determination that the native application is completely downloaded, installing the native application on the operating system.

Claims (55)

1. A method comprising, by an operating system of an artificial reality (AR) system:

instructing sensors on an AR headset to capture sensor data of a real-world environment;

discovering, based on the sensor data, a 3D location at which a native application configured to run natively on the operating system is downloadable, wherein the 3D location is determined based in part on a user's proximity to a real-world element associated with the native application;

generating and displaying a virtual object to represent the native application at the 3D location;

in response to detecting a user of the AR system interacting with the virtual object, downloading a first executable portion of the native application;

executing the first executable portion within a sandbox process executing on the operating system, the sandbox process comprising a limited set of access permissions predefined by the user of the AR system, wherein the executing first executable portion is restricted by the limited set of access permissions;

progressively downloading a remaining executable portion of the native application while the user is interacting with the executed first executable portion of the native application;

in response to a determination that the native application is completely downloaded, installing the native application on the operating system; and

launching the native application installed on the operating system, wherein the launched native application comprises a full set of access permissions, and the full set of access permissions permits greater access than the limited set of access permissions.

2. The method of claim 1 , wherein the limited set of access permissions for the sandbox process are predefined by the user prior to downloading the first executable portion of the native application.

3. The method of claim 2 , wherein detecting the user of the AR system interacting with the virtual object further comprises:

detecting an eye gaze at the virtual object, wherein the eye gaze is detected for a threshold period of time.

4. The method of claim 1 , wherein detecting the user of the AR system interacting with the virtual object further comprises:

detecting the user pointing at the virtual object, wherein the user pointing is detected for a threshold period of time.

5. The method of claim 1 , wherein detecting the user of the AR system interacting with the virtual object further comprises:

detecting the user approaching the virtual object.

6. The method of claim 1 , wherein the virtual object is offered based on user preferences.

7. The method of claim 6 , wherein the user preferences are determined based on user-defined settings.

8. The method of claim 1 , wherein the virtual object is a glint.

9. A system comprising:

one or more processors; and

one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:

instruct sensors on an artificial reality (AR) headset to capture sensor data of a real-world environment;

discover, based on the sensor data, a 3D location at which a native application configured to run natively on the operating system is downloadable, wherein the 3D location is determined based in part on a user's proximity to a real-world element associated with the native application;

generate and display a virtual object to represent the native application at the 3D location;

in response to detecting a user of an AR system interacting with the virtual object, download a first executable portion of the native application;

execute the first executable portion within a sandbox process executing on the operating system, the sandbox process comprising a limited set of access permissions predefined by the user of the AR system, wherein the executing first executable portion is restricted by the limited set of access permissions;

progressively download a remaining executable portion of the native application while the user is interacting with the executed first executable portion of the native application;

in response to a determination that the native application is completely downloaded, install the native application on the operating system; and

launching the native application installed on the operating system, wherein the launched native application comprises a full set of access permissions, and the full set of access permissions permits greater access than the limited set of access permissions.

10. The system of claim 9 , wherein the limited set of access permissions for the sandbox process are predefined by the user prior to downloading the first executable portion of the native application.

11. The system of claim 10 , wherein detecting the user of the AR system interacting with the virtual object further comprises:

detecting an eye gaze at the virtual object.

12. The system of claim 11 , wherein the eye gaze is detected for a threshold period of time.

13. The system of claim 9 , wherein detecting the user of the AR system interacting with the virtual object further comprises:

detecting the user pointing at the virtual object.

14. The system of claim 13 , wherein the user pointing is detected for a threshold period of time.

15. The system of claim 9 , wherein detecting the user of the AR system interacting with the virtual object further comprises:

detecting the user approaching the virtual object.

16. The system of claim 9 , wherein the virtual object is offered based on user preferences.

17. The system of claim 16 , wherein the user preferences are determined based on user-defined settings.

18. The method of claim 16 , further comprising:

prompting the user, prior to launching the native application, for permissions to launch the full application with the full set of access permissions.

19. The method of claim 18 , wherein,

the first executable portion is implicitly granted the limited set of access permissions via executing the first executable portion within the sandbox process, and

the user is not prompted for additional access permissions beyond the limited set of access permissions prior to executing first executable portion within the sandbox process.

20. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

instruct sensors on an artificial reality (AR) headset to capture sensor data of a real-world environment;

discover, based on the sensor data, a 3D location at which a native application configured to run natively on the operating system is downloadable, wherein the 3D location is determined based in part on a user's proximity to a real-world element associated with the native application;

generate and display a virtual object to represent the native application at the 3D location;

in response to detecting a user of an AR system interacting with the virtual object, download a first executable portion of the native application;

execute the first executable portion within a sandbox process executing on the operating system, the sandbox process comprising a limited set of access permissions predefined by the user of the AR system, wherein the executing first executable portion is restricted by the limited set of access permissions;

progressively download a remaining executable portion of the native application while the user is interacting with the executed first executable portion of the native application;

in response to a determination that the native application is completely downloaded, install the native application on the operating system; and

launching the native application installed on the operating system, wherein the launched native application comprises a full set of access permissions, and the full set of access permissions permits greater access than the limited set of access permissions.

Assignments (2)
CHANGE OF NAME Recorded Jul 6, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060591/0848 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2022
From: LOUIE, ALEXANDER MICHAEL; POESS, BERNHARD; TIRADO ARROYO, JOSSIE E.; HLAVAC, MICHAL
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 059063/0679 →