IP Library Granted Patent US 11,659,043
Granted Patent B1
US 11,659,043 · App. 17/586,734 · Granted May 23, 2023

Systems and methods for predictively downloading volumetric data

Inventor: Colleen Kelly Henry (Oakland, CA)
Assignee: Meta Platforms Technologies, LLC
H04L67/131G06F3/013G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,659,043
App. No.
17/586,734
Granted
May 23, 2023
Kind
B1
Abstract

A computer-implemented method for predictively downloading volumetric data may include (i) identifying an augmented reality device that (a) downloads volumetric data files representing pre-rendered three-dimensional segments of physical space within an augmented reality environment and (b) displays the augmented reality environment for viewing by a user, (ii) determining, based at least in part on a position of the user within the augmented reality environment, an expected physical space within the augmented reality environment that the user is predicted to view via the augmented reality device, and (iii) preemptively downloading, to the augmented reality device, a volumetric data file representing a pre-rendered three-dimensional segment of the expected physical space. Various other methods, systems, and computer-readable media are also disclosed.

Claims (54)

1. A computer-implemented method comprising:

identifying an augmented reality device that:

downloads volumetric data files representing pre-rendered three-dimensional segments of physical space within an augmented reality environment; and

displays the augmented reality environment for viewing by a user;

determining, based at least in part on a position of the user within the augmented reality environment, an expected physical space within the augmented reality environment that the user is predicted to view via the augmented reality device; and

preemptively downloading, to the augmented reality device, a volumetric data file representing a pre-rendered three-dimensional segment of the expected physical space.

2. The computer-implemented method of claim 1 , wherein:

determining the expected physical space within the augmented reality environment that the user is predicted to view comprises determining, by the augmented reality device, the expected physical space; and

preemptively downloading the volumetric data file comprises preemptively downloading, by the augmented reality device, the volumetric data file.

3. The computer-implemented method of claim 1 , wherein the augmented reality device comprises a headset dimensioned to be worn on the user's head and display the augmented reality environment via a display surface in front of the user's eyes.

4. The computer-implemented method of claim 1 , wherein determining the expected physical space within the augmented reality environment that the user is predicted to view comprises determining that the user is predicted to view the expected physical space within a predetermined window of upcoming time.

5. The computer-implemented method of claim 1 , wherein determining the expected physical space within the augmented reality environment that the user is predicted to view comprises:

monitoring movement of the user through the augmented reality environment; and

predicting, based on the movement, that expected future movement of the user through the augmented reality environment will bring the expected physical space into a field of vision of the user.

6. The computer-implemented method of claim 1 , wherein determining the expected physical space within the augmented reality environment that the user is predicted to view comprises:

monitoring a directionality of a gaze of the user within the augmented reality environment; and

predicting, based on the directionality of the gaze, that an expected future gaze of the user will bring the expected physical space into a field of vision of the user.

7. The computer-implemented method of claim 1 , wherein determining the expected physical space within the augmented reality environment that the user is predicted to view comprises:

determining a viewing distance of the expected physical space relative to a position of the user within the augmented reality environment; and

specifying a quality of the volumetric data file that is correlated to the viewing distance such that a larger, higher-viewing-quality file is correlated with a nearer viewing distance and a smaller, lower-viewing-quality file is correlated with a farther viewing distance.

8. The computer-implemented method of claim 7 , wherein preemptively downloading the volumetric data file comprises downloading a version of the volumetric data file of the specified quality.

9. The computer-implemented method of claim 7 , further comprising:

determining that the viewing distance has decreased; and

in response to determining that the viewing distance has decreased, downloading a higher quality version of the volumetric data file.

10. The computer-implemented method of claim 1 , wherein the augmented reality device comprises limited physical memory such that the limited physical memory is not capable of storing volumetric data files representing the totality of the augmented reality environment.

11. The computer-implemented method of claim 1 , wherein the volumetric data file comprises a combination of pre-rendered content and placeholders for personalized data that is personalized based on the user.

12. The computer-implemented method of claim 1 , further comprising:

detecting that an avatar of the user has entered the expected physical space; and

triggering an event stored in the volumetric data file in response to detecting that the avatar of the user has entered the expected physical space.

13. A computer-implemented method comprising:

identifying, by a media server, an augmented reality device that:

downloads, from the media server, volumetric data files representing pre-rendered three-dimensional segments of physical space within an augmented reality environment; and

displays the augmented reality environment for viewing by a user;

determining, based at least in part on a position of the user within the augmented reality environment, an expected physical space within the augmented reality environment that the user is predicted to view via the augmented reality device; and

preemptively downloading, from the media server to the augmented reality device, a volumetric data file representing a pre-rendered three-dimensional segment of the expected physical space.

14. The computer-implemented method of claim 13 , wherein the media server comprises a home media server that is connected to the augmented reality device via a local area network.

15. The computer-implemented method of claim 13 , wherein the media server comprises a remote media server that is connected to the augmented reality device via the Internet.

16. The computer-implemented method of claim 13 , wherein determining the expected physical space within the augmented reality environment that the user is predicted to view comprises:

monitoring movement of the user through the augmented reality environment; and

predicting, based on the movement, that expected future movement of the user through the augmented reality environment will bring the expected physical space into a field of vision of the user.

17. The computer-implemented method of claim 13 , wherein determining the expected physical space within the augmented reality environment that the user is predicted to view comprises:

monitoring a directionality of a gaze of the user within the augmented reality environment; and

predicting, based on the directionality of the gaze, that an expected future gaze of the user will bring the expected physical space into a field of vision of the user.

18. A system comprising:

an augmented reality device that:

identifies a media server that stores volumetric data files representing pre-rendered three-dimensional segments of physical space within an augmented reality environment;

in response to at least one predetermined trigger, downloads, from the media server, the volumetric data files; and

displays the augmented reality environment for viewing by a user; and a predictive download module that:

determines, based at least in part on a position of the user within the augmented reality environment, an expected physical space within the augmented reality environment that the user is predicted to view via the augmented reality device; and

triggers a download, from the media server to the augmented reality device, of a volumetric data file representing a pre-rendered three-dimensional segment of the expected physical space.

19. The system of claim 18 , wherein the augmented reality device stores the predictive download module.

20. The system of claim 18 , wherein the media server:

comprises a home media server that is connected to the augmented reality device via a local area network; and

stores the predictive download module.

Assignments (2)
CHANGE OF NAME Recorded May 27, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060203/0228 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2022
From: HENRY, COLLEEN KELLY
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 059687/0239 →