IP Library Granted Patent US 10,433,025
Granted Patent B2
US 10,433,025 · App. 15/592,185 · Granted Oct 1, 2019

Virtual reality resource scheduling of process in a cloud-based virtual reality processing system

Inventors: Anatoly D. Adamov (Palo Alto, CA); Arthur Van Hoff (Menlo Park, CA); Christopher P. Redmann (San Mateo, CA); Aleksandr O. Ryzhov (Los Gatos, CA)
H04N21/6587A63F13/30G06F3/011H04L67/10H04L67/38H04N21/00H04N21/2393H04N21/47202H04N5/23238
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,433,025
App. No.
15/592,185
Granted
Oct 1, 2019
Kind
B2
Abstract

Systems and methods are disclosed to receive a request for a virtual reality render project that includes information specifying virtual reality video data to be used to create a virtual reality render; determine a plurality of virtual reality jobs required to create the virtual reality render from the virtual reality video data; determine the availability of a plurality of virtual reality nodes across the network; create a virtual reality render map that specifies a processing sequence of the plurality of virtual reality jobs across the one or more virtual reality nodes to create the virtual reality render, the virtual reality render map being created based on at least the availability of the plurality of virtual reality nodes; and process the plurality of virtual reality jobs at the plurality of virtual reality nodes to create the virtual reality.

Claims (39)

1. A method comprising:

receiving a request for a render project that includes information specifying three-dimensional video data to be used to create a render, the information including a segment, a storage location of the segment, a storage location of initial video data, two or more cameras used to record the initial video data, a geometry of each of the two or more cameras used to record the initial video data, a format of the render, a geometry of the render, a time frame of the initial video data, a project identifier, and a priority of the render;

determining a plurality of jobs required to create the render from the three-dimensional video data;

determining an availability of a plurality of nodes across a network;

creating a render map that specifies a processing sequence of the plurality of jobs across the plurality of nodes to create the render, the render map being created based on at least the availability of the plurality of nodes; and

processing the plurality of jobs at the plurality of nodes to create three-dimensional content.

2. The method according to claim 1 , wherein at least some of the plurality of the jobs are processed in parallel at a same time.

3. The method according to claim 1 , wherein the plurality of nodes are distributed across the Internet.

4. The method according to claim 1 , wherein the plurality of nodes include a plurality of cloud-based storage locations where portions of the three-dimensional video data are stored and/or a plurality of graphics processing units.

5. The method according to claim 1 , wherein the three-dimensional content includes virtual reality content, augmented reality content, mixed reality content, or XR content.

6. The method according to claim 1 , wherein the request further includes metadata and the information further specifies one or more characteristics of the render.

7. The method according to claim 1 , further comprising determining a priority of the render project in relation to one or more other render projects, and wherein the creating the render map is based on the priority of the render project.

8. The method according to claim 1 , further comprising determining a cost associated with one or more of the plurality of nodes, and wherein creating the render map is based on the cost.

9. The method according to claim 1 , wherein the map specifies which of the plurality of nodes that will execute each of the plurality of jobs.

10. A cloud-based virtual reality content processing system comprising:

a network;

a plurality of processing servers communicatively coupled with the network; and

a processing schedule server communicatively coupled with network,

wherein the processing schedule server is configured to:

receive a request for a render project to be created from three-dimensional video data, the request including a segment, a storage location of the segment, a storage location of initial video data, two or more cameras used to record the initial video data, a geometry of each of the two or more cameras used to record the initial video data, a format of the render, a geometry of the render, a time frame of the initial video data, a project identifier, and a priority of the render;

determine a plurality of processing jobs required to create the render from the three-dimensional video data;

determine an availability of the plurality of the processing servers;

create a render map that specifies a processing sequence of the plurality of processing jobs across the plurality of the processing servers to create the render, the render map being created based on at least the availability of a plurality of nodes; and

instruct the plurality of the processing servers to execute the render map at the plurality of the processing servers.

11. The cloud-based content processing system according to claim 10 , wherein the processing schedule server is further configured to store the render after it is created by the plurality of the processing servers.

12. The cloud-based content processing system according to claim 10 , wherein the plurality of processing servers are distributed across the Internet.

13. The cloud-based content processing system according to claim 10 , wherein the processing schedule server is further configured to determine a priority of the render project in relation to one or more other render projects, and wherein the creating the render map is based on the priority of the render project.

14. The cloud-based content processing system according to claim 10 , wherein the processing schedule server is further configured to determine a cost associated with one or more of the plurality of nodes, and wherein the creating the render map is based on the cost.

15. The cloud-based content processing system according to claim 10 , further comprising a plurality of cloud-based storage locations where portions of the three-dimensional video data are stored.

16. The cloud-based content processing system according to claim 10 , wherein the processing schedule server is further configured to process the plurality of jobs at the plurality of nodes to create three-dimensional content and the three-dimensional content includes virtual reality content, augmented reality content, mixed reality content, or XR content.

17. The cloud-based content processing system according to claim 10 , wherein the request includes metadata specifying one or more characteristics of the render.

18. A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving a request for a render project that includes information specifying three-dimensional video data to be used to create a render, the information including a segment, a storage location of the segment, a storage location of initial video data, two or more cameras used to record the initial video data, a geometry of each of the two or more cameras used to record the initial video data, a format of the render, a geometry of the render, a time frame of the initial video data, a project identifier, and a priority of the render;

determining a plurality of jobs required to create the render from the three-dimensional video data;

determining an availability of a plurality of nodes across a network;

creating a render map that specifies a processing sequence of the plurality of jobs across the plurality of nodes to create the render, the render map being created based on at least the availability of the plurality of nodes; and

processing the plurality of jobs at the plurality of nodes to create three-dimensional content.

19. The computer storage medium of claim 18 , wherein the plurality of nodes include a plurality of cloud-based storage locations where portions of the three-dimensional video data are stored and/or a plurality of graphics processing units.

20. The computer storage medium of claim 18 , wherein the three-dimensional content includes virtual reality content, augmented reality content, mixed reality content, or XR content.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2025
From: VERIZON PATENT AND LICENSING INC.
To: HOLO-LIGHT GMBH
Reel/Frame 072700/0368 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 2, 2019
From: JAUNT, INC.
To: VERIZON PATENT AND LICENSING INC.
Reel/Frame 050602/0853 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2019
From: ADAMOV, ANATOLY D.; VAN HOFF, ARTHUR; REDMANN, CHRISTOPHER P.; RYZHOV, ALEKSANDR O.
To: JAUNT INC.
Reel/Frame 050054/0490 →
Continuity (4)
Provisional Application 62334223 · May 10, 2016
Provisional Application 62334238 · May 10, 2016
Provisional Application 62334271 · May 10, 2016
Related Publication 20170330365A1 · Nov 16, 2017