3D structure engine-based computation platform
A system and method enabling per-user-optimized computing, rendering, and provisioning within virtual worlds. The system comprises a server including memory and at least one processor, the memory storing a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented, and a computing optimization platform configured to store and provide rules for optimizing the computing, rendering and data provisioning to users via user devices. A plurality of connected devices connected to the server via a network provide multi-source data, user input, or combinations thereof, to the persistent virtual world system, updating the virtual replicas. The server retrieves user location, viewing position and orientation from the one or more user devices to determine a user interaction radius, thereby optimizing via the computing optimization platform the relevant computing, rendering and provisioning for the one or more user devices.
1. A system enabling computing, rendering, and provisioning within virtual worlds, the system comprising:
a server system comprising a server computer, the server computer comprising memory and a processor, the server system storing a persistent virtual world system comprising a data structure in which a virtual replica of a corresponding real object is represented, a replica editor configured to model and edit the virtual replica, a computing optimization platform configured to store and provide rules for optimizing computing, rendering and data provisioning for the virtual replica of the persistent virtual world system to a user via a user device, and a distribution platform,
wherein the virtual replica is configured to be updated in response to receiving real-world data from a sensing mechanism about the physical condition or physical environment of the corresponding real object,
wherein the server system optimizes via the computing optimization platform, the computing, rendering and provisioning for the virtual replica for the user device,
wherein the optimizing is performed based on contextual data including micro-contexts and a macro-context,
wherein the micro-contexts comprise user-related data and user interaction radius data,
wherein the macro-context includes location of real-world network equipment and real-world objects in a predefined area and micro contexts for optimizing the virtual replica for the user device, and
wherein the distribution platform is configured to distribute the computing, rendering, and provisioning across edge and cloud based on rules provided by the computing optimization platform.
2. The system of claim 1 , further comprising a plurality of devices configured to capture multi-source data that serves to update the virtual replica, and a fog server comprising memory and at least one processor, the fog server being located in an area proximate to the devices and configured to assist the server system and the devices in the processing of the persistent virtual world system.
3. The system of claim 2 , further comprising a virtual layer abstracting functions between the devices, the server system and the one or more fog servers, the virtual layer comprising the distribution platform.
4. The system of claim 3 , wherein the distribution platform comprises virtual cells configured to be linked with a plurality of physical network resource sources, and wherein two or more virtual cells are configured to be used in combination in order to dynamically allocate resources and engine tasks to the user device as part of the provisioning to the user device.
5. The system of claim 1 , wherein the server system further stores data from the real world captured by sensing mechanisms on the devices; and an operating system configured to manage computer hardware and software resources for performing per-user-optimized computing, rendering and provisioning.
6. The system of claim 1 , wherein the optimizing is performed by the optimization platform on application data of applications positioned in the persistent virtual world system based on interactions with the user, virtual replicas, other applications or virtual objects of the persistent virtual world system.
7. The system of claim 1 , wherein the optimizing is further based on a three dimensional data structure, scene graphs, and preparation for rendering stages.
8. The system of claim 7 , wherein the three-dimensional data structure comprises one or more octrees, quadtrees, BSP trees, sparse voxel octrees, three-dimensional arrays, kD trees, point clouds, wire-frames, boundary representations, constructive solid geometry trees, bintrees, or hexagonal structures, or combinations thereof.
9. The system of claim 1 , wherein the server system retrieves user location, viewing position, and orientation from the user device to determine a user interaction radius.
10. The system of claim 1 , wherein the user-related data comprises user location data, user viewing position and orientation, user social data, user preferences, user service context, or quality of service specific to the user, or a combination thereof, and wherein the user interaction radius data comprises real world objects, virtual objects, or other users within the user interaction radius, or a combination thereof.
11. A method enabling per-user-optimized computing of virtual worlds, the method comprising:
providing in memory of a server system comprising a server computer a persistent virtual world system comprising a data structure in which a virtual replica of a corresponding real object is represented, a replica editor configured to model and edit the virtual replica, a computing optimization platform configured to store and provide rules for optimizing computing, rendering and data provisioning for the virtual replica of the persistent virtual world system to a user via a user device, and a distribution platform, wherein the virtual replica is configured to be updated in response to receiving real-world data from a sensing mechanisms about the physical condition or physical environment of the corresponding real object;
optimizing, via the computing optimization platform, the computing, rendering and provisioning for the at least one virtual replica for the user device,
wherein the optimizing is performed based on contextual data including micro-contexts and a macro-context,
wherein the micro-contexts comprise user-related data and user interaction radius data,
wherein the macro-context includes location of real-world network equipment and real-world objects a predefined area, and micro contexts for optimizing the virtual replica for the user device, and
wherein the distribution platform is configured to distribute the computing, rendering, and provisioning across edge and cloud based on the rules provided by the computing optimization platform.
12. The method of claim 11 , further comprising providing one or more fog servers comprising memory and a processor, the fog servers being located in areas proximate to devices and configured to assist the server system and the devices in the processing of the persistent virtual world system.
13. The method of claim 12 , further comprising providing a virtual layer abstracting functions between the devices, the server system and the one or more fog servers, the virtual layer comprising the distribution platform.
14. The method of claim 13 , wherein the at least one distribution platform comprises virtual cells configured to be linked with a plurality of physical network resource sources, and wherein two or more virtual cells are configured to be used in combination in order to dynamically allocate resources and engine tasks to the user device as part of the provisioning to the user device.
15. The method of claim 11 further comprising providing in the server system data from the real world captured by sensing mechanisms on the devices;
and an operating system configured to manage computer hardware and software resources for performing per-user-optimized computing, rendering and provisioning.
16. The method of claim 11 , wherein the optimizing is performed by the optimization platform on application data of applications positioned in the persistent virtual world system based on interactions with users, virtual replicas, other applications or virtual objects of the persistent virtual world system.
17. The method of claim 11 , wherein the optimizing comprises:
performing three-dimensional data structure optimizations;
performing scene graphs optimizations; and
preparing for rendering stages.
18. The method of claim 11 , further comprising, retrieving, via the server system, user location, viewing position, and orientation from the user device to determine a user interaction radius.
19. The method of claim 17 , wherein preparing for the rendering stages comprises performing depth-culling, frustum culling, high-level occlusion culling, or implementation level-of-detail (LOD) algorithms, or a combination thereof.
20. One or more non-transitory computer-readable media having stored thereon instructions configured to, when executed by one or more computers, cause the one or more computers to:
provide in memory of a server system comprising a server computer a persistent virtual world system comprising a data structure in which a virtual replica of a corresponding real object is represented, a replica editor configured to model and edit the virtual replica, a computing optimization platform configured to store and provide rules for optimizing computing, rendering and data provisioning for the virtual replica of the persistent virtual world system to a user via a user device, wherein the virtual replica is configured to be updated in response to receiving real-world data from a sensing mechanisms about the physical condition or physical environment of the a corresponding real object;
optimize, via the computing optimization platform, the computing, rendering and provisioning for the virtual replica for the user device,
wherein the optimizing is performed based on contextual data including micro-contexts and a macro-context,
wherein the micro-contexts comprise user-related data and user interaction radius data,
wherein the macro-context includes location of real-world network equipment and real-world objects in a predefined area, and micro contexts for optimizing the virtual replica for the user device, and,
wherein the distribution platform is configured to distribute the computing, rendering, and provisioning across the edge and cloud based on rules provided by the computing optimization platform.