IP Library Granted Patent US 10,713,845
Granted Patent B2
US 10,713,845 · App. 16/363,179 · Granted Jul 14, 2020

Three-dimensional modelling with improved virtual reality experience

Inventors: Otso Makinen (Helsinki, FI); Antti Hatala (Helsinki, FI); Hannu Saransaari (Helsinki, FI); Jarno Muurimaki (Helsinki, FI); Jasin Bushnaief (Helsinki, FI); Johann Muszynski (Helsinki, FI); Mikko Pulkki (Helsinki, FI); Niilo Jaba (Helsinki, FI); Otto Laulajainen (Espoo, FI); Turkka Aijala (Helsinki, FI); Vinh Truong (Espoo, FI)
Assignee: Umbra Software Oy
G06T19/003A63F13/213A63F13/355A63F13/358A63F13/63A63F13/837G06F3/011G06F3/017G06F3/04815G06F3/14G06T3/4092G06T15/005G06T15/08G06T15/205G06T15/50G06T15/506G06T17/00G06T17/005G06T19/20G09G5/006H04L67/38H04N21/4312H04N21/47A63F2300/8082G06T19/006G06T2200/04G06T2200/16G06T2210/36G06T2210/61G09G2350/00G09G2370/022G09G2370/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,713,845
App. No.
16/363,179
Granted
Jul 14, 2020
Kind
B2
Abstract

A cloud network server system, a method, and a software program product for experiencing a three-dimensional (3D) model are provided. 3D model data associated with a 3D video game is uploaded to the cloud network server system. The system and method are used to design for example a computer game that renders non-spatial characteristics such as, smell, reflection and/or refraction of light, wind direction, sound reflection, etc., along with spatial and visibility information associated with 3D objects displayed in the 3D video game. Different versions of the 3D model are created based on memory, streaming bandwidth, and/or processing power requirements of different user terminal computers. Based on a virtual location of a user in the 3D model, parts of at least one version of the 3D model are rendered to the user.

Claims (48)

1. A method for experiencing a three-dimensional graphical computer model, comprises at least one distributed cloud network server system comprising a plurality of servers, at least one model upload computer and at least one user terminal computer, wherein,

the three-dimensional graphical computer model data is uploaded to the cloud network from the at least one model upload computer,

the three-dimensional graphical computer model is composed from the data and is spatially subdivided into an octree data structure of cells, wherein higher nodes in the octree data structure fill larger regions in space and have less detailed computational parameters,

a user connects to the cloud network with the at least one user terminal computer installed with an application configured for viewing the three-dimensional graphical computer model from said cloud server network,

based on a virtual location of the user within the three-dimensional graphical computer model, active tree nodes of the octree data structure are traversed and objects in the octree data structure that are optimized for a selected viewing distance from the virtual location are prioritized for streaming to the at least one user terminal computer and are displayed on a screen of the at least one user terminal computer to the user, and

additional non-spatial information is included with spatial and visibility information of the three-dimensional graphical computer model.

2. A method as claimed in claim 1 , wherein said additional non-spatial information included with the spatial information of the three-dimensional graphical computer model comprises any of the following: reflectance and/or refractance attributes of light at a particular location in the three-dimensional graphical computer model, reflectance of sound at a particular location in the three-dimensional graphical computer model, smell, temperature, wind, quantity of natural light at a certain time and/or air speed.

3. A method as claimed in claim 1 , wherein parts of the three-dimensional graphical computer model and associated non-spatial information are streamed to the application on said at least one user terminal computer.

4. A method as claimed in claim 3 , wherein said streaming prioritises the cell the user is currently in, or cells that are visible from the cell that the user is currently in, or are near the cell the user is currently in.

5. A method as claimed in claim 4 , wherein the complexity of the three-dimensional graphical computer model is adjusted based on the available streaming bandwidth to the at least one user terminal computer and/or memory and/or processing power of said at least one user terminal computer.

6. A method as claimed in claim 5 , wherein different versions of different sizes are created from the three-dimensional graphical computer model for different bandwidth, memory and/or processing power environments.

7. A method as claimed in claim 6 , wherein the plurality of different versions of the three-dimensional graphical computer model are hosted in the cloud network server system.

8. A method as claimed in claim 1 , wherein the cells are connected by portals that appear as doors or corridors in the three-dimensional graphical computer model.

9. A method as claimed in claim 1 , wherein the three-dimensional graphical computer model is a voxel grid with portal graphs.

10. A method as claimed in claim 1 , wherein the at least one user terminal computer is a mobile terminal computer, including one or more of a tablet or mobile phone, and wherein the viewing application is a virtual reality software application.

11. A method as claimed in claim 1 , wherein an information structure of the three-dimensional graphical computer model in the model upload computer and cloud server network can be transferred to and preserved in multiple different user applications using said three-dimensional graphical computer model.

12. A software program product stored on a non-transitory computer readable medium for providing a three-dimensional graphical computer model is executable in at least one distributed cloud network server system comprising a plurality of servers, at least one model upload computer and at least one user terminal computer, wherein,

three-dimensional graphical computer model data is configured to be uploaded to the cloud network from the at least one model upload computer,

the three-dimensional graphical computer model is configured to be composed from the data and is spatially subdivided into an octree data structure of cells, wherein higher nodes in the octree data structure fill larger regions in space and have less detailed computational parameters,

a user connects to the cloud network with the at least one user terminal computer installed with an application configured for viewing the three-dimensional graphical computer model from said cloud server network,

based on a virtual location of the user within the three-dimensional graphical computer model, active tree nodes of the octree data structure are traversed and objects in the octree data structure that are optimized for a selected viewing distance from the virtual location is sent are prioritized for streaming to the at least one user terminal computer and are displayed on a screen of the at least one user terminal computer to the user, and

additional non-spatial information is included with spatial and visibility information of the three-dimensional graphical computer model.

13. A software program product as claimed in claim 12 , wherein said additional non-spatial information included with the spatial information of the three-dimensional graphical computer model comprises any of the following: reflectance and/or refractance attributes of light at a particular location in the three-dimensional graphical computer model, reflectance of sound at a particular location in the three-dimensional graphical computer model, smell, temperature, wind, quantity of natural light at a certain time and/or air speed.

14. A software program product as claimed in claim 12 , wherein parts of the three-dimensional graphical computer model and associated non-spatial information are streamed to the application on said at least one user terminal computer.

15. A software program product as claimed in claim 14 , wherein said streaming prioritises the cell the user is currently in, or cells that are visible from the cell that the user is currently in, or are near the cell the user is currently in.

16. A software program product as claimed in claim 15 , wherein the complexity of the three-dimensional graphical computer model is adjusted based on the available streaming bandwidth to the at least one user terminal computer and/or memory and/or processing power of said at least one user terminal computer.

17. A software program product as claimed in claim 16 , wherein different versions of different sizes are created from the three-dimensional graphical computer model for different bandwidth, memory and/or processing power environments.

18. A software program product as claimed in claim 17 , wherein the plurality of different versions of the three-dimensional graphical computer model are hosted in the cloud network server system.

19. A software program product as claimed in claim 12 , wherein the cells are connected by portals that appear as doors or corridors in the three-dimensional graphical computer model.

20. A software program product as claimed in claim 12 , wherein the three-dimensional graphical computer model is a voxel grid with portal graphs.

21. A software program product as claimed in claim 12 , wherein the at least one user terminal computer is a mobile terminal computer, including one or more of a tablet or mobile phone, and wherein the viewing application is a virtual reality software application.

22. A software program product as claimed in claim 12 , wherein the information structure of the three-dimensional graphical computer model in the model upload computer and cloud server network can be transferred to and preserved in multiple different user applications using said three-dimensional graphical computer model.

23. A cloud server network system for providing a three-dimensional graphical computer comprising a plurality of servers, at least one model upload computer and at least one user terminal computer, wherein,

three-dimensional graphical computer model data is configured to be uploaded to the cloud network from the at least one model upload computer,

the three-dimensional graphical computer model is configured to be composed from the data and is spatially subdivided into an octree data structure of cells, wherein higher nodes in the octree data structure fill larger regions in space and have less detailed computational parameters,

a user is configured to connect to the cloud network with the at least one user terminal computer installed with an application configured for viewing the three-dimensional graphical computer model from said cloud server network,

based on a virtual location of the user within the three-dimensional graphical computer model, active tree nodes of the octree data structure are traversed and objects in the octree data structure that are optimized for a selected viewing distance from the virtual location are prioritized for streaming to the at least one user terminal computer and are configured to be displayed on a screen of the at least one user terminal computer to the user, and

additional non-spatial information is included with spatial and visibility information of the three-dimensional graphical computer model.

24. A cloud server network system as claimed in claim 23 , wherein said additional non-spatial information included with the spatial information of the three-dimensional graphical computer model is configured to comprise any of the following: reflectance and/or refractance attributes of light at a particular location in the three-dimensional graphical computer model, reflectance of sound at a particular location in the three-dimensional graphical computer model, smell, temperature, wind, quantity of natural light at a certain time and/or air speed.

25. A cloud server network system as claimed in claim 23 , wherein parts of the three-dimensional graphical computer model and associated non-spatial information are configured to be streamed to the application on said at least one user terminal computer.

26. A cloud server network system as claimed in claim 25 , wherein said streaming is configured to prioritise the cell the user is currently in, or cells that are visible from the cell that the user is currently in, or are near the cell the user is currently in.

27. A cloud server network system as claimed in claim 26 , wherein the complexity of the three-dimensional graphical computer model is configured to be adjusted based on the available streaming bandwidth to the at least one user terminal computer and/or memory and/or processing power of said at least one user terminal computer.

28. A cloud server network system as claimed in claim 27 , wherein different versions of different sizes are configured to be created from the three-dimensional graphical computer model for different bandwidth, memory and/or processing power environments.

29. A cloud server network system as claimed in claim 28 , wherein the plurality of different versions of the three-dimensional graphical computer model is configured to be hosted in the cloud network server system.

30. A cloud server network system as claimed in claim 23 , wherein the cells are configured to be connected by portals that may appear as doors or corridors in the three-dimensional graphical computer model.

31. A cloud server network system as claimed in claim 23 , wherein the three-dimensional graphical computer model is configured as a voxel grid with portal graphs.

32. A cloud server network system as claimed in claim 23 , wherein the at least one user terminal computer is configured to be a mobile terminal computer, including one or more of a tablet or mobile phone, and wherein the viewing application is configured to be a virtual reality software application.

33. A cloud server network system as claimed in claim 23 , wherein the information structure of the three-dimensional graphical computer model in the model upload computer and cloud server network is configured to be transferred to and preserved in multiple different user applications using said three-dimensional graphical computer model.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2024
From: A9.COM, INC.
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 069167/0493 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2022
From: UMBRA SOFTWARE OY
To: A9.COM, INC.
Reel/Frame 059919/0971 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2019
From: MAKINEN, OTSO; HATALA, ANTTI; SARANSAARI, HANNU; MUURIMAKI, JARNO; BUSHNAIEF, JASIN; MUSZYNSKI, JOHANN; PULKKI, MIKKO; JABA, NIILO; LAULAJAINEN, OTTO; AIJALA, TURKKA; TRUONG, VINH
To: UMBRA SOFTWARE OY
Reel/Frame 048687/0400 →
Continuity (5)
Continuation 15415130 · Jan 25, 2017
Provisional Application 62316180 · Mar 31, 2016
Provisional Application 62315866 · Mar 31, 2016
Provisional Application 62351119 · Jun 16, 2016
Related Publication 20190221038A1 · Jul 18, 2019