Method and system for adaptively changing display parameters of virtual reality content
Aspects of the present disclosure include a method and system for the delivery of virtual reality content that enables a more immersive experience to the user by adaptively changing display parameters of virtual reality content using resolution-defined projections. The resolution-defined projections are two-dimensional and virtual reality content agnostic. According to some aspects, the projections can be used to generate virtual reality content images and video that can be encoded and/or compressed for processing and transmission with lower or without increasing bandwidth requirements, and to be perceived of a higher resolution. Additional aspects include, the adaptive focus via the resolution-defined projections using the user's viewing direction and/or orientation, optimization data from a feedback loop and/or crowdsourcing data.
1. A computer-implemented method for adaptively changing one or more display parameters of virtual reality content, the method comprising:
storing, by a computer system in one or more storage devices, virtual reality image data captured by one or more image capturing devices;
retrieving, by the computer system from the one or more storage devices, one or more parameters of one or both of transmission speed of a wireless connection between a server with access to the one or more storage devices storing the virtual reality image data and a virtual reality device of a user requesting the virtual reality image data, and a display of the virtual reality device;
generating, by the computer system, one or more two-dimensional renditions from the virtual reality image data in real-time and according to the one or more retrieved parameters, wherein the one or more two-dimensional renditions are generated at least in part by mapping the virtual reality image data to a two-dimensional bijective resolution-defined projection, wherein each of the one or more two-dimensional renditions represents a full sphere of the virtual reality image data; and
transmitting, by the computer system to the virtual reality device being configured to inversely project the virtual reality image data to a sphere or other three-dimensional shape for display on the virtual reality device, at least a portion of one of the one or more two-dimensional renditions,
wherein the computer system comprises a computer processor and an electronic storage medium.
2. The computer-implemented method of claim 1 , wherein the two-dimensional bijective resolution-defined projection is generated based at least in part on a desired resolution distribution that is modified during playback of the virtual reality image data content according to the one or more retrieved parameters.
3. The computer-implemented method of claim 2 , further comprising: lowering a resolution of said at least the portion of one of the one or more two-dimensional renditions, before transmitting for display on the virtual reality device, to be of a resolution below or at about a maximum displayable resolution, and wherein the maximum displayable resolution is limited by at least one or both of a DPI of the display or a processing power of the virtual reality device.
4. The computer-implemented method of claim 3 , wherein the lowering of the resolution of said at least a portion of the one of the one or more two-dimensional plurality of renditions is a function of the modified desired resolution distribution.
5. The computer-implemented method of claim 3 , further comprising:
changing one or more parameters of at least one of the one or more two-dimensional renditions before transmitting for display on the virtual reality device,
wherein at least one or both of the lowered resolution of said at least the portion of one of the one or more two-dimensional renditions and the changed one or more parameters eliminates buffering as a result of the transmission speed of the wireless connection between the server with access to the one or more storage devices storing the virtual reality image data and the virtual reality device of the user requesting the virtual reality image data.
6. The computer-implemented method of claim 5 , wherein said one or both of lowering the resolution and changing the one or more parameters of the at least one of the one or more two-dimensional renditions is a function of the modified desired resolution distribution.
7. The computer-implemented method of claim 2 , wherein the retrieved one or more parameters comprises information about one or both of an arrangement and a geometry of the one or more image capturing devices used to capture the corresponding virtual reality image data.
8. The computer-implemented method of claim 7 , wherein the information about one or both of the arrangement and the geometry of the one or more image capturing devices used to capture the virtual reality image data is used in generating the one or more two-dimensional renditions.
9. A computer-implemented method for adaptively changing one or more display parameters of virtual reality content, the method comprising:
storing, by a computer system, virtual reality image data captured by one or more image capturing devices;
retrieving, by the computer system, one or more parameters of a display of a virtual reality device;
generating, by the computer system, one or more two-dimensional renditions from the virtual reality image data in real-time and according to the retrieved one or more parameters, wherein the one or more two-dimensional renditions are generated based at least in part by mapping the virtual reality image data to a two-dimensional bijective resolution-defined projection, wherein each of the one or more two-dimensional renditions represents a full sphere of the virtual reality image data;
one or both of adjusting, by the computer system, a resolution at least one of the one or more two-dimensional renditions and changing parameters of at least one of the one or more two-dimensional renditions, before transmitting for display to the virtual reality device, to be of a resolution below or at about a maximum displayable resolution, and wherein the maximum displayable resolution is limited by at least one or both of a DPI of the display or a processing power of the virtual reality device; and
accessing, by the computer system, at least a portion of one of the one or more two-dimensional renditions for inversely projecting the virtual reality image data to a sphere or other three-dimensional shape for display on the virtual reality device,
wherein the computer system comprises a computer processor and an electronic storage medium.
10. The computer-implemented method of claim 9 , wherein the two-dimensional bijective resolution-defined projection is generated based at least in part on a desired resolution distribution that is modified during playback of the virtual reality image data content according to the retrieved one or more parameters.
11. The computer-implemented method of claim 10 , wherein the adjusting of the resolution of said at least one of the one or more two-dimensional renditions is a function of the modified desired resolution distribution.
12. The computer-implemented method of claim 10 , wherein the retrieved one or more parameters comprises information about one or both of an arrangement and a geometry of the one or more image capturing devices used to capture the virtual reality image data.
13. The computer-implemented method of claim 12 , wherein the information about one or both of the arrangement and the geometry of the one or more image capturing devices used to capture the virtual reality image data is used in generating the one or more two-dimensional renditions.
14. A system for processing and delivering virtual reality content, the system comprising:
one or more computer servers comprising one or more processors and one or more storage devices; and
executable software stored on at least one of the one or more storage devices and executable on demand, the software operative with at least one of the one or more processors to cause the one or more computer servers to:
store virtual reality image data captured by one or more image capturing devices on the one or more storage devices;
retrieve one or more parameters of one or both of transmission speed of a connection between the one or more computer servers with access to the one or more storage devices storing the virtual reality image data and a virtual reality device of a user requesting the virtual reality image data, and a display of the virtual reality device;
generate one or more two-dimensional renditions from the virtual reality image data in real-time and according to the retrieved one or more parameters, wherein the one or more two-dimensional renditions are generated at least in part by mapping the virtual reality image data to a two-dimensional bijective resolution-defined projection, wherein each of the one or more two-dimensional renditions represents a full sphere of the virtual reality image data; and
transmit, via the connection, at least a portion of one of one or more two-dimensional renditions to the virtual reality device configured to inversely project the virtual reality image data to a sphere or other three-dimensional shape for display on the virtual reality device.
15. The system of claim 14 , wherein the connection comprises one or both of a wired connection and a wireless connection being configured to enable streaming of the virtual reality image data by the virtual reality device.
16. The system of claim 14 , wherein the two-dimensional bijective resolution-defined projection is based at least in part on a desired resolution distribution that is modified during playback of the virtual reality image data according to the retrieved parameters.
17. The system of claim 16 , wherein the software is additionally operative to further cause the one or more computer servers to:
lower a resolution and/or change one or more parameters of at least one of the one or more two-dimensional renditions, before transmitting for display to the virtual reality device, to be of a resolution below or at about a maximum displayable resolution, and
wherein the maximum displayable resolution is limited by at least one or both of a DPI of the display or a processing power of the virtual reality device.
18. The system of claim 17 , wherein said one or both of lowering the resolution and changing the one or more parameters of the at least one of the one or more two-dimensional renditions is a function of the modified desired resolution distribution.
19. The system of claim 16 , wherein the software is additionally operative to further cause the one or more computer servers to:
lower a resolution and/or change one or more parameters of at least one of the one or more two-dimensional renditions, before transmitting for display to the virtual reality device, to eliminate buffering as a result of transmission speed of a wireless connection between a server with access to the one or more storage devices storing the virtual reality image data and the virtual reality device of the user requesting the virtual reality image data.
20. The system of claim 19 , wherein said one or both of lowering the resolution and changing the one or more parameters of the at least one of the one or more two-dimensional renditions is a function of the modified desired resolution distribution.