IP Library Granted Patent US 9,799,097
Granted Patent B1
US 9,799,097 · App. 15/156,069 · Granted Oct 24, 2017

Method and system for defining a virtual reality resolution distribution

Inventors: Charles Dunn (Astoria, NY); Taher Baderkhan (New York, NY); Vincent Machacek (Brooklyn, NY); Husam Aldalaq (New York, NY); Juan Ferreira (Richmond Hill, NY); Daniel Morton (Elmsford, NY); Moshe Ben-Zacharia (New York, NY)
Assignee: Immersive Enterprises, LLC
G06T3/4092G06F3/012G06F3/013G06T3/005G06T19/006G06T19/20G06T2200/04G06T2200/08G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,799,097
App. No.
15/156,069
Granted
Oct 24, 2017
Kind
B1
Abstract

Aspects of the present disclosure include a method and system for the delivery of virtual reality content that enables a more immersive experience to the user by adaptively changing desired resolution distributions according to a variety of parameters and to create resolution-defined projections. The resolution-defined projections can be two-dimensional and virtual reality content agnostic. According to some aspects, the projections can be used to generate virtual reality content images and video that can be encoded and/or compressed for processing and transmission with lower or without increasing bandwidth requirements, and to be perceived of a higher resolution. Additional aspects may include, the adaptive focus via the resolution-defined projections using the user's viewing direction and/or orientation, system limitations, user vision's constraints, optimization data from a feedback loop and/or crowdsourcing data.

Claims (55)

1. A system for processing and delivering virtual reality content, the system comprising:

one or more computer servers comprising one or more processors and one or more storage devices; and

executable software stored on at least one of the one or more storage devices and executable on demand, the software operative with at least one of the one or more processors to cause the one or more computer servers to:

select one or more sets of parameters affecting a resolution of virtual reality content when inversely projected to a three-dimensional shape;

define a desired resolution distribution using at least one of the selected one or more sets of parameters;

create a two-dimensional bijective resolution-defined projection according to the desired resolution distribution;

map the virtual reality content using the two-dimensional bijective resolution-defined projection;

derive one or more two-dimensional renditions from the virtual reality content mapped to the two-dimensional bijective resolution-defined projection, wherein each of the one or more two-dimensional renditions represents a full sphere of virtual reality content;

access at least one of the one or more two-dimensional renditions; and

cause display, by a display device, an inverse projection of the virtual reality content to a sphere or other three dimensional shape.

2. The system of claim 1 , wherein at least one of the one or more sets of parameters corresponds to virtual reality content capturing set up, and wherein the software is additionally operative with at least one of the one or more processors to cause the one or more computer servers to:

match the resolution of the virtual reality content resulting from the set of parameters corresponding to the virtual content capturing set up to a spatial resolution that can be used to define the desired resolution distribution.

3. The system of claim 2 , wherein the set of parameters corresponding to the virtual content capturing set up comprises one or more of a physical arrangement of image capturing devices, lens properties, or stitching methods.

4. The system of claim 1 , wherein at least one of the one or more sets of parameters corresponds to a virtual reality device, and wherein the software is additionally operative with at least one of the one or more processors to cause the one or more computer servers to:

match the resolution of the virtual reality content resulting from the set of parameters corresponding to the virtual reality device to a spatial resolution that can be used to define the desired resolution distribution.

5. The system of claim 4 , wherein the set of parameters corresponding to the virtual reality device comprises one or more of display specifications, power consumption, connection properties, or processing speeds.

6. The system of claim 1 , wherein at least one of the one or more sets of parameters correspond to a visual capacity of a user, and wherein the software is additionally operative with at least one of the one or more processors to cause the one or more computer servers to:

match the resolution of the virtual reality content resulting from the set of parameters corresponding to the visual capacity of the user to a spatial resolution that can be used to define the desired resolution distribution.

7. The system of claim 6 , wherein the set of parameters corresponding to the visual capacity of the user comprises one or more of a viewing direction, a fovea field of view, eyeball movement, or visual impairments.

8. The system of claim 6 , wherein the set of parameters corresponding to the visual capacity of the user comprises specific visual impairments of the user, and wherein the software is additionally operative with at least one of the one or more processors to cause the one or more computer servers to:

match the resolution of the virtual reality content resulting from the set of parameters corresponding to the specific visual impairments of the user to the spatial resolution that can be used to define the desired resolution distribution, wherein the desired resolution distribution is implemented to correct or provide a therapeutic visual effect to the user.

9. The system of claim 1 , wherein at least one of the one or more sets of parameters corresponds to crowd sourced data, and wherein the software is additionally operative with at least one of the one or more processors to cause the one or more computer servers to:

match the resolution of the virtual reality content resulting from the set of parameters corresponding to the crowdsourced data to a spatial resolution that can be used to define the desired resolution distribution.

10. The system of claim 1 , wherein at least one of the one or more sets of parameters corresponds to feedback loop data defining one or more preferences of a user, and wherein the software is additionally operative with at least one of the one or more processors to cause the one or more computer servers to:

match the resolution of the virtual reality content resulting from the set of parameters corresponding to the feedback loop data defining the one or more preferences of the user to a spatial resolution that can be used to define the desired resolution distribution.

11. The system of claim 1 , wherein at least one of the one or more sets of parameters corresponds to content metrics, and wherein the software is additionally operative with at least one of the one or more processors to cause the one or more computer servers to:

match the resolution of the virtual reality content resulting from the set of parameters corresponding to the content metrics to a spatial resolution that can be used to define the desired resolution distribution.

12. The system of claim 11 , wherein the set of parameters corresponding to the content metrics comprises one or more of virtual reality content contrast, virtual reality content detected movement, or colors contained in the virtual reality content.

13. A computer-implemented method for processing and delivering virtual reality content, the method comprising:

selecting, by a computer system, one or more sets of parameters affecting a resolution of virtual reality content when inversely projected to a three-dimensional shape;

defining, by the computer system, a desired resolution distribution using at least one of the selected one or more sets of parameters;

creating, by the computer system, a two-dimensional bijective resolution-defined projection according to the desired resolution distribution;

mapping, by the computer system, the virtual reality content using the two-dimensional bijective resolution-defined projection;

deriving, by the computer system, one or more two-dimensional renditions from the virtual reality content mapped to the two-dimensional bijective resolution-defined projection, wherein each of the one or more two-dimensional renditions represents a full sphere of virtual reality content;

accessing, by the computer system, at least one of the one or more two-dimensional renditions; and

causing, by the computer system, display on a device an inverse projection of the virtual reality content to a sphere or other three-dimensional shape,

wherein the computer system comprises a computer processor and an electronic storage medium.

14. The method of claim 13 , wherein at least one of the one or more sets of parameters corresponds to a virtual reality content capturing set up, and wherein the method further comprises:

matching, by the computer system, the resolution of the virtual reality content resulting from the set of parameters corresponding to the virtual content capturing set up to a spatial resolution that can be used to define the desired resolution distribution.

15. The method of claim 14 , wherein the set of parameters corresponding to the virtual content capturing set up comprises one or more of a physical arrangement of image capturing devices, lens properties, or stitching methods.

16. The method of claim 13 , wherein at least one of the one or more sets of parameters corresponds to a virtual reality device, and wherein the method further comprises:

matching, by the computer system, the resolution of the virtual reality content resulting from the set of parameters corresponding to the virtual reality device to a spatial resolution that can be used to define the desired resolution distribution.

17. The method of claim 16 , wherein the set of parameters corresponding to the virtual reality device comprises one or more of display specifications, power consumption, connection properties, or processing speeds.

18. The method of claim 13 , wherein at least one of the one or more sets of parameters corresponds to a visual capacity of a user, and wherein the method further comprises:

matching, by the computer system, the resolution of the virtual reality content resulting from the set of parameters corresponding to the visual capacity of the user to a spatial resolution that can be used to define the desired resolution distribution.

19. The method of claim 18 , wherein the set of parameters corresponding to the visual capacity of the user comprises one or more of a viewing direction, a fovea field of view, eyeball movement, or visual impairments.

20. The method of claim 18 , wherein the set of parameters corresponding to the visual capacity of the user comprises specific visual impairments of the user, and wherein the method further comprises:

matching, by the computer system, the resolution of the virtual reality content resulting from the set of parameters corresponding to the specific visual impairments of the user to a spatial resolution that can be used to define the desired resolution distribution, wherein the desired resolution distribution is implemented to correct or provide a therapeutic visual effect to the user.

21. The method of claim 13 , wherein at least one of the one or more sets of parameters corresponds to crowdsourced data, and wherein the method further comprises:

matching, by the computer system, the resolution of the virtual reality content resulting from the set of parameters corresponding to the crowdsourced data to a spatial resolution that can be used to define the desired resolution distribution.

22. The method of claim 13 , wherein at least one of the one or more sets of parameters corresponds to feedback loop data defining one or more preferences of a user, and wherein the method further comprises:

matching, by the computer system, the resolution of the virtual reality content resulting from the set of parameters corresponding to the feedback loop data defining the one or more preferences of the user to a spatial resolution that can be used to define the desired resolution distribution.

23. The method of claim 13 , wherein at least one of the one or more sets of parameters corresponds to content metrics, and wherein the method further comprises:

matching, by the computer system, the resolution of the virtual reality content resulting from the set of parameters corresponding to the content metrics to a spatial resolution that can be used to define the desired resolution distribution.

24. The method of claim 23 , wherein the set of parameters corresponding to the content metrics comprises one or more of virtual reality content contrast, virtual reality content detected movement, or colors contained in the virtual reality content.

Assignments (11)
RELEASE OF SECOND LIEN SECURITY INTEREST IN PATENTS (REEL/FRAME 057335/0908) Recorded Jun 20, 2024
From: UBS AG, STAMFORD BRANCH
To: EAB GLOBAL, INC.; ROYALL & COMPANY, LLC
Reel/Frame 067799/0153 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Aug 27, 2021
From: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
To: YOUVISIT LLC
Reel/Frame 057336/0072 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Aug 27, 2021
From: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT
To: YOUVISIT LLC
Reel/Frame 057336/0079 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Aug 26, 2021
From: EAB GLOBAL, INC.; ROYALL & COMPANY, LLC (F/K/A ROYALL & COMPANY)
To: UBS AG, STAMFORD BRANCH, AS COLLATERAL AGENT
Reel/Frame 057335/0908 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 26, 2021
From: EAB GLOBAL, INC.; ROYALL & COMPANY, LLC (F/K/A ROYALL & COMPANY)
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 057350/0322 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2020
From: YOUVISIT LLC
To: EAB GLOBAL, INC.
Reel/Frame 052098/0413 →
SECURITY INTEREST Recorded Feb 6, 2020
From: YOUVISIT LLC
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 051741/0022 →
SECURITY INTEREST Recorded Feb 6, 2020
From: YOUVISIT LLC
To: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT
Reel/Frame 051741/0062 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2019
From: IMMERSIVE ENTERPRISES, LLC
To: YOUVISIT LLC
Reel/Frame 048710/0568 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2017
From: YOUVISIT LLC
To: IMMERSIVE ENTERPRISES, LLC
Reel/Frame 041868/0081 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2017
From: DUNN, CHARLES; BADERKHAN, TAHER; MACHACEK, VINCENT; ALDALAQ, HUSAM; FERREIRA, JUAN; BEN-ZACHARIA, MOSHE; MORTON, DANIEL
To: YOUVISIT LLC
Reel/Frame 041422/0701 →
Continuity (1)
Continuation 15143424 · Apr 29, 2016