Mixed reality system with virtual content warping and method of generating virtual content using same

1. A computer implemented method for warping virtual content, comprising:

receiving rendered virtual content data, the rendered virtual content data including a single far depth wherein the single far depth is the farthest depth of any virtual object in a currently displayed field of view;

receiving movement data indicating a user movement in a direction orthogonal to an optical axis; and

generating warped rendered virtual content data based on the rendered virtual content data, the single far depth, and the movement data,

wherein the rendered virtual content data corresponds to a near virtual object and a far virtual object,

wherein the warped rendered virtual content data corresponds to a warped near virtual object and a warped far virtual object, and

wherein a first position shift between the near virtual object and the warped near virtual object is substantially equal to a second position shift between the far virtual object and the warped far virtual object.

2. The method of claim 1 , wherein generating the warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data reduces a parallax related artifact compared to the rendered virtual content data.

3. The method of claim 2 , wherein the parallax related artifact is a disocclusion artifact.

4. A computer implemented method for warping virtual content, comprising:

receiving rendered virtual content data, the rendered virtual content data including a single far depth wherein the single far depth is the farthest depth of any virtual object in a currently displayed field of view;

receiving movement data indicating a user movement in a direction orthogonal to an optical axis; and

generating warped rendered virtual content data based on the rendered virtual content data, the single far depth, and the movement data,

wherein generating the warped rendered virtual content data based on the rendered virtual content data, the far depth, and the movement data reduces a parallax related artifact compared to the rendered virtual content data,

wherein the parallax related artifact is selected from the group consisting of a smearing artifact and a jitter artifact.

5. A computer implemented method for warping virtual content, comprising:

receiving rendered virtual content data, the rendered virtual content data including a single far depth wherein the single far depth is the farthest depth of any virtual object in a currently displayed field of view;

receiving movement data indicating a user movement in a direction orthogonal to an optical axis; and

generating warped rendered virtual content data based on the rendered virtual content data, the single far depth, and the movement data, wherein the rendered virtual content data corresponds to a first depth segment;

receiving second rendered virtual content data corresponding to a second depth segment, the second rendered virtual content data including a second far depth; and

generating warped second rendered virtual content data based on the second rendered virtual content data, the second far depth, and the movement data.

6. A computer implemented method for warping virtual content, comprising:

receiving rendered virtual content data, the rendered virtual content data including a single far depth, wherein the single far depth is the farthest depth of any virtual object in a currently displayed field of view (FOV) and a single near depth, wherein the single near depth is the nearest depth of any virtual object in the currently displayed FOV;

receiving movement data indicating a user movement in a direction orthogonal to an optical axis; and

generating warped rendered virtual content data based on the rendered virtual content data, the single far depth, the single near depth, and the movement data, wherein the rendered virtual content data corresponds to a first depth segment;

receiving second rendered virtual content data corresponding to a second depth segment, the second rendered virtual content data including a second far depth; and

generating warped second rendered virtual content data based on the second rendered virtual content data, the second far depth, and the movement data.

7. The method of claim 6 , wherein generating warped rendered virtual content data based on the rendered virtual content data, the far depth, the near depth, and the movement data comprises averaging the far depth and the near depth.

8. A computer implemented method for warping virtual content, comprising:

receiving rendered virtual content data;

dividing a depth of the rendered virtual content data into a plurality of discrete depth slices;

receiving movement data indicating a user movement in a direction orthogonal to an optical axis;

receiving gaze data indicating a user gaze;

determining a single depth as being a depth of a discrete depth slice selected based on the gaze data; and

generating warped rendered virtual content data based on the rendered virtual content data, the single depth, and the movement data, wherein the rendered virtual content data corresponds to a first depth segment;

receiving second rendered virtual content data corresponding to a second depth segment, the second rendered virtual content data including a second far depth; and

generating warped second rendered virtual content data based on the second rendered virtual content data, the second far depth, and the movement data.

9. A computer implemented method for warping virtual content, comprising:

receiving rendered virtual content data;

receiving movement data indicating a user movement in a direction orthogonal to an optical axis;

generating mesh data from the rendered virtual content data;

determining depth data from the mesh data;

simplifying one or more rendered virtual objects in the virtual content data into reconstructed meshes of the virtual objects to produce simplified rendered virtual content data including the reconstructed meshes of the virtual objects; and

generating warped rendered virtual content data based on the simplified rendered virtual content data, the mesh data, the depth data, and the movement data.

10. The method of claim 9 , further comprising adjusting a mesh size when generating the mesh data.

11. The method of claim 9 , wherein the mesh data is generated using a grid mesh.

12. The method of claim 9 , wherein the depth data is determined based on a plurality of depths in the mesh and content of the mesh at each of the plurality of depths.