Light-field viewpoint and pixel culling for a head mounted display device

1. A method, comprising:

identifying a pose of a head mounted display (HMD) device;

identifying, at the HMD device and based on the pose, a plurality of images associated with a light-field representing a scene to be displayed;

identifying, at the HMD device and based on the pose, a subset of a plurality of camera viewpoints of the light-field;

for each of the plurality of images selecting, based on the pose, non-contributing pixels within each image and removing the non-contributing pixels from image data of the light-field to generate a subset of pixels of the plurality of images;

interpolating at the HMD device, the image data of the light-field based on the pose and the subset of pixels to generate an interpolated view; and

displaying at the HMD device an image based on the interpolated view.

2. The method of claim 1 , wherein generating the subset of pixels comprises:

selecting a camera viewpoint from the subset of the plurality of camera viewpoints of the light-field;

tracing a plurality of rays through camera viewpoints of the light-field adjacent to the selected camera viewpoint; and

identifying the subset of pixels based on the plurality of rays.

3. The method of claim 2 , wherein generating the subset of pixels further comprises:

identifying a polygon based on an intersection of the plurality of rays with an image plane of an image corresponding to the selected camera viewpoint;

identifying a plurality of cells for the image; and

identifying the subset of pixels to include cells of the plurality of cells having at least a portion of their area within a perimeter of the polygon.

4. The method of claim 3 , wherein identifying the subset of pixels further comprises:

applying a conservative rasterization process to the polygon and the plurality of cells to identifying the cells having at least a portion of their area within the perimeter of the polygon.

5. The method of claim 1 , further comprising:

interpolating at the HMD device, image data of the light-field based on the pose and the subset of the plurality of camera viewpoints to generate the interpolated view.

6. The method of claim 5 , wherein identifying the subset of the plurality of camera viewpoints further comprises:

identifying a plurality of cells of a camera plane, each of the plurality of cells associated with a corresponding one of the plurality of camera viewpoints;

selecting a subset of the plurality of cells to include cells having an area at least partially within a perimeter of the intersection of a viewing frustum and the camera plane; and

identifying the subset of the plurality of camera viewpoints based on the selected subset of the plurality of cells.

7. The method of claim 6 , wherein selecting the subset of the plurality of cells comprises selecting the subset of the plurality of cells based on a conservative rasterization process applied to the intersection of the viewing frustum and the camera plane.

8. A head mounted display (HMD) device comprising:

a pose detector configured to identify a pose of a head mounted display (HMD) device;

a viewpoint select module configured to identify, based on the pose, a plurality of images associated with a light-field representing a scene to be displayed and a subset of a plurality of camera viewpoints of the light-field;

an image pixel select module configured to select for each of the plurality of images, based on the pose, a plurality of non-contributing pixels within each image and to remove the plurality of non-contributing pixels from image data of the light-field to generate a subset of pixels of the plurality of images;

a graphics processing unit (GPU) configured to interpolate the image data of the light-field based on the pose and the subset of pixels to generate an interpolated view; and

a display panel configured to display an image based on the interpolated view.

9. The HMD device of claim 8 , further comprising:

an application processor to select a camera viewpoint from the plurality of camera viewpoints of the light-field and to trace a plurality of rays through camera viewpoints of the light-field adjacent to the selected camera viewpoint; and

wherein the image pixel select module is configured to generate the subset of pixels based on the plurality of rays.

10. The HMD device of claim 9 , wherein the viewpoint select module is to:

identify a polygon based on an intersection of the plurality of rays with an image plane of an image corresponding to the selected camera viewpoint;

identify a plurality of cells for the image; and

identify the subset of pixels to include cells of the plurality of cells having at least a portion of their area within a perimeter of the polygon.

11. The HMD device of claim 10 , wherein the image pixel select module is to generate the subset of pixels by:

applying a conservative rasterization process to the polygon and the plurality of cells to identifying the cells having at least a portion of their area within the perimeter of the polygon.

12. The HMD device of claim 8 , wherein the GPU is configured to interpolate image data of the light-field based on the pose and the subset of the plurality of camera viewpoints to generate the interpolated view.

13. The HMD device of claim 12 , wherein the viewpoint select module is configured to identify a subset of the plurality of camera viewpoints of the light-field by:

identifying a plurality of cells of a camera plane, each of the plurality of cells associated with a corresponding one of the plurality of camera viewpoints;

selecting a subset of the plurality of cells to include cells having an area at least partially within a perimeter of the intersection of a viewing frustum and the camera plane; and

identifying the subset of the plurality of camera viewpoints based on the selected subset of the plurality of cells.

14. The HMD device of claim 13 , wherein the viewpoint select module is configured to select the subset of the plurality of cells based on a conservative rasterization process applied to the intersection of the viewing frustum and the camera plane.