IP Library Granted Patent US 10,438,318
Granted Patent B2
US 10,438,318 · App. 15/251,180 · Granted Oct 8, 2019

Blind spot rendering optimizations for eye tracking head mounted displays

Inventor: Daniel Pohl (Saarbrücken, DE)
Assignee: INTEL IP CORPORATION
G06T3/0012G06F3/013G06T15/005G06T19/006G06T2210/36
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,438,318
App. No.
15/251,180
Granted
Oct 8, 2019
Kind
B2
Abstract

Embodiments described herein provide for blind spot rendering optimizations for eye tracking head mounted displays. One embodiment provides an apparatus comprising first logic to receive eye-tracking data from an eye tracking system, second logic to determine a blind spot region for a scene based on the eye tracking data, and third logic to provide identifying data for the blind spot region to a renderer. The renderer is configured to render pixels of the scene that fall within the blind spot region at a lower rendering quality relative to the remainder of the scene.

Claims (44)

1. An apparatus comprising:

one or more processors to:

receive eye tracking data from an eye tracking system;

determine a blind spot region for each eye for a scene based on the eye tracking data, the blind spot region for each eye corresponding with a region of the scene which, when viewed via a display panel of a head mounted display, is to fall within a blind spot of the eye, wherein the blind spot of the eye is defined by an attachment point of an optic nerve; and

provide identifying data for the blind spot region to a renderer, wherein the renderer is operable to render pixels of the scene, including rendering pixels that fall within the blind spot region at a lower rendering quality relative to other regions of the scene, the renderer further operable to adjust, for lens distortion and aberration, pre-processing quality of areas of the scene that will be viewed through a center of a lens of the head mounted display and reducing quality of areas, including the blind spot region for each eye, that will be blurred by lens distortion.

2. The apparatus as in claim 1 , wherein the one or more processors are further to provide the identifying data for the blind spot region via a bounding region.

3. The apparatus as in claim 1 , wherein the one or more processors are further to provide the identifying data for the blind spot region via a sampling map.

4. The apparatus as in claim 3 , wherein the one or more processors are further to identify one or more sub-regions of the blind spot region via the sampling map.

5. The apparatus as in claim 4 , wherein the renderer is configured to interpolate between the one or more sub-regions of the blind spot region to determine a rendering quality for a pixel within the blind spot region.

6. The apparatus as in claim 1 , wherein the one or more processors are further to determine a center of a visual field for at least one eye based on the eye tracking data.

7. The apparatus as in claim 6 , wherein the one or more processors are further to determine the blind spot region relative to the center of the visual field.

8. The apparatus as in claim 7 , wherein the one or more processors are further to provide identifying data for a foveal region in the center of the visual field to the render and the renderer is to render pixels within the foveal region at a higher rendering quality relative to other regions of the scene.

9. The apparatus as in claim 8 , wherein the one or more processors are further to provide identifying data for one or more sub-regions for the foveal region and the renderer is configured to interpolate between the one or more sub-regions of the foveal region to determine a rendering quality for a pixel within the foveal region.

10. The apparatus as in claim 1 , wherein the renderer includes one or more of a rasterizer module, a ray-tracer module, a multi-resolution shader module, and an anti-aliasing module.

11. A method for rendering a scene for a head mounted display, the method comprising:

receiving eye-tracking data from an eye tracking system;

determining a blind spot region for each eye of a scene based on the eye tracking data, the blind spot region for each eye corresponding with a region of the scene which, when viewed via a display panel of a head mounted display, is to fall within a blind spot of the eye, wherein the blind spot of the eye is defined by an attachment point of an optic nerve;

providing, to a renderer, identifying data for the blind spot region of a scene to be displayed via the head mounted display to a renderer; and

rendering, with the renderer, pixels of the scene, including pixels that fall within the blind spot region at a lower rendering quality relative to other regions of the scene, including adjusting, for lens distortion and aberration, pre-processing quality of areas of the scene that will be viewed through a center of a lens of the head mounted display and reducing quality of areas, including the blind spot region for each eye, that will be blurred by lens distortion.

12. The method as in claim 11 , additionally comprising determining a center of a visual field for at least one eye based on the eye tracking data and providing identifying data for a foveal region in the center of the visual field to the render.

13. The method as in claim 12 , additionally comprising rendering pixels within the foveal region at a higher rendering quality relative to other regions of the scene.

14. The method as in claim 13 , additionally comprising providing, to the renderer, identifying data for one or more sub-regions of the blind spot region and the foveal region, each of the one or more sub-regions identifying a different rendering quality.

15. The method as in claim 14 , additionally comprising outputting a rendered scene to the head mounted display.

16. A system comprising:

a non-transitory machine-readable storage device to store instructions; and

one or more processors to execute the instructions, wherein the instructions cause the one or more processor to perform operations to:

receive eye tracking data from an eye tracking system;

determine a center of a visual field for at least one eye based on the eye tracking data;

determine a blind spot region for each eye for a scene relative to the center of the visual field, the blind spot region for each eye corresponding with a region of the scene which, when viewed via a display panel of a head mounted display, is to fall within a blind spot of the eye, wherein the blind spot of the eye is defined by an attachment point of an optic nerve; and

provide identifying data for the blind spot region to a renderer of the one or more processors;

render pixels of the scene, including pixels that fall within the blind spot region at a lower rendering quality relative to other regions of the scene by, at least in part, adjusting, for lens distortion and aberration, pre-processing quality of areas of the scene that will be viewed through a center of a lens of the head mounted display and reducing quality of areas, including the blind spot region for each eye, that will be blurred by lens distortion.

17. The system as in claim 16 , the instructions to cause the one or more processors to perform additional operations to provide identifying data for a foveal region in the center of the visual field to the render and the renderer is to render pixels within the foveal region at a higher rendering quality relative to other regions of the scene.

18. The system as in claim 17 , the instructions to cause the one or more processors to perform additional operations to provide identifying data for one or more sub-regions of the foveal region and the blind spot region.

19. The system as in clam 18 , wherein the renderer is configured to interpolate between the one or more sub-regions of the foveal region and the blind spot region to determine a rendering quality for a pixel within the foveal region.

20. The system as in claim 19 , wherein the renderer includes one or more of a rasterizer module, a ray-tracer module, a multi-resolution shader module, and an anti-aliasing module.

21. A non-transitory machine-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations for rendering a scene for a head mounted display, the operations comprising:

receiving eye-tracking data from an eye tracking system;

determining a blind spot region for each eye of a scene based on the eye tracking data, the blind spot region for each eye corresponding with a region of the scene which, when viewed via a display panel of a head mounted display, is to fall within a blind spot of the eye, wherein the blind spot of the eye is defined by an attachment point of an optic nerve;

providing, to a renderer, identifying data for the blind spot region of a scene to be displayed via the head mounted display to a renderer; and

rendering, with the renderer, pixels of the scene, including pixels that fall within the blind spot region at a lower rendering quality relative to other regions of the scene, including adjusting, for lens distortion and aberration, pre-processing quality of areas of the scene that will be viewed through a center of a lens of the head mounted display and reducing quality of areas, including the blind spot region for each eye, that will be blurred by lens distortion.

22. The non-transitory machine-readable medium as in claim 21 , the operations additionally comprising determining a center of a visual field for at least one eye based on the eye tracking data and providing identifying data for a foveal region in the center of the visual field to the render.

23. The non-transitory machine-readable medium as in claim 22 , the operations additionally comprising rendering pixels within the foveal region at a higher rendering quality relative to other regions of the scene.

24. The non-transitory machine-readable medium as in claim 23 , the operations additionally comprising providing, to the renderer, identifying data for one or more sub-regions of the blind spot region and the foveal region, each of the one or more sub-regions identifying a different rendering quality.

25. The non-transitory machine-readable medium as in claim 24 , the operations additionally comprising outputting a rendered scene to the head mounted display.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2021
From: INTEL IP CORPORATION
To: INTEL CORPORATION
Reel/Frame 057061/0588 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2021
From: INTEL IP CORPORATION
To: INTEL CORPORATION
Reel/Frame 057254/0415 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2017
From: INTEL CORPORATION
To: INTEL IP CORPORATION
Reel/Frame 041193/0996 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2016
From: POHL, DANIEL
To: INTEL CORPORATION
Reel/Frame 039871/0839 →
Continuity (1)
Related Publication 20180061117A1 · Mar 1, 2018