IP Library › Granted Patent US 10,878,614

Granted Patent B2

US 10,878,614 · App. 16/173,722 · Granted Dec 29, 2020

Motion biased foveated renderer

Inventors: Prasoonkumar Surti (Folsom, CA); Karthik Vaidyanathan (Berkeley, CA); Atsuo Kuwahara (Hillsboro, OR); Hugues Labbe (Folsom, CA); Sameer KP (Bangalore, IN); Jonathan Kennedy (Bristol, GB); Joydeep Ray (Folsom, CA); Travis T. Schluessler (Hillsboro, OR); John H. Feit (Folsom, CA); Nikos Kaburlasos (Lincoln, CA); Jacek Kwiatkowski (Santa Clara, CA); Tomer Bar-On (Petah Tikva, IL); Carsten Benthin (Voelklingen, DE); Adam T. Lake (Portland, OR); Vasanth Ranganathan (El Dorado Hills, CA); Abhishek R. Appu (El Dorado Hills, CA)

Assignee: Intel Corporation

G06T15/08 G02B27/017 G06K9/00604 G06K9/00765 G06T15/005 G06T15/10 G06T15/60 H04N5/23212 H04N5/3696 H04N13/239 H04N13/344 G06T2200/24

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 10,878,614
App. No.: 16/173,722
Granted: Dec 29, 2020
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

An embodiment of an electronic processing system may include an application processor, persistent storage media communicatively coupled to the application processor, a graphics subsystem communicatively coupled to the application processor, a sense engine communicatively coupled to the graphics subsystem to provide sensed information, a focus engine communicatively coupled to the sense engine and the graphics subsystem to provide focus information, a motion engine communicatively coupled to the sense engine, the focus engine, and the graphics subsystem to provide motion information, and a motion biased foveated renderer communicatively coupled to the motion engine, the focus engine, the sense engine to adjust one or more parameters of the graphics subsystem based on one or more of the sense information, the focus information, and the motion information. Other embodiments are disclosed and claimed.

Claims (84)

1. An electronic processing system, comprising:

an application processor;

persistent storage media communicatively coupled to the application processor;

a graphics subsystem communicatively coupled to the application processor;

a sense engine communicatively coupled to the graphics subsystem to provide sensed information;

a focus engine communicatively coupled to the sense engine and the graphics subsystem to provide focus information;

a motion engine communicatively coupled to the sense engine, the focus engine, and the graphics subsystem to provide motion information; and

a motion biased foveated renderer communicatively coupled to the motion engine, the focus engine, and the sense engine to adjust one or more parameters of the graphics subsystem based on one or more of the sensed information, the focus information, or the motion information, wherein the motion biased foveated renderer is to:

predict a future focus area of a user based on a motion vector of an object, wherein the object is to be rendered as part of a frame,

identify a head motion vector associated with a movement of a head of the user, wherein the head motion vector is to be along a first direction,

identify an eye motion vector associated with an eye of the user, wherein the eye motion vector is to be along a second direction that is to be different from the first direction,

determine a shape of a foveated area based on the first and second directions to enlarge the foveated area in the first and second directions, wherein the foveated area is to be associated with the frame, and

determine one or more of a size of the foveated area, a position of the foveated area or the shape of the foveated area based on the future focus area.

2. The system of claim 1 , wherein the motion biased foveated renderer is to:

predict the future focus area based on a current gaze area of the user,

cause the frame to be generated based on the foveated area and the future focus area at a time after the future focus area is predicted, and

determine the size and the shape of the foveated area based on the future focus area.

3. The system of claim 1 , wherein the motion biased foveated renderer is to:

determine the size of the foveated area based on the head motion vector and the eye motion vector.

4. The system of claim 3 , wherein the motion biased foveated renderer is to:

identify that the head motion vector is oriented along the first direction, and

identify that the eye motion vector is oriented along the second direction, wherein the first and second directions are opposite each other.

5. The system of claim 1 , wherein the motion biased foveated renderer is to predict the future focus area based on one or more of an acceleration of a gaze of the user or a velocity of the gaze.

6. The system of claim 1 , wherein the motion biased foveated renderer is to determine the shape of the foveated area based on the motion vector of the object so that the foveated area is to intersect with a motion of the object,

wherein the object is a virtual object.

7. An apparatus comprising:

a memory; and

logic communicatively coupled to the memory, wherein the logic is implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, the logic communicatively coupled to the memory to:

adjust one or more parameters of a graphics subsystem based on motion information;

predict a future focus area of a user based on a motion vector of an object, wherein the object is to be rendered as part of a frame;

identify a head motion vector associated with a movement of a head of the user, wherein the head motion vector is to be along a first direction;

identify an eye motion vector associated with an eye of the user, wherein the eye motion vector is to be along a second direction that is to be different from the first direction;

determine one or more of a size of the foveated area, a position of the foveated area or the shape of the foveated area based on the future focus area.

8. The apparatus of claim 7 , wherein the logic coupled to the memory is to:

predict the future focus area based on a current gaze area of the user;

cause the frame to be generated based on the foveated area and the future focus area at a time after the future focus area is predicted; and

determine the size and the shape of the foveated area based on the future focus area.

9. The apparatus of claim 7 , wherein the logic coupled to the memory is to:

determine the size of the foveated area based on the head motion vector and the eye motion vector.

10. The apparatus of claim 9 , wherein the logic coupled to the memory is to:

identify that the head motion vector is oriented along the first direction; and

identify that the eye motion vector is oriented along the second direction, wherein the first and second directions are opposite each other.

11. The apparatus of claim 7 , wherein the logic coupled to the memory is to predict the future focus area based on one or more of an acceleration of a gaze of the user or a velocity of the gaze.

12. The apparatus of claim 7 , wherein the logic coupled to the memory is to determine the shape of the foveated area based on the motion vector of the object so that the foveated area is to intersect with a motion of the object,

wherein the object is a virtual object.

13. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing device, cause the computing device to:

adjust one or more parameters of a graphics subsystem based on motion information;

predict a future focus area of a user based on a motion vector of an object, wherein the object is to be rendered as part of a frame;

identify a head motion vector associated with a movement of a head of the user, wherein the head motion vector is to be along a first direction;

identify an eye motion vector associated with an eye of the user, wherein the eye motion vector is to be along a second direction that is to be different from the first direction;

determine one or more of a size of the foveated area, a position of the foveated area or the shape of the foveated area based on the future focus area.

14. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:

predict the future focus area based on a current gaze area of the user;

cause the frame to be generated based on the foveated area and the future focus area at a time after the future focus area is predicted; and

determine the size and the shape of the foveated area based on the future focus area.

15. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:

determine the size of the foveated area based on the head motion vector and the eye motion vector.

16. The at least one non-transitory computer readable storage medium of claim 15 , wherein the instructions, when executed, cause the computing device to:

identify that the head motion vector is oriented along the first direction; and

identify that the eye motion vector is oriented along the second direction, wherein the first and second directions are opposite each other.

17. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to predict the future focus area based on one or more of an acceleration of a gaze of the user or a velocity of the gaze.

18. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to determine the shape of the foveated area based on the motion vector of the object so that the foveated area is to intersect with a motion of the object,

wherein the object is a virtual object.

19. A method comprising:

adjusting one or more parameters of a graphics subsystem based on motion information;

predicting a future focus area of a user based on a motion vector of an object, wherein the object is rendered as part of a frame;

identifying a head motion vector associated with a movement of a head of the user, wherein the head motion vector is to be along a first direction;

identifying an eye motion vector associated with an eye of the user, wherein the eye motion vector is to be along a second direction that is to be different from the first direction;

determining a shape of a foveated area based on the first and second directions to enlarge the foveated area in the first and second directions, wherein the foveated area is to be associated with the frame; and

determining one or more of a size of the foveated area, a position of the foveated area or the shape of the foveated area based on the future focus area.

20. The method of claim 19 , further comprising:

predicting the future focus area based on a current gaze area of the user;

causing the frame to be generated based on the foveated area and the future focus area at a time after the future focus area is predicted; and

determining the size and the shape of the foveated area based on the future focus area.

21. The method of claim 19 , further comprising:

determining the size of the foveated area based on the head motion vector and the eye motion vector.

22. The method of claim 21 , further comprising:

identifying that the head motion vector is oriented along the first direction; and

identifying that the eye motion vector is oriented along the second direction, wherein the first and second directions are opposite each other.

23. The method of claim 19 , further comprising predicting the future focus area based on one or more of an acceleration of a gaze of the user or a velocity of the gaze.

24. The method of claim 19 , further comprising determining the shape of the foveated area based on the motion vector of the object so that the foveated area is to intersect with a motion of the object,

wherein the object is a virtual object.

Continuity (2)

Continuation 15477019 · Apr 1, 2017

Related Publication 20190147640A1 · May 16, 2019

Cited By (1)

US 12,353,914