IP Library Granted Patent US 10,943,379
Granted Patent B2
US 10,943,379 · App. 16/533,920 · Granted Mar 9, 2021

Predictive viewport renderer and foveated color compressor

Inventors: Deepak S. Vembar (Portland, OR); Atsuo Kuwahara (Hillsboro, OR); Chandrasekaran Sakthivel (Sunnyvale, CA); Radhakrishnan Venkataraman (Folsom, CA); Brent E. Insko (Portland, OR); Anupreet S. Kalra (Folsom, CA); Hugues Labbe (Folsom, CA); Abhishek R. Appu (El Dorado Hills, CA); Ankur N. Shah (Folsom, CA); Joydeep Ray (Folsom, CA); ElMoustapha Ould-Ahmed-Vall (Chandler, AZ); James M. Holland (Folsom, CA)
Assignee: Intel Corporation
G06T11/60G06T9/00H04N19/124H04N19/167H04N19/17H04N19/436H04N19/503
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,943,379
App. No.
16/533,920
Granted
Mar 9, 2021
Kind
B2
Abstract

An embodiment of a graphics apparatus may include a focus identifier to identify a focus area, and a color compressor to selectively compress color data based on the identified focus area. Another embodiment of a graphics apparatus may include a motion detector to detect motion of a real object, a motion predictor to predict a motion of the real object, and an object placer to place a virtual object relative to the real object based on the predicted motion of the real object. Another embodiment of a graphics apparatus may include a frame divider to divide a frame into viewports, a viewport prioritizer to prioritize the viewports, a renderer to render a viewport of the frame in order in accordance with the viewport priorities, and a viewport transmitter to transmit a completed rendered viewport. Other embodiments are disclosed and claimed.

Claims (73)

1. A computing system comprising:

a graphics processor;

a central processing unit; and

a memory including a set of instructions, which when executed by one or more of the graphics processor or the central processing unit, cause the computing system to:

detect motion of a real object,

predict a motion of the real object based on the detected motion,

determine a latency, and

place a virtual object relative to the real object based on the predicted motion of the real object and the latency.

2. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:

predict a location of the real object; and

place the virtual object relative to the real object based on the location of the real object.

3. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:

predict an orientation of the real object; and

place the virtual object relative to the real object based on the orientation of the real object.

4. The system of claim 1 , wherein the instructions, when executed, cause the computing system to:

determine an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and

place the virtual object relative to the real object based on the amount of the latency.

5. The system of claim 4 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

6. The system of claim 4 , wherein the instructions, when executed, cause the computing system to:

predict the motion of the real object based on the latency.

7. An apparatus comprising:

a memory; and

logic communicatively coupled to the memory, wherein the logic is implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, the logic communicatively coupled to the memory to:

detect motion of a real object,

predict a motion of the real object based on the detected motion,

determine a latency, and

place a virtual object relative to the real object based on the predicted motion of the real object and the latency.

8. The apparatus of claim 7 , wherein the logic coupled to the memory is to:

predict a location of the real object; and

place the virtual object relative to the real object based on the location of the real object.

9. The apparatus of claim 7 , wherein the logic coupled to the memory is to:

predict an orientation of the real object; and

place the virtual object relative to the real object based on the orientation of the real object.

10. The apparatus of claim 7 , wherein the logic coupled to the memory is to:

determine an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and

place the virtual object relative to the real object based on the amount of the latency.

11. The apparatus of claim 10 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

12. The apparatus of claim 10 , wherein the logic coupled to the memory is to:

predict the motion of the real object based on the latency.

13. At least one non-transitory computer readable storage medium comprising a set of instructions, which when executed by a computing device, cause the computing device to:

detect motion of a real object;

predict a motion of the real object based on the detected motion;

determine a latency; and

place a virtual object relative to the real object based on the predicted motion of the real object and the latency.

14. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:

predict a location of the real object; and

place the virtual object relative to the real object based on the location of the real object.

15. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:

predict an orientation of the real object; and

place the virtual object relative to the real object based on the orientation of the real object.

16. The at least one non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, cause the computing device to:

determine an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and

place the virtual object relative to the real object based on the amount of the latency.

17. The at least one non-transitory computer readable storage medium of claim 16 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

18. The at least one non-transitory computer readable storage medium of claim 16 , wherein the instructions, when executed, cause the computing device to:

predict the motion of the real object based on the latency.

19. A method comprising:

detecting motion of a real object;

predicting a motion of the real object based on the detected motion;

determining a latency; and

placing a virtual object relative to the real object based on the predicted motion of the real object and the latency.

20. The method of claim 19 , further comprising:

predicting a location of the real object; and

placing the virtual object relative to the real object based on the location of the real object.

21. The method of claim 19 , further comprising:

predicting an orientation of the real object; and

placing the virtual object relative to the real object based on the orientation of the real object.

22. The method of claim 19 , further comprising:

determining an amount of the latency based on one or more of time to render an augmented reality scene, a number of augmented reality objects in the augmented reality scene, or a complexity of the augmented reality scene; and

placing the virtual object relative to the real object based on the amount of the latency.

23. The method of claim 22 , wherein the amount of the latency is to be a time difference between a time of capture of a real scene and a time that the augmented reality scene is to be rendered, wherein the real scene is to include the real object.

24. The method of claim 22 , further comprising:

predicting the motion of the real object based on the latency.

Continuity (2)
Continuation 15476990 · Apr 1, 2017
Related Publication 20200035005A1 · Jan 30, 2020
Cited By (1)
US 12,353,914