IP Library › Granted Patent US 11,024,267
Granted Patent B2
US 11,024,267 · App. 16/871,793 · Granted Jun 1, 2021

Display system

Inventors: Jeff Kempf (Dallas, TX); Dan Morgan (McKinney, TX)
Assignee: TEXAS INSTRUMENTS INCORPORATED
G09G5/391G06F3/013G09G5/363G09G3/2051G09G2320/0242G09G2340/0407G09G2340/0435G09G2350/00G09G2354/00G09G2360/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,024,267
App. No.
16/871,793
Granted
Jun 1, 2021
Kind
B2
Abstract

A gaze tracking display system includes a processor and display circuitry. The processor is configured to perform foveated rendering of image data, and to output foveated image data. The display circuitry is coupled to the processor. The display circuitry includes a display device and a display controller. The display device is configured to produce a viewable image. The display controller is configured to drive the display device. The display controller includes reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data received from the processor.

Claims (98)

1. A system, comprising:

a processor configured to perform foveated rendering of image data, to produce foveated image data; and

display circuitry coupled to the processor, the display circuitry comprising:

a display device; and

a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data; and

the frame buffer configured to:

store the foveated image data;

provide the stored foveated image data to the reconstruction circuitry; and

store no more than one-quarter of pixel data of the image data at the resolution of the display device.

2. A system, comprising:

a processor configured to perform foveated rendering of image data, to produce foveated image data; and

display circuitry coupled to the processor, the display circuitry comprising:

a display device; and

a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data; and

the frame buffer configured to:

store the foveated image data;

provide the stored foveated image data to the reconstruction circuitry; and

store no more than one-sixth of pixel data of the image at the resolution of the display device.

3. A system, comprising:

a processor configured to perform foveated rendering of image data, to produce foveated image data; and

display circuitry coupled to the processor, the display circuitry comprising:

a display device; and

a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data;

the frame buffer configured to:

store the foveated image data;

provide the stored foveated image data to the reconstruction circuitry; and

the display controller configured to convert the stored foveated image data from luminance and chrominance data to red-green-blue encoded data before transferring the foveated image data to the reconstruction circuitry.

4. A system, comprising:

a processor configured to perform foveated rendering of image data, to produce foveated image data; and

display circuitry coupled to the processor, the display circuitry comprising:

a display device; and

a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data;

the frame buffer configured to:

store the foveated image data; and

provide the stored foveated image data to the reconstruction circuitry;

the processor configured to:

produce a foveation header for the foveated image data, the foveation header comprising spatial replication information for blocks of the foveated image data; and

provide the foveation header to the display controller with the foveated image data; and

the display controller configured to apply the spatial replication information to reconstruct the image at the resolution of the display device from the foveated image data.

5. The system of claim 4 , wherein the foveation header comprises temporal replication information for the blocks of the foveated image data, and the display controller is configured to apply the temporal replication information to control writing of the foveated image data to the frame buffer.

6. The system of claim 1 , wherein the display device is configured to display red-green-blue encoded image data, and the processor is configured to provide the foveated image data encoded as luminance and chrominance values.

7. The system of claim 1 , wherein the display controller is configured to provide the image at the resolution of the display device to the display device at a rate of up to 1440 frames per second.

8. A system, comprising:

a processor configured to perform foveated rendering of image data, to produce foveated image data; and

display circuitry coupled to the processor, the display circuitry comprising:

a display device; and

a display controller configured to drive the display device, the display controller comprising reconstruction circuitry and a frame buffer coupled to the reconstruction circuitry;

the reconstruction circuitry configured to produce an image at a resolution of the display device based on the foveated image data;

the frame buffer configured to:

store the foveated image data; and

provide the stored foveated image data to the reconstruction circuitry; and

the reconstruction circuitry configured to:

receive the foveated image data from the processor;

perform pixel replication on the foveated image data to produce the image at the resolution of the display device; and

store the image at the resolution of the display device in the frame buffer.

9. A method comprising:

performing, by a processor, foveated rendering of image data to produce foveated image data;

transferring the foveated image data from the processor to a display controller that drives a display device;

providing, by the display controller, an output image at a resolution of the display device based on the foveated image data;

displaying, by the display device, the output image;

storing the foveated image data in a frame buffer;

providing the foveated image data from the frame buffer to the display controller; and

converting the stored foveated image data from luminance and chrominance values to red-green-blue encoded data before providing the output image.

10. A method comprising:

performing, by a processor, foveated rendering of image data to produce foveated image data;

transferring the foveated image data from the processor to a display controller that drives a display device;

producing, by the display controller, an output image at a resolution of the display device based on the foveated image data from the processor;

displaying, by the display device, the output image;

storing the foveated image data in a frame buffer;

providing the foveated image data from the frame buffer to the display controller;

producing, by the processor, a foveation header for the foveated image data, the foveation header comprising spatial replication information for pixels of the foveated image data;

providing, by the processor, the foveation header to the display controller with the foveated image data; and

applying, by the display controller, the spatial replication information to reconstruct the output image at the resolution of the display device based on the foveated image data.

11. The method of claim 10 , wherein the foveation header comprises temporal replication information for the pixels of the foveated image data, and the method further comprises:

applying, by the display controller, the temporal replication information to control writing of the foveated image data to the frame buffer.

12. The method of claim 9 , wherein the displaying comprises driving the display device with red-green-blue encoded image data, and wherein the foveated image data is encoded as luminance and chrominance values.

13. The method of claim 9 , further comprising providing the output image data to the display device at a rate of up to 1440 frames per second.

14. A display system, comprising:

a display device; and

a display controller coupled to the display device, the display controller configured to drive the display device, the display controller comprising:

a frame buffer configured to store foveated image data; and

reconstruction circuitry coupled to an output of the frame buffer, the reconstruction circuitry configured to produce an image at a resolution of the display device based on the stored foveated image data; and

the display controller coupled to the frame buffer, the display controller configured to convert the stored foveated image data from luminance and chrominance values to red-green-blue encoded data before transferring the foveated image data to the reconstruction circuitry.

15. A display system, comprising:

a display device; and

a display controller coupled to the display device, the display controller configured to drive the display device, the display controller comprising:

a frame buffer configured to store foveated image data; and

reconstruction circuitry coupled to an output of the frame buffer, the reconstruction circuitry configured to produce an image at a resolution of the display device based on the stored foveated image data;

the display controller configured to:

receive a foveation header with the foveated image data, the foveation header comprising:

spatial replication information for blocks of the foveated image data; and

temporal replication information for the blocks of the foveated image data;

apply the spatial replication information to reconstruct the image at the resolution of the display device based on the foveated image data; and

apply the temporal replication information to control writing of the foveated image data to the frame buffer.

Continuity (3)
Continuation 16232179 · Dec 26, 2018
Provisional Application 62611239 · Dec 28, 2017
Related Publication 20200273436A1 · Aug 27, 2020