IP Library › Granted Patent US 11,487,118
Granted Patent B2
US 11,487,118 · App. 17/122,040 · Granted Nov 1, 2022

Rendered optical super resolution display

Inventors: Jeffrey Matthew Kempf (Dallas, TX); John Peter Fenske (Richardson, TX)
Assignee: TEXAS INSTRUMENTS INCORPORATED
G02B27/0172G09G5/391G02B2027/014G09G2340/0457
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,487,118
App. No.
17/122,040
Granted
Nov 1, 2022
Kind
B2
Abstract

A method includes rendering, by at least one processor, a first sub-frame of an image, where the first sub-frame includes a first subset of pixels of the image. The method includes displaying the first sub-frame on a display. The method also includes rendering, by the at least one processor, a second sub-frame of the image, where the second sub-frame includes a second subset of pixels of the image, and where the second sub-frame is shifted a half-pixel diagonally from the first sub-frame. The method also includes displaying the second sub-frame on the display after displaying the first sub-frame, where the display is optically shifted a half-pixel diagonally to display the second sub-frame.

Claims (46)

1. A method, comprising:

in response to determining, by at least one processor, that a region of pixels of an input image is in a fovea region, producing super-samples from the input image for the region of pixels to produce a rendered image;

producing, by the at least one processor, a first sub-frame of the rendered image, wherein the first sub-frame comprises a first subset of pixels of the rendered image;

displaying the first sub-frame to produce a first displayed image;

producing, by the at least one processor, a second sub-frame of the rendered image, wherein the second sub-frame comprises a second subset of pixels of the rendered image, and wherein the second sub-frame is shifted a half-pixel diagonally from the first sub-frame; and

displaying the second sub-frame to produce a second displayed image after displaying the first sub-frame, wherein the second displayed image is optically shifted a half-pixel diagonally relative to the first displayed image.

2. The method of claim 1 , comprising displaying the first sub-frame and the second sub-frame at a rate of at least 75 Hertz.

3. The method of claim 1 , wherein the first subset of pixels includes one-fourth of the pixels of the input image, and the second subset of pixels includes one-fourth of the pixels of the input image.

4. The method of claim 3 , wherein the first subset of pixels includes every other pixel in odd rows of pixels of the input image.

5. The method of claim 3 , wherein the second subset of pixels includes every other pixel in even rows of pixels of the input image.

6. The method of claim 1 , further comprising:

producing a third sub-frame of the input image, wherein the third sub-frame comprises a third subset of the pixels of the input image, and wherein the third sub-frame is shifted a half-pixel up from the second sub-frame;

displaying the third sub-frame to produce a third displayed image after displaying the second sub-frame, wherein the third displayed image is optically shifted by a half-pixel up relative to the second displayed image;

producing a fourth sub-frame of the input image, wherein the fourth sub-frame comprises a fourth subset of the pixels of the input image, and wherein the fourth sub-frame is shifted a half-pixel diagonally from the third sub-frame; and

displaying the fourth sub-frame to produce a fourth displayed image after displaying the third sub-frame, wherein the fourth displayed image is optically shifted by a half-pixel diagonally to display the fourth sub-frame relative to the third display image.

7. The method of claim 1 , comprising applying an anti-aliasing filter to the first subset of pixels and the second subset of pixels.

8. The method of claim 7 , comprising applying spatially adaptive anti-aliasing to an edge region of the input image.

9. The method of claim 1 , wherein the region of pixels is a first region of pixels, the method further comprising:

in response to determining that a second region of pixels of the input image is outside the fovea region, producing down-samples of the second region of pixels with a spatial offset.

10. A processing unit configured to:

produce a first sub-frame of an image, wherein the first sub-frame comprises a first subset of pixels of the image, the image having the first subset of pixels, a second subset of pixels, and a third subset of pixels;

apply an anti-aliasing filter to the first subset of pixels using the third subset of pixels;

transmit the first sub-frame;

produce a second sub-frame of the image, wherein the second sub-frame comprises the second subset of pixels of the image, and wherein the second sub-frame is shifted a half-pixel diagonally from the first sub-frame;

apply the anti-aliasing filter to the second subset of pixels using the third subset of pixels; and

transmit the second sub-frame.

11. The processing unit of claim 10 , wherein the first subset of pixels and the second subset of pixels are in a fovea region.

12. The processing unit of claim 10 , wherein the anti-aliasing filter is a 3×3 finite impulse response (FIR) filter.

13. The processing unit of claim 10 , where the processing unit transmits the first sub-frame and the second sub-frame to a spatial light modulator (SLM) at a rate of at least 75 Hz.

14. The processing unit of claim 10 , wherein the first subset of pixels includes one-fourth of the pixels of the image, and the second subset of pixels includes one-fourth of the pixels of the image.

15. The processing unit of claim 10 , wherein the anti-aliasing filter is a diamond passband anti-aliasing filter.

16. A system comprising:

a display;

a processing unit configured to:

render an image;

produce a first sub-frame of the image, wherein the first sub-frame comprises a first subset of pixels of the image, the image having the first subset of pixels, a second subset of pixels, and a third subset of pixels;

apply an anti-aliasing filter to the first subset of pixels using the third subset of pixels;

produce a second sub-frame of the image, wherein the second sub-frame comprises the second subset of pixels of the image, and wherein the second sub-frame is shifted a half-pixel diagonally from the first sub-frame; and

apply the anti-aliasing filter to the second subset of pixels using the third subset of pixels; and

a spatial light modulator (SLM) coupled to the processing unit and optically coupled to the display, the SLM configured to:

receive the first sub-frame from the processing unit and project the first sub-frame to the display to produce a first projected image; and

receive the second sub-frame from the processing unit and project the second sub-frame to the display to produce a second projected image, wherein the second projected image is optically shifted by a half-pixel diagonally relative to the first projected image.

17. The system of claim 16 , wherein the processing unit applies the anti-aliasing filter to pixels within a fovea region in the first subset of pixels and in the second subset of pixels.

18. The system of claim 16 , wherein the SLM is configured to project the first sub-frame and the second sub-frame at a rate of at least 75 Hz.

19. The system of claim 16 , wherein the first subset of pixels includes one-fourth of the pixels of the image, and the second subset of pixels includes one-fourth of the pixels of the image.

20. The system of claim 16 , wherein the first subset of pixels is arranged in a quincunx arrangement.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2020
From: KEMPF, JEFFREY MATTHEW; FENSKE, JOHN PETER
To: TEXAS INSTRUMENTS INCORPORATED
Reel/Frame 054648/0574 →
Continuity (2)
Provisional Application 63024385 · May 13, 2020
Related Publication 20210356744A1 · Nov 18, 2021