IP Library Granted Patent US 10,192,292
Granted Patent B2
US 10,192,292 · App. 15/382,432 · Granted Jan 29, 2019

Accommodation-invariant computational near-eye displays

Inventors: Gordon Wetzstein (Palo Alto, CA); Robert Konrad (Stanford, CA)
Assignee: The Board of Trustees of the Leland Stanford Junior University
G06T5/003G02B27/0075G02B27/017G06T5/10G06T2207/20024G06T2207/20056G06T2207/20201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,192,292
App. No.
15/382,432
Granted
Jan 29, 2019
Kind
B2
Abstract

Near-eye display systems in accordance with embodiments of the invention enable accommodation-invariant display control. One embodiment includes a near-eye display; a processor; a memory containing a target image and an accommodation-invariant display application; where the processor is configured by the accommodation-invariant display application to calculate an impulse response of the near-eye display; calculate a compensation image by generating a deconvolved color channel of the target image using a ratio of the target image and the impulse response, where the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and display the compensation image on the near-eye display.

Claims (168)

1. A display system comprising:

a near-eye display;

a processor;

a memory containing a target image and an accommodation-invariant display application;

where the processor is configured by the accommodation-invariant display application to:

calculate an impulse response of the near-eye display;

calculate a compensation image by generating a deconvolved color channel of the target image using a ratio of the target image and the impulse response and inverse filtering, wherein:

the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and

the inverse filtering is evaluated by the processor by using the following expression:

i

c

(

x

,

y

)

=

-

1

{

{

i

(

x

,

y

)

}

{

ρ

~

(

x

,

y

)

}

}

where i c is the compensation image, i is the target image, {tilde over (ρ)}(x, y) is the integrated point spread function, and ℑ{⋅} is the discrete Fourier transform; and

display the compensation image on the near-eye display.

2. The display system of claim 1 , wherein the impulse response is an integrated point spread function.

3. The display system of claim 2 , wherein the integrated point spread function is evaluated by the processor by using the following expression:

{tilde over (ρ)}( r )=∫ o T ρ( r,f ( t )) dt

where {tilde over (ρ)}(r) is the integrated point spread function, ρ(r,f(t)) is a Gaussian point spread function, T is a finite exposure time, and f(t) maps time to temporally-varying focal lengths.

4. The display system of claim 3 , wherein the integrated point spread function further comprises a variance which is evaluated by the processor using the following expression:

σ

~

2

=

c

2

4

0

T

b

(

f

(

t

)

)

2

d

t

where {tilde over (σ)}is the variance, T is a finite exposure time, f(t) maps time to temporally-varying focal lengths, c is a constant, and b is a constant.

5. The display system of claim 1 , wherein generating the deconvolved color channel of the target image further comprises generating each color channel of the target image individually.

6. The display system of claim 1 , wherein the near-eye display is a head mounted display.

7. The display system of claim 1 , wherein the near-eye display is a virtual reality display.

8. The display system of claim 1 , wherein the near-eye display is an augmented reality display.

9. A method for displaying an image comprising:

calculating an impulse response of a near-eye display using a processor configured by an accommodation-invariant display application stored in a memory;

calculating a compensation image by generating a deconvolved color channel of a target image based on a ratio of the target image and the impulse response using inverse filtering using the processor, wherein:

the compensation image is a representation of the target image that remains in focus at a plurality of distances from the near-eye display; and

the inverse filtering is evaluated by the processor by using the following expression:

i

c

(

x

,

y

)

=

-

1

{

{

i

(

x

,

y

)

}

{

ρ

~

(

x

,

y

)

}

}

where i c the compensation image, i is the target image, {tilde over (ρ)}(x,y) is the integrated point spread function and ℑ{⋅} is the discrete Fourier transform; and

displaying the compensation image on the near-eye display.

10. The method of claim 9 , wherein the impulse response is an integrated point spread function.

11. The method of claim 10 , wherein the integrated point spread function is evaluated by the processor by using the following expression:

{tilde over (ρ)}( r )=∫ o T ρ( r,f ( t )) dt

where {tilde over (ρ)}(r) is the integrated point spread function, ρ(r,f(t)) is a Gaussian point spread function, T is a finite exposure time, and f(t) maps time to temporally-varying focal lengths.

12. The method of claim 11 , wherein the integrated point spread function further comprises a variance which is evaluated by the processor using the following expression:

σ

~

2

=

c

2

4

0

T

b

(

f

(

t

)

)

2

d

t

where {tilde over (σ)} is the variance, T is a finite exposure time, f(t) maps time to temporally-varying focal lengths, c is a constant, and b is a constant.

13. The method of claim 9 , wherein generating the deconvolved color channel of the target image further comprises generating each color of the target image individually.

14. The method of claim 9 , wherein the near-eye display is a head mounted display.

15. The method of claim 9 , wherein the near-eye display is a virtual reality display.

16. The method of claim 9 , wherein the near-eye display is an augmented reality display.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Feb 22, 2018
From: JPMORGAN CHASE BANK, N.A.
To: HIGH SCHOOL CUBE, LLC
Reel/Frame 045008/0607 →
RELEASE OF SECURITY INTEREST Recorded Feb 22, 2018
From: BANK OF AMERICA, N.A.
To: HIGH SCHOOL CUBE, LLC
Reel/Frame 045008/0640 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2017
From: WETZSTEIN, GORDON; KONRAD, ROBERT
To: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
Reel/Frame 043950/0293 →
SECURITY INTEREST Recorded Jan 27, 2017
From: HIGH SCHOOL CUBE, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 041102/0245 →
SECURITY INTEREST Recorded Jan 27, 2017
From: HIGH SCHOOL CUBE, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 041102/0283 →
Continuity (2)
Provisional Application 62295987 · Feb 16, 2016
Related Publication 20170236255A1 · Aug 17, 2017