3-dimensional electro-optical see-through displays
An exemplary display is placed in an optical pathway extending from an entrance pupil of a person's eye to a real-world scene beyond the eye. The display includes at least one 2-D added-image source that is addressable to produce a light pattern corresponding to a virtual object. The source is situated to direct the light pattern toward the person's eye to superimpose the virtual object on an image of the real-world scene as perceived by the eye via the optical pathway. An active-optical element is situated between the eye and the added-image source at a location that is optically conjugate to the entrance pupil and at which the active-optical element forms an intermediate image of the light pattern from the added-image source. The active-optical element has variable optical power and is addressable to change its optical power to produce a corresponding change in perceived distance at which the intermediate image is formed, as an added image to the real-world scene, relative to the eye.
1. A method for displaying, to a person via a see-through display, an image of a virtual 3-D scene containing objects located at differing 3-D depths within the scene, comprising:
providing a 2-D display physically extending in two directions away from an optical axis of the see-through display;
providing an active-optical element at a location to receive a light pattern emitted by the 2-D display, the active-optical element having an addressable and variable optical power;
switching the optical power of the active-optical element to provide multiple respective focal planes at respective focal distances corresponding to the differing 3-D depths within the virtual 3-D scene, such that the focal distance of the light pattern produced by the 2-D display is modulated in a time-sequential manner;
creating a plurality of perspective views of the virtual 3-D scene, each perspective view containing respective virtual objects at distances associated with respective accommodation cues being provided by the 2-D display; and
synchronously with switching of the focal planes, updating the light pattern on the 2-D display to render a selected one of the plurality of perspective views matched to the respective accommodation cues being provided by the 2-D display, wherein a switching rate of the focal planes is sufficiently fast to avoid flicker.
2. The method according to claim 1 , wherein the active-optical element is switched to change the optical power to produce a corresponding change in perceived distance at which an intermediate image is formed.
3. The method according to claim 2 , wherein the intermediate image is added to a real-world scene observable through the see-through display.
4. The method according to claim 2 , wherein a distance at which the intermediate image is formed can serve as an accommodation cue for the person with respect to the intermediate image.
5. The method according to claim 2 , wherein the step of switching the optical power includes correspondingly moving the intermediate image along an optical pathway relative to the focal plane to produce a corresponding change in distance of the image relative to the person's eye.
6. The method according to claim 1 , wherein, in synchrony with a signal driving the active-optical element, far and near virtual objects are rendered on two or more separate image frames and displayed sequentially.
7. The method according to claim 1 , wherein the switching rate, f N , is given by
f
N
=
f
min
N
,
where N is the total number of focal planes and f min is a lowest response speed (in Hz) among the 2-D display, the active-optical element, and electronics driving the 2-D display and active-optical element.
8. The method according to claim 1 , wherein the 2-D display comprises a 2-D array of light-producing pixels.
9. The method according to claim 1 , wherein the step of switching the optical power includes controlling dioptric spacing between adjacent focal planes and an overall range of accommodation cues.
10. A see-through display for placement in an optical pathway extending from an entrance pupil of a person's eye to a real-world scene beyond the eye for displaying to the person via the see-through display, an image of a virtual 3-D scene containing objects located at differing 3-D depths within the virtual 3-D scene, the display comprising:
a 2-D display physically extending in two directions away from an optical axis of the see-through display, the 2-D display addressable to produce at least two light patterns corresponding to respective virtual objects;
an active-optical element disposed at a location to receive the at least two light patterns emitted by the 2-D display, the active-optical element having an addressable and variable optical power;
a controller in communication with the 2-D display and the active-optical element, and configured to switch the optical power of the active-optical element to provide multiple respective focal planes at respective focal distances corresponding to the differing 3-D depths within the virtual 3-D scene, such that the focal distances of the at least two light patterns produced by the 2-D display is modulated in a time-sequential manner, the controller also configured to create a plurality of perspective views of the virtual 3-D scene, each perspective view containing respective virtual objects at distances associated with respective accommodation cues being provided by the 2-D display and configured to update the at least two patterns on the 2-D display, synchronously with switching of the focal planes, to render a selected one of the plurality of perspective views matched to the respective accommodation cues being provided by the 2-D display.
11. The see-through display of claim 10 , wherein the 2-D display comprises a 2-D array of light-producing pixels.
12. The see-through display of claim 10 , comprising a spherical mirror disposed on the optical axis in optical communication with the active-optical element and at a location such that the active-optical element is disposed between the spherical mirror and the 2-D display.
13. The see-through display of claim 12 , wherein the active-optical element is offset along the optical axis from the center of a radius of curvature of the spherical mirror.
14. The see-through display of claim 13 , wherein the active-optical element is offset by Δ, and an exit pupil of the 2-D display is magnified by an amount m p ,
m
p
=
R
R
+
2
Δ
.
15. The see-through display of claim 10 , wherein the active-optical element comprises a refractive active-optical element.
16. The see-through display of claim 15 , wherein the refractive active-optical element comprises a liquid lens.