Display system with low-latency pupil tracker
A display system aligns the location of its exit pupil with the location of a viewer's pupil by changing the location of the portion of a light source that outputs light. The light source may include an array of pixels that output light, thereby allowing an image to be displayed on the light source. The display system includes a camera that captures image(s) of the eye and negatives of the eye image(s) are displayed by the light source. In the negative image, the dark pupil of the eye is a bright spot which, when displayed by the light source, defines the exit pupil of the display system, such that image content may be presented by modulating the light source. The location of the pupil of the eye may be tracked by capturing the images of the eye.
1 . A method for displaying image content through a wearable display system, the method performed by at least one processor of the wearable display system and comprising:
accessing images of an eye of a user of the wearable display system, the images captured by an eye imaging device of the wearable display system;
determining a negative image of the eye by inverting intensity values of at least some pixels of the images of the eye;
emitting light to present the negative image of the eye; and
displaying the image content to the user by modulating the light propagating from the negative image of the eye.
2 . The method of claim 1 , wherein modulating the light comprises propagating the light through a spatial light modulator.
3 . The method of claim 1 , further comprising thresholding at least one of the images of the eye to convert the at least one image to the corresponding negative image of the eye.
4 . The method of claim 1 , wherein the light to present the negative image of the eye is emitted from a light source that includes a spatial light modulator.
5 . The method of claim 4 , wherein the spatial light modulator is an emissive spatial light modulator.
6 . The method of claim 5 , wherein the emissive spatial light modulator is an LED array.
7 . The method of claim 5 , wherein the emissive spatial light modulator comprises an array of binary light emitters each having an on state and an off state.
8 . The method of claim 1 , further comprising collimating the light that presents the negative image of the eye.
9 . The method of claim 1 , wherein the negative image of the eye defines a location of an exit pupil of a display of the display system.
10 . The method of claim 9 , wherein emitting light to form the negative image of the eye continuously aligns the exit pupil of the display with the pupil of the eye of the user.
11 . A head-mounted display system comprising:
an eye imaging device configured to capture images of an eye of a user;
an image inverter configured to invert intensity values of at least some pixels of the captured images of the eye to determine a negative image of the eye;
a light source configured to emit light to present the negative image of the eye; and
a spatial light modulator configured to display image content to the user by modulating the light propagating from the negative image of the eye.
12 . The display system of claim 11 , wherein the display system is configured to threshold at least one of the images of the eye to convert the at least one image to a corresponding negative image.
13 . The display system of claim 11 , wherein the light source is a second spatial light modulator.
14 . The display system of claim 13 , wherein the second spatial light modulator is an emissive spatial light modulator.
15 . The display system of claim 14 , wherein the emissive spatial light modulator is an LED array.
16 . The display system of claim 14 , wherein the emissive spatial light modulator comprises an array of binary light emitters each having an on state and an off state.
17 . The display system of claim 11 , further comprising:
light source optics configured to collimate light propagating from the light source to the spatial light modulator;
light source relay optics configured to receive light from the spatial light modulator and to form an image of the light source; and
pupil relay optics configured to receive light from the light source relay optics and to provide simultaneous images of the light source and spatial light modulator to the eye.
18 . One or more non-transitory computer-readable storage media storing instructions which, when executed by at least one processor, cause the at least one processor to perform operations for displaying image content through a wearable display system, the operations comprising:
accessing images of an eye of a user of the wearable display system, the images captured by an eye imaging device of the wearable display system;
determining a negative image of the eye by inverting intensity values of at least some pixels of the images of the eye;
emitting light to present the negative image of the eye; and
displaying the image content to the user by modulating the light propagating from the negative image of the eye.
19 . The one or more non-transitory computer-readable storage media of claim 18 , wherein the negative image of the eye defines a location of an exit pupil of a display of the display system.
20 . The one or more non-transitory computer-readable storage media of claim 19 , wherein emitting light to form the negative image of the eye continuously aligns the exit pupil of the display with the pupil of the eye of the user.