Systems and methods for operating a display system based on user perceptibility
Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.
1. A display system comprising:
a wearable display configured to present virtual content to a user;
an imaging device facing away from the wearable display, the imaging device configured to capture images; and
at least one processor communicatively coupled to the wearable display and the imaging device, the at least one processor configured to:
obtain an image of an eye of the user captured by the imaging device;
determine whether a threshold measure or more of motion blur is exhibited in one or more regions of the image, wherein the threshold measure of the motion blur is associated with a saccade; and
in response to a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, change a wavefront divergence of light outputted by the wearable display to form the virtual content while the threshold measure or more of motion blur is exhibited in the one or more regions of the image.
2. The display system of claim 1 , wherein to determine whether the threshold measure or more of motion blur is exhibited in one or more regions of the image, the at least one processor is configured to:
identify a target region of the image corresponding to a target portion of the user's eye; and
determine whether the threshold measure or more of motion blur is exhibited in the identified region of the image.
3. The display system of claim 2 , further comprising an infrared light source,
wherein the target portion of the user's eye comprises an illuminated portion of the user's eye, wherein the illuminated portion is illuminated by the light source.
4. The display system of claim 2 , wherein the target portion of the user's eye comprises one or more eye features selected from the group consisting of a pupil, at least a portion of an iris, and a portion of a limbic boundary.
5. The display system of claim 1 , wherein to determine whether the threshold measure or more of motion blur is exhibited in one or more regions of the image, the at least one processor is configured to:
convolving at least the one or more regions with one or more image kernels; and
determining, based on the convolution, whether the threshold measure or more of motion blur is exhibited in the one or more regions of the image.
6. The display system of claim 1 , wherein to determine whether the threshold measure or more of motion blur is exhibited in one or more regions of the image, the at least one processor is configured to:
extracting frequency information from the image; and
determining, based on the frequency information, whether the threshold measure or more of motion blur is exhibited in the one or more regions of the image.
7. The display system of claim 1 , wherein the processor is further configured to determine a direction associated with motion blur exhibited in one or more regions of the image.
8. The display system of claim 6 , wherein the processor is further configured to determine a magnitude associated with motion blur exhibited in one or more regions of the image.
9. The display system of claim 1 , wherein the at least one processor is further configured to, in response to a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, adjusting one or more power settings of the display system, or one or more virtual content rendering settings.
10. The display system of claim 1 , wherein the at least one processor is configured to change a depth plane on which virtual content is presented in response to the determination that the identified region contains the threshold measure or more.
11. The display system of claim 1 , wherein a second imaging device faces away from the user, the second imaging device configured to capture images of a real-world environment.