Depth plane selection for multi-depth plane display systems by user categorization
A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content may have an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.
1 . An augmented reality display system comprising:
a head-mounted display configured to present virtual content on a plurality of depth planes by outputting image light to a wearer; and
at least one processor communicatively coupled to the head-mounted display, wherein the at least one processor is configured to access a map of the world comprising respective positions for a plurality of virtual objects, wherein each of the virtual objects has a distinct associated depth plane, wherein the at least one processor is configured to perform content-based depth plane switching by:
determining a virtual object at which the wearer is most likely to be looking by identifying a virtual object having a greatest amount of visual change in a field of view of the wearer, wherein the greatest amount of visual change comprises a greatest amount of movement in the field of view;
retrieving associated depth information for the virtual object; and
switching the display to output the image light at a depth plane, of the plurality of depth planes, that corresponds to the associated depth information for the virtual object.
2 . The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to determine whether the wearer is a calibrated user or a guest user by determining the wearer's interpupillary distance, and wherein the content-based depth plane switching is performed based on determining that the wearer is a guest user.
3 . The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to determine that the wearer is most likely looking at the virtual object by determining that eyes of the wearer are fixating within a volume encompassing the virtual object.
4 . The augmented reality display system of claim 3 , wherein the display system is configured to:
determine an uncertainty associated with determining a position of a fixation point of the wearer; and
vary a size of the volume encompassing the virtual object based upon the uncertainty.
5 . The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to transition to dynamic calibration of the wearer based on an uncertainty associated with determining a position of a fixation point of the wearer exceeding a threshold value.
6 . The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to transition to dynamic calibration of the wearer based on an uncertainty associated with a location of the virtual object exceeding a threshold value.
7 . The augmented reality display system of claim 1 , wherein the head-mounted display comprises a plurality of waveguides forming a waveguide stack, wherein one or more of the waveguides are configured to output image light to an eye of the wearer with different amounts of wavefront divergence than one or more others of the waveguides, wherein the different amounts of wavefront divergence correspond to different depth planes at different distances away from the wearer, and wherein the display is configured to output image light from waveguides for different depth planes at different times.
8 . The augmented reality display system of claim 1 , wherein the content-based depth plane switching is performed without utilizing pre-existing eye-tracking calibration information for the wearer.
9 . The augmented reality display system of claim 1 , wherein the content-based depth plane switching is performed without performing an eye-tracking calibration for the wearer.
10 . The augmented reality display system of claim 1 , wherein the content-based depth plane switching is performed without utilizing pre-existing eye-tracking calibration information for the wearer and without performing an eye-tracking calibration for the wearer.
11 . A method for presenting virtual content using a head-mounted display, the method comprising:
responsive to determining that the head-mounted display is to perform content-based depth plane switching for the virtual content to be presented to a wearer of the head-mounted display, determining a virtual object at which the wearer is most likely to be looking by identifying a virtual object having a greatest amount of visual change in a field of view of the wearer, wherein the greatest amount of visual change comprises a greatest amount of movement in the field of view, and wherein the head-mounted display is configured to present the virtual content on a plurality of depth planes by outputting image light to the wearer;
retrieving associated depth information for the virtual object; and
switching the display to output the image light at a particular depth plane, of the plurality of depth planes, that corresponds to the associated depth information for the virtual object.
12 . The method of claim 11 , further comprising determining whether the wearer is a calibrated user or a guest user by determining the wearer's interpupillary distance, wherein the content-based depth plane switching is performed based on determining that the wearer is a guest user.
13 . The method of claim 11 , wherein determining that the wearer is most likely looking at the virtual object includes determining that eyes of the wearer are fixating within a volume encompassing the virtual object.
14 . The method of claim 13 , further comprising:
determining an uncertainty associated with determining a position of a fixation point of the wearer; and
varying a size of the volume encompassing the virtual object based upon the uncertainty.
15 . The method of claim 11 , further comprising transitioning to dynamic calibration of the wearer based on an uncertainty associated with determining a position of a fixation point of the wearer exceeding a threshold value.
16 . The method of claim 11 , further comprising transitioning to dynamic calibration of the wearer based on an uncertainty associated with a location of the virtual object exceeding a threshold value.
17 . The method of claim 11 , wherein the content-based depth plane switching is performed without utilizing pre-existing eye-tracking calibration information for the wearer.
18 . The method of claim 11 , wherein the content-based depth plane switching is performed without performing an eye-tracking calibration for the wearer.
19 . The method of claim 11 , wherein the content-based depth plane switching is performed without utilizing pre-existing eye-tracking calibration information for the wearer and without performing an eye-tracking calibration for the wearer.