Depth plane selection for multi-depth plane display systems by user categorization
A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.
1. An augmented reality display system comprising:
a head-mounted display configured to present virtual content by outputting image light to a wearer, wherein the head-mounted display comprises a plurality of waveguides forming a waveguide stack, wherein one or more of the waveguides are configured to output image light to an eye of the wearer with different amounts of wavefront divergence than one or more others of the waveguides, wherein the different amounts of wavefront divergence correspond to different depth planes at different distances away from the wearer, wherein the display is configured to output image light from waveguides for different depth planes at different times; and
at least one processor communicatively coupled to the head-mounted display, wherein the at least one processor is configured to access a map of the world comprising respective positions for a plurality of virtual objects, wherein each of the virtual objects has a distinct associated depth plane, wherein the at least one processor is configured to:
determine whether the wearer is a calibrated user or a guest user;
when the wearer is determined to be the calibrated user:
load pre-existing user depth plane switching calibration information; and
set depth plane switching parameters for the head-mounted display based upon the pre-existing user depth plane switching calibration information; and
when the wearer is determined to be the guest user, perform content-based depth plane switching, by:
identifying a virtual object at which the guest user is most likely to be looking by identifying a virtual object having a greatest amount of visual change in a field of view of the guest user, wherein the greatest amount of visual change comprises a greatest amount of movement in the field of view;
retrieving an associated depth plane of the virtual object; and
switching the waveguide outputting image light to the waveguide corresponding to the associated depth plane of the virtual object,
wherein content-based depth plane switching is performed without utilizing pre-existing guest user eye-tracking calibration information and without performing a guest user eye-tracking calibration.
2. The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to determine whether the wearer is the calibrated user or the guest user by determining the wearer's interpupillary distance.
3. The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to determine whether the guest user is most likely looking at the virtual object by determining whether eyes of the guest user are fixating within a volume encompassing the virtual object.
4. The augmented reality display system of claim 1 , wherein the display system is configured to:
determine an uncertainty associated with determining a position of a fixation point of the wearer; and
vary a size of a volume encompassing the virtual object based upon the uncertainty.
5. The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to transition to dynamic calibration of the guest user if an uncertainty associated with determining a position of a fixation point of the wearer exceeds a threshold value.
6. The augmented reality display system of claim 1 , wherein the augmented reality display system is configured to transition to dynamic calibration of the guest user if an uncertainty associated with a location of the virtual object exceeds a threshold value.
7. The augmented reality display system of claim 1 , wherein, upon detecting that the calibrated user is no longer wearing the head-mounted display after determining that the wearer is the calibrated user, the augmented reality display system is configured to continue to utilize the depth plane switching calibration information of the calibrated user for a predetermined amount of time or for a predetermined number of image frames.
8. A method comprising:
providing a head-mounted display configured to present virtual content by outputting image light to a wearer, wherein the head-mounted display comprises a plurality of waveguides forming a waveguide stack, wherein one or more of the waveguides are configured to output image light to an eye of the wearer with different amounts of wavefront divergence than one or more others of the waveguides, wherein the different amounts of wavefront divergence correspond to different depth planes at different distances away from the wearer, wherein the display is configured to output image light from waveguides for different depth planes at different times, wherein the display is configured to access a map of the world comprising respective positions for a plurality of virtual objects, wherein each of the virtual objects has a distinct associated depth plane;
determining that the user is a guest user;
performing content-based depth plane switching by:
identifying a virtual object at which the guest user is most likely to be looking by identifying a virtual object having a greatest amount of visual change in a field of view of the guest user, wherein the greatest amount of visual change comprises a greatest amount of movement in the field of view; and
retrieving an associated depth plane of the virtual object;
switching the waveguide outputting image light to the waveguide corresponding to the associated depth plane,
wherein content-based depth plane switching is performed without utilizing pre-existing guest user eye-tracking calibration information and without performing a guest user eye-tracking calibration.
9. The method of claim 8 , wherein determining whether the guest user is looking at a virtual object comprises determining whether the guest user's eyes are fixating within a volume encompassing the virtual object.
10. The method of claim 8 , wherein determining whether that the user is the guest user comprises determining the interpupillary distance of the user with one or more eye tracking cameras configured to image the eyes of the user.
11. The method of claim 10 , wherein determining that the user is the guest user comprises determining the interpupillary distance of the user with the one or more eye tracking cameras and determining that the interpupillary distance of the user is outside of a predetermined range.
12. The method of claim 11 , wherein determining that the user is the guest user comprises determining that the user's interpupillary distance is not within 1.0 mm of the measured interpupillary distance of a calibrated user.