Eclipse cursor for virtual content in mixed reality displays
Systems and methods for displaying a cursor and a focus indicator associated with real or virtual objects in a virtual, augmented, or mixed reality environment by a wearable display device are disclosed. The system can determine a spatial relationship between a user-movable cursor and a target object within the environment. The system may render a focus indicator (e.g., a halo, shading, or highlighting) around or adjacent objects that are near the cursor. When the cursor overlaps with a target object, the system can render the object in front of the cursor (or not render the cursor at all), so the object is not occluded by the cursor. The object can be rendered closer to the user than the cursor. A group of virtual objects can be scrolled, and a virtual control panel can be displayed indicating objects that are upcoming in the scroll.
1. A wearable display system comprising:
a head mounted display configured to project virtual content toward an eye of a user;
a hand-held user input device that is manipulable by the user and configured to control movement of a virtual cursor in a virtual environment that is displayed to the user via the head mounted display; and
a hardware processor in communication with the head mounted display and the hand-held user input device, the hardware processor programmed to:
direct the head mounted display to render a plurality of virtual icons at a first depth in the virtual environment;
identify a cursor location within the virtual environment, wherein the cursor location changes within the virtual environment in response to the user manipulating the hand-held user input device independent of movement of the head mounted display;
while the cursor location does not overlap with any of the plurality of virtual icons rendered at the first depth in the virtual environment, direct the head mounted display to render the virtual cursor at the cursor location and at a second depth in the virtual environment such that the virtual cursor is visible to the user at the second depth in the virtual environment; and
while the cursor location is positioned behind a particular virtual icon of the plurality of virtual icons, direct the head mounted display to render the particular virtual icon without rendering the virtual cursor to thereby inhibit the virtual cursor from obscuring any portion of the particular virtual icon, wherein the particular virtual icon is rendered at a third depth in the virtual environment that is closer to the user than the first depth or the second depth, and render a focus indicator surrounding the particular virtual icon, such that the particular virtual icon appears enlarged and setoff from the other virtual icons and without any obstruction by the virtual cursor that is controllable by the hand-held user input device.
2. The wearable display system of claim 1 , wherein the hand-held user input device comprises a handheld totem comprising a touch sensitive surface.
3. The wearable display system of claim 1 , wherein the first depth is the second depth.
4. The wearable display system of claim 1 , wherein the focus indicator emphasizes a visual appearance of the particular virtual icon.
5. The wearable display system of claim 4 , wherein to emphasize the visual appearance of the particular virtual icon, the hardware processor is programmed to direct the head mounted display to:
render a caption associated with the particular virtual icon;
render the particular virtual icon with additional virtual content than when rendered at the first depth; and/or
render the virtual particular icon with higher resolution or higher brightness than when rendered at the first depth.
6. The wearable display system of claim 1 , wherein the hardware processor is further programmed to accept user input to select the particular virtual icon.
7. The wearable display system of claim 1 , wherein the hardware processor is further programmed to:
in response to a determination that the cursor location is no longer behind the particular virtual icon, direct the head mounted display to render the particular virtual icon at the first depth.
8. The wearable display system of claim 7 , wherein the hardware processor is programmed to:
in response to the determination that the cursor location is no longer behind the particular virtual icon, render the virtual cursor at the cursor location.
9. The wearable display system of claim 1 , wherein the hardware processor is programmed to:
render a virtual layout comprising the plurality of virtual icons.
10. The wearable display system of claim 9 , wherein the hardware processor is programmed to receive a user indication to scroll the virtual layout.
11. The wearable display system of claim 10 , wherein the user indication comprises a scroll direction or a scroll speed.
12. The wearable display system of claim 10 , wherein the user indication comprises a hover of the cursor location at an edge of the virtual layout.
13. The wearable display system of claim 10 , wherein the hardware processor is programmed to direct the head mounted display to:
scroll the virtual layout; and
render a virtual content panel that comprises a representation of virtual icons that were not rendered prior to the scroll.
14. The wearable display system of claim 13 , wherein the virtual content panel is rendered at a depth that is different from a depth at which at least a portion of the virtual layout is rendered.
15. The wearable display system of claim 9 , wherein the virtual layout comprises a regular grid or an irregular grid.
16. The wearable display system of claim 1 , wherein the particular virtual icon comprises a thumbnail of an application or a media file.
17. A wearable display system comprising:
a head mounted display configured to project virtual content toward an eye of a user;
a hand-held user input device that is manipulable by the user and configured to control movement of a virtual cursor in a virtual environment that is displayed to the user via the head mounted display; and
a hardware processor in communication with the head mounted display and the hand-held user input device, the hardware processor programmed to:
direct the display to render a virtual layout of a plurality of virtual icons, wherein at least some of the plurality of virtual icons in the virtual layout are rendered at a first depth in the virtual environment;
receive, via the hand-held user input device, user input indicating an instruction to scroll the virtual layout;
in response to a determination that a cursor location of the virtual cursor moves within the virtual environment to a location behind a particular virtual icon of the plurality of virtual icons in response to the user manipulating the hand-held user input device independent of movement of the head mounted display, direct the display to:
render the particular virtual icon without rendering the virtual cursor thereby inhibiting the virtual cursor that is controllable by the hand-held user input from obscuring the particular virtual icon, and
render a focus indicator surrounding the particular virtual icon such that the particular virtual icon appears setoff from the other virtual icons; and
in response to receipt of the instruction to scroll the virtual layout:
direct the display to render a virtual content panel that comprises a representation of virtual icons that were not rendered prior to the scroll, the virtual content panel rendered at a second depth in the virtual environment, and
cause at least some of the plurality of virtual icons to scroll in a direction corresponding to the user input.
18. The wearable display system of claim 17 , wherein the first depth is different from the second depth.
19. The wearable display system of claim 17 , wherein the instruction to scroll comprises an indication of at least one of a scroll direction or a scroll speed.
20. The wearable display system of claim 17 , wherein the virtual content panel comprises a message indicative of content of the plurality of icons being scrolled.
21. The wearable display system of claim 17 , wherein the representation of the virtual icons comprises thumbnails.
22. The wearable display system of claim 17 , wherein the scroll of the virtual layout is performed with a momentum or a drag.
23. The wearable display system of claim 17 , wherein the user input is first user input and the instruction is a first instruction, wherein the hardware processor is further programmed to:
receive second user input indicating a second instruction to halt the scroll of the virtual layout; and
in response to receipt of the second instruction, direct the head mounted display to:
cease the scroll of the virtual layout; and
cease the render of the virtual content panel.
24. The wearable display system of claim 17 , wherein the hardware processor is further programmed to:
identify the cursor location within the environment, wherein the cursor location changes in response to the user input data received by the hand-held user input device;
based at least in part on a determination that the cursor location is not behind a location of a virtual icon, direct the head mounted display to render a virtual icon of the plurality of virtual icons at the first depth and render the virtual cursor at the cursor location; and
based at least in part on the determination that the cursor location is behind the location of the virtual icon of the plurality of virtual icons, direct the head mounted display to render the virtual icon at a third depth in lieu of directing the head mounted display to render the virtual cursor at the cursor location.