Method for generating a virtual user interface
A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
1. A method for generating a virtual user interface, comprising:
detecting a first gesture involving a hand of a user;
rendering, in real-time and in response to detecting the first gesture involving the hand of the user, a first virtual user interface related to the hand of the user, the first virtual interface including a first level menu item comprising a high level navigation menu item, icon or field, rendered and appearing on each of a plurality of first portions of the hand of the user;
detecting, at each said first portion, a second gesture involving the hand of the user;
rendering, in real-time and in response to detecting the second gesture involving the hand of the user, a second virtual user interface related to the hand of the user, said second virtual user interface including a plurality of discrete second level menu items, each appearing to be on or attached to an associated first level menu item at an associated first portion,
and
wherein the second virtual user interface comprises each said second level menu item expanding from and related to an associated first level menu item.
2. The method of claim 1 , wherein the first gesture is selected from the group consisting of:
the user opening the hand;
the user displaying an open palm of the hand; and
the user holding up the hand.
3. The method of claim 1 wherein each said first portion of the hand is a finger of the hand.
4. The method of claim 3 , wherein the finger of the hand is not a thumb of the hand such that the first virtual user interface is configured so that the thumb of the hand acts as a pointer for the first virtual user interface and the second gesture comprises the thumb pointing to the first virtual user interface.
5. The method of claim 1 , wherein the first virtual user interface is a higher level navigation menu item compared to the second virtual user interface.
6. The method of claim 1 , wherein the second gesture is the user spreading at least two fingers of the hand apart from each other.
7. The method of claim 6 , wherein the second gesture is the user spreading all four fingers of the hand apart from each other.
8. The method of claim 1 , wherein each of said second level menu items is rendered such that it appears to be on or attached to a finger of the hand of the user.
9. The method of claim 8 , wherein the finger of the hand is not a thumb of the hand such that the second virtual user interface is configured so that the thumb of the hand acts as a pointer for the second virtual user interface.
10. The method of claim 1 , wherein the second virtual user interface is a lower level navigation menu item compared to the first virtual user interface.
11. The method of claim 1 , further comprising:
detecting a third gesture involving the hand of the user; and
rendering, in real-time and in response to detecting the third gesture involving the hand of the user, a third virtual user interface related to the hand of the user,
wherein the third virtual user interface comprises a plurality of third level menu items arranged in an arc and moving relative to the hand of the user.
12. The method of claim 11 , wherein the third gesture is the user making a circling motion in a palm of the hand with a finger from a second hand.
13. The method of claim 12 , wherein the third virtual user interface is rendered such that:
the plurality of third level menu items move in a first direction relative to the hand of the user when the circling motion is clockwise, and
the plurality of third level menu items move in a second direction relative to the hand of the user when the circling motion is counter-clockwise.
14. The method of claim 13 , wherein the second direction is opposite of the first direction.
15. The method of claim 11 , wherein the third virtual user interface comprises a circle rendered on a palm of the hand of the user.
16. The method of claim 11 , wherein the plurality of third level menu items is rendered at least partially on fingers of the hand of the user.
17. The method of claim 16 , wherein a first menu item of the plurality of third level menu items is rendered such that it has a larger size compared to an associated second level menu item of the plurality of second level menu items, and
wherein each said first portion is rendered on a finger of the hand of the user.