Method of displaying selectable options
Methods for displaying selectable options in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, one or more selectable options are displayed in a three-dimensional computer-generated environment in accordance with the determination that the one or more criteria have been satisfied, including a criteria that a hand of the user is oriented in a predetermined manner with respect to an electronic device. In some embodiments, a user is able to perform one-handed actuation of a selectable option with a plurality of user inputs and/or gestures that satisfy one or more activation criteria.
1. A method comprising:
at an electronic device in communication with a display:
presenting, via the display, a three-dimensional environment;
while presenting the three-dimensional environment, determining that one or more criteria have been satisfied, including a requirement that a hand in the three-dimensional environment is oriented in a predetermined manner with respect to the electronic device, and a requirement that a gaze of a user is directed at the hand or within a threshold distance of the hand within the three-dimensional environment; and
in accordance with the determination that the one or more criteria have been satisfied, displaying, via the display, a control user interface element at a location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented with respect to the electronic device.
2. The method of claim 1 , wherein the three-dimensional environment includes a first location corresponding to a user of the electronic device, and an orientation of the hand in the predetermined manner is towards the first location.
3. The method of claim 1 , wherein the three-dimensional environment includes a first location corresponding to a user of the electronic device, and an orientation of the hand in the predetermined manner is within a threshold number of degrees of a vector pointing from the hand to the first location.
4. The method of claim 1 , wherein the determination that the one or more criteria have been satisfied includes determining, via an image sensor, a predetermined pose of the hand within the three-dimensional environment.
5. The method of claim 1 , wherein the requirement that the gaze of the user is directed at the hand in the three-dimensional environment is satisfied when a focus of the gaze of the user is within an area in the three-dimensional environment around the hand.
6. The method of claim 5 , wherein:
in accordance with a determination that the control user interface element is displayed in the three-dimensional environment, the area around the hand is a first size; and
in accordance with a determination that the control user interface element is not displayed in the three-dimensional environment, the area around the hand is a second size, smaller than the first size.
7. The method of claim 1 , wherein the one or more criteria include a requirement that the hand includes an open palm and a requirement that the open palm is oriented in the predetermined manner with respect to the electronic device.
8. The method of claim 1 , wherein the control user interface element includes a plurality of affordances that are selectable to perform respective operations.
9. The method of claim 8 , wherein the plurality of affordances are selectable to display respective applications in the three-dimensional environment.
10. The method of claim 8 , further comprising:
while displaying the control user interface element at the location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented:
detecting the gaze of the user, and
detecting a plurality of user inputs from the hand; and
in accordance with a determination that the gaze of the user is directed at an affordance from the plurality of affordances, and in accordance with a determination that the plurality of user inputs from the hand satisfies one or more selection criteria, selecting the affordance.
11. The method of claim 8 , wherein:
the three-dimensional environment includes a first user interface of a first application;
in accordance with a determination that one or more application focus criteria are satisfied, the plurality of affordances are selectable to perform respective operations associated with the first application; and
in accordance with a determination that the one or more application focus criteria are not satisfied, the plurality of affordances are not selectable to perform respective operations associated with the first application.
12. The method of claim 11 , wherein the one or more application focus criteria includes one or more of:
a requirement that a most recent user input was directed at the first application within a first threshold amount of time before the control user interface element was displayed, and
a requirement that the gaze of the user is directed at the first application within a second threshold amount of time before the control user interface element was displayed.
13. The method of claim 1 , further comprising:
presenting the hand in the three-dimensional environment, including presenting a portion of a physical environment that includes the hand.
14. The method of claim 1 , wherein an orientation of the control user interface element is based on an orientation of one or more objects in the three-dimensional environment.
15. The method of claim 1 , further comprising:
while displaying the control user interface element at the location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented, detecting a movement of the hand; and
in accordance with a determination that the movement of the hand satisfies one or more movement criteria, moving the control user interface element in accordance with the movement of the hand.
16. The method of claim 15 , further comprising:
in accordance with a determination that the movement of the hand satisfies one or more disassociation criteria, different from the one or more movement criteria, displaying the control user interface element at a location in the three-dimensional environment not associated with the hand, wherein the control user interface element does not move in response to detecting a movement of the hand.
17. The method of claim 15 , further comprising:
while moving the control user interface element in accordance with the movement of the hand, changing a spacing between elements in the control user interface element based at least on the movement of the hand.
18. An electronic device, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
presenting, via a display, a three-dimensional environment;
while presenting the three-dimensional environment, determining that one or more criteria have been satisfied, including a requirement that a hand in the three-dimensional environment is oriented in a predetermined manner with respect to the electronic device, and a requirement that a gaze of a user is directed at the band, or within a threshold distance of the hand within the three-dimensional environment; and
in accordance with the determination that the one or more criteria have been satisfied, displaying, via the display, a control user interface element at a location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented with respect to the electronic device.
19. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
present, via a display, a three-dimensional environment;
while presenting the three-dimensional environment, determine that one or more criteria have been satisfied, including a requirement that a hand in the three-dimensional environment is oriented in a predetermined manner with respect to the electronic device, and a requirement that a gaze of a user is directed at the hand, or within a threshold distance of the hand within the three-dimensional environment with respect to the electronic device; and
in accordance with the determination that the one or more criteria have been satisfied, display, via the display, a control user interface element at a location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented with respect to the electronic device.
20. The electronic device of claim 18 , wherein the three-dimensional environment includes a first location corresponding to a user of the electronic device, and an orientation of the hand in the predetermined manner is towards the first location.
21. The electronic device of claim 18 , wherein the three-dimensional environment includes a first location corresponding to a user of the electronic device, and an orientation of the hand in the predetermined manner is within a threshold number of degrees of a vector pointing from the hand to the first location.
22. The electronic device of claim 18 , wherein the determination that the one or more criteria have been satisfied includes determining, via an image sensor, a predetermined pose of the hand within the three-dimensional environment.
23. The electronic device of claim 18 , wherein the requirement that the gaze of the user is directed at the hand in the three-dimensional environment is satisfied when a focus of the gaze of the user is within an area in the three-dimensional environment around the hand.
24. The electronic device of claim 23 , wherein:
in accordance with a determination that the control user interface element is displayed in the three-dimensional environment, the area around the hand is a first size; and
in accordance with a determination that the control user interface element is not displayed in the three-dimensional environment, the area around the hand is a second size, smaller than the first size.
25. The electronic device of claim 18 , wherein the one or more criteria include a requirement that the hand includes an open palm and a requirement that the open palm is oriented in the predetermined manner with respect to the electronic device.
26. The electronic device of claim 18 , wherein the control user interface element includes a plurality of affordances that are selectable to perform respective operations.
27. The electronic device of claim 26 , wherein the plurality of affordances are selectable to display respective applications in the three-dimensional environment.
28. The electronic device of claim 26 , the one or more programs including instructions for:
while displaying the control user interface element at the location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented:
detecting the gaze of the user, and
detecting a plurality of user inputs from the hand; and
in accordance with a determination that the gaze of the user is directed at an affordance from the plurality of affordances, and in accordance with a determination that the plurality of user inputs from the hand satisfies one or more selection criteria, selecting the affordance.
29. The electronic device of claim 26 , wherein:
the three-dimensional environment includes a first user interface of a first application;
in accordance with a determination that one or more application focus criteria are satisfied, the plurality of affordances are selectable to perform respective operations associated with the first application; and
in accordance with a determination that the one or more application focus criteria are not satisfied, the plurality of affordances are not selectable to perform respective operations associated with the first application.
30. The electronic device of claim 29 , wherein the one or more application focus criteria includes one or more of:
a requirement that a most recent user input was directed at the first application within a first threshold amount of time before the control user interface element was displayed, and
a requirement that the gaze of the user is directed at the first application within a second threshold amount of time before the control user interface element was displayed.
31. The electronic device of claim 18 , the one or more programs including instructions for:
presenting the hand in the three-dimensional environment, including presenting a portion of a physical environment that includes the hand.
32. The electronic device of claim 18 , wherein an orientation of the control user interface element is based on an orientation of one or more objects in the three-dimensional environment.
33. The electronic device of claim 18 , the one or more programs including instructions for:
while displaying the control user interface element at the location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented, detecting a movement of the hand; and
in accordance with a determination that the movement of the hand satisfies one or more movement criteria, moving the control user interface element in accordance with the movement of the hand.
34. The electronic device of claim 33 , the one or more programs including instructions for:
in accordance with a determination that the movement of the hand satisfies one or more disassociation criteria, different from the one or more movement criteria, displaying the control user interface element at a location in the three-dimensional environment not associated with the hand, wherein the control user interface element does not move in response to detecting a movement of the hand.
35. The electronic device of claim 33 , the one or more programs including instructions for:
while moving the control user interface element in accordance with the movement of the hand, changing a spacing between elements in the control user interface element based at least on the movement of the hand.
36. The non-transitory computer readable storage medium of claim 19 , wherein the three-dimensional environment includes a first location corresponding to a user of the electronic device, and an orientation of the hand in the predetermined manner is towards the first location.
37. The non-transitory computer readable storage medium of claim 19 , wherein the three-dimensional environment includes a first location corresponding to a user of the electronic device, and an orientation of the hand in the predetermined manner is within a threshold number of degrees of a vector pointing from the hand to the first location.
38. The non-transitory computer readable storage medium of claim 19 , wherein the determination that the one or more criteria have been satisfied includes determining, via an image sensor, a predetermined pose of the hand within the three-dimensional environment.
39. The non-transitory computer readable storage medium of claim 19 , wherein the requirement that the gaze of the user is directed at the hand in the three-dimensional environment is satisfied when a focus of the gaze of the user is within an area in the three-dimensional environment around the hand.
40. The non-transitory computer readable storage medium of claim 39 , wherein:
in accordance with a determination that the control user interface element is displayed in the three-dimensional environment, the area around the hand is a first size; and
in accordance with a determination that the control user interface element is not displayed in the three-dimensional environment, the area around the hand is a second size, smaller than the first size.
41. The non-transitory computer readable storage medium of claim 19 , wherein the one or more criteria include a requirement that the hand includes an open palm and a requirement that the open palm is oriented in the predetermined manner with respect to the electronic device.
42. The non-transitory computer readable storage medium of claim 19 , wherein the control user interface element includes a plurality of affordances that are selectable to perform respective operations.
43. The non-transitory computer readable storage medium of claim 42 , wherein the plurality of affordances are selectable to display respective applications in the three-dimensional environment.
44. The non-transitory computer readable storage medium of claim 42 , the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
display the control user interface element at the location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented:
detect the gaze of the user, and detect a plurality of user inputs from the hand; and
in accordance with a determination that the gaze of the user is directed at an affordance from the plurality of affordances, and in accordance with a determination that the plurality of user inputs from the hand satisfies one or more selection criteria, selecting the affordance.
45. The non-transitory computer readable storage medium of claim 42 , wherein:
the three-dimensional environment includes a first user interface of a first application;
in accordance with a determination that one or more application focus criteria are satisfied, the plurality of affordances are selectable to perform respective operations associated with the first application; and
in accordance with a determination that the one or more application focus criteria are not satisfied, the plurality of affordances are not selectable to perform respective operations associated with the first application.
46. The non-transitory computer readable storage medium of claim 45 , wherein the one or more application focus criteria includes one or more of:
a requirement that a most recent user input was directed at the first application within a first threshold amount of time before the control user interface element was displayed, and
a requirement that the gaze of the user is directed at the first application within a second threshold amount of time before the control user interface element was displayed.
47. The non-transitory computer readable storage medium of claim 19 , the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
present the hand in the three-dimensional environment, including presenting a portion of a physical environment that includes the hand.
48. The non-transitory computer readable storage medium of claim 19 , wherein an orientation of the control user interface element is based on an orientation of one or more objects in the three-dimensional environment.
49. The non-transitory computer readable storage medium of claim 19 , the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
while displaying the control user interface element at the location in the three-dimensional environment associated with the predetermined manner in which the hand is oriented, detect a movement of the hand; and
in accordance with a determination that the movement of the hand satisfies one or more movement criteria, move the control user interface element in accordance with the movement of the hand.
50. The non-transitory computer readable storage medium of claim 49 , the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
in accordance with a determination that the movement of the hand satisfies one or more disassociation criteria, different from the one or more movement criteria, display the control user interface element at a location in the three-dimensional environment not associated with the hand, wherein the control user interface element does not move in response to detecting a movement of the hand.
51. The non-transitory computer readable storage medium of claim 49 , the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to:
while moving the control user interface element in accordance with the movement of the hand, change a spacing between elements in the control user interface element based at least on the movement of the hand.