Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
A computer system displays a first view of a three-dimensional environment. While displaying the first view, the computer system detects a first movement of a first hand that meets first criteria, and in response, displays a first virtual object that includes a first plurality of selectable controls at a first position in the first view, wherein the first position corresponds to a location of the first hand after the first movement in a physical environment. While displaying the first virtual object at the first position, the computer system detects a second movement of the first hand, and in response, displays movement of a representation of the first hand in the first view in accordance with the second movement of the first hand relative to a position of the first virtual object in the first view.
1. A method, comprising:
at a computer system that is in communication with a display generation component and one or more input devices:
displaying, via the display generation component, a first view of a three-dimensional environment;
while the first view of the three-dimensional environment is being displayed, detecting a first movement of a first hand that meets first criteria;
in response to detecting the first movement of the first hand that meets the first criteria, displaying, via the display generation component, a first virtual object that includes a first plurality of selectable controls at a first position in the first view of the three-dimensional environment, wherein the first position corresponds to a location of the first hand after the first movement in a physical environment;
while displaying, via the display generation component, the first virtual object at the first position, detecting a second movement of the first hand;
in response to detecting the second movement of the first hand, maintaining display of the first virtual object that includes the first plurality of selectable controls at the first position while a representation of the first hand moves in the first view of the three-dimensional environment in accordance with the second movement of the first hand relative to the first virtual object in the first view of the three-dimensional environment;
after detecting the second movement of the first hand, and while displaying the first virtual object at the first position in the first view of the three-dimensional environment, detecting movement of at least a first portion of the computer system; and
in response to detecting the movement of at least the first portion of the computer system, displaying a second view of the three-dimensional environment that is different from the first view of the three-dimensional environment and displaying the first virtual object at a second position in the second view of the three-dimensional environment, wherein the first position at which the first virtual object was displayed in response to the first movement of the first hand, and the second position, at which the first virtual object is displayed in response to the movement of the first portion of the computer system, correspond to different portions of the three-dimensional environment.
2. The method of claim 1 , wherein detecting the second movement of the first hand includes detecting a swipe gesture by the first hand in the physical environment, and the method includes:
in response to detecting the swipe gesture by the first hand and in accordance with a determination that the first hand is in a first configuration during the swipe gesture, moving input focus from a first selectable control in the first virtual object to a second selectable control different from the first selectable control in the first virtual object in accordance with the second movement of the first hand.
3. The method of claim 1 , wherein detecting the second movement of the first hand includes detecting a swipe gesture by the first hand in the physical environment, and the method includes:
in response to detecting the swipe gesture by the first hand and in accordance with a determination that the first hand is in a second configuration during the swipe gesture, displaying a second plurality of selectable controls that were not included in the first virtual object prior to detecting the swipe gesture by the first hand in the second configuration.
4. The method of claim 1 , wherein detecting the second movement of the first hand includes detecting a push gesture by the first hand and the method includes:
in response to detecting the push gesture by the first hand and in accordance with a determination that the push gesture meets activation criteria, selecting a respective selectable control of the first plurality of selectable controls in the first virtual object.
5. The method of claim 4 , including:
in response to detecting the push gesture by the first hand, moving the first virtual object in the first view of the three-dimensional environment in accordance with the movement of the first hand during the push gesture.
6. The method of claim 1 , including:
in response to detecting the second movement of the first hand:
in accordance with a determination that the second movement of the first hand corresponds to placing the first hand into a third configuration, performing a first operation with respect to the first virtual object; and
in accordance with a determination that the second movement of the first hand corresponds to placing the first hand into a fourth configuration that is different from the third configuration, performing a second operation that is different from the first operation with respect to the first virtual object.
7. The method of claim 1 , wherein displaying, via the display generation component, the first view of the three-dimensional environment includes displaying a mixed-reality environment of a first application, and wherein displaying the first virtual object includes replacing or blocking a view of at least a portion of the mixed-reality environment of the first application.
8. The method of claim 1 , wherein displaying the first virtual object that includes the first plurality of selectable controls includes:
in accordance with a determination that the three-dimensional environment corresponds to an environment of a first application, including a first set of selectable controls corresponding to the first application among the first plurality of selectable controls; and
in accordance with a determination that the three-dimensional environment corresponds to an environment of a second application different from the first application, including a second set of selectable controls corresponding to the second application, different from the first set of selectable controls corresponding to the first application, among the first plurality of selectable controls.
9. The method of claim 1 , wherein the three-dimensional environment includes a mixed reality environment of a first application, and wherein the method includes:
while displaying the first virtual object within the first view of the three-dimensional environment, detecting a third movement of the first hand; and
in response to detecting the third movement of the first hand and in accordance with a determination that the third movement of the first hand meets preset criteria for exiting the first application, ceasing to display the first virtual object and the first view of the three-dimensional environment, and displaying a view of the physical environment and a home menu that includes respective selectable controls for activating different applications.
10. The method of claim 1 , wherein:
the first view of the three-dimensional environment corresponds to a first viewpoint and the second view of the three-dimensional environment corresponds to a second viewpoint different from the first viewpoint; and
the first virtual object displayed at the first position in the first view of the three-dimensional environment has a first spatial relationship with the first viewpoint, and the first virtual object displayed at the second position in the second view of the three-dimensional environment has the first spatial relationship with the second viewpoint.
11. A computer system, comprising:
a display generation component;
one or more input devices;
one or more processors; and
memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display generation component, a first view of a three-dimensional environment;
while the first view of the three-dimensional environment is being displayed, detecting a first movement of a first hand that meets first criteria;
in response to detecting the first movement of the first hand that meets the first criteria, displaying, via the display generation component, a first virtual object that includes a first plurality of selectable controls at a first position in the first view of the three-dimensional environment, wherein the first position corresponds to a location of the first hand after the first movement in a physical environment;
while displaying, via the display generation component, the first virtual object at the first position, detecting a second movement of the first hand;
in response to detecting the second movement of the first hand, maintaining display of the first virtual object that includes the first plurality of selectable controls at the first position while a representation of the first hand moves in the first view of the three-dimensional environment in accordance with the second movement of the first hand relative to the first virtual object in the first view of the three-dimensional environment;
after detecting the second movement of the first hand, and while displaying the first virtual object at the first position in the first view of the three-dimensional environment, detecting movement of at least a first portion of the computer system; and
in response to detecting the movement of at least the first portion of the computer system, displaying a second view of the three-dimensional environment that is different from the first view of the three-dimensional environment and displaying the first virtual object at a second position in the second view of the three-dimensional environment, wherein the first position at which the first virtual object was displayed in response to the first movement of the first hand, and the second position, at which the first virtual object is displayed in response to the movement of the first portion of the computer system, correspond to different positions of the three-dimensional environment.
12. The computer system of claim 11 , wherein detecting the second movement of the first hand includes detecting a swipe gesture by the first hand in the physical environment, and wherein the one or more programs include instructions for:
in response to detecting the swipe gesture by the first hand and in accordance with a determination that the first hand is in a first configuration during the swipe gesture, moving input focus from a first selectable control in the first virtual object to a second selectable control different from the first selectable control in the first virtual object in accordance with the second movement of the first hand.
13. The computer system of claim 11 , wherein detecting the second movement of the first hand includes detecting a swipe gesture by the first hand in the physical environment, and wherein the one or more programs include instructions for:
in response to detecting the swipe gesture by the first hand and in accordance with a determination that the first hand is in a second configuration during the swipe gesture, displaying a second plurality of selectable controls that were not included in the first virtual object prior to detecting the swipe gesture by the first hand in the second configuration.
14. The computer system of claim 11 , wherein detecting the second movement of the first hand includes detecting a push gesture by the first hand, and wherein the one or more programs include instructions for:
in response to detecting the push gesture by the first hand and in accordance with a determination that the push gesture meets activation criteria, selecting a respective selectable control of the first plurality of selectable controls in the first virtual object.
15. The computer system of claim 14 , wherein the one or more programs include instructions for:
in response to detecting the push gesture by the first hand, moving the first virtual object in the first view of the three-dimensional environment in accordance with the movement of the first hand during the push gesture.
16. The computer system of claim 11 , wherein the one or more programs include instructions for:
in response to detecting the second movement of the first hand:
in accordance with a determination that the second movement of the first hand corresponds to placing the first hand into a third configuration, performing a first operation with respect to the first virtual object; and
in accordance with a determination that the second movement of the first hand corresponds to placing the first hand into a fourth configuration that is different from the third configuration, performing a second operation that is different from the first operation with respect to the first virtual object.
17. The computer system of claim 11 , wherein displaying, via the display generation component, the first view of the three-dimensional environment includes displaying a mixed-reality environment of a first application, and wherein displaying the first virtual object includes replacing or blocking a view of at least a portion of the mixed-reality environment of the first application.
18. The computer system of claim 11 , wherein displaying the first virtual object that includes the first plurality of selectable controls includes:
in accordance with a determination that the three-dimensional environment corresponds to an environment of a first application, including a first set of selectable controls corresponding to the first application among the first plurality of selectable controls; and
in accordance with a determination that the three-dimensional environment corresponds to an environment of a second application different from the first application, including a second set of selectable controls corresponding to the second application, different from the first set of selectable controls corresponding to the first application, among the first plurality of selectable controls.
19. The computer system of claim 11 , wherein the three-dimensional environment includes a mixed reality environment of a first application, and wherein the one or more programs include instructions for:
while displaying the first virtual object within the first view of the three-dimensional environment, detecting a third movement of the first hand; and
in response to detecting the third movement of the first hand and in accordance with a determination that the third movement of the first hand meets preset criteria for exiting the first application, ceasing to display the first virtual object and the first view of the three-dimensional environment, and displaying a view of the physical environment and a home menu that includes respective selectable controls for activating different applications.
20. The computer system of claim 11 , wherein:
the first view of the three-dimensional environment corresponds to a first viewpoint and the second view of the three-dimensional environment corresponds to a second viewpoint different from the first viewpoint; and
the first virtual object displayed at the first position in the first view of the three-dimensional environment has a first spatial relationship with the first viewpoint, and the first virtual object displayed at the second position in the second view of the three-dimensional environment has the first spatial relationship with the second viewpoint.
21. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a computer system that includes a display generation component and one or more input devices, cause the computer system to:
display, via the display generation component, a first view of a three-dimensional environment;
while the first view of the three-dimensional environment is being displayed, detect a first movement of a first hand that meets first criteria;
in response to detecting the first movement of the first hand that meets the first criteria, displaying, via the display generation component, a first virtual object that includes a first plurality of selectable controls at a first position in the first view of the three-dimensional environment, wherein the first position corresponds to a location of the first hand after the first movement in a physical environment;
while displaying, via the display generation component, the first virtual object at the first position, detect a second movement of the first hand;
in response to detecting the second movement of the first hand, maintain display of the first virtual object that includes the first plurality of selectable controls at the first position while a representation of the first hand moves in the first view of the three-dimensional environment in accordance with the second movement of the first hand relative to the first virtual object in the first view of the three-dimensional environment;
after detecting the second movement of the first hand, and while displaying the first virtual object at the first position in the first view of the three-dimensional environment, detect movement of at least a first portion of the computer system; and
in response to detecting the movement of at least the first portion of the computer system, display a second view of the three-dimensional environment that is different from the first view of the three-dimensional environment and display the first virtual object at a second position in the second view of the three-dimensional environment, wherein the first position at which the first virtual object was displayed in response to the first movement of the first hand, and the second position, at which the first virtual object is displayed in response to the movement of the first portion of the computer system, correspond to different portions of the three-dimensional environment.
22. The non-transitory computer readable storage medium of claim 21 , wherein detecting the second movement of the first hand includes detecting a swipe gesture by the first hand in the physical environment, and wherein the one or more programs include instructions, which when executed by the computer system, cause the computer system to:
in response to detecting the swipe gesture by the first hand and in accordance with a determination that the first hand is in a first configuration during the swipe gesture, move input focus from a first selectable control in the first virtual object to a second selectable control different from the first selectable control in the first virtual object in accordance with the second movement of the first hand.
23. The non-transitory computer readable storage medium of claim 21 , wherein detecting the second movement of the first hand includes detecting a swipe gesture by the first hand in the physical environment, and wherein the one or more programs include instructions, which when executed by the computer system, cause the computer system to:
in response to detecting the swipe gesture by the first hand and in accordance with a determination that the first hand is in a second configuration during the swipe gesture, display a second plurality of selectable controls that were not included in the first virtual object prior to detecting the swipe gesture by the first hand in the second configuration.
24. The non-transitory computer readable storage medium of claim 21 , wherein detecting the second movement of the first hand includes detecting a push gesture by the first hand, and wherein the one or more programs include instructions, which when executed by the computer system, cause the computer system to:
in response to detecting the push gesture by the first hand and in accordance with a determination that the push gesture meets activation criteria, select a respective selectable control of the first plurality of selectable controls in the first virtual object.
25. The non-transitory computer readable storage medium of claim 24 , wherein the one or more programs include instructions, which when executed by the computer system, cause the computer system to:
in response to detecting the push gesture by the first hand, move the first virtual object in the first view of the three-dimensional environment in accordance with the movement of the first hand during the push gesture.
26. The non-transitory computer readable storage medium of claim 21 , wherein the one or more programs include instructions, which when executed by the computer system, cause the computer system to:
in response to detecting the second movement of the first hand:
in accordance with a determination that the second movement of the first hand corresponds to placing the first hand into a third configuration, perform a first operation with respect to the first virtual object; and
in accordance with a determination that the second movement of the first hand corresponds to placing the first hand into a fourth configuration that is different from the third configuration, perform a second operation that is different from the first operation with respect to the first virtual object.
27. The non-transitory computer readable storage medium of claim 21 , wherein displaying, via the display generation component, the first view of the three-dimensional environment includes displaying a mixed-reality environment of a first application, and wherein displaying the first virtual object includes replacing or blocking a view of at least a portion of the mixed-reality environment of the first application.
28. The non-transitory computer readable storage medium of claim 21 , wherein displaying the first virtual object that includes the first plurality of selectable controls includes:
in accordance with a determination that the three-dimensional environment corresponds to an environment of a first application, including a first set of selectable controls corresponding to the first application among the first plurality of selectable controls; and
in accordance with a determination that the three-dimensional environment corresponds to an environment of a second application different from the first application, including a second set of selectable controls corresponding to the second application, different from the first set of selectable controls corresponding to the first application, among the first plurality of selectable controls.
29. The non-transitory computer readable storage medium of claim 21 , wherein the three-dimensional environment includes a mixed reality environment of a first application, and wherein the one or more programs include instructions, which when executed by the computer system, cause the computer system to:
while displaying the first virtual object within the first view of the three-dimensional environment, detect a third movement of the first hand; and
in response to detecting the third movement of the first hand and in accordance with a determination that the third movement of the first hand meets preset criteria for exiting the first application, cease to display the first virtual object and the first view of the three-dimensional environment, and display a view of the physical environment and a home menu that includes respective selectable controls for activating different applications.
30. The non-transitory computer readable storage medium of claim 21 , wherein:
the first view of the three-dimensional environment corresponds to a first viewpoint and the second view of the three-dimensional environment corresponds to a second viewpoint different from the first viewpoint; and
the first virtual object displayed at the first position in the first view of the three-dimensional environment has a first spatial relationship with the first viewpoint, and the first virtual object displayed at the second position in the second view of the three-dimensional environment has the first spatial relationship with the second viewpoint.