Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
A computer system concurrently displays a view of a physical environment; and a computer-generated user interface element overlaid on the view of the physical environment. An appearance of the computer-generated user interface element is based on an appearance of the view of the physical environment on which the computer-generated user interface element is overlaid. In response to an appearance of the physical environment changing, the appearance of the computer-generated user interface element is updated at a first time based on a graphical composition of the appearance of one or more portions of the physical environment at different times prior to the first time, including: an appearance of a first portion of the physical environment at a second time that is before the first time; and an appearance of a second portion of the physical environment at a third time that is before the second time.
1. A method, comprising:
at a computer system that is in communication with a display generation component:
concurrently displaying, via the display generation component:
a view of a physical environment; and
a computer-generated user interface element overlaid on at least a portion of the view of the physical environment, wherein an appearance of the computer-generated user interface element is based on an appearance of one or more portions of the view of the physical environment on which the computer-generated user interface element is overlaid;
while concurrently displaying the view of the physical environment and the computer-generated user interface element, an appearance of a portion of the physical environment changes; and
in response to the change in appearance of the portion of the physical environment, updating the appearance of the computer-generated user interface element at a first time based on a graphical composition of the appearance of one or more portions of the physical environment at different times prior to the first time, wherein the appearance of the computer-generated user interface element is based on:
an appearance of a first portion of the physical environment at a second time that is before the first time; and
an appearance of a second portion of the physical environment at a third time that is before the second time.
2. The method of claim 1 , wherein the appearance of the portion of the physical environment changes in response to movement of the computer system relative to the physical environment.
3. The method of claim 1 , wherein the appearance of the portion of the physical environment changes in response to movement of one or more objects in the physical environment, wherein the one or more objects are distinct from the computer system.
4. The method of claim 1 , wherein the computer-generated user interface element includes content, and the updating of the appearance of the computer-generated user interface element based on the graphical composition is applied to one or more regions of the computer-generated user interface element distinct from the content of the computer-generated user interface element.
5. The method of claim 1 , wherein:
the graphical composition is based a first amount on the appearance of the first portion of the physical environment at the second time that is before the first time and based a second amount on the appearance of the second portion of the physical environment at the third time that is before the second time; and
the first amount is different from the second amount.
6. The method of claim 5 , wherein at the first time, a contribution of one or more portions of the physical environment at a time closer to the first time to the appearance of the computer-generated user interface element at the first time is greater than the contribution of one or more portions of the physical environment at a time further from the first time t 0 the appearance of the computer-generated user interface element at the first time.
7. The method of claim 6 , wherein the contribution of one or more portions of the physical environment at a time furthest from the first time t 0 the appearance of the computer-generated user interface element at the first time is less than the contribution of one or more portions of the physical environment at any time closer to the first time t 0 the appearance of the computer-generated user interface element at the first time.
8. The method of claim 1 , wherein the graphical composition is based on the appearance of the one or more portions of the physical environment at a number of different times prior to the first time, and the number of different times is based on an amount of movement of the computer system relative to the physical environment.
9. The method of claim 1 , wherein determining the graphical composition includes applying a noise pattern to information captured about the appearance of the one or more portions of the physical environment at the different times.
10. The method of claim 1 , wherein, in determining the graphical composition of the one or more portions of the physical environment at the different times, the appearance of the first portion of the physical environment at the second time is offset from the appearance of the second portion of the physical environment at the third time based on a difference between a perspective of the computer system at the second time and a perspective of the computer system at the third time.
11. The method of claim 1 , wherein determining the graphical composition of the appearance of the one or more portions of the physical environment at the different times includes blurring views of the physical environment captured by one or more cameras of the computer system.
12. The method of claim 1 , wherein the graphical composition is partially translucent.
13. The method of claim 1 , wherein determining the graphical composition of the appearance of the one or more portions of the physical environment at the different times includes reducing resolution of information captured about the one or more portions of the physical environment at different times prior to the first time.
14. The method of claim 1 , wherein the appearance of the computer-generated user interface element is updated as a viewing perspective of the computer-generated user interface element changes.
15. The method of claim 1 , wherein the appearance of the computer-generated user interface element is updated as the computer-generated user interface element is moved.
16. The method of claim 1 , wherein the appearance of the computer-generated user interface element is updated based on one or more additional computer-generated user interface elements having simulated positions behind a simulated position of the computer-generated user interface element.
17. The method of claim 16 , wherein the appearance of the one or more additional computer-generated user interface elements is updated over time.
18. The method of claim 1 , wherein the computer-generated user interface element is a back surface of a displayed user interface that includes one or more selectable user interface objects.
19. The method of claim 1 , wherein the appearance of the computer-generated user interface element is based on an appearance of one or more portions of the view of the physical environment on which the computer-generated user interface element is overlaid without regard to a simulated position of the computer-generated user interface element relative to the physical environment.
20. The method of claim 1 , wherein a simulated position of the computer-generated user interface element is a first distance from a viewpoint of a user, and the appearance of the computer-generated user interface element is based on an appearance of one or more portions of the physical environment that are a second distance from the viewpoint of the user, wherein the first distance is greater than the second distance.
21. A computer system that is in communication with a display generation component, comprising:
one or more processors; and
memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for:
concurrently displaying, via the display generation component:
a view of a physical environment; and
a computer-generated user interface element overlaid on at least a portion of the view of the physical environment, wherein an appearance of the computer-generated user interface element is based on an appearance of one or more portions of the view of the physical environment on which the computer-generated user interface element is overlaid;
while concurrently displaying the view of the physical environment and the computer-generated user interface element, an appearance of a portion of the physical environment changes; and
in response to the change in appearance of the portion of the physical environment, updating the appearance of the computer-generated user interface element at a first time based on a graphical composition of the appearance of one or more portions of the physical environment at different times prior to the first time, wherein the appearance of the computer-generated user interface element is based on:
an appearance of a first portion of the physical environment at a second time that is before the first time; and
an appearance of a second portion of the physical environment at a third time that is before the second time.
22. The computer system of claim 21 , wherein the appearance of the portion of the physical environment changes in response to movement of the computer system relative to the physical environment.
23. The computer system of claim 21 , wherein the appearance of the portion of the physical environment changes in response to movement of one or more objects in the physical environment, wherein the one or more objects are distinct from the computer system.
24. The computer system of claim 21 , wherein the computer-generated user interface element includes content, and the updating of the appearance of the computer-generated user interface element based on the graphical composition is applied to one or more regions of the computer-generated user interface element distinct from the content of the computer-generated user interface element.
25. The computer system of claim 21 , wherein:
the graphical composition is based a first amount on the appearance of the first portion of the physical environment at the second time that is before the first time and based a second amount on the appearance of the second portion of the physical environment at the third time that is before the second time; and
the first amount is different from the second amount.
26. The computer system of claim 25 , wherein at the first time, a contribution of one or more portions of the physical environment at a time closer to the first time t 0 the appearance of the computer-generated user interface element at the first time is greater than the contribution of one or more portions of the physical environment at a time further from the first time to the appearance of the computer-generated user interface element at the first time.
27. The computer system of claim 26 , wherein the contribution of one or more portions of the physical environment at a time furthest from the first time to the appearance of the computer-generated user interface element at the first time is less than the contribution of one or more portions of the physical environment at any time closer to the first time to the appearance of the computer-generated user interface element at the first time.
28. The computer system of claim 21 , wherein the graphical composition is based on the appearance of the one or more portions of the physical environment at a number of different times prior to the first time, and the number of different times is based on an amount of movement of the computer system relative to the physical environment.
29. The computer system of claim 21 , wherein determining the graphical composition includes applying a noise pattern to information captured about the appearance of the one or more portions of the physical environment at the different times.
30. The computer system of claim 21 , wherein, in determining the graphical composition of the one or more portions of the physical environment at the different times, the appearance of the first portion of the physical environment at the second time is offset from the appearance of the second portion of the physical environment at the third time based on a difference between a perspective of the computer system at the second time and a perspective of the computer system at the third time.
31. The computer system of claim 21 , wherein determining the graphical composition of the appearance of the one or more portions of the physical environment at the different times includes blurring views of the physical environment captured by one or more cameras of the computer system.
32. The computer system of claim 21 , wherein the graphical composition is partially translucent.
33. The computer system of claim 21 , wherein determining the graphical composition of the appearance of the one or more portions of the physical environment at the different times includes reducing resolution of information captured about the one or more portions of the physical environment at different times prior to the first time.
34. The computer system of claim 21 , wherein the appearance of the computer-generated user interface element is updated as a viewing perspective of the computer-generated user interface element changes.
35. The computer system of claim 21 , wherein the appearance of the computer-generated user interface element is updated as the computer-generated user interface element is moved.
36. The computer system of claim 21 , wherein the appearance of the computer-generated user interface element is updated based on one or more additional computer-generated user interface elements having simulated positions behind a simulated position of the computer-generated user interface element.
37. The computer system of claim 36 , wherein the appearance of the one or more additional computer-generated user interface elements is updated over time.
38. The computer system of claim 21 , wherein the computer-generated user interface element is a back surface of a displayed user interface that includes one or more selectable user interface objects.
39. The computer system of claim 21 , wherein the appearance of the computer-generated user interface element is based on an appearance of one or more portions of the view of the physical environment on which the computer-generated user interface element is overlaid without regard to a simulated position of the computer-generated user interface element relative to the physical environment.
40. The computer system of claim 21 , wherein a simulated position of the computer-generated user interface element is a first distance from a viewpoint of a user, and the appearance of the computer-generated user interface element is based on an appearance of one or more portions of the physical environment that are a second distance from the viewpoint of the user, wherein the first distance is greater than the second distance.
41. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a computer system that is in communication with a display generation component, cause the computer system to:
concurrently display, via the display generation component:
a view of a physical environment; and
a computer-generated user interface element overlaid on at least a portion of the view of the physical environment, wherein an appearance of the computer-generated user interface element is based on an appearance of one or more portions of the view of the physical environment on which the computer-generated user interface element is overlaid;
while concurrently displaying the view of the physical environment and the computer-generated user interface element, an appearance of a portion of the physical environment changes; and
in response to the change in appearance of the portion of the physical environment, updating the appearance of the computer-generated user interface element at a first time based on a graphical composition of the appearance of one or more portions of the physical environment at different times prior to the first time wherein the appearance of the computer-generated user interface element is based on:
an appearance of a first portion of the physical environment at a second time that is before the first time; and
an appearance of a second portion of the physical environment at a third time that is before the second time.
42. The non-transitory computer readable storage medium of claim 41 , wherein the appearance of the portion of the physical environment changes in response to movement of the computer system relative to the physical environment.
43. The non-transitory computer readable storage medium of claim 41 , wherein the appearance of the portion of the physical environment changes in response to movement of one or more objects in the physical environment, wherein the one or more objects are distinct from the computer system.
44. The non-transitory computer readable storage medium of claim 41 , wherein the computer-generated user interface element includes content, and the updating of the appearance of the computer-generated user interface element based on the graphical composition is applied to one or more regions of the computer-generated user interface element distinct from the content of the computer-generated user interface element.
45. The non-transitory computer readable storage medium of claim 41 , wherein:
the graphical composition is based a first amount on the appearance of the first portion of the physical environment at the second time that is before the first time and based a second amount on the appearance of the second portion of the physical environment at the third time that is before the second time; and
the first amount is different from the second amount.
46. The non-transitory computer readable storage medium of claim 45 , wherein at the first time, a contribution of one or more portions of the physical environment at a time closer to the first time to the appearance of the computer-generated user interface element at the first time is greater than the contribution of one or more portions of the physical environment at a time further from the first time to the appearance of the computer-generated user interface element at the first time.
47. The non-transitory computer readable storage medium of claim 46 , wherein the contribution of one or more portions of the physical environment at a time furthest from the first time to the appearance of the computer-generated user interface element at the first time is less than the contribution of one or more portions of the physical environment at any time closer to the first time to the appearance of the computer-generated user interface element at the first time.
48. The non-transitory computer readable storage medium of claim 41 , wherein the graphical composition is based on the appearance of the one or more portions of the physical environment at a number of different times prior to the first time, and the number of different times is based on an amount of movement of the computer system relative to the physical environment.
49. The non-transitory computer readable storage medium of claim 41 , wherein determining the graphical composition includes applying a noise pattern to information captured about the appearance of the one or more portions of the physical environment at the different times.
50. The non-transitory computer readable storage medium of claim 41 , wherein, in determining the graphical composition of the one or more portions of the physical environment at the different times, the appearance of the first portion of the physical environment at the second time is offset from the appearance of the second portion of the physical environment at the third time based on a difference between a perspective of the computer system at the second time and a perspective of the computer system at the third time.
51. The non-transitory computer readable storage medium of claim 41 , wherein determining the graphical composition of the appearance of the one or more portions of the physical environment at the different times includes blurring views of the physical environment captured by one or more cameras of the computer system.
52. The non-transitory computer readable storage medium of claim 41 , wherein the graphical composition is partially translucent.
53. The non-transitory computer readable storage medium of claim 41 , wherein determining the graphical composition of the appearance of the one or more portions of the physical environment at the different times includes reducing resolution of information captured about the one or more portions of the physical environment at different times prior to the first time.
54. The non-transitory computer readable storage medium of claim 41 , wherein the appearance of the computer-generated user interface element is updated as a viewing perspective of the computer-generated user interface element changes.
55. The non-transitory computer readable storage medium of claim 41 , wherein the appearance of the computer-generated user interface element is updated as the computer-generated user interface element is moved.
56. The non-transitory computer readable storage medium of claim 41 , wherein the appearance of the computer-generated user interface element is updated based on one or more additional computer-generated user interface elements having simulated positions behind a simulated position of the computer-generated user interface element.
57. The non-transitory computer readable storage medium of claim 56 , wherein the appearance of the one or more additional computer-generated user interface elements is updated over time.
58. The non-transitory computer readable storage medium of claim 41 , wherein the computer-generated user interface element is a back surface of a displayed user interface that includes one or more selectable user interface objects.
59. The non-transitory computer readable storage medium of claim 41 , wherein the appearance of the computer-generated user interface element is based on an appearance of one or more portions of the view of the physical environment on which the computer-generated user interface element is overlaid without regard to a simulated position of the computer-generated user interface element relative to the physical environment.
60. The non-transitory computer readable storage medium of claim 41 , wherein a simulated position of the computer-generated user interface element is a first distance from a viewpoint of a user, and the appearance of the computer-generated user interface element is based on an appearance of one or more portions of the physical environment that are a second distance from the viewpoint of the user, wherein the first distance is greater than the second distance.