Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
A computer system, while displaying a view of a computer-generated environment, detects movement of a physical object, and in response: in accordance with a determination that a user is within a threshold distance of a first portion of the physical object and that the physical object meets preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion, without changing an appearance of virtual content displayed at a position corresponding to the physical object's second portion; and in accordance with a determination that the user is within the threshold distance and that the physical object does not meet the preset criteria, the computer system changes an appearance of virtual content displayed at a position corresponding to a current location of the physical object's first portion.
1. A method, comprising:
at a computer system that is in communication with a display generation component:
displaying, via the display generation component, a view of a computer-generated environment;
while displaying the computer-generated environment and while the computer-generated environment does not include a visual representation of a first portion and a second portion of a first physical object present in a physical environment in which a user is located, detecting first movement of the first physical object in the physical environment;
in response to detecting the first movement of the first physical object in the physical environment:
in accordance with a determination that the user is within a threshold distance of the first portion of the first physical object and outside the threshold distance of the second portion of the first physical object and that the first physical object meets preset criteria, the preset criteria including a requirement related to a preset characteristic of the first physical object other than a distance of the first physical object from the user, changing an appearance of a portion of virtual content displayed at a position corresponding to a current location of the first portion of the first physical object, without changing an appearance of a portion of the virtual content displayed at a position corresponding to the second portion of the first physical object, wherein the first portion of the first physical object and the second portion of the physical object are both part of an extent of the first physical object that is potentially visible to the user based on a field of view of the user for the computer-generated environment; and
in accordance with a determination that the user is within the threshold distance of the first physical object present in the physical environment surrounding the user and that the first physical object does not meet the preset criteria, forgoing changing an appearance of a portion of virtual content displayed at a position corresponding to a current location of the first portion of the first physical object.
2. The method of claim 1 , wherein the first portion of the first physical object and the second portion of the first physical object are continuous portions of the first physical object.
3. The method of claim 1 , wherein the portion of the virtual content displayed at the position corresponding to the first portion of the first physical object and the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object include respective portions of the same virtual object.
4. The method of claim 1 , wherein changing the appearance of the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object, without changing the appearance of the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object includes:
while maintaining display of the virtual content, applying a first visual effect to the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object, without applying the first visual effect to the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object.
5. The method of claim 1 , wherein the preset characteristic of the first physical object includes a first characteristic that distinguishes between a person and non-person physical objects, and determining that the first physical object meets the preset criteria includes detecting presence of the first characteristic on the first physical object.
6. The method of claim 1 , wherein the preset characteristic of the first physical object includes a second characteristic that is indicative of human speech coming from the first physical object as the first physical object is moving toward the user, and determining that the first physical object meets the preset criteria includes detecting the second characteristic at the location of the first physical object.
7. The method of claim 1 , wherein the preset characteristic of the first physical object includes a third characteristic that distinguishes an animal from a person and non-person physical objects, and determining that the first physical object meets the preset criteria includes detecting presence of the third characteristic on the first physical object.
8. The method of claim 1 , wherein the preset characteristic of the first physical object includes a fourth characteristic that is based on a movement speed of the first physical object, and determining that the first physical object meets the preset criteria includes detecting a characteristic value of the fourth characteristic of the first physical object exceeds a preset threshold value.
9. The method of claim 1 , wherein the preset characteristic of the first physical object includes a fifth characteristic that is indicative of occurrence of an event that requires the user's immediate attention, and determining that the first physical object meets the preset criteria includes detecting presence of the fifth characteristic on the first physical object.
10. The method of claim 1 , wherein the preset characteristic of the first physical object includes a sixth characteristic that is indicative of presence of an identifier object on the first physical object, and determining that the first physical object meets the preset criteria includes detecting presence of the sixth characteristic at a location corresponding to the first physical object.
11. The method of claim 1 , wherein the preset characteristic of the first physical object includes a seventh characteristic that is based on a movement pattern of the first physical object, and determining that the first physical object meets the preset criteria includes detecting the seventh characteristic based on the movement pattern of the first physical object meets preset criteria.
12. The method of claim 1 , wherein the preset characteristic of the first physical object includes an eighth characteristic that is based on a match between a recognized identity of the first physical object and a first preset identity, and determining that the first physical object meets the preset criteria includes detecting the eighth characteristic meeting preset criteria.
13. The method of claim 1 , wherein the computer-generated environment includes a virtual environment without concurrently including a representation of a physical environment surrounding the user.
14. The method of claim 1 , wherein the computer-generated environment includes an augmented reality environment that includes a representation of the physical environment concurrently displayed with the virtual content, and wherein the change in appearance in the virtual content is displayed concurrently with a portion of the representation of the physical environment that is displayed via the display generation component in regions adjacent to the virtual content.
15. The method of claim 1 , including:
after changing the appearance of the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object without changing the appearance of the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object, detecting additional movement of the first physical object in the physical environment; and
in response to detecting the additional movement of the first physical object in the physical environment, changing the appearance of another portion of the virtual content displayed at a position corresponding to the current location of the second portion of the first physical object.
16. A computer system, comprising:
a display generation component;
one or more input devices;
one or more processors; and
memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display generation component, a view of a computer-generated environment;
while displaying the computer-generated environment and while the computer-generated environment does not include a visual representation of a first portion and a second portion of a first physical object present in a physical environment in which a user is located, detecting first movement of the first physical object in the physical environment;
in response to detecting the first movement of the first physical object in the physical environment:
in accordance with a determination that the user is within a threshold distance of the first portion of the first physical object and outside the threshold distance of the second portion of the first physical object, and that the first physical object meets preset criteria, the preset criteria including a requirement related to a preset characteristic of the first physical object other than a distance of the first physical object from the user, changing an appearance of a portion of virtual content displayed at a position corresponding to a current location of the first portion of the first physical object, without changing an appearance of a portion of the virtual content displayed at a position corresponding to the second portion of the first physical object, wherein the first portion of the first physical object and the second portion of the physical object are both part of an extent of the first physical object that is potentially visible to the user based on a field of view of the user for the computer-generated environment; and
in accordance with a determination that the user is within the threshold distance of the first physical object present in the physical environment surrounding the user and that the first physical object does not meet the preset criteria, forgoing changing an appearance of a portion of virtual content displayed at a position corresponding to a current location of the first portion of the first physical object.
17. The computer system of claim 16 , wherein the first portion of the first physical object and the second portion of the first physical object are continuous portions of the first physical object.
18. The computer system of claim 16 , wherein the portion of the virtual content displayed at the position corresponding to the first portion of the first physical object and the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object include respective portions of the same virtual object.
19. The computer system of claim 16 , wherein changing the appearance of the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object, without changing the appearance of the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object includes:
while maintaining display of the virtual content, applying a first visual effect to the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object, without applying the first visual effect to the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object.
20. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes a first characteristic that distinguishes between a person and non-person physical objects, and determining that the first physical object meets the preset criteria includes detecting presence of the first characteristic on the first physical object.
21. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes a second characteristic that is indicative of human speech coming from the first physical object as the first physical object is moving toward the user, and determining that the first physical object meets the preset criteria includes detecting the second characteristic at the location of the first physical object.
22. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes a third characteristic that distinguishes an animal from a person and non-person physical objects, and determining that the first physical object meets the preset criteria includes detecting presence of the third characteristic on the first physical object.
23. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes a fourth characteristic that is based on a movement speed of the first physical object, and determining that the first physical object meets the preset criteria includes detecting a characteristic value of the fourth characteristic of the first physical object exceeds a preset threshold value.
24. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes a fifth characteristic that is indicative of occurrence of an event that requires the user's immediate attention, and determining that the first physical object meets the preset criteria includes detecting presence of the fifth characteristic on the first physical object.
25. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes a sixth characteristic that is indicative of presence of an identifier object on the first physical object, and determining that the first physical object meets the preset criteria includes detecting presence of the sixth characteristic at a location corresponding to the first physical object.
26. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes a seventh characteristic that is based on a movement pattern of the first physical object, and determining that the first physical object meets the preset criteria includes detecting the seventh characteristic based on the movement pattern of the first physical object meets preset criteria.
27. The computer system of claim 16 , wherein the preset characteristic of the first physical object includes an eighth characteristic that is based on a match between a recognized identity of the first physical object and a first preset identity, and determining that the first physical object meets the preset criteria includes detecting the eighth characteristic meeting preset criteria.
28. The computer system of claim 16 , wherein the computer-generated environment includes a virtual environment without concurrently including a representation of a physical environment surrounding the user.
29. The computer system of claim 16 , wherein the computer-generated environment includes an augmented reality environment that includes a representation of the physical environment concurrently displayed with the virtual content, and wherein the change in appearance in the virtual content is displayed concurrently with a portion of the representation of the physical environment that is displayed via the display generation component in regions adjacent to the virtual content.
30. The computer system of claim 16 , wherein the one or more programs include instructions for:
after changing the appearance of the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object without changing the appearance of the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object, detecting additional movement of the first physical object in the physical environment; and
in response to detecting the additional movement of the first physical object in the physical environment, changing the appearance of another portion of the virtual content displayed at a position corresponding to the current location of the second portion of the first physical object.
31. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by a computer system that includes a display generation component, and one or more input devices, cause the computer system to:
display, via the display generation component, a view of a computer-generated environment;
while displaying the computer-generated environment and while the computer-generated environment does not include a visual representation of a first portion and a second portion of a first physical object present in a physical environment in which a user is located, detect first movement of the first physical object in the physical environment;
in response to detecting the first movement of the first physical object in the physical environment:
in accordance with a determination that the user is within a threshold distance of the first portion of the first physical object and outside the threshold distance of the second portion of the first physical object, and that the first physical object meets preset criteria, the preset criteria including a requirement related to a preset characteristic of the first physical object other than a distance of the first physical object from the user, change an appearance of a portion of virtual content displayed at a position corresponding to a current location of the first portion of the first physical object, without changing an appearance of a portion of the virtual content displayed at a position corresponding to the second portion of the first physical object, wherein the first portion of the first physical object and the second portion of the physical object are both part of an extent of the first physical object that is potentially visible to the user based on a field of view of the user for the computer-generated environment; and
in accordance with a determination that the user is within the threshold distance of the first physical object present in the physical environment surrounding the user and that the first physical object does not meet the preset criteria, forgo changing an appearance of a portion of virtual content displayed at a position corresponding to a current location of the first portion of the first physical object.
32. The non-transitory computer-readable storage medium of claim 31 , wherein the first portion of the first physical object and the second portion of the first physical object are continuous portions of the first physical object.
33. The non-transitory computer-readable storage medium of claim 31 , wherein the portion of the virtual content displayed at the position corresponding to the first portion of the first physical object and the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object include respective portions of the same virtual object.
34. The non-transitory computer-readable storage medium of claim 31 , wherein changing the appearance of the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object, without changing the appearance of the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object includes:
while maintaining display of the virtual content, applying a first visual effect to the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object, without applying the first visual effect to the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object.
35. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes a first characteristic that distinguishes between a person and non-person physical objects, and determining that the first physical object meets the preset criteria includes detecting presence of the first characteristic on the first physical object.
36. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes a second characteristic that is indicative of human speech coming from the first physical object as the first physical object is moving toward the user, and determining that the first physical object meets the preset criteria includes detecting the second characteristic at the location of the first physical object.
37. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes a third characteristic that distinguishes an animal from a person and non-person physical objects, and determining that the first physical object meets the preset criteria includes detecting presence of the third characteristic on the first physical object.
38. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes a fourth characteristic that is based on a movement speed of the first physical object, and determining that the first physical object meets the preset criteria includes detecting a characteristic value of the fourth characteristic of the first physical object exceeds a preset threshold value.
39. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes a fifth characteristic that is indicative of occurrence of an event that requires the user's immediate attention, and determining that the first physical object meets the preset criteria includes detecting presence of the fifth characteristic on the first physical object.
40. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes a sixth characteristic that is indicative of presence of an identifier object on the first physical object, and determining that the first physical object meets the preset criteria includes detecting presence of the sixth characteristic at a location corresponding to the first physical object.
41. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes a seventh characteristic that is based on a movement pattern of the first physical object, and determining that the first physical object meets the preset criteria includes detecting the seventh characteristic based on the movement pattern of the first physical object meets preset criteria.
42. The non-transitory computer-readable storage medium of claim 31 , wherein the preset characteristic of the first physical object includes an eighth characteristic that is based on a match between a recognized identity of the first physical object and a first preset identity, and determining that the first physical object meets the preset criteria includes detecting the eighth characteristic meeting preset criteria.
43. The non-transitory computer-readable storage medium of claim 31 , wherein the computer-generated environment includes a virtual environment without concurrently including a representation of a physical environment surrounding the user.
44. The non-transitory computer-readable storage medium of claim 31 , wherein the computer-generated environment includes an augmented reality environment that includes a representation of the physical environment concurrently displayed with the virtual content, and wherein the change in appearance in the virtual content is displayed concurrently with a portion of the representation of the physical environment that is displayed via the display generation component in regions adjacent to the virtual content.
45. The non-transitory computer-readable storage medium of claim 31 , wherein the one or more programs include instructions that, when executed by the one or more processors, cause the computer system to:
after changing the appearance of the portion of virtual content displayed at the position corresponding to the current location of the first portion of the first physical object without changing the appearance of the portion of the virtual content displayed at the position corresponding to the second portion of the first physical object, detect additional movement of the first physical object in the physical environment; and
in response to detecting the additional movement of the first physical object in the physical environment, change the appearance of another portion of the virtual content displayed at a position corresponding to the current location of the second portion of the first physical object.