Granted Patent B2

US 12,554,373 · App. 18/371,374 · Granted Feb 17, 2026

Inventors: Israel Pastrana Vicente (Spring, TX); Matan Stauber (San Francisco, CA); Zoey C. Taylor (San Francisco, CA)

Assignee: APPLE INC.

G06F3/04815G06F3/013G06F3/0482G06F3/04845G06F3/04883G06T19/20G06T2219/2004G06T2219/2016

Abstract

Claims (129)

1 . A method, comprising:

at a computer system that is in communication with a first display generation component and one or more input devices:

displaying, via the first display generation component, a first object at a first position in a first view of a three-dimensional environment;

while displaying, via the first display generation component, the first object at the first position in the first view of the three-dimensional environment, displaying a first set of one or more control objects, wherein a respective control object of the first set of one or more control objects corresponds to a respective operation applicable to the first object;

detecting, via the one or more input devices, a first user input that corresponds to a request to move the first object in the three-dimensional environment; and

in response to detecting the first user input that corresponds to a request to move the first object in the three-dimensional environment:

moving the first object from the first position to a second position; and

while moving the first object from the first position to the second position, visually deemphasizing, relative to the first object, at least one of the first set of one or more control objects that corresponds to the respective operation that is applicable to the first object.

2 . The method of claim 1 , wherein the at least one of the first set of one or more control objects that is visually deemphasized during movement of the first object from the first position to the second position includes a closing affordance, and the method includes:

while displaying the closing affordance with the first object, detecting a second user input selecting the closing affordance; and

in response to detecting the second user input selecting the closing affordance, ceasing to display the first object in the three-dimensional environment.

3 . The method of claim 1 , wherein the at least one of the first set of one or more control objects that is visually deemphasized during movement of the first object from the first position to the second position includes a resizing affordance, and the method includes:

while displaying the resizing affordance with the first object, detecting a third user input selecting and dragging the resizing affordance; and

in response to detecting the third user input selecting and dragging the resizing affordance, resizing the first object in accordance with the third user input.

4 . The method of claim 1 , wherein:

visually deemphasizing, relative to the first object, the at least one of the first set of one or more control objects includes visually deemphasizing a first respective control object that corresponds to a first respective operation applicable to the first object and a second respective control object that corresponds to a second respective operation applicable to the first object.

5 . The method of claim 1 , wherein visually deemphasizing the at least one of the first set of one or more control objects relative to the first object during the movement of the first object, includes visually deemphasizing a fourth respective control object that corresponds to a fourth respective operation applicable to the first object without visually deemphasizing a third respective control object that corresponds to a third respective operation applicable to the first object.

6 . The method of claim 1 , including:

while displaying a fifth respective control object of the first set of one or more control objects with the first object, detecting a fourth user input selecting the fifth respective control object; and

in response to detecting the fourth user input selecting the fifth respective control object of the first set of one or more control objects, in accordance with a determination that the fifth respective control object is associated with a plurality of control options for performing respective operations with respect to the first object, displaying the plurality of control options.

7 . The method of claim 1 , wherein visually deemphasizing the at least one of the first set of one or more control objects while moving the first object includes:

displaying a sixth respective control object of the at least one of the first set of one or more control objects with a smaller size relative to a size of the sixth respective control object before the first object started moving.

8 . The method of claim 1 , wherein visually deemphasizing the at least one of the first set of one or more control objects while moving the first object includes:

ceasing to display a seventh respective control object of the at least one of the first set of one or more control objects during at least a portion of the movement of the first object.

9 . The method of claim 1 , wherein detecting the first user input that corresponds to a request to move the first object in the three-dimensional environment includes detecting an air gesture directed to the first object, followed by a movement of the air gesture.

10 . The method of claim 1 , including:

while displaying a first control object of the first set of one or more control objects with the first object, wherein the first control object corresponds to a first operation applicable to the first object, detecting that user attention is directed to a respective portion of the first object that corresponds to a second operation, different from the first operation, that is applicable to the first object; and

in conjunction with detecting that the user attention is directed to the respective portion of the first object that corresponds to the second operation that is applicable to the first object, in accordance with a determination that the user attention meets attention criteria, visually deemphasizing, relative to the first object, the first control object that corresponds to the first operation that is applicable to the first object.

11 . The method of claim 10 , including:

in response to detecting that the user attention is directed to the respective portion of the first object that corresponds to the second operation that is applicable to the first object, in accordance with a determination that the user attention meets the attention criteria, displaying a second control object, different from the first control object, that corresponds to the second operation that is applicable to the first object.

12 . The method of claim 1 , including:

while displaying a third control object of the first set of one or more control objects with the first object, wherein the third control object corresponds to a third operation applicable to the first object, detecting that current user attention is directed to the third control object; and

in conjunction with detecting that the current user attention is directed to the third control object, in accordance with a determination that the current user attention meets second attention criteria, visually emphasizing, relative to the first object, the third control object that corresponds to the third operation that is applicable to the first object.

13 . The method of claim 12 , including:

in conjunction with detecting that the current user attention is directed to the third control object, in accordance with a determination that the current user attention meets the second attention criteria, visually deemphasizing, relative to the first object, a fourth control object of the first set of one or more control objects, wherein the fourth control object corresponds to a fourth operation, different from the third operation, that is applicable to the first object.

14 . The method of claim 13 , wherein visually deemphasizing, relative to the first object, the fourth control object includes reducing a size of the third control object relative to the first object.

15 . The method of claim 13 , wherein:

visually deemphasizing, relative to the first object, the fourth control object includes reducing a spatial extent of the fourth control object such that the fourth control object does not intersect with a reactive region of the third control object.

16 . The method of claim 1 , including:

detecting that respective user attention is directed to a fifth control object of the first set of one or more control objects; and

in response to detecting that the respective user attention is directed to the fifth control object:

in accordance with a determination that the respective user attention meets third attention criteria, wherein the third attention criteria require that the respective user attention has been directed to the fifth control object for at least a threshold amount of time, visually emphasizing, relative to the first object, the fifth control object; and

in accordance with a determination that the respective user attention does not meet the third attention criteria, forgoing visually emphasizing, relative to the first object, the fifth control object.

17 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with a first display generation component and one or more input devices, the one or more programs including instructions for:

displaying, via the first display generation component, a first object at a first position in a first view of a three-dimensional environment;

while displaying, via the first display generation component, the first object at the first position in the first view of the three-dimensional environment, displaying a first set of one or more control objects, wherein a respective control object of the first set of one or more control objects corresponds to a respective operation applicable to the first object;

detecting, via the one or more input devices, a first user input that corresponds to a request to move the first object in the three-dimensional environment; and

in response to detecting the first user input that corresponds to a request to move the first object in the three-dimensional environment:

moving the first object from the first position to a second position; and

while moving the first object from the first position to the second position, visually deemphasizing, relative to the first object, at least one of the first set of one or more control objects that corresponds to the respective operation that is applicable to the first object.

18 . The non-transitory computer readable storage medium of claim 17 , wherein the at least one of the first set of one or more control objects that is visually deemphasized during movement of the first object from the first position to the second position includes a closing affordance, and the one or more programs further include instructions for:

while displaying the closing affordance with the first object, detecting a second user input selecting the closing affordance; and

in response to detecting the second user input selecting the closing affordance, ceasing to display the first object in the three-dimensional environment.

19 . The non-transitory computer readable storage medium of claim 17 , wherein the at least one of the first set of one or more control objects that is visually deemphasized during movement of the first object from the first position to the second position includes a resizing affordance, and the one or more programs further include instructions for:

while displaying the resizing affordance with the first object, detecting a third user input selecting and dragging the resizing affordance; and

in response to detecting the third user input selecting and dragging the resizing affordance, resizing the first object in accordance with the third user input.

20 . The non-transitory computer readable storage medium of claim 17 , wherein:

visually deemphasizing, relative to the first object, the at least one of the first set of one or more control objects includes visually deemphasizing a first respective control object that corresponds to a first respective operation applicable to the first object and a second respective control object that corresponds to a second respective operation applicable to the first object.

21 . The non-transitory computer readable storage medium of claim 17 , wherein visually deemphasizing the at least one of the first set of one or more control objects relative to the first object during the movement of the first object, includes visually deemphasizing a fourth respective control object that corresponds to a fourth respective operation applicable to the first object without visually deemphasizing a third respective control object that corresponds to a third respective operation applicable to the first object.

22 . The non-transitory computer readable storage medium of claim 17 , the one or more programs further including instructions for:

while displaying a fifth respective control object of the first set of one or more control objects with the first object, detecting a fourth user input selecting the fifth respective control object; and

in response to detecting the fourth user input selecting the fifth respective control object of the first set of one or more control objects, in accordance with a determination that the fifth respective control object is associated with a plurality of control options for performing respective operations with respect to the first object, displaying the plurality of control options.

23 . The non-transitory computer readable storage medium of claim 17 , wherein visually deemphasizing the at least one of the first set of one or more control objects while moving the first object includes:

displaying a sixth respective control object of the at least one of the first set of one or more control objects with a smaller size relative to a size of the sixth respective control object before the first object started moving.

24 . The non-transitory computer readable storage medium of claim 17 , wherein visually deemphasizing the at least one of the first set of one or more control objects while moving the first object includes:

ceasing to display a seventh respective control object of the at least one of the first set of one or more control objects during at least a portion of the movement of the first object.

25 . The non-transitory computer readable storage medium of claim 17 , wherein detecting the first user input that corresponds to a request to move the first object in the three-dimensional environment includes detecting an air gesture directed to the first object, followed by a movement of the air gesture.

26 . The non-transitory computer readable storage medium of claim 17 , the one or more programs further including instructions for:

while displaying a first control object of the first set of one or more control objects with the first object, wherein the first control object corresponds to a first operation applicable to the first object, detecting that user attention is directed to a respective portion of the first object that corresponds to a second operation, different from the first operation, that is applicable to the first object; and

in conjunction with detecting that the user attention is directed to the respective portion of the first object that corresponds to the second operation that is applicable to the first object, in accordance with a determination that the user attention meets attention criteria, visually deemphasizing, relative to the first object, the first control object that corresponds to the first operation that is applicable to the first object.

27 . The non-transitory computer readable storage medium of claim 26 , the one or more programs further including instructions for:

in response to detecting that the user attention is directed to the respective portion of the first object that corresponds to the second operation that is applicable to the first object, in accordance with a determination that the user attention meets the attention criteria, displaying a second control object, different from the first control object, that corresponds to the second operation that is applicable to the first object.

28 . The non-transitory computer readable storage medium of claim 17 , the one or more programs further including instructions for:

while displaying a third control object of the first set of one or more control objects with the first object, wherein the third control object corresponds to a third operation applicable to the first object, detecting that current user attention is directed to the third control object; and

in conjunction with detecting that the current user attention is directed to the third control object, in accordance with a determination that the current user attention meets second attention criteria, visually emphasizing, relative to the first object, the third control object that corresponds to the third operation that is applicable to the first object.

29 . The non-transitory computer readable storage medium of claim 28 , the one or more programs further including instructions for:

in conjunction with detecting that the current user attention is directed to the third control object, in accordance with a determination that the current user attention meets the second attention criteria, visually deemphasizing, relative to the first object, a fourth control object of the first set of one or more control objects, wherein the fourth control object corresponds to a fourth operation, different from the third operation, that is applicable to the first object.

30 . The non-transitory computer readable storage medium of claim 29 , wherein visually deemphasizing, relative to the first object, the fourth control object includes reducing a size of the third control object relative to the first object.

31 . The non-transitory computer readable storage medium of claim 29 , wherein:

visually deemphasizing, relative to the first object, the fourth control object includes reducing a spatial extent of the fourth control object such that the fourth control object does not intersect with a reactive region of the third control object.

32 . The non-transitory computer readable storage medium of claim 17 , the one or more programs further including instructions for:

detecting that respective user attention is directed to a fifth control object of the first set of one or more control objects; and

in response to detecting that the respective user attention is directed to the fifth control object:

in accordance with a determination that the respective user attention meets third attention criteria, wherein the third attention criteria require that the respective user attention has been directed to the fifth control object for at least a threshold amount of time, visually emphasizing, relative to the first object, the fifth control object; and

in accordance with a determination that the respective user attention does not meet the third attention criteria, forgoing visually emphasizing, relative to the first object, the fifth control object.

33 . A computer system that is in communication with a first display generation component and one or more input devices, the computer system comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, via the first display generation component, a first object at a first position in a first view of a three-dimensional environment;

while displaying, via the first display generation component, the first object at the first position in the first view of the three-dimensional environment, displaying a first set of one or more control objects, wherein a respective control object of the first set of one or more control objects corresponds to a respective operation applicable to the first object;

detecting, via the one or more input devices, a first user input that corresponds to a request to move the first object in the three-dimensional environment; and

in response to detecting the first user input that corresponds to a request to move the first object in the three-dimensional environment:

moving the first object from the first position to a second position; and

while moving the first object from the first position to the second position, visually deemphasizing, relative to the first object, at least one of the first set of one or more control objects that corresponds to the respective operation that is applicable to the first object.

34 . The computer system of claim 33 , wherein the at least one of the first set of one or more control objects that is visually deemphasized during movement of the first object from the first position to the second position includes a closing affordance, and the one or more programs further include instructions for:

while displaying the closing affordance with the first object, detecting a second user input selecting the closing affordance; and

in response to detecting the second user input selecting the closing affordance, ceasing to display the first object in the three-dimensional environment.

35 . The computer system of claim 33 , wherein the at least one of the first set of one or more control objects that is visually deemphasized during movement of the first object from the first position to the second position includes a resizing affordance, and the one or more programs further include instructions for:

while displaying the resizing affordance with the first object, detecting a third user input selecting and dragging the resizing affordance; and

in response to detecting the third user input selecting and dragging the resizing affordance, resizing the first object in accordance with the third user input.

36 . The computer system of claim 33 , wherein:

visually deemphasizing, relative to the first object, the at least one of the first set of one or more control objects includes visually deemphasizing a first respective control object that corresponds to a first respective operation applicable to the first object and a second respective control object that corresponds to a second respective operation applicable to the first object.

37 . The computer system of claim 33 , wherein visually deemphasizing the at least one of the first set of one or more control objects relative to the first object during the movement of the first object, includes visually deemphasizing a fourth respective control object that corresponds to a fourth respective operation applicable to the first object without visually deemphasizing a third respective control object that corresponds to a third respective operation applicable to the first object.

38 . The computer system of claim 33 , the one or more programs further including instructions for:

while displaying a fifth respective control object of the first set of one or more control objects with the first object, detecting a fourth user input selecting the fifth respective control object; and

in response to detecting the fourth user input selecting the fifth respective control object of the first set of one or more control objects, in accordance with a determination that the fifth respective control object is associated with a plurality of control options for performing respective operations with respect to the first object, displaying the plurality of control options.

39 . The computer system of claim 33 , wherein visually deemphasizing the at least one of the first set of one or more control objects while moving the first object includes:

displaying a sixth respective control object of the at least one of the first set of one or more control objects with a smaller size relative to a size of the sixth respective control object before the first object started moving.

40 . The computer system of claim 33 , wherein visually deemphasizing the at least one of the first set of one or more control objects while moving the first object includes:

ceasing to display a seventh respective control object of the at least one of the first set of one or more control objects during at least a portion of the movement of the first object.

41 . The computer system of claim 33 , wherein detecting the first user input that corresponds to a request to move the first object in the three-dimensional environment includes detecting an air gesture directed to the first object, followed by a movement of the air gesture.

42 . The computer system of claim 33 , the one or more programs further including instructions for:

while displaying a first control object of the first set of one or more control objects with the first object, wherein the first control object corresponds to a first operation applicable to the first object, detecting that user attention is directed to a respective portion of the first object that corresponds to a second operation, different from the first operation, that is applicable to the first object; and

in conjunction with detecting that the user attention is directed to the respective portion of the first object that corresponds to the second operation that is applicable to the first object, in accordance with a determination that the user attention meets attention criteria, visually deemphasizing, relative to the first object, the first control object that corresponds to the first operation that is applicable to the first object.

43 . The computer system of claim 42 , the one or more programs further including instructions for:

in response to detecting that the user attention is directed to the respective portion of the first object that corresponds to the second operation that is applicable to the first object, in accordance with a determination that the user attention meets the attention criteria, displaying a second control object, different from the first control object, that corresponds to the second operation that is applicable to the first object.

44 . The computer system of claim 33 , the one or more programs further including instructions for:

while displaying a third control object of the first set of one or more control objects with the first object, wherein the third control object corresponds to a third operation applicable to the first object, detecting that current user attention is directed to the third control object; and

in conjunction with detecting that the current user attention is directed to the third control object, in accordance with a determination that the current user attention meets second attention criteria, visually emphasizing, relative to the first object, the third control object that corresponds to the third operation that is applicable to the first object.

45 . The computer system of claim 44 , the one or more programs further including instructions for:

in conjunction with detecting that the current user attention is directed to the third control object, in accordance with a determination that the current user attention meets the second attention criteria, visually deemphasizing, relative to the first object, a fourth control object of the first set of one or more control objects, wherein the fourth control object corresponds to a fourth operation, different from the third operation, that is applicable to the first object.

46 . The computer system of claim 45 , wherein visually deemphasizing, relative to the first object, the fourth control object includes reducing a size of the third control object relative to the first object.

47 . The computer system of claim 45 , wherein:

visually deemphasizing, relative to the first object, the fourth control object includes reducing a spatial extent of the fourth control object such that the fourth control object does not intersect with a reactive region of the third control object.

48 . The computer system of claim 33 , the one or more programs further including instructions for:

detecting that respective user attention is directed to a fifth control object of the first set of one or more control objects; and

in response to detecting that the respective user attention is directed to the fifth control object:

in accordance with a determination that the respective user attention meets third attention criteria, wherein the third attention criteria require that the respective user attention has been directed to the fifth control object for at least a threshold amount of time, visually emphasizing, relative to the first object, the fifth control object; and

in accordance with a determination that the respective user attention does not meet the third attention criteria, forgoing visually emphasizing, relative to the first object, the fifth control object.

Assignments (1)

Continuity (5)

References Cited (24)