Granted Patent B2

US 12,535,931 · App. 18/473,182 · Granted Jan 27, 2026

Inventors: Sean L. Seguin (Lafayette, CO); Lorena S. Pazmino (San Francisco, CA); Zoey C. Taylor (San Francisco, CA)

Assignee: Apple Inc.

G06F3/04815G06F3/013G06F3/02G06F3/0482G06F3/0488G06F3/1454G06T19/006H04W76/10

Abstract

Claims (162)

1 . A method comprising:

at a first computer system in communication with a display generation component, one or more input devices and one or more cameras:

visually detecting, via the one or more cameras, a second computer system in a physical environment that corresponds to a three-dimensional environment that is visible via the display generation component; and

in response to visually detecting the second computer system:

in accordance with a determination that the second computer system satisfies one or more connection criteria, displaying, in the three-dimensional environment, a first selectable option that is selectable to initiate a process to establish a connection between the first computer system and the second computer system; and

in accordance with a determination that the second computer system does not satisfy the one or more connection criteria, forgoing displaying the first selectable option in the three-dimensional environment.

2 . The method of claim 1 , wherein satisfaction of the one or more connection criteria is based on a wireless connection between the first computer system and the second computer system.

3 . The method of claim 1 , wherein satisfaction of the one or more connection criteria is in accordance with a determination that the first computer system and the second computer system are associated with a same user account.

4 . The method of claim 1 , wherein satisfaction of the one or more connection criteria is in accordance with a determination that the second computer system is in a wake state.

5 . The method of claim 1 , wherein satisfaction of the one or more connection criteria is in accordance with a determination that the second computer system is in an unlocked state.

6 . The method of claim 1 , wherein:

the physical environment of the first computer system includes a plurality of computer systems, including the second computer system; and

satisfaction of the one or more connection criteria is in accordance with a determination that the second computer system is a closest computer system of the plurality of computer systems relative to the first computer system.

7 . The method of claim 6 , wherein the determination that the second computer system is the closest computer system of the plurality of computer systems is based on a strength of a wireless signal transmitted by the second computer system.

8 . The method of claim 1 , wherein satisfaction of the one or more connection criteria is in accordance with a determination that the first computer system has not detected a respective event for ceasing display of the first selectable option.

9 . The method of claim 1 , wherein the physical environment of the first computer system includes a third computer system, different from the second computer system, and wherein the method further comprises:

in response to visually detecting the second computer system and the third computer system:

in accordance with a determination that the second computer system satisfies the one or more connection criteria and the third computer system satisfies the one or more connection criteria, concurrently displaying, via the display generation component:

the first selectable option; and

a second selectable option that is selectable to initiate a process to establish a connection between the first computer system and the third computer system.

10 . The method of claim 1 , wherein the first selectable option is displayed at a first location in the three-dimensional environment that is within a threshold distance of a portion of the second computer system.

11 . The method of claim 10 , further comprising:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting movement of the second computer system in the physical environment; and

in response to detecting the movement:

ceasing display of the first selectable option in the three-dimensional environment.

12 . The method of claim 10 , further comprising:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting movement of the second computer system in the physical environment; and

in response to detecting the movement:

displaying, via the display generation component, the first selectable option at a second location, different from the first location, in the three-dimensional environment that is within the threshold distance of the portion of the second computer system.

13 . The method of claim 1 , wherein the second computer system is in communication with a second display generation component, different from the display generation component.

14 . The method of claim 1 , wherein the second computer system is in communication with a keyboard.

15 . The method of claim 1 , wherein the second computer system is in communication with a trackpad.

16 . The method of claim 1 , wherein the physical environment of the first computer system includes a third computer system, different from the second computer system, the method further comprising:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting, via the one or more input devices, an input corresponding to selection of the first selectable option; and

in response to detecting the input:

providing an indication of a request for a user of the first computer system to provide a disambiguation input.

17 . The method of claim 16 , wherein:

the second computer system is in communication with one or more second input devices, different from the one or more input devices, that include one or more physical buttons; and the disambiguation input includes selection of a first button of the one or more physical buttons.

18 . The method of claim 16 , wherein:

the second computer system is in communication with one or more second input devices, different from the one or more input devices, that include a touch-sensitive surface; and

the disambiguation input includes an input of a contact on the touch-sensitive surface.

19 . The method of claim 16 , wherein providing the indication of the request for the user of the first computer system to provide the disambiguation input includes displaying, via the display generation component, a visual prompt of the request.

20 . The method of claim 1 , wherein the physical environment of the first computer system includes a first input device, different from the one or more input devices, and wherein the method further comprises:

in response to visually detecting the first input device:

in accordance with a determination that the first input device satisfies one or more second connection criteria, displaying, via the display generation component, a second selectable option that is selectable to initiate a process to establish a connection between the first computer system and the first input device.

21 . The method of claim 20 , further comprising:

while displaying the second selectable option in accordance with the determination that the first input device satisfies the one or more second connection criteria in response to visually detecting the first input device, detecting, via the one or more input devices, an input corresponding to a selection of the second selectable option; and

in response to detecting the input:

initiating a process to establish the connection between the first computer system and the first input device.

22 . The method of claim 21 , further comprising:

in response to detecting the input:

displaying, via the display generation component, a visual animation indicating the connection at one or more locations in the three-dimensional environment that are within a threshold distance of a portion of the first input device.

23 . The method of claim 1 , further comprising:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting, via the one or more input devices, an input corresponding to selection of the first selectable option; and

in response to detecting the input:

establishing the connection between the first computer system and the second computer system, including displaying, via the display generation component, a representation of content from the second computer system in the three-dimensional environment.

24 . The method of claim 23 , wherein:

the second computer system is in communication with a second display generation component, different from the display generation component; and

displaying the representation of content from the second computer system in the three-dimensional environment includes displaying the representation of content from the second computer system at a location that is a distance behind the second display generation component in the three-dimensional environment.

25 . The method of claim 23 , wherein in accordance with a determination that, when the input is detected, the first selectable option is displayed in a system user interface, displaying the representation of content from the second computer system in the three-dimensional environment includes:

displaying the representation of content from the second computer system at a location that is based on a viewpoint of a user of the first computer system.

26 . A first computer system that is in communication with a display generation component and one or more input devices, the first computer system comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:

visually detecting, via one or more cameras, a second computer system in a physical environment that corresponds to a three-dimensional environment that is visible via the display generation component; and

in response to visually detecting the second computer system:

in accordance with a determination that the second computer system satisfies one or more connection criteria, displaying, in the three-dimensional environment, a first selectable option that is selectable to initiate a process to establish a connection between the first computer system and the second computer system; and

in accordance with a determination that the second computer system does not satisfy the one or more connection criteria, forgoing displaying the first selectable option in the three-dimensional environment.

27 . A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first computer system that is in communication with a display generation component and one or more input devices, cause the first computer system to perform a method comprising:

visually detecting, via one or more cameras, a second computer system in a physical environment that corresponds to a three-dimensional environment that is visible via the display generation component; and

in response to visually detecting the second computer system:

in accordance with a determination that the second computer system satisfies one or more connection criteria, displaying, in the three-dimensional environment, a first selectable option that is selectable to initiate a process to establish a connection between the first computer system and the second computer system; and

in accordance with a determination that the second computer system does not satisfy the one or more connection criteria, forgoing displaying the first selectable option in the three-dimensional environment.

28 . The first computer system of claim 26 , wherein:

the physical environment of the first computer system includes a plurality of computer systems, including the second computer system; and

satisfaction of the one or more connection criteria is in accordance with a determination that the second computer system is the closest computer system of the plurality of computer systems relative to the first computer system.

29 . The first computer system of claim 28 , wherein the determination that the second computer system is the closest computer system of the plurality of computer systems is based on a strength of a wireless signal transmitted by the second computer system.

30 . The first computer system of claim 26 , wherein the physical environment of the first computer system includes a third computer system, different from the second computer system, and wherein the instructions are further for:

in response to visually detecting the second computer system and the third computer system:

in accordance with a determination that the second computer system satisfies the one or more connection criteria and the third computer system satisfies the one or more connection criteria, concurrently displaying, via the display generation component:

the first selectable option; and

a second selectable option that is selectable to initiate a process to establish a connection between the first computer system and the third computer system.

31 . The first computer system of claim 26 , wherein the first selectable option is displayed at a first location in the three-dimensional environment that is within a threshold distance of a portion of the second computer system, and wherein the instructions are further for:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting movement of the second computer system in the physical environment; and

in response to detecting the movement:

ceasing display of the first selectable option in the three-dimensional environment.

32 . The first computer system of claim 26 , wherein the first selectable option is displayed at a first location in the three-dimensional environment that is within a threshold distance of a portion of the second computer system, and wherein the instructions are further for:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting movement of the second computer system in the physical environment; and

in response to detecting the movement:

displaying, via the display generation component, the first selectable option at a second location, different from the first location, in the three-dimensional environment that is within the threshold distance of the portion of the second computer system.

33 . The first computer system of claim 26 , wherein the physical environment of the first computer system includes a third computer system, different from the second computer system, and wherein the instructions are further for:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting, via the one or more input devices, an input corresponding to selection of the first selectable option; and

in response to detecting the input:

providing an indication of a request for a user of the first computer system to provide a disambiguation input.

34 . The first computer system of claim 33 , wherein:

the second computer system is in communication with one or more second input devices, different from the one or more input devices, that include one or more physical buttons; and

the disambiguation input includes selection of a first button of the one or more physical buttons.

35 . The first computer system of claim 33 , wherein:

the second computer system is in communication with one or more second input devices, different from the one or more input devices, that include a touch-sensitive surface; and

the disambiguation input includes an input of a contact on the touch-sensitive surface.

36 . The first computer system of claim 33 , wherein providing the indication of the request for the user of the first computer system to provide the disambiguation input includes displaying, via the display generation component, a visual prompt of the request.

37 . The first computer system of claim 26 , wherein the physical environment of the first computer system includes a first input device, different from the one or more input devices, and wherein the instructions are further for:

in response to visually detecting the first input device:

in accordance with a determination that the first input device satisfies one or more second connection criteria, displaying, via the display generation component, a second selectable option that is selectable to initiate a process to establish a connection between the first computer system and the first input device.

38 . The first computer system of claim 37 , wherein the instructions are further for:

while displaying the second selectable option in accordance with the determination that the first input device satisfies the one or more second connection criteria in response to visually detecting the first input device, detecting, via the one or more input devices, an input corresponding to a selection of the second selectable option; and

in response to detecting the input:

initiating a process to establish the connection between the first computer system and the first input device.

39 . The first computer system of claim 26 , wherein the instructions are further for:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting, via the one or more input devices, an input corresponding to selection of the first selectable option; and

in response to detecting the input:

establishing the connection between the first computer system and the second computer system, including displaying, via the display generation component, a representation of content from the second computer system in the three-dimensional environment.

40 . The first computer system of claim 39 , wherein:

the second computer system is in communication with a second display generation component, different from the display generation component; and

displaying the representation of content from the second computer system in the three-dimensional environment includes displaying the representation of content from the second computer system at a location that is a distance behind the second display generation component in the three-dimensional environment.

41 . The first computer system of claim 39 , wherein in accordance with a determination that, when the input is detected, the first selectable option is displayed in a system user interface, displaying the representation of content from the second computer system in the three-dimensional environment includes:

displaying the representation of content from the second computer system at a location that is based on a viewpoint of a user of the first computer system.

42 . The non-transitory computer readable storage medium of claim 27 , wherein:

the physical environment of the first computer system includes a plurality of computer systems, including the second computer system; and

satisfaction of the one or more connection criteria is in accordance with a determination that the second computer system is the closest computer system of the plurality of computer systems relative to the first computer system.

43 . The non-transitory computer readable storage medium of claim 42 , wherein the determination that the second computer system is the closest computer system of the plurality of computer systems is based on a strength of a wireless signal transmitted by the second computer system.

44 . The non-transitory computer readable storage medium of claim 27 , wherein the physical environment of the first computer system includes a third computer system, different from the second computer system, and wherein the method further comprises:

in response to visually detecting the second computer system and the third computer system:

in accordance with a determination that the second computer system satisfies the one or more connection criteria and the third computer system satisfies the one or more connection criteria, concurrently displaying, via the display generation component:

the first selectable option; and

a second selectable option that is selectable to initiate a process to establish a connection between the first computer system and the third computer system.

45 . The non-transitory computer readable storage medium of claim 27 , wherein the first selectable option is displayed at a first location in the three-dimensional environment that is within a threshold distance of a portion of the second computer system, and wherein the method further comprises:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting movement of the second computer system in the physical environment; and

in response to detecting the movement:

ceasing display of the first selectable option in the three-dimensional environment.

46 . The non-transitory computer readable storage medium of claim 27 , wherein the first selectable option is displayed at a first location in the three-dimensional environment that is within a threshold distance of a portion of the second computer system, and wherein the method further comprises:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting movement of the second computer system in the physical environment; and

in response to detecting the movement:

displaying, via the display generation component, the first selectable option at a second location, different from the first location, in the three-dimensional environment that is within the threshold distance of the portion of the second computer system.

47 . The non-transitory computer readable storage medium of claim 27 , wherein the physical environment of the first computer system includes a third computer system, different from the second computer system, and wherein the method further comprises:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting, via the one or more input devices, an input corresponding to selection of the first selectable option; and

in response to detecting the input:

providing an indication of a request for a user of the first computer system to provide a disambiguation input.

48 . The non-transitory computer readable storage medium of claim 47 , wherein:

the second computer system is in communication with one or more second input devices, different from the one or more input devices, that include one or more physical buttons; and

the disambiguation input includes selection of a first button of the one or more physical buttons.

49 . The non-transitory computer readable storage medium of claim 47 , wherein:

the second computer system is in communication with one or more second input devices, different from the one or more input devices, that include a touch-sensitive surface; and

the disambiguation input includes an input of a contact on the touch-sensitive surface.

50 . The non-transitory computer readable storage medium of claim 47 , wherein providing the indication of the request for the user of the first computer system to provide the disambiguation input includes displaying, via the display generation component, a visual prompt of the request.

51 . The non-transitory computer readable storage medium of claim 27 , wherein the physical environment of the first computer system includes a first input device, different from the one or more input devices, and wherein the method further comprises:

in response to visually detecting the first input device:

in accordance with a determination that the first input device satisfies one or more second connection criteria, displaying, via the display generation component, a second selectable option that is selectable to initiate a process to establish a connection between the first computer system and the first input device.

52 . The non-transitory computer readable storage medium of claim 51 , the method further comprising:

while displaying the second selectable option in accordance with the determination that the first input device satisfies the one or more second connection criteria in response to visually detecting the first input device, detecting, via the one or more input devices, an input corresponding to a selection of the second selectable option; and

in response to detecting the input:

initiating a process to establish the connection between the first computer system and the first input device.

53 . The non-transitory computer readable storage medium of claim 27 , the method further comprising:

while displaying the first selectable option in accordance with the determination that the second computer system satisfies the one or more connection criteria in response to visually detecting the second computer system, detecting, via the one or more input devices, an input corresponding to selection of the first selectable option; and

in response to detecting the input:

establishing the connection between the first computer system and the second computer system, including displaying, via the display generation component, a representation of content from the second computer system in the three-dimensional environment.

54 . The non-transitory computer readable storage medium of claim 53 , wherein:

the second computer system is in communication with a second display generation component, different from the display generation component; and

displaying the representation of content from the second computer system in the three-dimensional environment includes displaying the representation of content from the second computer system at a location that is a distance behind the second display generation component in the three-dimensional environment.

55 . The non-transitory computer readable storage medium of claim 53 , wherein in accordance with a determination that, when the input is detected, the first selectable option is displayed in a system user interface, displaying the representation of content from the second computer system in the three-dimensional environment includes:

displaying the representation of content from the second computer system at a location that is based on a viewpoint of a user of the first computer system.

Assignments (1)

Continuity (4)

References Cited (400)