IP Library › Granted Patent US 12663910

Granted Patent B2

US 12663910 · App. 18/611,377 · Granted Jun 23, 2026

Devices, methods, and graphical user interfaces for content collaboration and sharing

Inventors: Benjamin H. Boesel (Sunnyvale, CA); Shih-Sang Chiu (San Francisco, CA); Stephen O. Lemay (Palo Alto, CA); Jay Moon (San Francisco, CA); Matthew J. Sundstrom (Campbell, CA)

Assignee: Apple Inc.

G06F3/04815 G06F3/0484

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12663910
App. No.: 18/611,377
Granted: Jun 23, 2026
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Techniques and user interfaces for collaborating on content and sharing content in an extended reality environment. In some embodiments, while a user is collaborating with another user, a computer system switches from spatially synchronized viewing to unsynchronized viewing when the user edits a document. In some embodiments, content is added to a three-dimensional environment and is shared in a real-time communication session in response to a computer system detecting a set of one or more inputs including a request to add content to the three-dimensional environment in the real-time communication session.

Claims (117)

1 . A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

while the computer system is in a real-time communication session that includes two or more participants, wherein the real-time communication session includes a three-dimensional environment shared by the two or more participants:

displaying, via the one or more display generation components, a representation of the three-dimensional environment;

while displaying the representation of the three-dimensional environment, detecting, via the one or more input devices, a set of one or more inputs including a request to add content to the three-dimensional environment in the real-time communication session;

in response to detecting the set of one or more inputs including the request to add the content to the three-dimensional environment in the real-time communication session, adding the content to the three-dimensional environment and sharing the content in the real-time communication session; and

while the content is shared in the real-time communication session:

displaying, via the one or more display generation components, a representation of the content having a first appearance in the three-dimensional environment; and

in response to a determination that an event has occurred, displaying, via the one or more display generation components, the representation of the content having a second appearance in the three-dimensional environment without including the second appearance in the real-time communication session.

2 . The computer system of claim 1 , the one or more programs including further instructions for:

while the content is shared in the real-time communication session:

displaying, via the one or more display generation components, a representation of the content having a third appearance in the three-dimensional environment;

detecting, via the one or more input devices, an input corresponding to a request to change a state of the content in the three-dimensional environment; and

in response to detecting the input corresponding the request to change the state of the content in the three-dimensional environment, displaying, via the one or more display generation components, the representation of the content having a fourth appearance in the three-dimensional environment that is different from the third appearance.

3 . The computer system of claim 1 , the one or more programs including further instructions for:

in response to detecting the set of one or more inputs including the request to add the content to the three-dimensional environment in the real-time communication session, sending the content to one or more participants of the real-time communication session.

4 . The computer system of claim 3 , the one or more programs including further instructions for:

detecting, via the one or more input devices, a first request to control the content in the real-time communication session; and

in response to detecting the first request to control the content in the real-time communication session, controlling the content in the real-time communication session, including changing a state of the content in the real-time communication session.

5 . The computer system of claim 4 , wherein the first request to control the content in the three-dimensional environment includes a set of one or more inputs by a user of the computer system.

6 . The computer system of claim 4 , the one or more programs including further instructions for:

while the computer system has control of the content in the real-time communication session, a second participant requests to control the content in the real-time communication session; and

in response to the second participant requesting to control the content in the real-time communication session, ceasing control of the content in the real-time communication session by the computer system.

7 . The computer system of claim 6 , the one or more programs including further instructions for:

after ceasing control of the content by the computer system, detecting, via the one or more input devices, a second request to control the content in the real-time communication session; and

in response to detecting the second request to control the content in the real-time communication session, controlling the content in the real-time communication session.

8 . The computer system of claim 4 , the one or more programs including further instructions for:

in response to detecting the first request to control the content in the real-time communication session:

in accordance with a determination that a network used to perform the real-time communication session is in a first state, sending, via a first communication channel a final state of the content in the real-time communication session.

9 . The computer system of claim 8 , the one or more programs including further instructions for:

while the network used to perform the real-time communication session is in the first state, sending, via a second communication channel, intermediate states of the content in the real-time communication session.

10 . The computer system of claim 1 , wherein the event includes a distance between the content and a position associated with a user of the computer system in the three-dimensional environment satisfying a threshold distance.

11 . The computer system of claim 1 , wherein the event includes a gaze of a user of the computer system satisfying a set of gaze criteria.

12 . The computer system of claim 1 , wherein the content includes a three-dimensional virtual object.

13 . The computer system of claim 1 , wherein the content includes a video.

14 . The computer system of claim 1 , wherein the content includes a virtual document.

15 . The computer system of claim 1 , wherein displaying the representation of the three-dimensional environment includes displaying the representation of the three-dimensional environment from a first viewpoint that is different from a viewpoint of the three-dimensional environment of a second participant in the real-time communication session.

16 . The computer system of claim 1 , the one or more programs including further instructions for:

displaying, via the one or more display generation components, a representation of one or more of the participants in the three-dimensional environment.

17 . A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system that is in communication with one or more display generation components and one or more input devices, the one or more programs including instructions for:

displaying, via the one or more display generation components, a representation of the three-dimensional environment;

while the content is shared in the real-time communication session:

displaying, via the one or more display generation components, a representation of the content having a first appearance in the three-dimensional environment; and

18 . The non-transitory computer-readable storage medium of claim 17 , the one or more programs including further instructions for:

while the content is shared in the real-time communication session:

displaying, via the one or more display generation components, a representation of the content having a third appearance in the three-dimensional environment;

detecting, via the one or more input devices, an input corresponding to a request to change a state of the content in the three-dimensional environment; and

19 . The non-transitory computer-readable storage medium of claim 17 , the one or more programs including further instructions for:

20 . The non-transitory computer-readable storage medium of claim 19 , the one or more programs including further instructions for:

detecting, via the one or more input devices, a first request to control the content in the real-time communication session; and

21 . The non-transitory computer-readable storage medium of claim 20 , wherein the first request to control the content in the three-dimensional environment includes a set of one or more inputs by a user of the computer system.

22 . The non-transitory computer-readable storage medium of claim 20 , the one or more programs including further instructions for:

while the computer system has control of the content in the real-time communication session, a second participant requests to control the content in the real-time communication session; and

23 . The non-transitory computer-readable storage medium of claim 22 , the one or more programs including further instructions for:

after ceasing control of the content by the computer system, detecting, via the one or more input devices, a second request to control the content in the real-time communication session; and

in response to detecting the second request to control the content in the real-time communication session, controlling the content in the real-time communication session.

24 . The non-transitory computer-readable storage medium of claim 20 , the one or more programs including further instructions for:

in response to detecting the first request to control the content in the real-time communication session:

25 . The non-transitory computer-readable storage medium of claim 24 , the one or more programs including further instructions for:

26 . The non-transitory computer-readable storage medium of claim 17 , wherein the event includes a distance between the content and a position associated with a user of the computer system in the three-dimensional environment satisfying a threshold distance.

27 . The non-transitory computer-readable storage medium of claim 17 , wherein the event includes a gaze of a user of the computer system satisfying a set of gaze criteria.

28 . The non-transitory computer-readable storage medium of claim 17 , wherein the content includes a three-dimensional virtual object.

29 . The non-transitory computer-readable storage medium of claim 17 , wherein the content includes a video.

30 . The non-transitory computer-readable storage medium of claim 17 , wherein the content includes a virtual document.

31 . The non-transitory computer-readable storage medium of claim 17 , wherein displaying the representation of the three-dimensional environment includes displaying the representation of the three-dimensional environment from a first viewpoint that is different from a viewpoint of the three-dimensional environment of a second participant in the real-time communication session.

32 . The non-transitory computer-readable storage medium of claim 17 , the one or more programs including further instructions for:

displaying, via the one or more display generation components, a representation of one or more of the participants in the three-dimensional environment.

33 . A method, comprising:

at a computer system that is in communication with one or more display generation components and one or more input devices:

displaying, via the one or more display generation components, a representation of the three-dimensional environment;

while the content is shared in the real-time communication session:

displaying, via the one or more display generation components, a representation of the content having a first appearance in the three-dimensional environment; and

34 . The method of claim 33 , further comprising:

while the content is shared in the real-time communication session:

displaying, via the one or more display generation components, a representation of the content having a third appearance in the three-dimensional environment;

detecting, via the one or more input devices, an input corresponding to a request to change a state of the content in the three-dimensional environment; and

35 . The method of claim 33 , further comprising:

36 . The method of claim 35 , further comprising:

detecting, via the one or more input devices, a first request to control the content in the real-time communication session; and

37 . The method of claim 36 , wherein the first request to control the content in the three-dimensional environment includes a set of one or more inputs by a user of the computer system.

38 . The method of claim 36 , further comprising:

while the computer system has control of the content in the real-time communication session, a second participant requests to control the content in the real-time communication session; and

39 . The method of claim 38 , further comprising:

after ceasing control of the content by the computer system, detecting, via the one or more input devices, a second request to control the content in the real-time communication session; and

in response to detecting the second request to control the content in the real-time communication session, controlling the content in the real-time communication session.

40 . The method of claim 36 , further comprising:

in response to detecting the first request to control the content in the real-time communication session:

41 . The method of claim 40 , further comprising:

42 . The method of claim 33 , wherein the event includes a distance between the content and a position associated with a user of the computer system in the three-dimensional environment satisfying a threshold distance.

43 . The method of claim 33 , wherein the event includes a gaze of a user of the computer system satisfying a set of gaze criteria.

44 . The method of claim 33 , wherein the content includes a three-dimensional virtual object.

45 . The method of claim 33 , wherein the content includes a video.

46 . The method of claim 33 , wherein the content includes a virtual document.

47 . The method of claim 33 , wherein displaying the representation of the three-dimensional environment includes displaying the representation of the three-dimensional environment from a first viewpoint that is different from a viewpoint of the three-dimensional environment of a second participant in the real-time communication session.

48 . The method of claim 33 , further comprising:

displaying, via the one or more display generation components, a representation of one or more of the participants in the three-dimensional environment.