IP Library › Granted Patent US 12,113,948
Granted Patent B1
US 12,113,948 · App. 18/421,827 · Granted Oct 8, 2024

Systems and methods of managing spatial groups in multi-user communication sessions

Inventors: Connor A. Smith (Sunnyvale, CA); Willem Mattelaer (San Jose, CA); Joseph P. Cerra (San Francisco, CA); Kevin Lee (San Jose, CA)
Assignee: Apple Inc.
H04N13/117H04N13/194
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,113,948
App. No.
18/421,827
Filed
Jan 24, 2024
Granted
Oct 8, 2024
Kind
B1
Examiner
VO, TUNG T
Art Unit
2425
USPC
348/43
Abstract

Some examples of the disclosure are directed to systems and methods for managing locations of users in a spatial group within a communication session based on the display of shared content in a three-dimensional environment. In some examples, a first electronic device and a second electronic device are in communication within a communication session. In some examples, the first electronic device displays a three-dimensional environment including an avatar corresponding to a user of the second electronic device. In some examples, in response to detecting an input corresponding to a request to display shared content in the three-dimensional environment, if the shared content is a first type of content, the first electronic positions the avatar a first distance away from the viewpoint, and if the shared content is a second type of content, the first electronic device positions the avatar a second distance away from the viewpoint.

Claims (85)

1. A method comprising:

at a first electronic device in communication with a display, one or more input devices, a second electronic device and a third electronic device:

while in a communication session with the second electronic device and the third electronic device, displaying, via the display, a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device at a first location and a three-dimensional representation corresponding to a user of the third electronic device at a second location, different from the first location, in the computer-generated environment relative to a viewpoint of the first electronic device;

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, receiving, via the one or more input devices, a first input corresponding to a request to display content in the computer-generated environment; and

in response to receiving the first input, in accordance with a determination that the content corresponds to shared content:

displaying, via the display, a first object corresponding to the shared content in the computer-generated environment; and

displaying the three-dimensional representation corresponding to the user of the second electronic device at a first updated location and the three-dimensional representation corresponding to the user of the third electronic device at a second updated location, different from the first updated location, in the computer-generated environment relative to the viewpoint, including:

moving the three-dimensional representation of the user of the second electronic device to the first updated location and moving the three-dimensional representation of the user of the third electronic device to the second updated location in a respective direction that is selected based on a location of the first object.

2. The method of claim 1 , wherein the first object is a shared application window associated with an application operating on the first electronic device.

3. The method of claim 1 , wherein the first updated location and the second updated location are determined relative to a reference line in the computer-generated environment.

4. The method of claim 3 , wherein:

before receiving the first input, the user of the first electronic device, the user of the second electronic device, and the user of the third electronic device are arranged within a spatial group having a center point; and

the reference line extends between the location of the first object in the computer-generated environment and the center point of the spatial group.

5. The method of claim 4 , wherein the center point is determined based on a calculated average of the viewpoint of the first electronic device, the first location, and the second location.

6. The method of claim 3 , wherein:

the respective direction of movement of the three-dimensional representation corresponding to the user of the second electronic device is clockwise relative to the reference line in the computer-generated environment; and

the respective direction of movement of the three-dimensional representation corresponding to the user of the third electronic device is counterclockwise relative to the reference line in the computer-generated environment.

7. The method of claim 1 , further comprising:

before receiving the first input, detecting an indication of a change in state of the second electronic device; and

in response to detecting the indication:

replacing display of the three-dimensional representation corresponding to the user of the second electronic device with a two-dimensional representation of the user of the second electronic device; and

displaying the three-dimensional representation corresponding to the user of the third electronic device at a third updated location relative to the viewpoint, including:

moving the three-dimensional representation of the user of the third electronic device to the third updated location in the respective direction that is selected based on a location of the two-dimensional representation of the user of the second electronic device.

8. The method of claim 1 , wherein the first electronic device, the second electronic device, and the third electronic device include a head-mounted display, respectively.

9. The method of claim 1 , wherein the three-dimensional representation of the user of the second electronic device and the three-dimensional representation of the user of the third electronic device are moved to the first updated location and the second updated location, respectively, in the respective direction with an animation of the movement.

10. The method of claim 1 , further comprising:

in response to receiving the first input, in accordance with a determination that the content corresponds to private content:

displaying, via the display, a second object corresponding to the private content in the computer-generated environment; and

maintaining display of the three-dimensional representation corresponding to the user of the second electronic device at the first location and maintaining display of the three-dimensional representation corresponding to the user of the third electronic device at the second location in the computer-generated environment.

11. The method of claim 10 , further comprising:

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device, the three-dimensional representation corresponding to the user of the third electronic device, and the second object, receiving, via the one or more input devices, a second input corresponding to a request to share the private content with the user of the second electronic device and the user of the third electronic device; and

in response to receiving the second input:

redisplaying the second object as a shared object in the computer-generated environment; and

displaying the three-dimensional representation corresponding to the user of the second electronic device at a third updated location and the three-dimensional representation corresponding to the user of the third electronic device at a fourth updated location, different from the third updated location, in the computer-generated environment relative to the viewpoint, including:

moving the three-dimensional representation of the user of the second electronic device to the third updated location and moving the three-dimensional representation of the user of the third electronic device to the fourth updated location in the respective direction that is selected based on a location of the second object.

12. The method of claim 1 , further comprising:

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, detecting an indication of a request to display shared content in the computer-generated environment; and

in response to detecting the indication:

displaying, via the display, a second object corresponding to the shared content in the computer-generated environment; and

updating the viewpoint of the first electronic device in the computer-generated environment relative to a location of the second object.

13. The method of claim 1 , wherein the viewpoint of the first electronic device, the first location, and the second location are arranged according to a spatial group in the computer-generated environment, the method further comprising:

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, detecting an indication that the user of the second electronic device is no longer in the communication session; and

in response to detecting the indication:

ceasing display of the three-dimensional representation corresponding to the user of the second electronic device in the computer-generated environment; and

maintaining display of the three-dimensional representation corresponding to the user of the third electronic device at the second location in the computer-generated environment.

14. The method of claim 13 , further comprising:

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the third electronic device, detecting an indication that a user of a fourth electronic device has joined the communication session; and

in response to detecting the indication:

displaying, via the display, a three-dimensional representation corresponding to the user of the fourth electronic device at the first location in the computer-generated environment.

15. The method of claim 13 , further comprising:

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the third electronic device, receiving, via the one or more input devices, a second input corresponding to a request to display shared content in the computer-generated environment; and

in response to receiving the second input:

displaying, via the display, a respective object corresponding to the shared content in the computer-generated environment; and

displaying the three-dimensional representation corresponding to the user of the third electronic device at a third location, different from the first location and the second location, in the computer-generated environment.

16. The method of claim 15 , wherein:

prior receiving the second input, the second location at which the three-dimensional representation corresponding to the user of the third electronic device is displayed is a first distance from the viewpoint of the first electronic device; and

in response to receiving the second input, the third location at which the three-dimensional representation corresponding to the user of the third electronic device is displayed is a second distance, smaller than the first distance, from the viewpoint.

17. The method of claim 13 , wherein the computer-generated environment further includes a respective object corresponding to shared content, the method further comprising:

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the third electronic device and the respective object, receiving, via the one or more input devices, a second input corresponding to a request to cease display of the shared content in the computer-generated environment; and

in response to receiving the second input:

ceasing display of the respective object in the computer-generated environment; and

displaying the three-dimensional representation corresponding to the user of the third electronic device at a third location, different from the first location and the second location, in the computer-generated environment.

18. The method of claim 1 , wherein the viewpoint of the first electronic device, the first location, and the second location are arranged according to a spatial group in the computer-generated environment, the method further comprising:

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, detecting an indication that a user of a fourth electronic device has joined the communication session; and

in response to detecting the indication:

displaying, via the display, a three-dimensional representation corresponding to the user of the fourth electronic device at a third location in the computer-generated environment;

moving the three-dimensional representation corresponding to the user of the second electronic device to a fourth location, different from the first location, in the computer-generated environment; and

moving the three-dimensional representation corresponding to the user of the third electronic device to a fifth location, different from the second location, in the computer-generated environment.

19. An electronic device comprising:

one or more processors;

memory; and

one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method comprising:

while in a communication session with a second electronic device and a third electronic device, displaying, via a display, a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device at a first location and a three-dimensional representation corresponding to a user of the third electronic device at a second location, different from the first location, in the computer-generated environment relative to a viewpoint of the electronic device;

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, receiving, via one or more input devices, a first input corresponding to a request to display content in the computer-generated environment; and

in response to receiving the first input, in accordance with a determination that the content corresponds to shared content:

displaying, via the display, a first object corresponding to the shared content in the computer-generated environment; and

displaying the three-dimensional representation corresponding to the user of the second electronic device at a first updated location and the three-dimensional representation corresponding to the user of the third electronic device at a second updated location, different from the first updated location, in the computer-generated environment relative to the viewpoint, including:

moving the three-dimensional representation of the user of the second electronic device to the first updated location and moving the three-dimensional representation of the user of the third electronic device to the second updated location in a respective direction that is selected based on a location of the first object.

20. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising:

while in a communication session with a second electronic device and a third electronic device, displaying, via a display, a computer-generated environment including a three-dimensional representation corresponding to a user of the second electronic device at a first location and a three-dimensional representation corresponding to a user of the third electronic device at a second location, different from the first location, in the computer-generated environment relative to a viewpoint of the electronic device;

while displaying the computer-generated environment including the three-dimensional representation corresponding to the user of the second electronic device and the three-dimensional representation corresponding to the user of the third electronic device, receiving, via one or more input devices, a first input corresponding to a request to display content in the computer-generated environment; and

in response to receiving the first input, in accordance with a determination that the content corresponds to shared content:

displaying, via the display, a first object corresponding to the shared content in the computer-generated environment; and

displaying the three-dimensional representation corresponding to the user of the second electronic device at a first updated location and the three-dimensional representation corresponding to the user of the third electronic device at a second updated location, different from the first updated location, in the computer-generated environment relative to the viewpoint, including:

moving the three-dimensional representation of the user of the second electronic device to the first updated location and moving the three-dimensional representation of the user of the third electronic device to the second updated location in a respective direction that is selected based on a location of the first object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2024
From: SMITH, CONNOR A.; MATTELAER, WILLEM; CERRA, JOSEPH P.; LEE, KEVIN
To: APPLE INC.
Reel/Frame 066246/0655 →
Continuity (4)
Provisional Application 63587595 · Oct 3, 2023
Provisional Application 63578616 · Aug 24, 2023
Provisional Application 63514327 · Jul 18, 2023
Provisional Application 63506116 · Jun 4, 2023
Cited By (37)
US 12,272,005 US 12,299,251 US 12,315,091 US 12,321,563 US 12,321,666 US 12,353,672 US 12,394,167 US 12,443,273 US 12,456,271 US 12,461,641 US 12,475,635 US 12,511,009 US 12,511,847 US 12,524,142 US 12,524,956 US 12,524,977 US 12,535,931 US 12,541,280 US 12,566,532 US 12,596,472 US 12,608,115 US 12,608,877 US 12,608,890 US 12,620,187 US 12,625,608 US 12,632,170 US 12,633,044 US 12,657,958 US 12,663,853 US 12,663,875 US 12,663,907 US 12,675,958 US 12,681,587 US 12,687,922 US 12,688,660 US 12,737,093 US 12,749,272