Granted Patent B2

US 11,399,155 · App. 17/157,166 · Granted Jul 26, 2022

Inventors: Marcel Van Os (San Francisco, CA); Lee S. Broughton (Santa Cruz, CA); Peter Callaway (San Jose, CA); Pablo F. Caro (San Francisco, CA); Jae Woo Chang (San Jose, CA); Allison Dryer (San Francisco, CA); Craig M. Federighi (Los Altos Hills, CA); Robert Garcia (San Francisco, CA); Stephen O. Lemay (Palo Alto, CA); John Louch (Boulder, CO); Hoan Pham (San Jose, CA)

Assignee: Apple Inc.

H04N7/15G06F9/542H04L51/04H04L51/043H04L51/046H04M1/72439H04N5/2628H04N7/141H04N7/144H04N7/147H04N7/152H04N21/42204H04N21/4316H04N21/47G06T7/20G06T2207/10016G06T2207/30196H04L51/24H04N21/42224H04N2007/145

Abstract

Claims (161)

1. An electronic device, comprising:

a display;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, on the display, a live video communication user interface that includes concurrently displaying:

a representation of a view of a camera of the electronic device at a respective size; and

a plurality of participant representations that includes:

a representation of a first participant in a live video communication session;

a representation of a second participant in the live video communication session; and

a representation of a third participant in the live video communication session, wherein the representation of the first participant is larger than the representation of the second participant and the representation of the third participant, and wherein the live video communication user interface is concurrently displayed with a first user interface that includes a first plurality of user interface objects;

while displaying the plurality of participant representations, receiving an input that corresponds to a request to increase a size of the live video communication user interface; and

in response to receiving the input that corresponds to the request to increase the size of the live video communication user interface:

increasing the size of the live video communication user interface, including:

increasing sizes of the plurality of participant representations relative to the representation of the view of the camera of the electronic device, wherein after increasing the sizes of the plurality of participant representation, the representation of the first participant remains larger than the representation of the second participant and the representation of the third participant; and

while the live video communication user interface including the plurality of participant representations is displayed:

decreasing an amount of the first user interface that is displayed while increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, wherein the amount of the first user interface that is displayed is decreased relative to an increased size of the live video communication user interface.

2. The electronic device of claim 1 , wherein:

before increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the first participant is a first horizontal distance from the representation of the third participant; and

in response to receiving the input and after increasing the size of the live video communication user interface and the sizes of the plurality of participant representations:

the representation of the first participant is a second horizontal distance from the representation of the third participant, wherein the second horizontal distance is greater than the first horizontal distance.

3. The electronic device of claim 2 , wherein:

the representation of the first participant is a leftmost representation of the plurality of participant representations; and

the representation of the third participant is a rightmost representation of the plurality of participant representations.

4. The electronic device of claim 1 , wherein the input corresponds to a swipe input.

5. The electronic device of claim 1 , wherein:

the live video communication user interface is concurrently displayed with the first user interface;

an affordance is located at a position adjacent to the live video communication user interface and the first user interface; and

the input is detected at a location that corresponds to the affordance.

6. The electronic device of claim 1 , wherein:

before decreasing the amount of the first user interface that is displayed and while the plurality of participant representations are displayed, the first user interface includes a first amount user interface objects that are concurrently displayed on the display; and

in response to receiving the input and after decreasing the amount of the first user interface that is displayed and while the plurality of participant representations are displayed, the first user interface includes a second amount of user interface objects that are concurrently displayed on the display, wherein the second amount is less than the first amount.

7. The electronic device of claim 1 , wherein:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a first set of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the first set of the plurality of participant representations continue to overlap each other.

8. The electronic device of claim 1 , wherein:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a rightmost representation of the plurality of participant representations and a leftmost representation of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the rightmost representation of the plurality of participant representations and the leftmost representation of the plurality of participant representations do not overlap each other.

9. The electronic device of claim 1 , wherein increasing the size of the live video communication user interface includes increasing an amount of the display that the live video communication user interface occupies.

10. The electronic device of claim 1 , the one or more programs further include instructions for:

before increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the second participant is larger than the representation of the third participant; and

after increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the second participant remains larger than the representation of the third participant and relative sizes of the plurality of participant representations are maintained with respect to each other.

11. The electronic device of claim 1 , wherein increasing the size of the live video communication user interface includes continuing to display the representation of the view of the camera of the electronic device at the respective size.

12. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display, the one or more programs including instructions for:

displaying, on the display, a live video communication user interface that includes concurrently displaying:

a representation of a view of a camera of the electronic device at a respective size; and

a plurality of participant representations that includes:

a representation of a first participant in a live video communication session;

a representation of a second participant in the live video communication session; and

a representation of a third participant in the live video communication session, wherein the representation of the first participant is larger than the representation of the second participant and the representation of the third participant, and wherein the live video communication user interface is concurrently displayed with a first user interface that includes a first plurality of user interface objects;

while displaying the plurality of participant representations, receiving an input that corresponds to a request to increase a size of the live video communication user interface; and

in response to receiving the input that corresponds to the request to increase the size of the live video communication user interface:

increasing the size of the live video communication user interface, including:

increasing sizes of the plurality of participant representations relative to the representation of the view of the camera of the electronic device, wherein after increasing the sizes of the plurality of participant representation, the representation of the first participant remains larger than the representation of the second participant and the representation of the third participant; and

while the live video communication user interface including the plurality of participant representations is displayed:

decreasing an amount of the first user interface that is displayed while increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, wherein the amount of the first user interface that is displayed is decreased relative to an increased size of the live video communication user interface.

13. The non-transitory computer-readable storage medium of claim 12 , wherein:

before increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the first participant is a first horizontal distance from the representation of the third participant; and

in response to receiving the input and after increasing the size of the live video communication user interface and the sizes of the plurality of participant representations:

the representation of the first participant is a second horizontal distance from the representation of the third participant, wherein the second horizontal distance is greater than the first horizontal distance.

14. The non-transitory computer-readable storage medium of claim 13 , wherein:

the representation of the first participant is a leftmost representation of the plurality of participant representations; and

the representation of the third participant is a rightmost representation of the plurality of participant representations.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the input corresponds to a swipe input.

16. The non-transitory computer-readable storage medium of claim 12 , wherein:

the live video communication user interface is concurrently displayed with the first user interface;

an affordance is located at a position adjacent to the live video communication user interface and the first user interface; and

the input is detected at a location that corresponds to the affordance.

17. The non-transitory computer-readable storage medium of claim 12 , wherein:

before decreasing the amount of the first user interface that is displayed and while the plurality of participant representations are displayed, the first user interface includes a first amount user interface objects that are concurrently displayed on the display; and

in response to receiving the input and after decreasing the amount of the first user interface that is displayed and while the plurality of participant representations are displayed, the first user interface includes a second amount of user interface objects that are concurrently displayed on the display, wherein the second amount is less than the first amount.

18. The non-transitory computer-readable storage medium of claim 12 , wherein:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a first set of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the first set of the plurality of participant representations continue to overlap each other.

19. The non-transitory computer-readable storage medium of claim 12 , wherein:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a rightmost representation of the plurality of participant representations and a leftmost representation of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the rightmost representation of the plurality of participant representations and the leftmost representation of the plurality of participant representations do not overlap each other.

20. The non-transitory computer-readable storage medium of claim 12 , wherein increasing the size of the live video communication user interface includes increasing an amount of the display that the live video communication user interface occupies.

21. The non-transitory computer-readable storage medium of claim 12 , wherein the one or more programs further include instructions for:

before increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the second participant is larger than the representation of the third participant; and

after increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the second participant remains larger than the representation of the third participant and relative sizes of the plurality of participant representations are maintained with respect to each other.

22. The non-transitory computer-readable storage medium of claim 12 , wherein increasing the size of the live video communication user interface includes continuing to display the representation of the view of the camera of the electronic device at the respective size.

23. A method, comprising:

at an electronic device with a display:

displaying, on the display, a live video communication user interface that includes concurrently displaying:

a representation of a view of a camera of the electronic device at a respective size; and

a plurality of participant representations that includes:

a representation of a first participant in a live video communication session;

a representation of a second participant in the live video communication session; and

a representation of a third participant in the live video communication session, wherein the representation of the first participant is larger than the representation of the second participant and the representation of the third participant, and wherein the live video communication user interface is concurrently displayed with a first user interface that includes a first plurality of user interface objects;

while displaying the plurality of participant representations, receiving an input that corresponds to a request to increase a size of the live video communication user interface; and

in response to receiving the input that corresponds to the request to increase the size of the live video communication user interface:

increasing the size of the live video communication user interface, including:

increasing sizes of the plurality of participant representations relative to the representation of the view of the camera of the electronic device, wherein after increasing the sizes of the plurality of participant representation, the representation of the first participant remains larger than the representation of the second participant and the representation of the third participant; and

while the live video communication user interface including the plurality of participant representations is displayed:

decreasing an amount of the first user interface that is displayed while increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, wherein the amount of the first user interface that is displayed is decreased relative to an increased size of the live video communication user interface.

24. The method of claim 23 , further comprising:

before increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the first participant is a first horizontal distance from the representation of the third participant; and

in response to receiving the input and after increasing the size of the live video communication user interface and the sizes of the plurality of participant representations:

the representation of the first participant is a second horizontal distance from the representation of the third participant, wherein the second horizontal distance is greater than the first horizontal distance.

25. The method of claim 24 , further comprising:

the representation of the first participant is a leftmost representation of the plurality of participant representations; and

the representation of the third participant is a rightmost representation of the plurality of participant representations.

26. The method of claim 23 , wherein the input corresponds to a swipe input.

27. The method of claim 23 , further comprising:

the live video communication user interface is concurrently displayed with the first user interface;

an affordance is located at a position adjacent to the live video communication user interface and the first user interface; and

the input is detected at a location that corresponds to the affordance.

28. The method of claim 23 , further comprising:

before decreasing the amount of the first user interface that is displayed and while the plurality of participant representations are displayed, the first user interface includes a first amount user interface objects that are concurrently displayed on the display; and

in response to receiving the input and after decreasing the amount of the first user interface that is displayed and while the plurality of participant representations are displayed, the first user interface includes a second amount of user interface objects that are concurrently displayed on the display, wherein the second amount is less than the first amount.

29. The method of claim 23 , further comprising:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a first set of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the first set of the plurality of participant representations continue to overlap each other.

30. The method of claim 23 , further comprising:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a rightmost representation of the plurality of participant representations and a leftmost representation of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the rightmost representation of the plurality of participant representations and the leftmost representation of the plurality of participant representations do not overlap each other.

31. The method of claim 23 , wherein increasing the size of the live video communication user interface includes increasing an amount of the display that the live video communication user interface occupies.

32. The method of claim 23 , further comprising:

before increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the second participant is larger than the representation of the third participant; and

after increasing the size of the live video communication user interface and the sizes of the plurality of participant representations, the representation of the second participant remains larger than the representation of the third participant and relative sizes of the plurality of participant representations are maintained with respect to each other.

33. The method of claim 23 , wherein increasing the size of the live video communication user interface includes continuing to display the representation of the view of the camera of the electronic device at the respective size.

34. An electronic device, comprising:

a display;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, on the display, a live video communication user interface that includes concurrently displaying:

a representation of a view of a camera of the electronic device at a respective size; and

a plurality of participant representations that includes:

a representation of a first participant in a live video communication session;

a representation of a second participant in the live video communication session; and

a representation of a third participant in the live video communication session, wherein the representation of the first participant is larger than the representation of the second participant and the representation of the third participant;

while displaying the plurality of participant representations, receiving an input that corresponds to a request to increase a size of the live video communication user interface; and

in response to receiving the input that corresponds to the request to increase the size of the live video communication user interface, increasing the size of the live video communication user interface, including:

increasing sizes of the plurality of participant representations relative to the representation of the view of the camera of the electronic device, wherein after increasing the sizes of the plurality of participant representation, the representation of the first participant remains larger than the representation of the second participant and the representation of the third participant, wherein:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a first set of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the first set of the plurality of participant representations continue to overlap each other.

35. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display, the one or more programs including instructions for:

displaying, on the display, a live video communication user interface that includes concurrently displaying:

a representation of a view of a camera of the electronic device at a respective size; and

a plurality of participant representations that includes:

a representation of a first participant in a live video communication session;

a representation of a second participant in the live video communication session; and

a representation of a third participant in the live video communication session, wherein the representation of the first participant is larger than the representation of the second participant and the representation of the third participant;

while displaying the plurality of participant representations, receiving an input that corresponds to a request to increase a size of the live video communication user interface; and

in response to receiving the input that corresponds to the request to increase the size of the live video communication user interface, increasing the size of the live video communication user interface, including:

increasing sizes of the plurality of participant representations relative to the representation of the view of the camera of the electronic device, wherein after increasing the sizes of the plurality of participant representation, the representation of the first participant remains larger than the representation of the second participant and the representation of the third participant, wherein:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a first set of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the first set of the plurality of participant representations continue to overlap each other.

36. A method, comprising:

at an electronic device with a display:

displaying, on the display, a live video communication user interface that includes concurrently displaying:

a representation of a view of a camera of the electronic device at a respective size; and

a plurality of participant representations that includes:

a representation of a first participant in a live video communication session;

a representation of a second participant in the live video communication session; and

a representation of a third participant in the live video communication session, wherein the representation of the first participant is larger than the representation of the second participant and the representation of the third participant;

while displaying the plurality of participant representations, receiving an input that corresponds to a request to increase a size of the live video communication user interface; and

in response to receiving the input that corresponds to the request to increase the size of the live video communication user interface, increasing the size of the live video communication user interface, including:

increasing sizes of the plurality of participant representations relative to the representation of the view of the camera of the electronic device, wherein after increasing the sizes of the plurality of participant representation, the representation of the first participant remains larger than the representation of the second participant and the representation of the third participant, wherein:

before increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, a first set of the plurality of participant representations overlap each other; and

in response to receiving the input and after increasing the size of the live video communication user interface and while the plurality of participant representations are displayed, the first set of the plurality of participant representations continue to overlap each other.

Continuity (6)

Cited By (13)

US 12,192,617 US 12,314,553 US 12,394,077 US 12,401,889 US 12,495,204 US 12,506,953 US 12,530,116 US 12,602,154 US 12,647,673 US 12,659,569 US 12,666,132 US 12,671,891 US 12,701,334