Creative camera
The present disclosure generally relates to displaying visual effects in image data. In some examples, visual effects include an avatar displayed on a user's face. In some examples, visual effects include stickers applied to image data. In some examples, visual effects include screen effects. In some examples, visual effects are modified based on depth data in the image data.
1. An electronic device, comprising:
a display apparatus;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display apparatus, a live video communication user interface of a live video communication application, the live video communication user interface including concurrently displaying on the display:
a representation of a first participant in a live video communication session displayed at a first size;
a representation of a subject participating in the live video communication session with the first participant, wherein the representation of the subject is displayed at a second size that is smaller than the first size; and
a first affordance that is associated with a camera effects mode, wherein the first affordance is separate from the representation of the subject;
while concurrently displaying the representation of the first participant, the representation of the subject, and the first affordance, detecting a gesture directed to the first affordance; and
in response to detecting the gesture directed to the first affordance:
activating the camera effects mode; and
increasing a size of the representation of the subject participating in the live video communication session to a third size that is larger than the second size and occupies at least a portion of the display that was occupied by the representation of the first participant prior to detecting the gesture directed to the first affordance.
2. The electronic device of claim 1 , the one or more programs further including instructions for:
prior to displaying the first affordance, detecting a first input on the live video communication user interface, the first input corresponding to a request to display one or more options associated with the live video communication session;
in response to detecting the first input:
displaying the one or more options associated with the live video communication session; and
displaying the first affordance.
3. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
detecting a selection of an effects option affordance; and
in response to detecting selection of the effects option affordance, modifying an appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance.
4. The electronic device of claim 3 , the one or more programs further including instructions for:
detecting a second input on the live video communication user interface, the second input corresponding to a request to reduce the size of the representation of the subject participating in the live video communication session; and
in response to detecting the second input, concurrently displaying:
the representation of the subject participating in the live video communication session having the modified appearance based on the visual effect associated with the selected effects option affordance; and
one or more representations of respective participants in the live video communication session.
5. The electronic device of claim 3 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the representation of the subject is a live preview of a field of view of a camera of the electronic device, the one or more programs further including instructions for:
after modifying the appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance, transmitting data corresponding to the modified appearance of the representation of the subject participating in the live video communication session to at least the first remote participant of the plurality of participants.
6. The electronic device of claim 1 , wherein the representation of the subject participating in the live video communication session includes image data captured by a camera associated with the electronic device.
7. The electronic device of claim 1 , wherein the representation of the subject participating in the live video communication session includes image data transmitted to the electronic device from a second electronic device.
8. The electronic device of claim 1 , the one or more programs further including instructions for:
in response to detecting the gesture directed to the first affordance, displaying a first visual-effect affordance associated with a first type of visual effect and a second visual-effect affordance associated with a second type of visual effect that is different from the first type of visual effect.
9. The electronic device of claim 8 , the one or more programs further including instructions for:
detecting a selection of one of the affordances associated with a type of visual effect; and
in response to detecting the selection of the affordance associated with the visual effect, displaying a plurality of visual effect options corresponding to the visual effect.
10. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display one or more visual effects.
11. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display a virtual avatar;
detecting a change in a face in a field of view of one or more cameras of the electronic device; and
changing an appearance of the virtual avatar based on the detected change in the face.
12. The electronic device of claim 1 , wherein the live video communication user interface further includes:
a representation of a second participant in the live video communication session; and
a representation of a third participant in the live video communication session.
13. The electronic device of claim 1 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the live video communication user interface further includes a representation of the first remote participant, the one or more programs further including instructions for:
further in response to detecting the gesture directed to the first affordance, reducing a size of the representation of the first remote participant.
14. The electronic device of claim 1 , the one or more programs further including instructions for:
while the camera effects mode is activated:
displaying a first visual effect in the representation of the subject participating in the live video communication session;
detecting an input corresponding to the first visual effect; and
in response to detecting the input corresponding to the first visual effect:
in accordance with a determination that the input is a first type, modifying a location of the first visual effect in the representation of the subject participating in the live video communication session based on a magnitude and direction of the input; and
in accordance with a determination that the input is a second type, modifying a size of the first visual effect based on the magnitude of the input.
15. The electronic device of claim 14 , wherein modifying the location of the first visual effect includes:
prior to detecting termination of the input, displaying movement of the first visual effect based on the magnitude and direction of the input; and
in accordance with a determination that the first visual effect moves across a border region of a predetermined location, generating an indication that the first visual effect has crossed the border region.
16. The electronic device of claim 15 , wherein the indication is at least one of a haptic feedback or a visual feedback.
17. The electronic device of claim 14 , wherein:
modifying the location of the first visual effect includes displaying movement of the first visual effect from a first location to a second location; and
modifying the size of the first visual effect includes displaying a transition of the first visual effect from a first displayed size to a second displayed size.
18. The electronic device of claim 14 , wherein:
modifying the location of the first visual effect includes transitioning the first visual effect from appearing at a first location to appearing at a second location, without displaying the first visual effect appearing at an intermediate location; and
modifying the size of the first visual effect includes transitioning the first visual effect from a first displayed size to a second displayed size, without displaying the first visual effect having an intermediate size.
19. The electronic device of claim 1 , the one or more programs further including instructions for:
displaying the live video communication user interface without the first affordance;
detecting a touch input on the live video communication user interface; and
in response to detecting the touch input:
in accordance with a determination that the camera effects mode is activated, displaying a live video communication options user interface including the first affordance and a plurality of visual effects affordances; and
in accordance with a determination that the camera effects mode is not activated, displaying the live video communication options user interface including the first affordance and excluding the plurality of visual effects affordances.
20. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for:
displaying, via the display apparatus, a live video communication user interface of a live video communication application, the live video communication user interface including concurrently displaying on the display:
a representation of a first participant in a live video communication session displayed at a first size;
a representation of a subject participating in the live video communication session with the first participant, wherein the representation of the subject is displayed at a second size that is smaller than the first size; and
a first affordance that is associated with a camera effects mode, wherein the first affordance is separate from the representation of the subject;
while concurrently displaying the representation of the first participant, the representation of the subject, and the first affordance, detecting a gesture directed to the first affordance; and
in response to detecting the gesture directed to the first affordance:
activating the camera effects mode; and
increasing a size of the representation of the subject participating in the live video communication session to a third size that is larger than the second size and occupies at least a portion of the display that was occupied by the representation of the first participant prior to detecting the gesture directed to the first affordance.
21. The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:
prior to displaying the first affordance, detecting a first input on the live video communication user interface, the first input corresponding to a request to display one or more options associated with the live video communication session;
in response to detecting the first input:
displaying the one or more options associated with the live video communication session; and
displaying the first affordance.
22. The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:
while the camera effects mode is activated:
detecting a selection of an effects option affordance; and
in response to detecting selection of the effects option affordance, modifying an appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance.
23. The non-transitory computer-readable storage medium of claim 22 , the one or more programs further including instructions for:
detecting a second input on the live video communication user interface, the second input corresponding to a request to reduce the size of the representation of the subject participating in the live video communication session; and
in response to detecting the second input, concurrently displaying:
the representation of the subject participating in the live video communication session having the modified appearance based on the visual effect associated with the selected effects option affordance; and
one or more representations of respective participants in the live video communication session.
24. The non-transitory computer-readable storage medium of claim 22 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the representation of the subject is a live preview of a field of view of a camera of the electronic device, the one or more programs further including instructions for:
after modifying the appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance, transmitting data corresponding to the modified appearance of the representation of the subject participating in the live video communication session to at least the first remote participant of the plurality of participants.
25. The non-transitory computer-readable storage medium of claim 20 , wherein the representation of the subject participating in the live video communication session includes image data captured by a camera associated with the electronic device.
26. The non-transitory computer-readable storage medium of claim 20 , wherein the representation of the subject participating in the live video communication session includes image data transmitted to the electronic device from a second electronic device.
27. The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:
in response to detecting the gesture directed to the first affordance, displaying a first visual-effect affordance associated with a first type of visual effect and a second visual-effect affordance associated with a second type of visual effect that is different from the first type of visual effect.
28. The non-transitory computer-readable storage medium of claim 27 , the one or more programs further including instructions for:
detecting a selection of one of the affordances associated with a type of visual effect; and
in response to detecting the selection of the affordance associated with the visual effect, displaying a plurality of visual effect options corresponding to the visual effect.
29. The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display one or more visual effects.
30. The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display a virtual avatar;
detecting a change in a face in a field of view of one or more cameras of the electronic device; and
changing an appearance of the virtual avatar based on the detected change in the face.
31. The non-transitory computer-readable storage medium of claim 20 , wherein the live video communication user interface further includes:
a representation of a second participant in the live video communication session; and
a representation of a third participant in the live video communication session.
32. The non-transitory computer-readable storage medium of claim 20 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the live video communication user interface further includes a representation of the first remote participant, the one or more programs further including instructions for:
further in response to detecting the gesture directed to the first affordance, reducing a size of the representation of the first remote participant.
33. The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:
while the camera effects mode is activated:
displaying a first visual effect in the representation of the subject participating in the live video communication session;
detecting an input corresponding to the first visual effect; and
in response to detecting the input corresponding to the first visual effect:
in accordance with a determination that the input is a first type, modifying a location of the first visual effect in the representation of the subject participating in the live video communication session based on a magnitude and direction of the input; and
in accordance with a determination that the input is a second type, modifying a size of the first visual effect based on the magnitude of the input.
34. The non-transitory computer-readable storage medium of claim 33 , wherein modifying the location of the first visual effect includes:
prior to detecting termination of the input, displaying movement of the first visual effect based on the magnitude and direction of the input; and
in accordance with a determination that the first visual effect moves across a border region of a predetermined location, generating an indication that the first visual effect has crossed the border region.
35. The non-transitory computer-readable storage medium of claim 34 , wherein the indication is at least one of a haptic feedback or a visual feedback.
36. The non-transitory computer-readable storage medium of claim 33 , wherein:
modifying the location of the first visual effect includes displaying movement of the first visual effect from a first location to a second location; and
modifying the size of the first visual effect includes displaying a transition of the first visual effect from a first displayed size to a second displayed size.
37. The non-transitory computer-readable storage medium of claim 33 , wherein:
modifying the location of the first visual effect includes transitioning the first visual effect from appearing at a first location to appearing at a second location, without displaying the first visual effect appearing at an intermediate location; and
modifying the size of the first visual effect includes transitioning the first visual effect from a first displayed size to a second displayed size, without displaying the first visual effect having an intermediate size.
38. The non-transitory computer-readable storage medium of claim 20 , the one or more programs further including instructions for:
displaying the live video communication user interface without the first affordance;
detecting a touch input on the live video communication user interface; and
in response to detecting the touch input:
in accordance with a determination that the camera effects mode is activated, displaying a live video communication options user interface including the first affordance and a plurality of visual effects affordances; and
in accordance with a determination that the camera effects mode is not activated, displaying the live video communication options user interface including the first affordance and excluding the plurality of visual effects affordances.
39. A method comprising:
at an electronic device having a display apparatus:
displaying, via the display apparatus, a live video communication user interface of a live video communication application, the live video communication user interface including concurrently displaying on the display:
a representation of a first participant in a live video communication session displayed at a first size;
a representation of a subject participating in the live video communication session with the first participant, wherein the representation of the subject is displayed at a second size that is smaller than the first size; and
a first affordance that is associated with a camera effects mode, wherein the first affordance is separate from the representation of the subject;
while concurrently displaying the representation of the first participant, the representation of the subject, and the first affordance, detecting a gesture directed to the first affordance; and
in response to detecting the gesture directed to the first affordance:
activating the camera effects mode; and
increasing a size of the representation of the subject participating in the live video communication session to a third size that is larger than the second size and occupies at least a portion of the display that was occupied by the representation of the first participant prior to detecting the gesture directed to the first affordance.
40. The method of claim 39 , further comprising:
prior to displaying the first affordance, detecting a first input on the live video communication user interface, the first input corresponding to a request to display one or more options associated with the live video communication session;
in response to detecting the first input:
displaying the one or more options associated with the live video communication session; and
displaying the first affordance.
41. The method of claim 39 , further comprising:
while the camera effects mode is activated:
detecting a selection of an effects option affordance; and
in response to detecting selection of the effects option affordance, modifying an appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance.
42. The method of claim 41 , further comprising:
detecting a second input on the live video communication user interface, the second input corresponding to a request to reduce the size of the representation of the subject participating in the live video communication session; and
in response to detecting the second input, concurrently displaying:
the representation of the subject participating in the live video communication session having the modified appearance based on the visual effect associated with the selected effects option affordance; and
one or more representations of respective participants in the live video communication session.
43. The method of claim 41 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the representation of the subject is a live preview of a field of view of a camera of the electronic device, the method further comprising:
after modifying the appearance of the representation of the subject participating in the live video communication session based on a visual effect associated with the selected effects option affordance, transmitting data corresponding to the modified appearance of the representation of the subject participating in the live video communication session to at least the first remote participant of the plurality of participants.
44. The method of claim 39 , wherein the representation of the subject participating in the live video communication session includes image data captured by a camera associated with the electronic device.
45. The method of claim 39 , wherein the representation of the subject participating in the live video communication session includes image data transmitted to the electronic device from a second electronic device.
46. The method of claim 39 , further comprising:
in response to detecting the gesture directed to the first affordance, displaying a first visual-effect affordance associated with a first type of visual effect and a second visual-effect affordance associated with a second type of visual effect that is different from the first type of visual effect.
47. The method of claim 46 , further comprising:
detecting a selection of one of the affordances associated with a type of visual effect; and
in response to detecting the selection of the affordance associated with the visual effect, displaying a plurality of visual effect options corresponding to the visual effect.
48. The method of claim 39 , further comprising:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display one or more visual effects.
49. The method of claim 39 , further comprising:
while the camera effects mode is activated:
modifying an appearance of the representation of the subject participating in the live video communication session to display a virtual avatar;
detecting a change in a face in a field of view of one or more cameras of the electronic device; and
changing an appearance of the virtual avatar based on the detected change in the face.
50. The method of claim 39 , wherein the live video communication user interface further includes:
a representation of a second participant in the live video communication session; and
a representation of a third participant in the live video communication session.
51. The method of claim 39 , wherein a plurality of participants are participating in the live video communication session, the plurality of participants including the subject and the first participant, wherein the first participant is a first remote participant, and wherein the live video communication user interface further includes a representation of the first remote participant, the method further comprising:
further in response to detecting the gesture directed to the first affordance, reducing a size of the representation of the first remote participant.
52. The method of claim 39 , further comprising:
while the camera effects mode is activated:
displaying a first visual effect in the representation of the subject participating in the live video communication session;
detecting an input corresponding to the first visual effect; and
in response to detecting the input corresponding to the first visual effect:
in accordance with a determination that the input is a first type, modifying a location of the first visual effect in the representation of the subject participating in the live video communication session based on a magnitude and direction of the input; and
in accordance with a determination that the input is a second type, modifying a size of the first visual effect based on the magnitude of the input.
53. The method of claim 52 , wherein modifying the location of the first visual effect includes:
prior to detecting termination of the input, displaying movement of the first visual effect based on the magnitude and direction of the input; and
in accordance with a determination that the first visual effect moves across a border region of a predetermined location, generating an indication that the first visual effect has crossed the border region.
54. The method of claim 53 , wherein the indication is at least one of a haptic feedback or a visual feedback.
55. The method of claim 52 , wherein:
modifying the location of the first visual effect includes displaying movement of the first visual effect from a first location to a second location; and
modifying the size of the first visual effect includes displaying a transition of the first visual effect from a first displayed size to a second displayed size.
56. The method of claim 52 , wherein:
modifying the location of the first visual effect includes transitioning the first visual effect from appearing at a first location to appearing at a second location, without displaying the first visual effect appearing at an intermediate location; and
modifying the size of the first visual effect includes transitioning the first visual effect from a first displayed size to a second displayed size, without displaying the first visual effect having an intermediate size.
57. The method of claim 39 , further comprising:
displaying the live video communication user interface without the first affordance;
detecting a touch input on the live video communication user interface; and
in response to detecting the touch input:
in accordance with a determination that the camera effects mode is activated, displaying a live video communication options user interface including the first affordance and a plurality of visual effects affordances; and
in accordance with a determination that the camera effects mode is not activated, displaying the live video communication options user interface including the first affordance and excluding the plurality of visual effects affordances.