Media effect application
Exemplary embodiments relate to the application of media effects, such as visual overlays, sound effects, etc. to a video conversation. A media effect may be applied as a reaction to an occurrence in the conversation, such as in response to an emotional reaction detected by emotion analysis of information associated with the video. Effect application may be controlled through gestures, such as applying different effects with different gestures, or canceling automatic effect application using a gesture. Effects may also be applied in group settings, and may affect multiple users. A real-time data channel may synchronize effect application across multiple participants. When broadcasting a video stream that includes effects, the three channels may be sent to an intermediate server, which stitches the three channels together into a single video stream; the single video stream may then be sent to a broadcast server for distribution to the broadcast recipients.
1. A method, comprising:
receiving a video conversation at a server from a client device, the video conversation comprising original audio data carried on an audio channel and one or more original video frames carried on a video channel, the video conversation received from a first participant in the video conversation;
identifying a media effect to be applied to the video conversation, the media effect comprising an audible or graphical modification configured to be automatically applied to change the original audio data or the one or more original video frames received from the first participant, the media effect being received from a promoter;
generating an instruction for a client device associated with the first participant in the video conversation to cause the device to automatically present the media effect, wherein information associated with the media effect is transmitted between the server and the device on a control channel distinct from the audio channel the video channel; and
incrementing an advertising counter associated with the promoter in response to generating the instruction.
2. The method of claim 1 , further comprising receiving the media effect at the server from a device associated with the promoter.
3. The method of claim 1 , further comprising calculating a fee to be charged to the promoter based on a value of the advertising counter.
4. The method of claim 1 , wherein automatically presenting the media effect comprises displaying a recommendation dialog on the display, the recommendation dialog including the media effect, and further comprising:
receiving a selection of a selected media effect from the recommendation dialog; and
presenting the selected media effect at a client device associated with a second participant in the video conversation.
5. The method of claim 1 , wherein the media effect is retrieved from a library of media effects, the library comprising multiple media effects associated with a single style, the multiple media effects associated with different emotional states, the identified media effect being a media effect associated with the single style corresponding to the matched emotional state.
6. The method of claim 1 , wherein automatically presenting the media effect comprises:
fading in the media effect on the display;
detecting a cancellation instruction; and
refraining from presenting the media effect on a display associated with a second participant in the video conversation.
7. The method of claim 1 , wherein the media effect alters a visual appearance of two or more participants in the video conversation in a coordinated manner.
8. A non-transitory computer-readable medium storing instructions configured to cause one or more processors to:
receive a video conversation at a server from a client device, the video conversation comprising original audio data carried on an audio channel and one or more original video frames carried on a video channel, the video conversation received from a first participant in the video conversation;
identify a media effect to be applied to the video conversation, the media effect comprising an audible or graphical modification configured to be automatically applied to change the original audio data or the one or more original video frames received from the first participant, the media effect being received from a promoter;
generate an instruction for a client device associated with the first participant in the video conversation to cause the device to automatically present the media effect, wherein information associated with the media effect is transmitted between the server and the device on a control channel distinct from the audio channel the video channel; and
increment an advertising counter associated with the promoter in response to generating the instruction.
9. The medium of claim 8 , further storing instructions for receiving the media effect at the server from a device associated with the promoter.
10. The medium of claim 8 , further storing instructions for calculating a fee to be charged to the promoter based on a value of the advertising counter.
11. The medium of claim 8 , wherein automatically presenting the media effect comprises displaying a recommendation dialog on the display, the recommendation dialog including the media effect, and further comprising:
receiving a selection of a selected media effect from the recommendation dialog; and
presenting the selected media effect at a client device associated with a second participant in the video conversation.
12. The medium of claim 8 , wherein the media effect is retrieved from a library of media effects, the library comprising multiple media effects associated with a single style, the multiple media effects associated with different emotional states, the identified media effect being a media effect associated with the single style corresponding to the matched emotional state.
13. The medium of claim 8 , wherein automatically presenting the media effect comprises:
fading in the media effect on the display;
detecting a cancellation instruction; and
refraining from presenting the media effect on a display associated with a second participant in the video conversation.
14. The medium of claim 8 , wherein the media effect alters a visual appearance of
two or more participants in the video conversation in a coordinated manner.
15. An apparatus comprising:
a non-transitory computer readable medium configured to store instructions for facilitating a video conversation; and
a processor configured to execute the instructions, the instructions configured to cause the processor to:
receive a video conversation at a server from a client device, the video conversation comprising original audio data carried on an audio channel and one or more original video frames carried on a video channel, the video conversation received from a first participant in the video conversation;
identify a media effect to be applied to the video conversation, the media effect comprising an audible or graphical modification configured to be automatically applied to change the original audio data or the one or more original video frames received from the first participant, the media effect being received from a promoter;
generate an instruction for a client device associated with the first participant in the video conversation to cause the device to automatically present the media effect, wherein information associated with the media effect is transmitted between the server and the device on a control channel distinct from the audio channel the video channel; and
increment an advertising counter associated with the promoter in response to generating the instruction.
16. The apparatus of claim 15 , wherein the processor is further configured to receive the media effect at the server from a device associated with the promoter.
17. The apparatus of claim 15 , wherein the processor is further configured to calculate a fee to be charged to the promoter based on a value of the advertising counter.
18. The apparatus of claim 15 , wherein automatically presenting the media effect comprises displaying a recommendation dialog on the display, the recommendation dialog including the media effect, and further comprising:
receiving a selection of a selected media effect from the recommendation dialog; and
presenting the selected media effect at a client device associated with a second participant in the video conversation.
19. The apparatus of claim 15 , wherein the media effect is retrieved from a library of media effects, the library comprising multiple media effects associated with a single style, the multiple media effects associated with different emotional states, the identified media effect being a media effect associated with the single style corresponding to the matched emotional state.
20. The apparatus of claim 15 , wherein automatically presenting the media effect comprises:
fading in the media effect on the display;
detecting a cancellation instruction; and
refraining from presenting the media effect on a display associated with a second participant in the video conversation.