Messenger MSQRD-mask indexing
Exemplary embodiments relate to the creation of a media effect index for group video conversations. Media effect application (e.g., in the form of graphical overlays, filters, sounds, etc.) may be tracked in a timeline during a chat session. The resulting index may be used to create a highlights reel, which may serve as an index into a live show or may be used to determine the best time to insert materials into a recording of the conversation. The index may be used to automatically detect events in the video feed, to allow viewers to skip ahead to exciting moments (e.g., represented by clusters of applications of particular types of media effects), to determine where each participant spoke in a discussion, or to provide a common “watch together” experience while multiple users watch a common video. An analysis of the index may be used for research or consumer testing.
1. A computer-implemented method, comprising:
receiving a media effect index containing time-stamped entries reflecting the application of media effects to or by participants in a video stream of a group video conversation;
determining, based on the time-stamps, that media effects were applied by or to two or more different participants in the group conversation;
determining that the media effects were applied to the two or more different participants within a predetermined threshold period of time;
determining, based on the application of the two or more media effects within the threshold period of time, that an event has occurred within the group video conversation;
recording information regarding the occurrence of the event in the media effect index.
2. The method of claim 1 further comprising:
receiving a video stream of the group conversation;
detecting an emotional reaction of one or more participants in the group conversation; and
applying a media effect to the one or more participants relevant to the detected emotional reaction.
3. The method of claim 1 wherein media effects may be applied to one or more participants in the group conversation by any participant in the group conversation.
4. The method of claim 1 wherein the information regarding the occurrence of the event stored in the media effect index includes information about the applied media effects, the information including at least a media effect identifier, a time the media effect was applied and the participant to which the media effect was applied.
5. The method of claim 1 wherein an event is determined to have occurred only for detected media effects associated with particular emotional reactions.
6. The method of claim 1 further comprising:
receiving an instruction to replay the group video conversation;
receiving an instruction to skip ahead to a time corresponding to application of a media effect to a specified participant
consulting the media effect index to identify a point in the group video conversation corresponding to an application of the media effect to the specified; participant; and
setting a playback time in the replay of the group video conversation to the identified point.
7. The method of claim 1 further comprising:
receiving an instruction to search the group video conversation for an event corresponding to an application of a media effect;
consulting the media effect index to identify a point in the group video call corresponding to the event; and
returning a time in the group video corresponding to the identified point.
8. A non-transitory, computer-readable medium storing instructions configured to cause a processor to:
receive a media effect index containing time-stamped entries reflecting the application of media effects to or by participants in a video stream of a group video conversation;
determine, based on the time-stamps, that media effects were applied by or to two or more different participants in the group conversation;
determine that the media effects were applied to the two or more different participants within a predetermined threshold period of time;
determine, based on the application of a the two or more media effects within the threshold period of time, that an event has occurred within the group video conversation;
record information regarding the occurrence of the event in the media effect index.
9. The medium of claim 8 , the stored instructions further causing the processor to:
receive a video stream of the group conversation;
detect an emotional reaction of one or more participants in the group conversation; and
apply a media effect to the one or more participants relevant to the detected emotional reaction.
10. The medium of claim 8 wherein media effects may be applied to one or more participants in the group conversation by any participant in the group conversation.
11. The medium of claim 8 wherein the information regarding the occurrence of the event stored in the media effect index includes information about the applied media effects, the information including at least a media effect identifier, a time the media effect was applied and the participant to which the media effect was applied.
12. The medium of claim 8 wherein an event is determined to have occurred only for detected media effects associated with particular emotional reactions.
13. The medium of claim 8 , the instructions further causing the processor to:
receive an instruction to replay the group video conversation;
receive an instruction to skip ahead to a time corresponding to application of a media effect to a specified participant
consult the media effect index to identify a point in the group video conversation corresponding to an application of the media effect to the specified; participant; and
set a playback time in the replay of the group video conversation to the identified point.
14. The medium of claim 8 , the instruction further causing the processor to:
receive an instruction to search the group video conversation for an event corresponding to an application of a media effect;
consult the media effect index to identify a point in the group video call corresponding to the event; and
return a time in the group video corresponding to the identified point.
15. A system comprising:
a non-transitory, computer readable medium storing instructions for facilitating a group video conversation; and
a processor configured to execute the instructions, the instructions configured to cause the processor to:
receive a media effect index containing time-stamped entries reflecting the application of media effects to or by participants in a video stream of a group video conversation;
determine, based on the time-stamps, that media effects were applied by or to two or more different participants in the group conversation;
determine that the media effects were applied to the two or more different participants within a predetermined threshold period of time;
determine, based on the application of a the two or more media effects within the threshold period of time, that an event has occurred within the group video conversation;
record information regarding the occurrence of the event in the media effect index.
16. The system of claim 15 , the instructions further configured to cause the processor to:
receive a video stream of the group conversation;
detect an emotional reaction of one or more participants in the group conversation; and
apply a media effect to the one or more participants relevant to the detected emotional reaction.
17. The system of claim 15 wherein media effects may be applied to one or more participants in the group conversation by any participant in the group conversation.
18. The system of claim 15 wherein an event is determined to have occurred only for detected media effects associated with particular emotional reactions.
19. The system of claim 15 , the instructions further configured to cause the processor to:
receive an instruction to replay the group video conversation;
receive an instruction to skip ahead to a time corresponding to application of a media effect to a specified participant
consult the media effect index to identify a point in the group video conversation corresponding to an application of the media effect to the specified; participant; and
set a playback time in the replay of the group video conversation to the identified point.
20. The system of claim 15 , the instructions further configured to cause the processor to:
receive an instruction to search the group video conversation for an event corresponding to an application of a media effect;
consult the media effect index to identify a point in the group video call corresponding to the event; and
return a time in the group video corresponding to the identified point.