Synthesizing a presentation of a multimedia event
View Patent ↗Example embodiments of a media synchronization system and method for synthesizing a presentation of a multimedia event are generally described herein. In some example embodiments, the media synchronization system includes a media ingestion module to access a plurality of media clips received from a plurality of client devices, a media analysis module to determine a temporal relation between a first media clip from the plurality of media clips and a second media clip from the plurality of media clips, and a content creation module to align the first media clip and the second media clip based on the temporal relation, and to combine the first media clip and the second media clip to generate the presentation.
1. A system comprising:
a processor-implemented media ingestion module configured to access a plurality of media clips including a first video clip with a first audio waveform and a second video clip with a second audio waveform;
a media analysis module configured to:
match a first acoustic fingerprint of at least a part of the first audio waveform with a second acoustic fingerprint of at least a part of the second audio waveform;
determine a temporal overlap of the first video clip with the second video clip based at least in part on the match; and
a content creation module configured to:
merge the first video clip and the second video clip into a group of overlapping video clips based on the temporal overlap relation; and
generate a presentation that includes the group formed by merging the first video clip and the second video clip based on the temporal overlap to generate the presentation.
2. The system of claim 1 , wherein the first video clip with the first audio waveform is received from a first client device and the second video clip with the second audio waveform is received from a second client device.
3. The system of claim 1 , wherein:
the media analysis module is further configured to match a first video fingerprint of at least a part of the first video clip with a second video fingerprint of at least a part of the second video clip; and
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
4. The system of claim 1 , wherein:
the media analysis module is further configured to match a first metadata of at least a part of the first video clip with a second metadata of at least a part of the second video clip; and
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
5. The system of claim 1 , wherein:
the media analysis module is further configured to match a first event name of at least a part of the first video clip with a second event name of at least a part of the second video clip; and
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
6. The system of claim 1 , wherein:
the media analysis module is further configured to match a first event location of at least a part of the first video clip with a second event location of at least a part of the second video clip; and
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
7. The system of claim 1 , wherein:
the media analysis module is further configured to match a first chord progression of at least a part of the first video clip with a second chord progression of at least a part of the second video clip; and
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
8. The system of claim 1 , wherein:
the first acoustic fingerprint comprises a first chord progression and the second acoustic fingerprint comprises a second chord progression;
the media analysis module is further configured to match the first chord progression with the second chord progression; and
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
9. A method comprising:
accessing, by a processor, a plurality of media clips including a first video clip with a first audio waveform and a second video clip with a second audio waveform;
matching a first acoustic fingerprint of at least a part of the first audio waveform with a second acoustic fingerprint of at least a part of the second audio waveform;
determining a temporal overlap of the first video clip with the second video clip based at least in part on the match;
merging the first video clip and the second video clip into a group of overlapping video clips based on the temporal overlap; and
generating a presentation that includes the group formed by merging the first video clip and the second video clip based on the temporal overlap.
10. The method of claim 9 , wherein the first video clip with the first audio waveform is received from a first client device and the second video clip with the second audio waveform is received from a second client device.
11. The method of claim 9 , further comprising:
matching a first video fingerprint of at least a part of the first video clip with a second video fingerprint of at least a part of the second video clip; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
12. The method of claim 9 , further comprising:
matching a first metadata of at least a part of the first video clip with a second metadata of at least a part of the second video clip; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
13. The method of claim 9 , further comprising:
matching a first event name of at least a part of the first video clip with a second event name of at least a part of the second video clip; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
14. The method of claim 9 , further comprising:
matching a first event location of at least a part of the first video clip with a second event location of at least a part of the second video clip; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
15. The method of claim 9 , further comprising:
the first acoustic fingerprint comprises a first chord progression and the second acoustic fingerprint comprises a second chord progression;
matching the first chord progression with the second chord progression; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
16. A non-transitory machine-readable storage medium having instructions embodied thereon, which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
accessing a plurality of media clips including a first video clip with a first audio waveform and a second video clip with a second audio waveform;
matching a first acoustic fingerprint of at least a part of the first audio waveform with a second acoustic fingerprint of at least a part of the second audio waveform;
determining a temporal overlap of the first video clip with the second video clip based at least in part on the match;
merging the first video clip and the second video clip into a group of overlapping video clips based on the temporal overlap; and
generating a presentation that includes the group formed by merging the first video clip and the second video clip based on the temporal overlap.
17. The non-transitory machine-readable storage medium of claim 16 , wherein the first video clip with the first audio waveform is received from a first client device and the second video clip with the second audio waveform is received from a second client device.
18. The non-transitory machine-readable storage medium of claim 16 , wherein the operations further comprise:
matching a first video fingerprint of at least a part of the first video clip with a second video fingerprint of at least a part of the second video clip; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
19. The non-transitory machine-readable storage medium of claim 16 , wherein the operations further comprise:
matching a first metadata of at least a part of the first video clip with a second metadata of at least a part of the second video clip; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.
20. The non-transitory machine-readable storage medium of claim 16 , wherein the operations further comprise:
matching a first event name of at least a part of the first video clip with a second event name of at least a part of the second video clip; and wherein
the determining of the temporal overlap of the first video clip and the second video clip is based on the match.