Text-driven editor for audio and video assembly
The disclosed technology is a system and computer-implemented method for assembling and editing a video program from spoken words or soundbites. The disclosed technology imports source audio/video clips and any of multiple formats. Spoken audio is transcribed into searchable text. The text transcript is synchronized to the video track by timecode markers. Each spoken word corresponds to a timecode marker, which in turn corresponds to a video frame or frames. Using word processing operations and text editing functions, a user selects video segments by selecting corresponding transcribed text segments. By selecting text and arranging that text, a corresponding video program is assembled. The selected video segments are assembled on a timeline display in any chosen order by the user. The sequence of video segments may be reordered and edited, as desired, to produce a finished video program for export.
1. A computer-implemented method comprising:
generating a transcript map associating words of a transcription of an audio track to video frames of a digital video that comprises the audio track and a video track;
receiving an indication of a selection of one or more words from the transcription of the audio track; and
generating a media fragment universal resource identifier for a video clip corresponding to the selected one or more words comprising:
an HTML code comprising the media fragment universal resource identifier referencing the digital video,
a first time code from the transcript map associated with a start of a first word in the selected one or more words from the transcription of the audio track, and
a second time code from the transcript map associated with an end of a last word in the selected one or more words of the transcription of the audio track.
2. The computer-implemented method as recited in claim 1 , further comprising generating the transcription of the audio track by:
extracting, from the digital video, the audio track;
determining time codes for increments of the audio track based on metadata of the digital video;
generating a transcription of the audio track; and
assigning the time codes for the increments of the audio track to corresponding increments of the transcription of the audio track.
3. The computer-implemented method as recited in claim 2 , wherein generating the transcript map comprises:
determining a start time code and an end time code for every word in the transcription of the audio track; and
generating the transcript map comprising the words of the transcription of the audio track correlated with corresponding start time codes and end time codes.
4. The computer-implemented method as recited in claim 1 , wherein receiving the indication of the selection of the one or more words from the transcription of the audio track comprises receiving an indication of a user highlighting the one or more words within a display comprising the transcription of the audio track.
5. The computer-implemented method as recited in claim 4 , wherein receiving the indication of the selection of the one or more words from the transcription of the audio track further comprises receiving an indication of a drag and drop of the highlighted one or more words from the display comprising the transcription of the audio track to an assembly panel display associated with the video clip.
6. The computer-implemented method as recited in claim 1 , further comprising determining the first time code and the second time code by:
determining, within the transcript map, a start time code associated with a first word from the selected one or more words from the transcription of the audio track; and
determining, within the transcript map, an end time code associated with a last word from the selected one or more words from the transcription of the audio track.
7. The computer-implemented method as recited in claim 6 , wherein determining the first time code and the second time code further comprises:
utilizing the start time code associated with the first word from the selected one or more words as the first time code; and
utilizing the end time code associated with the last word from the selected one or more words as the second time code.
8. A system comprising:
at least one physical processor; and
physical memory comprising computer-executable instructions that, when executed by the at least one physical processor, cause the at least one physical processor to perform acts comprising:
generating a transcript map associating words of a transcription of an audio track to video frames of a digital video comprising the audio track and a video track;
receiving an indication of a selection of one or more words from the transcription of the audio track; and
generating a media fragment universal resource identifier for a video clip corresponding to the selected one or more words comprising:
an HTML code comprising the media fragment universal resource identifier referencing the digital video,
a first time code from the transcript map associated with a start of a first word in the selected one or more words from the transcription of the audio track, and
a second time code from the transcript map associated with an end of a last word in the selected one or more words of the transcription of the audio track.
9. The system as recited in claim 8 , wherein the physical memory further comprises computer-executable instructions that, when executed by the at least one physical processor, cause the at least one physical processor to perform an act comprising generating the transcription of the audio track by:
extracting, from the digital video, the audio track;
determining time codes for increments of the audio track based on metadata of the digital video;
generating a transcription of the audio track; and
assigning the time codes for the increments of the audio track to corresponding increments of the transcription of the audio track.
10. The system as recited in claim 9 , wherein the physical memory further comprises computer-executable instructions that, when executed by the at least one physical processor, cause the at least one physical processor to perform the act comprising generating the transcript map by:
determining a start time code and an end time code for every word in the transcription of the audio track; and
generating the transcript map comprising the words of the transcription of the audio track correlated with corresponding start time codes and end time codes.
11. The system as recited in claim 8 , wherein the physical memory further comprises computer-executable instructions that, when executed by the at least one physical processor, cause the at least one physical processor to perform the act comprising receiving the indication of the selection of the one or more words from the transcription of the audio track by receiving an indication of a user highlighting the one or more words within a display comprising the transcription of the audio track.
12. The system as recited in claim 11 , wherein the physical memory further comprises computer-executable instructions that, when executed by the at least one physical processor, cause the at least one physical processor to further perform the act comprising receiving the indication of the selection of the one or more words from the transcription of the audio track by receiving an indication of a drag and drop of the highlighted one or more words from the display comprising the transcription of the audio track to an assembly panel display associated with the video clip.
13. The system as recited in claim 8 , wherein the physical memory further comprises computer-executable instructions that, when executed by the at least one physical processor, cause the at least one physical processor to perform an act comprising determining the first time code and the second time code by:
determining, within the transcript map, a start time code associated with a first word from the selected one or more words from the transcription of the audio track; and
determining, within the transcript map, an end time code associated with a last word from the selected one or more words from the transcription of the audio track.
14. The system as recited in claim 13 , wherein the physical memory further comprises computer-executable instructions that, when executed by the at least one physical processor, cause the at least one physical processor to further perform the act comprising determining the first time code and the second time code by:
utilizing the start time code associated with the first word from the selected one or more words as the first time code; and
utilizing the end time code associated with the last word from the selected one or more words as the second time code.
15. A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to perform acts comprising:
generating a transcript map associating words of a transcription of an audio track to video frames of a digital video comprising the audio track and a video track;
receiving an indication of a selection of one or more words from the transcription of the audio track; and
generating a media fragment universal resource identifier for a video clip corresponding to the selected one or more words comprising:
an HTML code comprising the media fragment universal resource identifier referencing the digital video,
a first time code from the transcript map associated with a start of a first word in the selected one or more words from the transcription of the audio track, and
a second time code from the transcript map associated with an end of a last word in the selected one or more words of the transcription of the audio track.
16. The non-transitory computer-readable medium as recited in claim 15 , further comprising computer-executable instructions that, when executed by the at least one processor of the computing device, cause the computing device to perform an act comprising generating the transcription of the audio track by:
extracting, from the digital video, the audio track;
determining time codes for increments of the audio track based on metadata of the digital video;
generating a transcription of the audio track; and
assigning the time codes for the increments of the audio track to corresponding increments of the transcription of the audio track.
17. The non-transitory computer-readable medium as recited in claim 16 , further comprising computer-executable instructions that, when executed by the at least one processor of the computing device, cause the computing device to perform the act comprising generating the transcript map by:
determining a start time code and an end time code for every word in the transcription of the audio track; and
generating the transcript map comprising the words of the transcription of the audio track correlated with corresponding start time codes and end time codes.
18. The non-transitory computer-readable medium as recited in claim 15 , further comprising computer-executable instructions that, when executed by the at least one processor of the computing device, cause the computing device to perform an act comprising determining the first time code and the second time code by:
determining, within the transcript map, a start time code associated with a first word from the selected one or more words from the transcription of the audio track; and
determining, within the transcript map, an end time code associated with a last word from the selected one or more words from the transcription of the audio track.
19. The non-transitory computer-readable medium as recited in claim 18 , further comprising computer-executable instructions that, when executed by the at least one processor of the computing device, cause the computing device to further perform the act comprising determining the first time code and the second time code by:
utilizing the start time code associated with the first word from the selected one or more words as the first time code; and
utilizing the end time code associated with the last word from the selected one or more words as the second time code.
20. The non-transitory computer-readable medium as recited in claim 19 , further comprising computer-executable instructions that, when executed by the at least one processor of the computing device, cause the computing device to perform the act comprising receiving the indication of the selection of the one or more words from the transcription of the audio track by receiving an indication of a user highlighting the one or more words within a display comprising the transcription of the audio track.