Expandable video loop with replacement audio
Techniques for manipulating an expandable video loop with replacement audio are provided. A video that includes a performance by an individual is accessed. One or more processors are used to identify a minimum desired loop within the performance by the individual. Video information is extracted from the video loop and analyzed with machine learning. An audio file is obtained based on a script written by a user. The script is combined with a synthesized voice which is created from the individual video performance to obtain the audio file. The extracted video information is used to manipulate the lips of the individual based on the audio file. A second video loop is created, combining the individual from the first video loop with the video of the manipulated lips of the individual and the synthesized audio file. The second video loop is appended to the end of the first video loop.
1 . A computer-implemented method for video generation comprising:
accessing a first video, wherein the first video includes a performance by an individual;
identifying, using one or more processors, a minimum desired loop within the performance by the individual;
extracting video information from the minimum desired loop that was identified within the first video;
obtaining a first audio file;
manipulating lips of the individual within the video information which was extracted, wherein the manipulating is based on the first audio file; and
creating a second video, wherein the second video comprises a second loop, wherein the second loop includes the video information which was manipulated, and wherein the second video includes the first audio file.
2 . The method of claim 1 further comprising producing a third loop.
3 . The method of claim 2 wherein the third loop is based on a second audio file.
4 . The method of claim 3 wherein the third loop further comprises altering lips of the individual within the video information which was extracted, wherein the manipulating is based on the second audio file.
5 . The method of claim 4 further comprising appending the third loop to the second video.
6 . The method of claim 4 further comprising replacing, in the second video, the second loop with the third loop.
7 . The method of claim 1 wherein the minimum desired loop, when viewed repeatedly by a human, is not easily perceivable as a loop.
8 . The method of claim 7 wherein a runtime of a single loop of the minimum desired loop comprises ten or more seconds.
9 . The method of claim 7 wherein a runtime of a single loop of the minimum desired loop comprises one or more gestures or head movements by the individual.
10 . The method of claim 1 wherein the identifying a minimum desired loop is based on the first audio file.
11 . The method of claim 1 wherein the obtaining a first audio file further comprises writing a script, wherein the script comprises text.
12 . The method of claim 11 further comprising recording a user reading the script.
13 . The method of claim 11 further comprising obtaining audio information from the performance by the individual.
14 . The method of claim 13 further comprising synthesizing a voice of the individual, wherein the synthesizing is based on the script.
15 . The method of claim 1 further comprising synthesizing one or more new gestures for the individual, wherein the gestures are based on the first audio file.
16 . The method of claim 15 wherein the one or more new gestures include one or more repetitive head movements.
17 . The method of claim 1 wherein the second video comprises a stream.
18 . The method of claim 1 wherein the second video comprises a livestream.
19 . The method of claim 1 wherein the second video comprises a video help line for a customer.
20 . The method of claim 1 further comprising enabling, within an ecommerce environment, an ecommerce purchase of one or more products for sale, wherein the second video includes the one or more products for sale, and wherein the second video includes the ecommerce environment.
21 . A computer program product embodied in a non-transitory computer readable medium for video generation, the computer program product comprising code which causes one or more processors to perform operations of:
accessing a first video, wherein the first video includes a performance by an individual;
identifying, using one or more processors, a minimum desired loop within the performance by the individual;
extracting video information from the minimum desired loop that was identified within the first video;
obtaining a first audio file;
manipulating lips of the individual within the video information which was extracted, wherein the manipulating is based on the first audio file; and
creating a second video, wherein the second video comprises a second loop, wherein the second loop includes the video information which was manipulated, and wherein the second video includes the first audio file.
22 . A computer system for video generation, comprising:
a memory which stores instructions;
one or more processors coupled to the memory wherein the one or more processors, when executing the instructions which are stored, are configured to:
access a first video, wherein the first video includes a performance by an individual;
identify, using one or more processors, a minimum desired loop within the performance by the individual;
extract video information from the minimum desired loop that was identified within the first video;
obtain a first audio file;
manipulate lips of the individual within the video information which was extracted, wherein the manipulating is based on the first audio file; and
create a second video, wherein the second video comprises a second loop, wherein the second loop includes the video information which was manipulated, and wherein the second video includes the first audio file.