Direct user manipulation of video to generate scrubbing videos
The present disclosure provides systems and methods that generate a scrubbing video that depicts a scrubbing operation performed on a first video. In particular, a user can directly manipulate video playback of the first video (e.g., by interacting with a touch-sensitive display screen) and the scrubbing video can depict such manipulation. As one example, the user can “scratch” his or her videos like a disc jockey (DJ) scratches records to produce scrubbing videos that are remixes (e.g., looping remixes) of his or her original videos. Thus, the systems and methods of the present disclosure enable a user to capture and edit a new type of video that allows the user to directly manipulate its timeline, producing fun and creative results.
1. A computing system comprising:
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
obtaining a first video that comprises a first plurality of image frames;
providing a first image frame of the first video for display in a user interface;
receiving a user input that requests that a scrubbing operation be performed on the first video, and wherein the user input further requests generation of a second video that depicts a performance of the scrubbing operation on the first video;
in response to receipt of the user input, performing the scrubbing operation on the first video, wherein performing the scrubbing operation comprises transitioning the user interface from display of the first image frame of the first video to display of at least a second image frame of the first video; and
generating the second video, wherein the second video depicts the performance of the scrubbing operation on the first video.
2. The computing system of claim 1 , wherein:
the user input has a momentum;
performing the scrubbing operation comprises transitioning the user interface from display of the first image frame to display of at least the second image frame at a speed that is positively correlated to the momentum of the user input; and
the second video depicts the transitioning from the first image frame to at least the second image frame at the speed that is positively correlated to the momentum of the user input.
3. The computing system of claim 1 , wherein:
the user input has an input duration;
performing the scrubbing operation comprises transitioning the user interface from display of the first image frame to display of at least the second image frame for a transition duration that is at least as long as the input duration; and
the second video depicts the transitioning of the user interface for the transition duration.
4. The computing system of claim 3 , wherein:
the user input has a final momentum; and
the transition duration comprises the input duration plus a wind down period that corresponds to a dissipation of the final momentum of the user input.
5. The computing system of claim 1 , wherein:
the user input requests the scrubbing operation that includes both a forward chronological scrubbing and a reverse chronological scrubbing; and
the second video depicts both the forward chronological scrubbing and the reverse chronological scrubbing.
6. The computing system of claim 1 , further comprising:
a touch-sensitive display screen that displays the user interface;
wherein the user input comprises a user touch action with respect to the touch-sensitive display screen.
7. The computing system of claim 6 , wherein the computing system is capable of receiving the user input at an entirety of a display area of the touch-sensitive display screen associated with display of the first video.
8. The computing system of claim 6 , wherein the user touch action with respect to the touch-sensitive display screen comprises a two-finger drag action.
9. The computing system of claim 8 , wherein, in response to a one-finger drag action, the computing system is configured to perform a second scrubbing operation without generating a third video.
10. The computing system of claim 6 , wherein performing the scrubbing operation comprises:
in response to movement of the user touch action in a rightwards or upwards direction, performing a forward chronological scrubbing; and
in response to movement of the user touch action in a rightwards or upwards direction, performing a forward chronological scrubbing.
11. The computing system of claim 6 , wherein the computing system consists of a user computing device that includes the one or more processors, the one or more or more non-transitory computer-readable media, and the touch-sensitive display screen, wherein the user computing device comprises a smartphone or a tablet.
12. The computing system of claim 1 , wherein:
the first plurality of image frames of the first video comprises both keyframe image frames and in-between image frames;
transitioning the user interface from display of the first image frame to display of at least the second image frame comprises displaying at least one in-between image frame; and
the second video comprises the at least one in-between image frame.
13. The computing system of claim 1 , wherein generating the second video comprises generating a record of a frame number and a display duration for each of the first plurality of image frames that was displayed in the user interface during performance of the scrubbing operation.
14. The computing system of claim 13 , wherein generating the second video further comprises, at playback of the second video, displaying each frame number for its corresponding display duration specified by the record.
15. A computer-implemented method, comprising
obtaining, by a computing system comprising one or more computing devices, a first video that comprises a first plurality of image frames;
providing, by the computing system, a first image frame of the first video for display in a user interface;
receiving, by the computing system, a user input that requests that a scrubbing operation be performed on the first video, and wherein the user input further requests generation of a second video that depicts a performance of the scrubbing operation on the first video;
in response to receipt of the user input, performing, by the computing system, the scrubbing operation on the first video, wherein performing, by the computing system, the scrubbing operation comprises transitioning, by the computing system, the user interface from display of the first image frame of the first video to display of at least a second image frame of the first video; and
generating, by the computing system, the second video that depicts a performance of the scrubbing operation on the first video.
16. The computer-implemented method of claim 15 , wherein:
receiving, by the computing system, the user input comprises receiving, by the computing system, the user input that requests the scrubbing operation that includes both a forward chronological scrubbing and a reverse chronological scrubbing; and
generating, by the computing system, the second video comprises generating, by the computing system, the second video that depicts both the forward chronological scrubbing and the reverse chronological scrubbing.
17. The computer-implemented method of claim 15 , wherein receiving, by the computing system, the user input comprises receiving, by the computing system, the user input that comprises a two-finger drag action.
18. The computer-implemented method of claim 15 , wherein performing, by the computing system, the scrubbing operation comprises:
in response to movement of the user input in a rightwards or upwards direction, performing, by the computing system, a forward chronological scrubbing; and
in response to movement of the user input in a rightwards or upwards direction, performing, by the computing system, a forward chronological scrubbing.
19. The computer-implemented method of claim 15 , wherein:
receiving, by the computing system, the user input comprises receiving, by the computing system, the user input that has a momentum;
performing, by the computing system, the scrubbing operation comprises transitioning, by the computing system, the user interface from display of the first image frame to display of at least the second image frame at a speed that is positively correlated to the momentum of the user input; and
generating, by the computing system, the second video comprises generating, by the computing system, the second video that depicts the transitioning from the first image frame to at least the second image frame at the speed that is positively correlated to the momentum of the user input.
20. A mobile computing device, comprising:
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
obtaining a first video that comprises a first plurality of image frames;
providing a first image frame of the first video for display in a user interface;
receiving a user input that requests that a scrubbing operation be performed on the first video, and wherein the user input further requests generation of a second video that depicts a performance of the scrubbing operation on the first video;
in response to receipt of the user input, performing the scrubbing operation on the first video, wherein performing the scrubbing operation comprises transitioning the user interface from display of the first image frame of the first video to display of at least a second image frame of the first video; and
generating the second video that depicts a performance of the scrubbing operation on the first video.