Systems and Methods for Video Editing and Effects
Aspects of the disclosed technology can determine when a user has made a gesture mapped to an effect and can display the effect on the video. Additional aspects of the disclosed technology can automatically match movements between a source video and a live feed of a user. Yet further aspects of the disclosed technology can customize a video based on a determined focus of the video creator.
1 . A method for determining when a user has made a gesture mapped to an effect and displaying the effect on the video, the method comprising:
receiving at least a portion of a video;
determining that the portion of the video depicts a user making a pose mapped to an effect;
selecting a location for displaying the effect; and
enabling the effect, on the video, at the selected location.
2 . A method for matching movements between a source video and a live feed of a second user, the method comprising:
tracking a first user depicted in a source video with a first soundtrack;
generating a corresponding set of kinematic model movements for the first user;
providing an indication of the set of kinematic model movements in a second video with the first soundtrack;
tracking movements of the second user; and
determining an accuracy of a match between the tracked movement of the second user and the set of kinematic model movements.
3 . A method for customizing a video based on a determined focus of the video creator, the method comprising:
capturing video and eye tracking data;
correlating the eye tracking data to video coordinates; and
customizing the video based on the eye tracking coordinates.