Methods and systems of spatiotemporal pattern recognition for video content development
Presenting event-specific video content that conforms to a user selection of an event type includes processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that uses machine learning to develop an understanding of at least one event within the at least one video feed to determine at least one event type, wherein the at least one event type includes an entry in a relationship library at least detailing a relationship between two visible features of the at least one video feed, extracting the video content displaying the at least one event and associating the understanding with the video content in a video content data structure. A user interface is configured to permit a user to indicate a preference for at least one event type that is used to retrieve and provide corresponding extracted video content with the data structure in a new video feed.
1. A method for animating motion of a feature in an enhanced video feed, comprising:
processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that is trained through a use of a machine learning system to detect at least one event within the at least one video feed, the training based on adjusting an input feature and a weight within the machine learning system, wherein the machine learning system input feature is selected from at least one spatiotemporal pattern group consisting of:
duration of relative motion of visible features with respect to each other,
rate of motion of at least two visible features with respect to each other,
acceleration of motion of at least two visible features with respect to each other, and
projected point of intersection of at least two visible features with respect to each other;
applying a second video feed to the machine learning system to detect an event in the second video feed;
generating an animation of a feature present in the event in the second video feed, the animation having attributes based on motion of the feature in the event;
automatically, under computer control, providing an enhanced video feed that represents the animation within the detected at least one event within the at least one video feed, the animation being represented within a context of the at least one event within the at least one video feed and the attributes of motion of the feature in the event in the second video feed, the context being based on characteristics of at least one spatiotemporal pattern used to detect the event within the at least one video feed.
2. The method of claim 1 , wherein the context is based on characteristics of a plurality of spatiotemporal patterns associated with the at least one event within the at least one video feed.
3. The method of claim 1 , further comprising providing a comparison of at least one playing style represented in the at least one event within the at least one video feed with at least one playing style represented in the event in the second video feed, the comparison based on a similarity of at least one spatiotemporal pattern associated with each of the at least one event within the at least one video feed and the event in the second video feed.
4. The method of claim 3 , wherein the comparison is based on a similarity of a playing style represented in the at least one event within the at least one video feed, as determined by the machine learning system, with at least one feature of the playing style represented in the event in the second video feed.
5. The method of claim 3 , further comprising presenting at least one metric based on the comparison in the enhanced video feed.
6. The method of claim 5 , wherein the at least one metric is spatiotemporally aligned in the enhanced video feed with at least one feature of the at least one video feed on which the similarity is based.
7. The method of claim 1 , wherein the training is further based on a visible feature state transition model that combines transition probabilities of a model learned empirically from training data with observed features of movement of at least one of the two visible features.
8. A method for animating motion of a feature in an enhanced video feed, comprising:
processing at least one video feed through at least one spatiotemporal pattern recognition algorithm that is trained through a use of a machine learning system to detect at least one event within the at least one video feed, the at least one spatiotemporal pattern recognition algorithm is based on at least one pattern recognized by adjusting an input feature of a plurality of input features and a weight thereof within the machine learning system, wherein the machine learning system is constructed to process the plurality of input features of the at least one video feed, the plurality of input features comprising:
duration of relative motion of visible features with respect to each other,
rate of motion of at least two visible features with respect to each other,
relative acceleration of motion of at least two visible features, and
relative projected point of intersection of at least two visible features;
applying a second video feed to the machine learning system to detect an event in the second video feed;
generating an animation of a feature present in the event in the second video feed, the animation having attributes based on motion of the feature in the event;
automatically, under computer control, providing an enhanced video feed that represents the animation within the detected event within the at least one video feed, the animation being represented within a context of the event within the at least one video feed and the attributes of motion of the feature in the event in the second video feed, the context being based on characteristics of at least one spatiotemporal pattern used to detect the event within the at least one video feed.