SYSTEM AND METHOD FOR PERFORMING SPATIO-TEMPORAL ANALYSIS OF SPORTING EVENTS
Methods and systems are provided to enable the exploration of event data captured from video feeds, such as from sporting event venues, the discovery of relevant events (such as within a video feed of a sporting event), and the presentation of novel insights, analytic results, and visual displays that enhance decision-making, provide improved entertainment and provide other benefits.
1 . A method, comprising:
Taking a video feed of an event;
Using machine learning to develop an understanding of the event based on the video feed;
Automatically, under computer control, aligning the video feed with the understanding; and
Producing a transformed video feed that includes at least one highlight that is extracted from the machine learning of the event.
2 . A method of claim 1 , wherein the event is a sporting event.
3 . A method of claim 1 , further comprising:
performing automatic recognition of a camera position based, at least in part, on a scene in the video feed; and
augmenting the video feed with at least one of additional imagery and graphics rendered within a 3D space of the scene.
4 . A method of claim 1 , wherein the transformed video feed creates a highlight video feed of video for a defined set of players.
5 . A method of claim 1 , further comprising delivering the transformed video feed to at least one of an inbox, a mobile device, a table, an application, a scoreboard, a Jumbotron board, a video board, and a television network.
6 . A method of claim 1 , wherein developing an understanding comprises applying machine learning to determine at least one spatiotemporal pattern of the event.
7 . A method of claim 6 , further comprising using a human validation process to at least one of validate and teach the machine learning of the spatiotemporal pattern.
8 . A method of claim 6 , further comprising:
taking data relating to a known configuration of a venue where the event takes place; and
automatically, under computer control, recognizing a camera pose based on the video feed and the known configuration.
9 . A method of claim 8 , wherein the venue is a sporting event venue.
10 . A method of claim 6 , further comprising presenting at least one metric in the augmented feed based on the determined spatiotemporal pattern.
11 . A method of claim 10 , further comprising enabling a user to interact with at least one of the video feed and a frame of the video feed in a 3D user interface.
12 . A method, comprising:
taking a data set associated with a video feed of a live event;
taking spatiotemporal features of the live event;
applying machine learning to determine at least one spatiotemporal pattern of the event; and
calculating a metric based on the determined pattern.
13 . A method of claim 12 , wherein the metric is at least one of a shot quality metric (SEFG), an EFG+ metric, a rebound positioning metric, a rebounding attack metric, a rebounding conversion metric, a event-count per playing time metric, and an efficiency per event-count metric.
14 . A method of claim 12 , further comprising:
providing an interactive, graphical user interface for exploration of data extracted by the machine learning, wherein the graphical user interface enables exploration and analysis of events.
15 . A method of claim 14 , wherein the graphical user interface is at least one of a mobile device interface, a laptop interface, a tablet interface, a large-format touchscreen, and a personal computer interface.
16 . A method of claim 14 , wherein the exploration enables at least one of a touch interaction, a gesture interaction, a voice interaction and a motion-based interaction.
17 . A method, comprising:
taking a data set associated with a video feed of a live event;
automatically, under computer control, recognizing a camera pose for the video;
tracking at least one of a player and an object in the video feed; and
placing the tracked items in a spatial location corresponding to spatial coordinates.
18 . A method of claim 17 , further comprising delivering contextualized information during the event to a viewer.
19 . A method of claim 18 , wherein the contextualized information includes at least one of a statistic, a replay, a visualization, a highlight, a compilation of highlights, and a replay.
20 . A method of claim 18 , further comprising providing a touch screen interaction with a visual representation of at least one item of the contextualized information.