Methods and systems of spatiotemporal pattern recognition for video content development
A location in a video may be specified and content related to the location may be accessed. A method for accessing the related content may include receiving a reference to a pixel location in a frame of a video feed of a filmed occurrence and accessing a spatio-temporal index corresponding to the filmed occurrence. The spatio-temporal index may index information relating to events or objects of the filmed occurrence and corresponding pixel locations at which the events or the objects are detected in the video feed. The method may further include querying the spatio-temporal index using the pixel location to determine particular information of an indexed event or an indexed object and receiving the particular information wherein the particular information indicates at least one of spatial and temporal alignment parameters for aligning the indexed event with a corresponding event in at least one other video feed of the filmed occurrence.
1 . A method for accessing content related to location in a video, the method comprising:
receiving a reference to a pixel location in a frame of a video feed of a filmed occurrence;
accessing a spatio-temporal index corresponding to the filmed occurrence, wherein the spatio-temporal index is based on a time alignment of the video feed of the filmed occurrence with at least one other video feed of the filmed occurrence and the spatio-temporal index indexes information relating to events or objects of the filmed occurrence and corresponding pixel locations at which the events or the objects are detected in the video feed;
querying the spatio-temporal index using the pixel location to determine particular information of an indexed event or an indexed object; and
receiving the particular information wherein the particular information indicates at least one of spatial and temporal alignment parameters for aligning the indexed event or the indexed object with a corresponding event or a corresponding object in the at least one other video feed of the filmed occurrence.
2 . The method of claim 1 , further comprising displaying the aligned event or the aligned object and corresponding event or corresponding object based on the particular information on a user interface.
3 . The method of claim 1 , wherein receiving the particular information further comprises receiving statistics for a participant in a sporting event associated with the pixel location.
4 . The method of claim 1 , wherein receiving the particular information further comprises receiving statistics relating to a matchup of a sporting event associated with the pixel location.
5 . The method of claim 1 , further comprising additionally querying the spatio-temporal index using an event identifier or an object identifier in the particular information of the indexed event or the indexed object relevant to the pixel location.
6 . The method of claim 1 , wherein the video feed of the filmed occurrence is a tracking video feed.
7 . A video content system for accessing content related to location in a video, the video content system comprising:
one or more computer processors;
memory storing computer-executable instructions that, when executed by the one or more computer processors, cause the one or more computer processors to perform operations comprising:
receiving a reference to a pixel location in a frame of a video feed of a filmed occurrence;
accessing a spatio-temporal index corresponding to the filmed occurrence, wherein the spatio-temporal index is based on a time alignment of the video feed of the filmed occurrence with at least one other video feed of the filmed occurrence and the spatio-temporal index indexes information relating to events or objects of the filmed occurrence and corresponding pixel locations at which the events or the objects are detected in the video feed;
querying the spatio-temporal index using the pixel location to determine particular information of an indexed event or an indexed object; and
receiving the particular information wherein the particular information indicates at least one of spatial and temporal alignment parameters for aligning the indexed event or the indexed object with a corresponding event or a corresponding object in at least one other video feed of the filmed occurrence.
8 . The video content system of claim 7 , the operations further comprising displaying the aligned event or the aligned object and corresponding event or corresponding object based on the particular information on a user interface.
9 . The video content system of claim 7 , wherein receiving the particular information further comprises receiving statistics for a participant in a sporting event associated with the pixel location.
10 . The video content system of claim 7 , wherein receiving the particular information further comprises receiving statistics relating to a matchup of a sporting event associated with the pixel location.
11 . The video content system of claim 7 , the operations further comprising additionally querying the spatio-temporal index using an event identifier or an object identifier in the particular information of the indexed event or the indexed object relevant to the pixel location.
12 . The video content system of claim 7 , wherein the video feed of the filmed occurrence is a tracking video feed.
13 . A non-transitory computer-readable medium storing computer-executable instructions for generating augmented video content, the computer-executable instructions comprising instructions for:
receiving a reference to a pixel location in a frame of a video feed of a filmed occurrence;
accessing a spatio-temporal index corresponding to the filmed occurrence, wherein the spatio-temporal index is based on a time alignment of the video feed of the filmed occurrence with at least one other video feed of the filmed occurrence and the spatio-temporal index indexes information relating to events or objects of the filmed occurrence and corresponding pixel locations at which the events or the objects are detected in the video feed;
querying the spatio-temporal index using the pixel location to determine particular information of an indexed event or an indexed object; and
receiving the particular information wherein the particular information indicates at least one of spatial and temporal alignment parameters for aligning the indexed event or the indexed object with a corresponding event or a corresponding object in at least one other video feed of the filmed occurrence.
14 . The non-transitory computer-readable medium of claim 13 , the computer-executable instructions further comprising instructions for displaying the aligned event or the aligned object and corresponding event or corresponding object based on the particular information on a user interface.
15 . The non-transitory computer-readable medium of claim 13 , wherein receiving the particular information further comprises receiving statistics for a participant in a sporting event associated with the pixel location.
16 . The non-transitory computer-readable medium of claim 13 , wherein receiving the particular information further comprises receiving statistics relating to a matchup of a sporting event associated with the pixel location.
17 . The non-transitory computer-readable medium of claim 13 , the computer-executable instructions further comprising instructions for additionally querying the spatio-temporal index using an event identifier or an object identifier in the particular information of the indexed event or the indexed object relevant to the pixel location.
18 . The non-transitory computer-readable medium of claim 13 , wherein the video feed of the filmed occurrence is a tracking video feed.