Methods and systems of spatiotemporal pattern recognition for video content development
A media system generally includes a memory device that stores an event datastore that stores a plurality of event records, each event record corresponding to a respective event and event metadata describing at least one feature of the event. The media system (a) receives a request to generate an aggregated clip comprised of one or more media segments, where each media segment depicts a respective event; (b) for each event record from at least a subset of the plurality of event records, determines an interest level of the event corresponding to the event record; (c) determines one or more events to depict in the aggregated clip based on the respective interest levels of the one or more events; (d) generates the aggregated clip based on the respective media segments that depict the one or more events; and (e) transmits the aggregated clip to a user device.
1. A method for displaying content on a client device, the method comprising:
receiving a video feed corresponding to a filmed occurrence from an external resource;
receiving a spatiotemporal index corresponding to the filmed occurrence from the external resource, wherein the spatiotemporal index indexes information relating to events and objects captured in the video feed as a function of respective video frames in which the events and objects are detected;
outputting a video corresponding to the video feed via a user interface of the client device;
receiving a user command via the user interface to display augmented content, wherein the user command is received while a particular video frame is being displayed and includes identification information for an object in the particular video frame;
querying the spatiotemporal index using a frame identifier of the particular video frame and the object identification information to determine particular information that is relevant to the object in the particular video frame;
obtaining the particular information;
spatially aligning the particular information with respect to the object in the particular video frame based on the spatiotemporal index; and
augmenting the video with the spatially aligned particular information to obtain an augmented video; and
displaying the augmented video via the user interface.
2. The method of claim 1 , wherein the identification information of the object comprises object spatial location information.
3. The method of claim 1 , wherein the identification information of the object facilitates determining spatial location information for the object based on the spatiotemporal index.
4. A method for displaying content on a client device, the method comprising:
receiving a video feed corresponding to a filmed occurrence from an external resource;
receiving a spatiotemporal index corresponding to the filmed occurrence from the external resource, wherein the spatiotemporal index indexes information relating to events and objects captured in the video feed as a function of respective video frames in which the events and objects are detected;
outputting a video corresponding to the video feed via a user interface of the client device;
receiving a user command via the user interface to display augmented content, wherein the command is received while a particular video frame is being displayed and includes an indication of a spatial location in the particular video frame;
querying the spatiotemporal index using a frame identifier of the particular video frame and the spatial location to determine particular information that is relevant to the particular video frame;
obtaining the particular information;
spatially aligning the particular information with respect to the spatial location in the particular video frame based on the spatiotemporal index; and
augmenting the video with the spatially aligned particular information to obtain an augmented video; and
displaying the augmented video via the user interface.
5. The method of claim 4 , wherein the particular information corresponds to a pixel location on the user interface.
6. The method of claim 5 , wherein the particular information relates to an indexed object indicated by the pixel location in the particular frame.
7. The method of claim 5 , wherein the pixel location is associated with an indexed object in the spatiotemporal index.
8. The method of claim 5 , wherein the particular information pertains td the indexed object.
9. The method of claim 4 , wherein the spatially aligned particular information is an indicator of an advertisement and wherein the indicated advertisement is received separate from the video feed by the client device.
10. A client device for user-indicated augmentation of a playing video stream, the system comprising:
a graphical user interface circuit with a connection to a user interface device, wherein the graphical user interface circuit is adapted to receive user commands and display video content through the connection to the user interface device; and
a video transformation circuit with a connection to the graphical user interface circuit and with a connection to a spatiotemporal index resource, wherein the video transformation circuit:
receives an indication of a video frame of the playing video stream and a spatial location information for a location in the video frame identified by the indication via the connection to the graphical user interface circuit;
retrieves information describing an object from the spatiotemporal index resource based on the spatial location information;
spatially aligns the information describing the object relative to a spatiotemporal location of the object; and
provides an augmented video comprising a portion of the video stream overlaid with the spatially aligned information describing the object,
wherein the augmented video is received by the graphical user interface circuit from the video transformation circuit for display via the user interface device.
11. The client device of claim 10 , wherein the spatial location information is for an object present in the video frame identified by the indication.
12. The client device of claim 10 , wherein the spatial location information corresponds to a pixel location on the user interface device.
13. The client device of claim 12 , wherein the object-related information relates to an indexed object indicated by the pixel location in the video frame identified by the indication.
14. The client device of claim 12 , wherein the pixel location is associated with an indexed object in the spatiotemporal index.
15. The client device of claim 10 , wherein the spatial location information is an indicator of an advertisement and wherein the indicated advertisement is received separate from the augmented video by the client device.