COMPUTERIZED SYSTEM AND METHOD FOR KEY EVENT DETECTION USING DENSE DETECTION ANCHORS

1 . A method comprising:

retrieving a frame sequence depicting an event, the frame sequence having a plurality of frames, each frame corresponding to a temporal location of the frame sequence;

extracting a feature from each frame of the plurality of frames;

combining the extracted features to generate an input matrix;

applying an event detection model to the input matrix to combine features across all temporal locations and generate an output matrix;

determining confidences and temporal displacements from the output matrix; and

determining, based on the confidences and temporal displacements, the event depicted by the frame sequence.

2 . The method of claim 1 , wherein the output matrix comprises a plurality of classes for each frame, and wherein the confidences and temporal displacements are determined for every frame and every class.

3 . The method of claim 1 , wherein determining confidences and temporal displacements further comprises performing separate convolution operations on the output matrix.

4 . The method of claim 1 , wherein the event detection model includes a model trunk selected from a group consisting of a 1-D U-Net and a transformer encoder (TE).

5 . The method of claim 1 , wherein determining the event depicted by the frame sequence based on the confidences and temporal displacements includes consolidating the confidences and temporal displacements by displacing the confidences by the temporal displacements.

6 . The method of claim 1 , wherein prior to applying the event detection model, a dimensionality reduction technique is applied to the input matrix.

7 . The method of claim 1 , further comprising training the event detection model by optimizing a confidence loss and a temporal displacement loss.

8 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

retrieve a frame sequence depicting an event, the frame sequence having a plurality of frames, each frame corresponding to a temporal location of the frame sequence;

extract a feature from each frame of the plurality of frames;

combine the extracted features to generate an input matrix;

apply an event detection model to the input matrix to combine features across all temporal locations and generate an output matrix;

determine confidences and temporal displacements from the output matrix; and

determine, based on the confidences and temporal displacements, the event depicted by the frame sequence.

9 . The computer-readable storage medium of claim 8 , wherein the output matrix comprises a plurality of classes for each frame, and wherein the confidences and temporal displacements are determined for every frame and every class.

10 . The computer-readable storage medium of claim 8 , wherein determining confidences and temporal displacements further comprises performing separate convolution operations on the output matrix.

11 . The computer-readable storage medium of claim 8 , wherein the event detection model includes a model trunk selected from a group consisting of a 1-D U-Net and a transformer encoder (TE).

12 . The computer-readable storage medium of claim 8 , wherein determining the event depicted by the frame sequence based on the confidences and temporal displacements includes consolidating the confidences and temporal displacements by displacing the confidences by the temporal displacements.

13 . The computer-readable storage medium of claim 8 , wherein prior to applying the event detection model, a dimensionality reduction technique is applied to the input matrix.

14 . The computer-readable storage medium of claim 8 , wherein the instructions further configure the computer to train the event detection model by optimizing a confidence loss and a temporal displacement loss.

15 . A computing device comprising:

a processor configured to:

retrieve a frame sequence depicting an event, the frame sequence having a plurality of frames, each frame corresponding to a temporal location of the frame sequence;

extract a feature from each frame of the plurality of frames;

combine the extracted features to generate an input matrix;

apply an event detection model to the input matrix to combine features across all temporal locations and generate an output matrix;

determine confidences and temporal displacements from the output matrix; and

determine, based on the confidences and temporal displacements, the event depicted by the frame sequence.

16 . The computing device of claim 15 , wherein the output matrix comprises a plurality of classes for each frame, and wherein the confidences and temporal displacements are determined for every frame and every class.

17 . The computing device of claim 15 , wherein determining confidences and temporal displacements further comprises performing separate convolution operations on the output matrix.

18 . The computing device of claim 15 , wherein the event detection model includes a model trunk selected from a group consisting of a 1-D U-Net and a transformer encoder (TE).

19 . The computing device of claim 15 , wherein determining the event depicted by the frame sequence based on the confidences and temporal displacements includes consolidating the confidences and temporal displacements by displacing the confidences by the temporal displacements.

20 . The computing device of claim 15 , wherein the processor is further configured to train the event detection model by optimizing a confidence loss and a temporal displacement loss.