Hierarchical surveilance video compression repository
Apparatus and methods for processing video surveillance data includes training a data repository, using a first plurality of surveillance video files including a first plurality of video frames, to identify macroblocks of the video frames representing average content of the first plurality of surveillance video files. An ordered data structure is generated by sorting the plurality of macroblocks of video frames based on image differences within the plurality of macroblocks. The ordered data structure includes a root node. A second plurality of surveillance video files including a second plurality of video frames is received. The second plurality of video frames is inserted into the generated ordered data structure. References to the generated ordered data structure are stored in the data store for each frame of the second plurality of video frames along with a difference between corresponding video frames and references.
1. A method for processing video surveillance data comprising:
calculating average pixel values of corresponding macroblocks in intraframes in each of a first plurality of surveillance video files comprising a first plurality of video frames over a period of time;
generating an ordered data structure of a plurality of macroblocks of video frames contained in each of the first plurality of surveillance video files by sorting the plurality of macroblocks of video frames based on image differences within the plurality of macroblocks, wherein the ordered data structure includes a root node, wherein the root node comprises a frame that comprises one or more macroblocks having the average pixel values;
receiving a second plurality of surveillance video files comprising a second plurality of video frames;
inserting the second plurality of video frames into the ordered data structure; and
storing, in a data repository, references to the ordered data structure for each frame of the second plurality of video frames and a difference between corresponding video frames and the references.
2. The method of claim 1 , further comprising:
retrieving the ordered data structure, in response to receiving a retrieval request from a user; and
generating at least a portion of a surveillance video file based on the retrieval request using the ordered data structure.
3. The method of claim 1 , further comprising:
sending, to the data repository, by one or more image capture devices providing at least one of the first plurality of surveillance video files or the second plurality of surveillance video files, metadata containing at least image capture device information and frame information, prior to calculating the average pixel values.
4. The method of claim 1 , further comprising performing entropy encoding to reduce differences between analyzed frames contained in the second plurality of surveillance video files.
5. The method of claim 1 , wherein each branch of the ordered data structure represents a macroblock representation of frames having differences not exceeding a predefined threshold.
6. The method of claim 5 , wherein each branch of the ordered data structure is associated with a unique identifier stored in the data repository.
7. The method of claim 1 , wherein a format of the first plurality of surveillance video files and/or the second plurality of surveillance video files comprises one or more of: H.264, H.265 or H.266.
8. A system for processing video surveillance data comprising:
a hardware processor configured to:
calculate average pixel values of corresponding macroblocks in intraframes in each of a first plurality of surveillance video files comprising a first plurality of video frames over a period of time;
generate an ordered data structure of a plurality of macroblocks of video frames contained in each of the first plurality of surveillance video files by sorting the plurality of macroblocks of video frames based on image differences within the plurality of macroblocks, wherein the ordered data structure includes a root node, wherein the root node comprises a frame that comprises one or more macroblocks having the average pixel values;
receive a second plurality of surveillance video files comprising a second plurality of video frames;
insert the second plurality of video frames into the ordered data structure; and
store, in a data repository, references to the ordered data structure for each frame of the second plurality of video frames and a difference between corresponding video frames and references.
9. The system of claim 8 , wherein the hardware processor is further configured to:
retrieve the ordered data structure, in response to receiving a retrieval request from a user; and
generate at least a portion of a surveillance video file based on the retrieval request using the ordered data structure.
10. The system of claim 8 , wherein the hardware processor is further configured to:
send, to the data repository, by one or more image capture devices providing at least one of the first plurality of surveillance video files or the second plurality of surveillance video files, metadata containing at least image capture device information and frame information, prior to calculating the average pixel values.
11. The system of claim 8 , wherein the hardware processor is further configured to perform entropy encoding to reduce differences between analyzed frames contained in the second plurality of surveillance video files.
12. The system of claim 8 , wherein each branch of the ordered data structure represents a macroblock representation of frames having differences not exceeding a predefined threshold.
13. The system of claim 12 , wherein each branch of the ordered data structure is associated with a unique identifier stored in the data repository.
14. The system of claim 8 , wherein a format of the first plurality of surveillance video files and/or the second plurality of surveillance video files comprises one or more of H.264, H.265 or H.266.