Systems, methods, and software for improved video data recovery effectiveness
Methods, systems, and software are provided herein that allow for storing a data file in a storage device. The storage system splits a video data file into a plurality of data segments, generates a plurality of recovery headers for the data segments, and combines ones of the recovery headers with ones of the data segments to form a plurality of storage packets.
1. A method of recovery of a storage system in response to a corruption, loss, or unavailability of a file index, the method comprising:
scanning the storage system for a recovery flag, wherein the recovery flag is common among storage packets to identify recovery headers associated with the storage packets;
reading the recovery headers and associated data segments from the storage system for the storage packets in which the recovery flag is found;
grouping the associated data segments into data object groups, wherein each of the data object groups includes a subset of the recovery headers and a corresponding subset of the associated data segments, wherein the subset of the recovery headers each include common Object ID that uniquely identifies a data object on the storage system;
reassembling data objects stored on the storage system by reordering the corresponding subset of associated data segments for each of the data object groups based on a Sequence Number in the subset of the recovery headers that specifies an order of the corresponding subset of associated data segments to re-create the data object without any information from the file index.
2. The method of claim 1 , further comprising:
identifying an orphan data object for one of the data object groups where the subset of associated data segments does not include all data segments of a complete data object based on the subset of recovery headers indicating a non-contiguous Sequence Number.
3. The method of claim 1 , wherein the recovery headers each include a Chunk Size that indicates a size of an associated data segment for reading the associated data segments from the storage system.
4. The method of claim 1 , wherein reading the recovery headers from the storage system further comprises:
performing error checking on the recovery headers based on Error Detection Code included in each of the recovery headers.
5. The method of claim 1 , wherein the Object ID comprises a Format ID, wherein the Format ID comprises a counter which increments each time a format of the storage system occurs.
6. The method of claim 5 , wherein the Object ID comprises a Primary Object ID, wherein the Primary Object ID comprises a counter that increments when a new data object is stored in the storage system and resets to zero each time a format of the storage system occurs.