Flattened Historical Material Extracts
A system to generate historical usage data of a computing resource includes a module is configured to use at least one processor of the system to receive a query including a target and a time window and to retrieve historical file system data from backups of computing resources, where the historical file system data includes a file system object that was processed by the target during the time window. The module is further configured to use at least one processor of the system to generate historical usage data by converting the historical file system data to a temporally flat format that preserves a provenance of the file system object and to store the historical usage in a hierarchical data structure. The module is additionally configured to use at least one processor of the system to provide the hierarchical data structure in a response to the received query.
1 . A system to generate historical usage data of a computing resource, the system comprising:
a module is configured to use at least one processor of the system to:
receive a query comprising a target and a time window;
retrieve historical file system data from backups of computing resources, the historical file system data comprising a file system object that was processed by the target during the time window;
generate historical usage data by converting the historical file system data to a temporally flat format that preserves a provenance of the file system object;
store the historical usage in a hierarchical data structure; and
provide the hierarchical data structure in a response to the received query.
2 . The system of claim 1 , wherein the target comprises a computing resource or a user of the computing resource.
3 . The system of claim 1 , wherein the file system object was created, modified, or deleted during the time window.
4 . The system of claim 1 , wherein the historical file system data further comprises at two or more versions of the file system object, wherein at least one version of the two or more versions of the file system object was modified during the time window.
5 . The system of claim 1 , wherein the historical file system data comprises metadata that is indicative of a file system event that was generated during the time window.
6 . The system of claim 1 , wherein to convert the historical file system data to the temporally flat format, the module is further configured to use at least one processor of the system to:
retrieve a first version of the file system object from the historical file system data;
retrieve a second version of the file system object from the historical file system data; and
modify the first version of the file system object and the second version of the file system object to distinguish the first version of the file system object from the second version of the file system object when each version is stored concurrently in a same partition of the hierarchical data structure.
7 . The system of claim 6 , wherein to convert the historical file system data to a temporally flat format that preserves the provenance of the file system object, the module further configured to use at least one processor of the system to generate a file system object comprising metadata that useful to determine the provenance of the file system object.
8 . The system of claim 7 , wherein the metadata comprises an original identifier of the file system object.
9 . The system of claim 1 , wherein the hierarchical data structure comprises a file system data structure of one or more computing resource.
10 . The system of claim 1 , wherein a hierarchy of the hierarchical data structure does not depend on a time.
11 . The system of claim 1 , the historical file system data comprises data operated on or generated by the target within the time window.
12 . The system of claim 1 , wherein storing the temporally flat historical file system data in a hierarchical data structure comprises:
determining that the file system object satisfies an indicated criteria; and
enhancing an indicator of the file system object in the hierarchical data structure to indicate that the data object satisfies the indicated criteria.
13 . A method for generating historical usage data of a computing resource, the method comprising:
receiving a query comprising a target and a time window;
retrieving historical file system data from backups of computing resources, the historical file system data comprising a file system object that was processed by the target during the time window;
generating historical usage data by converting the historical file system data to a temporally flat format that preserves a provenance of the file system object;
storing the historical usage in a hierarchical data structure; and
providing the hierarchical data structure in a response to the received query.
14 . The method of claim 13 , wherein the target comprises a computing resource or a user of the computing resource.
15 . The method of claim 13 , wherein the file system object was created, modified, or deleted during the time window.
16 . The method of claim 13 , wherein the historical file system data comprises metadata that is indicative of a file system event that was generated during the time window.
17 . The method of claim 13 , wherein converting the historical file system data to the temporally flat format comprises:
retrieving a first version of the file system object from the historical file system data;
retrieving a second version of the file system object from the historical file system data; and
modifying the first version of the file system object and the second version of the file system object to distinguish the first version of the file system object from the second version of the file system object when each version is stored concurrently in a same partition of the hierarchical data structure.
18 . The method of claim 17 , wherein converting the historical file system data to a temporally flat format that preserves the provenance of the file system object comprises generating a file system object comprising metadata that useful to determine the provenance of the file system object.
19 . A non-transitory machine-readable medium comprising instructions, which when executed by a machine, causes the machine to perform operations comprising:
receiving a query comprising a target and a time window;
retrieving historical file system data from backups of computing resources, the historical file system data comprising a file system object that was processed by the target during the time window;
generating historical usage data by converting the historical file system data to a temporally flat format that preserves a provenance of the file system object;
storing the historical usage in a hierarchical data structure; and
providing the hierarchical data structure in a response to the received query.
20 . The non-transitory machine-readable medium of claim 19 , wherein converting the historical file system data to the temporally flat format comprises:
retrieving a first version of the file system object from the historical file system data;
retrieving a second version of the file system object from the historical file system data; and
modifying the first version of the file system object and the second version of the file system object to distinguish the first version of the file system object from the second version of the file system object when each version is stored concurrently in a same partition of the hierarchical data structure.