Large content file optimization

1. A system, comprising:

a processor configured to:

determine that a size associated with a content file is greater than a threshold size, wherein a storage system is configured to generate one or more component file metadata structures for the content file, wherein metadata associated with the content file is stored in a first component file metadata structure, wherein the content file is stored by the storage system;

in response to the determination that the size associated with the content file is greater than the threshold size:

generate one or more additional component file metadata structures for the content file;

store file metadata of the content file split across a plurality of component file metadata structures, wherein the plurality of component file metadata structures are associated with different portions of the content file, wherein the first component file metadata structure is configured to store file metadata corresponding to the content file prior to the split and the one or more additional component file metadata structures are configured to store file metadata corresponding to the content file after the split, wherein a component file metadata structure of the content file specifies a tree structure organizing data components of the content file and each component file metadata structure of the plurality of component file metadata structures is configured to store a portion of the file metadata of content file, wherein each component file metadata structure includes a corresponding root node, a corresponding plurality of intermediate nodes, and a corresponding plurality of leaf nodes; and

update a snapshot tree to reference the plurality of component file metadata structures for the content file, wherein the snapshot tree is configured to store file system metadata associated with a primary system, wherein the snapshot tree includes a first root node, a first plurality of intermediate nodes, and a first plurality of leaf nodes, wherein a first leaf node of the first plurality of leaf nodes includes a first reference to a first root node associated with the first component file metadata structure of the component file metadata structures and a second leaf node of the first plurality of leaf nodes includes a second reference to a second root node associated with a second component file metadata structure of the component file metadata structures; and

a memory coupled to the processor and configured to provide the processor with instructions.

2. The system of claim 1 , wherein to update the snapshot tree to reference the plurality of component file metadata structures, the processor is further configured to update the first plurality of leaf nodes of the snapshot tree with corresponding pointers to the plurality of component file metadata structures.

3. The system of claim 1 , wherein a leaf node of the corresponding plurality of leaf nodes includes a pointer to a brick associated with one or more data chunks of the content file.

4. The system of claim 1 , wherein a leaf node of the corresponding plurality of leaf nodes includes an identifier of a brick associated with one or more data chunks of the content file.

5. The system of claim 1 , wherein the processor is configured to receive a backup snapshot that includes at least a portion of the content file.

6. The system of claim 5 , wherein the processor is configured to determine that the size associated with the content file is greater than the threshold size based on a user input.

7. The system of claim 5 , wherein the processor is configured to determine that the size associated with the content file is greater than the threshold size based on the plurality of data chunks of the content file included in the received backup snapshot.

8. The system of claim 5 , wherein the received backup snapshot includes a first portion of the content file and a previously stored backup snapshot includes a second portion of the content file.

9. The system of claim 8 , wherein the size associated with the content file included in the second portion is less than the threshold size, and wherein the size associated with the content file included in a combination of the first portion and the second portion is greater than the threshold size.

10. The system of claim 1 , wherein the processor is further configured to:

perform a maintenance process; and

determine that the content file is greater than the threshold size based in part on the maintenance process.

11. The system of claim 10 , wherein the processor is further configured to generate a new view of file system data that includes the content file, wherein the new view includes the plurality of component file metadata structures.

12. The system of claim 1 , wherein a plurality of storage nodes, in parallel, are configured to store the file metadata of the content file split across the plurality of component file metadata structures.

13. A method, comprising:

determining that a size associated with a content file is greater than a threshold size, wherein a storage system is configured to generate one or more component file metadata structures for the content file, wherein metadata associated with the content file is stored in a first component file metadata structure, wherein the content file is stored by the storage system;

in response to the determining that the size associated with the content file is greater than the threshold size:

generating one or more additional component file metadata structures for the content file;

storing file metadata of the content file split across a plurality of component file metadata structures, wherein the plurality of component file metadata structures are associated with different portions of the content file, wherein the first component file metadata structure is configured to store metadata corresponding to the content file prior to the split and the one or more additional component file metadata structures are configured to store metadata corresponding to the content file after the split, wherein a component file metadata structure of the content file specifies a tree structure organizing data components of the content file and each component file metadata structure of the plurality of component file metadata structures is configured to store a portion of the file metadata of the content file, wherein each component file metadata structure includes a corresponding root node, a corresponding plurality of intermediate nodes, and a corresponding plurality of leaf nodes; and

updating a snapshot tree to reference the plurality of component file metadata structures for the content file, wherein the snapshot tree is configured to store file system metadata associated with a primary system, wherein the snapshot tree includes a first root node, a first plurality of intermediate nodes, and a first plurality of leaf nodes, wherein a first leaf node of the first plurality of leaf nodes includes a first reference to a first root node associated with the first component file metadata structure of the component file metadata structures and a second leaf node of the first plurality of leaf nodes includes a second reference to a second root node associated with a second component file metadata structure of the component file metadata structures.

14. The method of claim 13 , further comprising receiving a backup snapshot that includes at least a portion of the content file.

15. The method of claim 14 , wherein the size associated with the content file is determined to be greater than the threshold size based on a user input.

16. The method of claim 14 , wherein the size associated with the content file is determined to be greater than the threshold size based on the plurality of data chunks of the content file included in the received backup snapshot.

17. The method of claim 14 , wherein the received backup snapshot includes a first portion of the content file and a previously stored backup snapshot includes a second portion of the content file.

18. The method of claim 14 , further comprising:

performing a maintenance process; and

determining that the content file is greater than the threshold size based in part on the maintenance process.

19. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

determining that a size associated with a content file is greater than a threshold size, wherein a storage system is configured to generate one or more component file metadata structures for the content file, wherein metadata associated with the content file is stored in a first component file metadata structure, wherein the content file is stored by the storage system;

in response to the determination that the size associated with the content file is greater than the threshold size:

generate one or more additional component file metadata structures for the content file;

storing file metadata of the content file split across a plurality of component file metadata structures, wherein the plurality of component file metadata structures are associated with different portions of the content file, wherein the first component file metadata structure is configured to store metadata corresponding to the content file prior to the split and the one or more additional component file metadata structures are configured to store metadata corresponding to the content file after the split, wherein a component file metadata structure of the content file specifies tree structure organizing data components of the content file and each component file metadata structure of the plurality of component file metadata structures is configured to store a portion of the file metadata of the content file, wherein each component file metadata structure includes a corresponding root node, a corresponding plurality of intermediate nodes, and a corresponding plurality of leaf nodes; and

updating a snapshot tree to reference the plurality of component file metadata structures for the content file, wherein the snapshot tree is configured to store file system metadata associated with a primary system, wherein the snapshot tree includes a first root node, a first plurality of intermediate nodes, and a first plurality of leaf nodes, wherein a first leaf node of the first plurality of leaf nodes includes a first reference to a first root node associated with the first component file metadata structure of the component file metadata structures and a second leaf node of the first plurality of leaf nodes includes a second reference to a second root node associated with a second component file metadata structure of the component file metadata structures.