Large content file optimization

1. A method, comprising:

generating a plurality of component file metadata structures for a content file, wherein a first component file metadata structure for the content file is generated in response to a first backup snapshot and a second component file metadata structure for the content file is generated in response to a second backup snapshot; and

storing file metadata of the content file split across the plurality of component file metadata structures, wherein the plurality of component file metadata structures are associated with different portions of the content file, wherein a component file metadata structure of the plurality of component file metadata structures stores file metadata corresponding to a portion of the content file, wherein the file metadata corresponding to the portion of the content file includes one or more references to locations of data chunks associated with the portion of the content file.

2. The method of claim 1 , wherein the component file metadata structure includes at least a root node and a plurality of nodes storing data.

3. The method of claim 1 , further comprising updating a tree data structure to reference each of the plurality of component file metadata structures.

4. The method of claim 3 , wherein the tree data structure includes a root node and a plurality of nodes storing data.

5. The method of claim 4 , wherein a first node of the plurality of nodes storing data includes a first reference to the first component file metadata structure of the content file and a second node of the plurality of nodes storing data includes a second reference to the second component file metadata structure of the content file.

6. The method of claim 5 , wherein a corresponding lock is needed to access each of the plurality of component file metadata structures.

7. The method of claim 1 , wherein the file metadata of the content file split across the plurality of component file metadata structures is stored in parallel.

8. The method of claim 1 , further comprising receiving an indication to perform a backup that includes the content file.

9. The method of claim 8 , further comprising determining that a size of the content file is greater than or equal to a threshold size.

10. The method of claim 1 , wherein each of the plurality of component file metadata structures is associated with a corresponding file offset of the content file.

11. The method of claim 1 , wherein the first backup snapshot is a full backup snapshot or a first incremental backup snapshot.

12. The method of claim 11 , wherein the second backup snapshot is a second incremental backup snapshot.

13. The method of claim 1 , wherein a size of the content file is less than a threshold size after the first backup snapshot and the size of the content file is greater than or equal to the threshold size after the second backup snapshot.

14. A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:

generating a plurality of component file metadata structures for a content file, wherein a first component file metadata structure for the content file is generated in response to a first backup snapshot and a second component file metadata structure for the content file is generated in response to a second backup snapshot; and

storing file metadata of the content file split across the plurality of component file metadata structures, wherein the plurality of component file metadata structures are associated with different portions of the content file, wherein a component file metadata structure of the plurality of component file metadata structures stores file metadata corresponding to a portion of the content file, wherein the file metadata corresponding to the portion of the content file includes one or more references to locations of data chunks associated with the portion of the content file.

15. The computer program product of claim 14 , wherein the component file metadata structure includes at least a root node and a plurality of nodes storing data.

16. The computer program product of claim 14 , further comprising updating a tree data structure to reference each of the plurality of component file metadata structures.

17. The computer program product of claim 16 , wherein the tree data structure includes a root node and a plurality of nodes storing data.

18. The computer program product of claim 17 , wherein a first node of the plurality of nodes storing data includes a first reference to the first component file metadata structure of the content file and a second node of the plurality of nodes storing data includes a second reference to the second component file metadata structure of the content file.

19. The computer program product of claim 14 , wherein each of the plurality of component file metadata structures is associated with a corresponding file offset of the content file.

20. A system, comprising:

a processor configured to:

generate a plurality of component file metadata structures for a content file, wherein a first component file metadata structure for the content file is generated in response to a first backup snapshot and a second component file metadata structure for the content file is generated in response to a second backup snapshot; and

store file metadata of the content file split across the plurality of component file metadata structures, wherein the plurality of component file metadata structures are associated with different portions of the content file, wherein a component file metadata structure of the plurality of component file metadata structures stores file metadata corresponding to a portion of the content file, wherein the file metadata corresponding to the portion of the content file includes one or more references to locations of data chunks associated with the portion of the content file; and

a memory coupled to the processor and configured to provide the processor with instructions.