Managing objects stored at a remote storage

1. A method, comprising:

receiving an indication to store to a remote storage a new archive of a snapshot of a source storage;

determining that at least one shared data chunk of the new archive is already stored in an existing chunk object of the remote storage storing data chunks of a previous archive;

determining one or more evaluation metrics for the existing chunk object based at least in part on a retention period associated with one or more individual chunks stored in the existing chunk object and a data lock period associated with an entire portion of the existing chunk object, wherein the one or more evaluation metrics for the existing chunk object are based at least in part on a percentage of data chunks of the existing chunk object that have expired and an amount of time before the existing chunk object is allowed to be removed from the remote storage; and

determining based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in a new chunk object of the remote storage.

2. The method of claim 1 , wherein determining that the at least one shared data chunk of the new archive that is already stored in the existing chunk object of the remote storage storing data chunks of a previous archive includes comparing a corresponding chunk identifier associated with the at least one shared data chunk of the new archive with a plurality of chunk identifiers stored in an archive chunk metadata data structure.

3. The method of claim 2 , wherein the archive chunk metadata data structure includes a plurality of entries, wherein each entry of the plurality of entries associates a chunk identifier corresponding to a data chunk with a chunk object identifier associated with a chunk object storing the data chunk.

4. A method, comprising:

receiving an indication to store to a remote storage a new archive of a snapshot of a source storage;

determining that at least one shared data chunk of the new archive is already stored in an existing chunk object of the remote storage storing data chunks of a previous archive;

determining one or more evaluation metrics for the existing chunk object based at least in part on a retention period associated with one or more individual chunks stored in the existing chunk object and a data lock period associated with an entire portion of the existing chunk object, wherein the one or more evaluation metrics for the existing chunk object include a percentage of data chunks of the existing chunk object that have expired; and

determining based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in a new chunk object of the remote storage, wherein determining based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in the new chunk object of the remote storage includes comparing the percentage of data chunks of the existing chunk object that have expired to an expiration threshold percentage.

5. The method of claim 4 , further comprising referencing the at least one shared data chunk from the existing chunk object in response to determining that the percentage of data chunks of the existing chunk object that have expired is not greater than the expiration threshold percentage.

6. The method of claim 4 , further comprising storing the at least one shared data chunk in the new chunk object of the remote storage in response to determining that the percentage of data chunks of the existing chunk object that have expired is greater than the expiration threshold percentage.

7. A method, comprising:

receiving an indication to store to a remote storage a new archive of a snapshot of a source storage;

determining that at least one shared data chunk of the new archive is already stored in an existing chunk object of the remote storage storing data chunks of a previous archive;

determining one or more evaluation metrics for the existing chunk object based at least in part on a retention period associated with one or more individual chunks stored in the existing chunk object and a data lock period associated with an entire portion of the existing chunk object, wherein the one or more evaluation metrics for the existing chunk object include an amount of time before the existing chunk object is allowed to be removed from the remote storage; and

determining based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in a new chunk object of the remote storage, wherein determining based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in the new chunk object of the remote storage includes comparing the amount of time before the existing chunk object can be removed from the remote storage to an expiration threshold period.

8. The method of claim 7 , wherein the amount of time is based on the retention period associated with one or more individual chunks stored in the existing chunk object and the data lock period associated with the entire portion of the existing chunk object.

9. The method of claim 7 , further comprising referencing the at least one shared data chunk from the existing chunk object in response to determining that the amount of time before the existing chunk object can be removed from the remote storage is not within the expiration threshold period.

10. The method of claim 7 , further comprising storing the at least one shared data chunk in the new chunk object of the remote storage in response to determining that the amount of time before the existing chunk object can be removed from the remote storage is within the expiration threshold period.

11. The method of claim 1 , wherein determining based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in the new chunk object of the remote storage includes comparing the percentage of data chunks of the existing chunk object that have expired to an expiration threshold percentage and comparing the amount of time before the existing chunk object can be removed from the remote storage to an expiration threshold period.

12. The method of claim 11 , further comprising referencing the at least one shared data chunk from the existing chunk object in response to determining that the percentage of data chunks of the existing chunk object that have expired is not greater than the expiration threshold percentage and/or the amount of time before the existing chunk object can be removed from the remote storage is not within the expiration threshold period.

13. The method of claim 11 , further comprising storing the at least one shared data chunk in the new chunk object of the remote storage in response to determining that that the percentage of data chunks of the existing chunk object that have expired is greater than the expiration threshold percentage and the amount of time before the existing chunk object can be removed from the remote storage is within the expiration threshold period.

14. The method of claim 1 , wherein in response determining to reference the at least one shared data chunk of the new archive from the existing chunk object includes generating archive metadata for the new archive that references the at least one shared data chunk.

15. A non-transitory computer readable medium and comprising computer instructions for:

receiving an indication to store to a remote storage a new archive of a snapshot of a source storage;

determining that at least one shared data chunk of the new archive is already stored in an existing chunk object of the remote storage storing data chunks of a previous archive;

determining one or more evaluation metrics for the existing chunk object based at least in part on a retention period associated with one or more individual chunks stored in the existing chunk object and a data lock period associated with an entire portion of the existing chunk object, wherein the one or more evaluation metrics for the existing chunk object are based at least in part on a percentage of data chunks of the existing chunk object that have expired and an amount of time before the existing chunk object is allowed to be removed from the remote storage; and

determining based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in a new chunk object of the remote storage.

16. A system, comprising:

one or more processors configured to:

receive an indication to store to a remote storage a new archive of a snapshot of a source storage;

determine that at least one shared data chunk of the new archive is already stored in an existing chunk object of the remote storage storing data chunks of a previous archive;

determine one or more evaluation metrics for the existing chunk object based at least in part on a retention period associated with one or more individual chunks stored in the existing chunk object and a data lock period associated with an entire portion of the existing chunk object, wherein the one or more evaluation metrics for the existing chunk object are based at least in part on a percentage of data chunks of the existing chunk object that have expired and an amount of time before the existing chunk object is allowed to be removed from the remote storage; and

determine based on the one or more evaluation metrics whether to reference the at least one shared data chunk of the new archive from the existing chunk object or store the at least one shared data chunk in a new chunk object of the remote storage; and

a memory coupled to the one or more processors and configured to provide the one or more processors with instructions.

17. The non-transitory computer readable medium of claim 15 , wherein determining that the at least one shared data chunk of the new archive that is already stored in the existing chunk object of the remote storage storing data chunks of a previous archive includes comparing a corresponding chunk identifier associated with the at least one shared data chunk of the new archive with a plurality of chunk identifiers stored in an archive chunk metadata data structure.

18. The non-transitory computer readable medium of claim 17 , wherein the archive chunk metadata data structure includes a plurality of entries, wherein each entry of the plurality of entries associates a chunk identifier corresponding to a data chunk with a chunk object identifier associated with a chunk object storing the data chunk.

19. The non-transitory computer readable medium of claim 15 , wherein in response determining to reference the at least one shared data chunk of the new archive from the existing chunk object includes generating archive metadata for the new archive that references the at least one shared data chunk.

20. The system of claim 16 , wherein to determine that the at least one shared data chunk of the new archive that is already stored in the existing chunk object of the remote storage storing data chunks of a previous archive, the one or more processors are configured to compare a corresponding chunk identifier associated with the at least one shared data chunk of the new archive with a plurality of chunk identifiers stored in an archive chunk metadata data structure.