System and method for archiving data in a decentralized data protection system
A node for use in a data archive includes a persistent storage and a data protection agent. The persistent storage stores a copy of data. The data protection agent obtains a request to archive the copy of the data; in response to the request: generates an archive of the copy of the data; stores the archive in an archive node; generates metadata based on the archive; deletes the copy of the data from the persistent storage; and, after deleting the copy of the data, advertises, to a second node, that the copy of the data is stored in the node.
1. A node for use in a data archive, comprising:
a persistent storage that stores a copy of data; and
a data protection agent programmed to:
obtain a request to archive the copy of the data;
in response to the request:
generate an archive of the copy of the data;
store the archive in an archive node;
generate metadata based on the archive;
delete the copy of the data from the persistent storage; and
after deleting the copy of the data, advertise, to a plurality of second nodes, that the copy of the data is stored in the node.
2. The node of claim 1 , wherein the metadata comprises:
an association of the metadata with the copy of the data;
an identifier of the copy of the data; and
retrieval information for the archive.
3. The node of claim 1 wherein the copy of the data is advertised by maintaining an entry in a distributed data storage map of the archive associated with the copy of the data.
4. The node of claim 1 , wherein the data protection agent is further programmed to:
obtain a second request for the copy of the data from one of the plurality of second nodes;
in response to the second request:
make a determination that the copy of the data is not stored in the persistent storage; and
in response to the determination:
orchestrate retrieval of the copy of the data for the one of the plurality of second nodes.
5. The node of claim 4 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
sending retrieval information for the archive to the one of the plurality of second nodes.
6. The node of claim 4 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
obtaining a copy of the archive;
generating a second copy of the data using the copy of the archive; and
providing the second copy of the data to the one of the plurality of second nodes.
7. The node of claim 4 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
obtaining a copy of the archive; and
providing the copy of the archive to the one of the plurality of second nodes.
8. A method for managing a node in a data archive, comprising:
obtaining a request to archive a copy of data stored in the node;
in response to the request:
generating an archive of the copy of the data;
storing the archive in an archive node;
generating metadata based on the archive;
deleting the copy of the data from persistent storage of the node; and
after deleting the copy of the data, advertising, to a plurality of second nodes, that the copy of the data is stored in the node.
9. The method of claim 8 , wherein the metadata comprises:
an association of the metadata with the copy of the data;
an identifier of the copy of the data; and
retrieval information for the archive.
10. The method of claim 8 , wherein the copy of the data is advertised by maintaining an entry in a distributed data storage map of the archive associated with the copy of the data.
11. The method of claim 8 , wherein the method further comprises:
obtaining a second request for the copy of the data from the one of the plurality of second nodes;
in response to the second request:
making a determination that the copy of the data is not stored in the persistent storage; and
in response to the determination:
orchestrating retrieval of the copy of the data for the one of the plurality of second nodes.
12. The method of claim 11 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
sending retrieval information for the archive to the one of the plurality of second nodes.
13. The method of claim 12 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
obtaining a copy of the archive;
generating a second copy of the data using the copy of the archive; and
providing the second copy of the data to the one of the plurality of second nodes.
14. The method of claim 12 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
obtaining a copy of the archive; and
providing the copy of the archive to the one of the plurality of second nodes.
15. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing a node in a data archive, the method comprising:
obtaining a request to archive a copy of data stored in the node;
in response to the request:
generating an archive of the copy of the data;
storing the archive in an archive node;
generating metadata based on the archive;
deleting the copy of the data from persistent storage of the node; and
after deleting the copy of the data, advertising, to a plurality of second nodes, that the copy of the data is stored in the node.
16. The non-transitory computer readable medium of claim 15 , wherein the metadata comprises:
an association of the metadata with the copy of the data;
an identifier of the copy of the data; and
retrieval information for the archive.
17. The non-transitory computer readable medium of claim 15 , wherein the copy of the data is advertised by maintaining an entry in a distributed data storage map of the archive associated with the copy of the data.
18. The non-transitory computer readable medium of claim 15 , wherein the method further comprises:
obtaining a second request for the copy of the data from the one of the plurality of second nodes; and
in response to the second request:
making a determination that the copy of the data is not stored in the persistent storage;
in response to the determination:
orchestrating retrieval of the copy of the data for the one of the plurality of second nodes.
19. The non-transitory computer readable medium of claim 18 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
sending retrieval information for the archive to the one of the plurality of second nodes.
20. The non-transitory computer readable medium of claim 19 , wherein orchestrating retrieval of the copy of the data for the one of the plurality of second nodes comprises:
obtaining a copy of the archive;
generating a second copy of the data using the copy of the archive; and
providing the second copy of the data to the one of the plurality of second nodes.