Method, device and computer program product for recovering metadata
Embodiments of the present disclosure relate to a method, device and computer program product for recovering metadata. The method comprises detecting whether first metadata corresponding to a first journal at a first device is corrupted, and obtaining second metadata corresponding to a second journal from a second device in the case that the first metadata is corrupted, wherein the second device is remote from the first device. The method further includes recovering the first metadata based on the second metadata, the first journal and the second journal. Embodiments of the present disclosure utilize remote backup metadata for recovery in the case that local metadata (which for example includes index information) is corrupted without reserving metadata snapshot locally, thereby saving the storage space.
1. A method for recovering metadata, comprising:
detecting, by a system comprising a processor, whether first metadata, comprising periodically dumped metadata, corresponding to a first journal at a first device is corrupted;
in response to the detecting indicating that the first metadata, comprising the periodically dumped metadata, is corrupted, obtaining, from a second device, second metadata corresponding to a second journal, wherein the second journal is a latest journal, wherein the second metadata comprises latest dumped metadata, wherein preceding metadata, representing at least part of the periodically dumped metadata preceding the latest journal, is deleted, and wherein the second device is remote from the first device; and
recovering the first metadata, comprising the periodically dumped metadata, based on the second metadata, the first journal and the second journal.
2. The method of claim 1 , wherein the recovering the first metadata comprising the periodically dumped metadata, comprises:
determining a first time when the first journal is generated and a second time when the second journal is generated;
obtaining a set of journals generated between the second time and the first time; and
recovering the first metadata, comprising the periodically dumped metadata, based on the second metadata and the set of journals.
3. The method of claim 1 , further comprising:
replicating a third journal from the first device to the second device for updating the second metadata;
storing, in the first device, a fourth journal that has not been replicated to the second device; and
deleting, from the first device, a fifth journal that has been replicated to the second device.
4. The method of claim 1 , wherein the recovering the first metadata comprising the periodically dumped metadata, comprises:
obtaining a first set of journals from the first device between a third journal and the first journal, the third journal being the latest journal that has been replicated from the first device to the second device;
obtaining a second set of journals from the second device between the second journal and the third journal; and
recovering, based on the second metadata, the first metadata by replaying the second set of journals and the first set of journals.
5. The method of claim 1 , further comprising:
in response to the second metadata being corrupted:
sending the first metadata, comprising the periodically dumped metadata, from the first device to the second device; and
continuing to replicate journals from the first device to the second device starting from the first journal.
6. The method of claim 1 , further comprising:
storing the first metadata, comprising the periodically dumped metadata, and the second metadata using a B+ tree index structure.
7. The method of claim 6 , wherein the first metadata, comprising the periodically dumped metadata, is data describing user data in a distribution storage system, the method further comprising:
searching data in the distribution storage system using the first metadata, comprising the periodically dumped metadata.
8. A device for recovering metadata, comprising:
a processing unit; and
a memory coupled to the processing unit and having instructions stored thereon, the instructions, when executed by the processing unit, performing acts of:
detecting whether first metadata, comprising periodically dumped metadata, corresponding to a first journal at a first device is corrupted;
in response to the detecting indicating that the first metadata, comprising the periodically dumped metadata, is corrupted, obtaining, from a second device, second metadata corresponding to a second journal, wherein the second journal is a latest journal, wherein the second metadata comprises latest dumped metadata, wherein preceding metadata, representing at least part of the periodically dumped metadata preceding the latest journal, is deleted, and wherein the second device is remote from the first device; and
recovering the first metadata, comprising the periodically dumped metadata, based on the second metadata, the first journal and the second journal.
9. The device of claim 8 , wherein the recovering the first metadata comprising the periodically dumped metadata, comprises:
determining a first time when the first journal is generated and a second time when the second journal is generated;
obtaining a set of journals generated between the second time and the first time; and
recovering the first metadata, comprising the periodically dumped metadata, based on the second metadata and the set of journals.
10. The device of claim 8 , the acts further comprising:
replicating a third journal from the first device to the second device for updating the second metadata;
storing, in the first device, a fourth journal that has not been replicated to the second device; and
deleting, from the first device, a fifth journal that has been replicated to the second device.
11. The device of claim 8 , wherein the recovering the first metadata comprising the periodically dumped metadata, comprises:
obtaining a first set of journals from the first device between a third journal and the first journal, the third journal being the latest journal that has been replicated from the first device to the second device;
obtaining a second set of journals from the second device between the second journal and the third journal; and
recovering, based on the second metadata, the first metadata, comprising the periodically dumped metadata, by replaying the second set of journals and the first set of journals.
12. The device of claim 8 , further comprising:
in response to the second metadata being corrupted:
sending the first metadata, comprising the periodically dumped metadata, from the first device to the second device; and
continuing to replicate journals from the first device to the second device starting from the first journal.
13. The device of claim 8 , the acts further comprising:
storing the first metadata, comprising the periodically dumped metadata, and the second metadata using a B+ tree index structure.
14. The device of claim 13 , wherein the first metadata, comprising the periodically dumped metadata, is data describing user data in a distribution storage system, the acts further comprising:
searching data in the distribution storage system using the first metadata, comprising the periodically dumped metadata.
15. A computer program product, which is stored on a non-transitory computer readable medium and comprises computer executable instructions, the computer executable instructions, when executed, causing a computer to execute operations, comprising: in response to detecting that first metadata, comprising periodically dumped metadata, corresponding to a first journal at a first device is corrupted, obtaining, from a second device, second metadata corresponding to a second journal, wherein the second journal is a latest journal, wherein the second metadata comprises latest dumped metadata, wherein preceding metadata, representing at least part of the periodically dumped metadata preceding the latest journal, is deleted, and wherein the second device is remote from the first device; and recovering the first metadata, comprising the periodically dumped metadata, based on the second metadata, the first journal and the second journal.
16. The computer program product of claim 15 , wherein the recovering the first metadata, comprising the periodically dumped metadata, comprises:
determining a first time when the first journal is generated and a second time when the second journal is generated;
obtaining a set of journals generated between the second time and the first time; and
recovering the first metadata, comprising the periodically dumped metadata, based on the second metadata and the set of journals.
17. The computer program product of claim 15 , wherein the operations further comprise:
replicating a third journal from the first device to the second device for updating the second metadata;
storing, in the first device, a fourth journal that has not been replicated to the second device; and
deleting, from the first device, a fifth journal that has been replicated to the second device.
18. The computer program product of claim 15 , wherein the operations further comprise:
obtaining a first set of journals from the first device between a third journal and the first journal, the third journal being the latest journal that has been replicated from the first device to the second device;
obtaining a second set of journals from the second device between the second journal and the third journal; and
recovering, based on the second metadata, the first metadata, comprising the periodically dumped metadata, by replaying the second set of journals and the first set of journals.
19. The computer program product of claim 15 , wherein the operations further comprise:
in response to the second metadata being corrupted:
sending the first metadata, comprising the periodically dumped metadata, from the first device to the second device; and
continuing to replicate journals from the first device to the second device starting from the first journal.
20. The computer program product of claim 15 , wherein the operations further comprise:
storing the first metadata, comprising the periodically dumped metadata, and the second metadata using a B+ tree index structure, wherein the first metadata, comprising the periodically dumped metadata, is data describing user data in a distribution storage system, and searching data in the distribution storage system using the first metadata, comprising the periodically dumped metadata.