Methods, electronic devices and computer program product for replicating metadata
Metadata is replicated. For instance, in response to receiving a request for replicating metadata to a target node, information of an index structure associated with the metadata is obtained. The index structure may include terminal nodes for storing the metadata and index nodes for storing index information of the terminal nodes. Next, the metadata from the terminal nodes is extracted based on the information of the index structure. Further, a sequence is generated to be replicated of the metadata. The sequence to be replicated includes items of the metadata, and locations of the items in the sequence to be replicated are determined based on key information corresponding to the items. In addition, the items of the metadata, in the sequence to be replicated, are replicated to the target node. In this way, only the metadata in the index structure is replicated, thereby reducing the data amount of replication.
1. A method, comprising:
in response to receiving a request for replicating metadata to a target node, obtaining, by a system comprising a processor, information of an index structure associated with the metadata, the index structure comprising terminal nodes for storing the metadata and index nodes for storing index information of the terminal nodes;
extracting the metadata from the terminal nodes based on the information of the index structure;
generating a sequence to be replicated of the metadata, the sequence to be replicated comprising a plurality of items of the metadata, locations of the plurality of items in the sequence to be replicated being determined based on key information corresponding to the plurality of items; and
replicating, to the target node, the plurality of items of the metadata in the sequence to be replicated, wherein the replicating the plurality of items of the metadata to the target node comprises:
determining a maximum length of metadata that the target node permits to be replicated in each replication;
determining, based on the maximum length, a number of items that is able to be replicated from the metadata in each replication; and
replicating the number of items from the metadata to the target node.
2. The method of claim 1 , wherein the replicating the plurality of items of the metadata to the target node comprises:
comparing a total size of the plurality of items of the metadata with a threshold size;
in response to the total size exceeding the threshold size, partitioning the plurality of items of the metadata according to a predetermined size, the predetermined size being below or equal to the threshold size, the partitioning resulting in a partitioned plurality of items of the metadata; and
replicating the partitioned plurality of items of the metadata to the target node.
3. The method of claim 1 , further comprising:
recording key information of an end item replicated to the target node in each replication, as key information of a start item of a next replication.
4. The method of claim 1 , further comprising:
in response to failure of the replication of the number of items from the metadata, determining an end item replicated to the target node in a preceding replication; and
replicating the number of items following the end item of the metadata to the target node.
5. The method of claim 3 , further comprising:
in response to failure of the replication of the number of items from the metadata, determining an end item replicated to the target node in a preceding replication; and
replicating the number of items following the end item of the metadata to the target node.
6. The method of claim 1 , wherein the obtaining the information of the index structure comprises:
obtaining information related to leaf pages and index pages included in a B+Tree, the leaf pages being used for storing the metadata and the index pages being used for storing index information of the leaf pages.
7. A device, comprising:
at least one processing unit; and
at least one memory, which is coupled to the at least one processing unit and stores a machine executable instruction, the instruction, when executed by the at least one processing unit, causes the device to execute acts of:
in response to receiving a request for replicating metadata to a target node, obtaining information of an index structure associated with the metadata, the index structure including terminal nodes for storing the metadata and index nodes for storing index information of the terminal nodes;
extracting the metadata from the terminal nodes, based on the information of the index structure;
generating a sequence to be replicated of the metadata, the sequence to be replicated comprising a plurality of items of the metadata, locations of the plurality of items in the sequence to be replicated being determined based on key information corresponding to the plurality of items; and
replicating, to the target node, the plurality of items of the metadata in the sequence to be replicated, wherein the replicating the plurality of items of the metadata to the target node comprises:
determining an upper limit on length of metadata that the target node permits to be replicated in each replication;
determining, based on the upper limit on length, a number of items that is able to be replicated from the metadata in each replication; and
replicating the number of items from the metadata to the target node.
8. The device of claim 7 , wherein the replicating the plurality of items of the metadata to the target node comprises:
comparing a total size of the plurality of items of the metadata with a threshold size;
in response to the total size exceeding the threshold size, partitioning the plurality of items of the metadata according to a predetermined size, the predetermined size being below or equal to the threshold size, resulting in a partitioned plurality of items of the metadata; and
replicating the partitioned plurality of items of the metadata to the target node.
9. The electronic device of claim 7 , wherein the acts further comprise:
recording key information of an end item replicated to the target node in each replication, as key information of a start item of a next replication.
10. The device of claim 7 , wherein the acts further comprise:
in response to failure of the replication of the number of items from the metadata, determining an end item replicated to the target node in a preceding replication; and
replicating the number of items following the end item of the metadata to the target node.
11. The device of claim 9 , wherein the acts further comprise:
in response to failure of the replication of the number of items from the metadata, determining an end item replicated to the target node in a preceding replication; and
replicating the number of items following the end item of the metadata to the target node.
12. The device of claim 7 , wherein the obtaining the information of the index structure comprises:
obtaining information related to leaf pages and index pages included in a B+Tree, the leaf pages being used for storing the metadata and the index pages being used for storing index information of the leaf pages.
13. A computer program product, which is stored on a non-transitory computer readable medium and comprises at least one machine executable instruction, the at least one machine executable instruction, when executed, causes a machine to execute operations, comprising:
in response to receiving a request for replicating metadata to a target node, obtaining information of an index structure associated with the metadata, the index structure comprising terminal nodes for storing the metadata and index nodes for storing index information of the terminal nodes;
extracting the metadata from the terminal nodes based on the information of the index structure;
generating a sequence to be replicated of the metadata, the sequence to be replicated comprising a plurality of items of the metadata, locations of the plurality of items in the sequence to be replicated being determined based on key information corresponding to the plurality of items; and
replicating, to the target node, the plurality of items of the metadata in the sequence to be replicated, wherein the replicating the plurality of items of the metadata to the target node comprises:
determining a limit on length of metadata that the target node permits to be replicated in each replication;
determining, based on the limit on length, a number of items that can be replicated from the metadata in each replication; and
replicating the number of items from the metadata to the target node.
14. The computer program product of claim 13 , wherein the replicating the plurality of items of the metadata to the target node comprises:
comparing a total size of the plurality of items of the metadata with a threshold size;
in response to the total size exceeding the threshold size, partitioning the plurality of items of the metadata according to a predetermined size, the predetermined size being below or equal to the threshold size, resulting in a partitioned plurality of items of the metadata; and
replicating the partitioned plurality of items of the metadata to the target node.
15. The computer program product of claim 13 , wherein the operations further comprise:
recording key information of an end item replicated to the target node in each replication, as key information of a start item of a next replication.
16. The computer program product of claim 13 , wherein the operations further comprise:
in response to failure of the replication of the number of items from the metadata, determining an end item replicated to the target node in a preceding replication; and
replicating the number of items following the end item of the metadata to the target node.
17. The computer program product of claim 13 , wherein the obtaining the information of the index structure comprises:
obtaining information related to leaf pages and index pages included in a B+Tree, the leaf pages being used for storing the metadata and the index pages being used for storing index information of the leaf pages.
18. The computer program product of claim 13 , wherein the operations further comprise:
arranging the metadata sequentially based on the key information.
19. The computer program product of claim 13 , wherein the operations further comprise:
searching the index structure associated with the metadata by a total size.
20. The computer program product of claim 13 , wherein the operations further comprise:
in response to determining the limit on length of the metadata, replicating the metadata in batches.