Parity block generation method and apparatus
A parity block generation method and apparatus are disclosed. The method comprises: for a plurality of original data blocks for which parity blocks are to be generated, determining a global coding matrix for the plurality of original data blocks; for each local domain that is obtained by dividing the plurality of original data blocks, determining a local coding matrix of the local domain on the basis of the global coding matrix, wherein each local domain comprises original data blocks that belong to the local domain; and generating, on the basis of the global coding matrix, global parity blocks for the plurality of original data blocks, and generating, on the basis of the local coding matrix of each local domain, a local reconstruction parity block of each local domain, such that the global parity blocks have a derivation relationship with the local reconstruction parity block of each local domain.
1 . A parity block generation method, implemented by any node device in a distributed system, comprising:
determining a global coding matrix for a plurality of original data blocks stored in the distributed system;
obtaining each local domain by dividing the plurality of original data blocks, and determining a local coding matrix of the local domain based on the global coding matrix, wherein each local domain comprises original data blocks that belong to the local domain; and
generating, based on the global coding matrix, global parity blocks for the plurality of original data blocks, and generating, based on the local coding matrix of each local domain, a local reconstruction parity block of each local domain, wherein the global parity blocks have a derivation relationship with the local reconstruction parity block of each local domain.
2 . The method according to claim 1 , wherein the global coding matrix comprises one or more global coding vectors, each global coding vector comprises global coding parameters in one-to-one correspondence with respective original data blocks; and
for each local domain, the determining the local coding matrix of the local domain based on the global coding matrix comprises:
for each original data block in the local domain, determining, based on a global coding parameter corresponding to the original data block in each global coding vector, a local coding parameter corresponding to the original data block, to obtain the local coding parameter corresponding to each original data block in the local domain; and
determining, based on the local coding parameter corresponding to each original data block in the local domain, the local coding matrix of the local domain.
3 . The method according to claim 1 , wherein the generating, based on the global coding matrix, the global parity blocks for the plurality of original data blocks, and the generating, based on the local coding matrix of each local domain, the local reconstruction parity block of each local domain comprises:
determining a target coding matrix based on the global coding matrix and the local coding matrix of each local domain; and
generating, based on the target coding matrix, the global parity blocks for the plurality of original data blocks and the local reconstruction parity block of each local domain.
4 . The method according to claim 1 , further comprising:
in a case that any global parity block is lost, recovering the lost global parity block based on an unlost global parity block and the local reconstruction parity block of each local domain.
5 . The method according to claim 1 , further comprising:
in a case that any local reconstruction parity block is lost, recovering the lost local reconstruction parity block based on the global parity blocks and unlost local reconstruction parity blocks of respective local domains.
6 . An electronic device, comprising:
a processor; and
a memory for storing processor-executable instructions;
wherein the processor runs the executable instructions to perform operations of:
determining a global coding matrix for a plurality of original data blocks stored in a distributed system;
obtaining each local domain by dividing the plurality of original data blocks, and determining a local coding matrix of the local domain based on the global coding matrix, wherein each local domain comprises original data blocks that belong to the local domain; and
generating, based on the global coding matrix, global parity blocks for the plurality of original data blocks, and generating, based on the local coding matrix of each local domain, a local reconstruction parity block of each local domain, wherein the global parity blocks have a derivation relationship with the local reconstruction parity block of each local domain.
7 . The electronic device according to claim 6 , wherein the global coding matrix comprises one or more global coding vectors, each global coding vector comprises global coding parameters in one-to-one correspondence with respective original data blocks; and
wherein the processor runs the executable instructions to perform further operations of:
for each original data block in the local domain, determining, based on a global coding parameter corresponding to the original data block in each global coding vector, a local coding parameter corresponding to the original data block, to obtain the local coding parameter corresponding to each original data block in the local domain; and
determining, based on the local coding parameter corresponding to each original data block in the local domain, the local coding matrix of the local domain.
8 . The electronic device according to claim 6 , wherein the processor runs the executable instructions to perform further operations of:
determining a target coding matrix based on the global coding matrix and the local coding matrix of each local domain; and
generating, based on the target coding matrix, the global parity blocks for the plurality of original data blocks and the local reconstruction parity block of each local domain.
9 . The electronic device according to claim 6 , wherein the processor runs the executable instructions to perform further operations of:
in a case that any global parity block is lost, recovering the lost global parity block based on an unlost global parity block and the local reconstruction parity block of each local domain.
10 . The electronic device according to claim 6 , wherein the processor runs the executable instructions to perform further operations of:
in a case that any local reconstruction parity block is lost, recovering the lost local reconstruction parity block based on the global parity blocks and unlost local reconstruction parity blocks of respective local domains.
11 . A non-transitory computer-readable storage medium, storing a computer program therein, wherein the computer program, when executed by a processor, implements operations of:
determining a global coding matrix for a plurality of original data blocks stored in a distributed system;
obtaining each local domain by dividing the plurality of original data blocks, and determining a local coding matrix of the local domain based on the global coding matrix, wherein each local domain comprises original data blocks that belong to the local domain; and
generating, based on the global coding matrix, global parity blocks for the plurality of original data blocks, and generating, based on the local coding matrix of each local domain, a local reconstruction parity block of each local domain, wherein the global parity blocks have a derivation relationship with the local reconstruction parity block of each local domain.
12 . The non-transitory computer-readable storage medium according to claim 11 , wherein the global coding matrix comprises one or more global coding vectors, each global coding vector comprises global coding parameters in one-to-one correspondence with respective original data blocks; and
wherein the computer program, when executed by the processor, implements further operations of:
for each original data block in the local domain, determining, based on a global coding parameter corresponding to the original data block in each global coding vector, a local coding parameter corresponding to the original data block, to obtain the local coding parameter corresponding to each original data block in the local domain; and
determining, based on the local coding parameter corresponding to each original data block in the local domain, the local coding matrix of the local domain.
13 . The non-transitory computer-readable storage medium according to claim 11 , wherein the computer program, when executed by the processor, implements further operations of:
determining a target coding matrix based on the global coding matrix and the local coding matrix of each local domain; and
generating, based on the target coding matrix, the global parity blocks for the plurality of original data blocks and the local reconstruction parity block of each local domain.
14 . The non-transitory computer-readable storage medium according to claim 11 , wherein the computer program, when executed by the processor, implements further operations of:
in a case that any global parity block is lost, recovering the lost global parity block based on an unlost global parity block and the local reconstruction parity block of each local domain.
15 . The non-transitory computer-readable storage medium according to claim 11 , wherein the computer program, when executed by the processor, implements further operations of:
in a case that any local reconstruction parity block is lost, recovering the lost local reconstruction parity block based on the global parity blocks and unlost local reconstruction parity blocks of respective local domains.