Granted Patent B2

US 12,235,723 · App. 18/029,700 · Granted Feb 25, 2025

Inventors: Qinghai Wang (Shandong, CN); Xiangrui Meng (Shandong, CN)

Assignee: INSPUR SUZHOU INTELLIGENT TECHNOLOGY CO., LTD.

G06F11/1088G06F11/1448H03M13/373

Abstract

Claims (43)

1. A data reconstruction method based on erasure coding, wherein, the method comprises:

acquiring data offset information of incremental data in a data object;

acquiring corresponding data segments from a plurality of source object-based storage devices according to the data offset information; wherein, the source object-based storage devices are target object-based storage devices storing incremental data among respective object-based storage devices storing data objects based on erasure coding, and a quantity of the source object-based storage devices is the same as a quantity of data disks corresponding to the erasure coding;

integrating the data segments into an erasure incremental segment, and writing the erasure incremental segment into a to-be-reconstructed object-based storage device, which has no incremental data stored therein, among the respective object-based storage devices;

wherein, the data offset information comprises an offset start address and an offset data length;

the step of acquiring corresponding data segments from a plurality of source object-based storage devices according to the data offset information comprises:

acquiring an erasure offset start address by equally dividing the offset start address in accordance with the quantity of the data disks, and acquiring an erasure offset data length by equally dividing the offset data length in accordance with the quantity of the data disks;

acquiring the corresponding data segments from the plurality of source object-based storage devices according to the erasure offset start address and the erasure offset data length.

2. The data reconstruction method based on erasure coding according to claim 1 , wherein, before the step of acquiring an erasure offset data length by equally dividing the offset data length in accordance with the quantity of the data disks, the method further comprises:

determining whether the offset data length is an integral multiple of an erasure band data length corresponding to the erasure coding;

if the offset data length is an integral multiple of the erasure band data length corresponding to the erasure coding, then performing the step of acquiring an erasure offset data length by equally dividing the offset data length in accordance with the quantity of the data disks;

if the offset data length is not an integral multiple of the erasure band data length corresponding to the erasure coding, then increasing the offset data length to an integral multiple of the erasure band data length, and

performing the step of acquiring an erasure offset data length by equally dividing the increased offset data length in accordance with the quantity of the data disks based on the increased offset data length.

3. The data reconstruction method based on erasure coding according to claim 2 , wherein, the consecutive data section is a consecutive data address range occupied by the data of the data segments, and the data address range, corresponding to each of the erasure incremental segments in the data section, is recorded in position information.

4. The data reconstruction method based on erasure coding according to claim 1 , wherein, when an item quantity of the data offset information is more than 1, before the step of writing the erasure incremental segment into a to-be-reconstructed object-based storage device, which has no incremental data stored therein, among the respective object-based storage devices, the method further comprises:

storing the erasure incremental segments corresponding to items of the data offset information as a consecutive data section, and recording the position information of each of the erasure incremental segments in the data section;

the step of writing the erasure incremental segment into a to-be-reconstructed object-based storage device, which has no incremental data stored therein, among the respective object-based storage devices comprises:

writing the respective erasure incremental segments, read from the data section according to the position information, into the to-be-reconstructed object-based storage device, which has no incremental data stored therein, among the respective object-based storage devices.

5. The data reconstruction method based on erasure coding according to claim 1 , wherein, the step of writing the erasure incremental segment into a to-be-reconstructed object-based storage device, which has no incremental data stored therein, among the respective object-based storage devices comprises:

writing the erasure incremental segment into an address range, corresponding to the offset start address and the offset data length, in the to-be-reconstructed object-based storage device.

6. The data reconstruction method based on erasure coding according to claim 1 , wherein, the step of acquiring data offset information of incremental data in a data object comprises:

acquiring the data offset information of the incremental data in the data object from a writing operation log of a placement group in which the data object is placed.

7. The data reconstruction method based on erasure coding according to claim 1 , wherein, the data object is collectively stored by a plurality of object-based storage devices based on erasure coding storage mechanism.

8. The data reconstruction method based on erasure coding according to claim 1 , wherein, the incremental data is the data that has changed in the data object.

9. The data reconstruction method based on erasure coding according to claim 1 , wherein, the incremental data is a portion of the data in the data object.

10. The data reconstruction method based on erasure coding according to claim 1 , wherein, the data offset information represents the offset location where the incremental data is located in the data object.

11. The data reconstruction method based on erasure coding according to claim 1 , after acquiring the data offset information of the incremental data in the data object, further comprising acquiring corresponding data segments from the plurality of source object-based storage devices according to the data offset information, wherein, the source object-based storage devices are target object-based storage devices storing incremental data among respective object-based storage devices collectively storing the data object based on erasure coding.

12. The data reconstruction method based on erasure coding according to claim 1 , wherein, when a distributed object storage is carried out based on erasure coding, the data object is collectively stored and maintained by the plurality of object-based storage devices in conformity with the quantity of disks meeting the requirements of erasure coding, so as to cause the data stored in the plurality of object-based storage devices to be collectively integrated as an entirety of the data object.

13. The data reconstruction method based on erasure coding according to claim 1 , after acquiring the corresponding data segments from the plurality of source object-based storage devices in accordance with the data offset information, further comprising integrating the data segments into an erasure incremental segment, then the erasure incremental segment is written into the to-be-reconstructed object-based storage device.

14. The data reconstruction method based on erasure coding according to claim 1 , wherein, the data offset information comprises an offset start address and an offset data length, the offset start address is data address corresponding to a start position of the incremental data; the offset data length is address length occupied by the entire data of the incremental data.

15. The data reconstruction method based on erasure coding according to claim 1 , wherein, the erasure coding evenly stores the data object in respective data disks, and the incremental data is evenly stored in respective data disks.

16. A data reconstruction device based on erasure coding, wherein, the device comprises:

a memory, for storing a computer program;

a processor, for executing the computer program to implement the steps of the data reconstruction method based on erasure coding according to claim 1 .

17. The data reconstruction device based on erasure coding according to claim 16 , wherein, the step of acquiring corresponding data segments from a plurality of source object-based storage devices according to the data offset information comprises:

acquiring an erasure offset start address by equally dividing the offset start address in accordance with the quantity of the data disks, and acquiring an erasure offset data length by equally dividing the offset data length in accordance with the quantity of the data disks;

acquiring the corresponding data segments from the plurality of source object-based storage devices according to the erasure offset start address and the erasure offset data length.

18. The data reconstruction device based on erasure coding according to claim 17 , wherein, before the step of acquiring an erasure offset data length by equally dividing the offset data length in accordance with the quantity of the data disks, the method further comprises:

determining whether the offset data length is an integral multiple of an erasure band data length corresponding to the erasure coding;

when the offset data length is an integral multiple of the erasure band data length corresponding to the erasure coding, then performing the step of acquiring an erasure offset data length by equally dividing the offset data length in accordance with the quantity of the data disks;

when the offset data length is not an integral multiple of the erasure band data length corresponding to the erasure coding, then increasing the offset data length to an integral multiple of the erasure band data length, and

performing the step of acquiring an erasure offset data length by equally dividing the increased offset data length in accordance with the quantity of the data disks based on the increased offset data length.

19. A non-transitory computer readable storage medium, wherein, the non-transitory computer readable storage medium stores a computer program, the computer program is configured to be executed by a processor to implement the data reconstruction method based on erasure coding according to claim 1 .

Assignments (2)

Priority Claims (1)

Continuity (1)

References Cited (16)