Handling deletes with distributed erasure coding
Inter-zone network traffic generated during deletion of a data chunk that has been replicated by employing geographically distributed (GEO) erasure coding is reduced. In one aspect, if a data chunk is to be deleted, partial coding chunks are generated by a source zone and provided to destination zones that store complete coding chunks for updating the complete coding chunks based on combining them with the received partial coding chunks. In another aspect, if a first data chunk is to be deleted and a second data chunk is to be replicated, partial coding chunks are generated by the source zone for each data chunk. Further, the partial coding chunks created for different data chunks can be combined to generate transforming chunks, which can then be transferred to the destination zones. The destination zones can then update the complete coding chunks based on combining them with the received transforming chunks.
1. A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
in response to determining that a data chunk stored within a first zone of a geographically distributed storage system is to be deleted, determining a group of partial coding chunks associated with the data chunk,
determining a second zone of the geographically distributed storage system that stores a complete coding chunk associated with the data chunk, wherein the complete coding chunk is determined based on an erasure coding of the data chunk, and
directing, to the second zone, a partial coding chunk of the group of partial coding chunks to facilitate a modification of the complete coding chunk, wherein the modification results in a removal of information related to the data chunk from the complete coding chunk.
2. The system of claim 1 , wherein the determining the group of partial coding chunks comprises determining the group of partial coding chunks based on defined coding matrix data.
3. The system of claim 2 , wherein the defined coding matrix data comprises a set of defined coefficients, and wherein the partial coding chunk is determined based on a result of multiplying the data chunk with a coefficient of the set of defined coefficients.
4. The system of claim 1 , wherein the modification comprises a combination of the complete coding chunk with the partial coding chunk.
5. The system of claim 1 , wherein the operations further comprise:
subsequent to the modification, deleting the data chunk.
6. The system of claim 1 , wherein the operations further comprise:
subsequent to the modification, deleting the partial coding chunk.
7. The system of claim 1 , wherein the modification results in a modified complete coding chunk that is stored within the second zone.
8. The system of claim 1 , wherein the geographically distributed storage system comprises a geographically distributed object storage system.