Opportunistic ‘XOR’ of data for geographically diverse storage
Opportunistic combining of data chunks is disclosed. Data chunks stored in storage devices of different zones of a zone storage system can be convolved to conserve memory. The zone storage system can be a geographically diverse storage system. A convolved chunk can be stored at a zone that does not contribute a local data chunk to the data represented in the convolved chunk. A zone storage component can be androgynous, rather than being explicitly configured to act as a front/back end storage device. This androgyny can enable the zone storage system to store a complete chunk at a zone based on real time use. In an aspect, an androgynous zone storage component can take on, or transition between, a de facto front-end storage device character or de facto back-end storage device character in response to deployment of the androgynous zone storage component in the storage system.
1. A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
determining a number of data zones comprising a distributed storage construct;
determining that a count of ready data chunks is less than the number of data zones, wherein the ready data chunks comprise a first data chunk stored in a first zone storage device corresponding to a first data zone of the data zones and a second data chunk stored in a second zone storage device corresponding to a second zone of the data zones; and
in response to combining the first data chunk and the second data chunk into a first combined data chunk, storing the first combined data chunk in a third zone storage device corresponding to the a third data zone of the data zones, wherein the third zone storage device is not the same zone storage device as the first zone storage device, and wherein the third zone storage device is not the same zone storage device as the second zone storage device.
2. The system of claim 1 , wherein the operations further comprise:
in response to combining a third data chunk of the ready data chunks, wherein the third data chunk is stored in the third zone storage device, and the first combined data chunk into a second combined data chunk, storing the second combined data chunk in a fourth zone storage device corresponding to a fourth data zone of the data zones, and wherein the fourth zone storage device is not the same zone storage device as the first zone storage device, second zone storage device, or third zone storage device.
3. The system of claim 1 , wherein the operations further comprise:
in response to combining a third data chunk of the ready data chunks, wherein the third data chunk is stored in the fourth zone storage device corresponding to a fourth data zone of the data zones, and the first combined data chunk into a second combined data chunk, storing the second combined data chunk in a third zone storage device, wherein the fourth zone storage device is not the same zone storage device as the first zone storage device, second zone storage device, or third zone storage device.
4. The system of claim 1 , wherein:
the storing the first combined data chunk is in response to combining the first data chunk, the second data chunk, and a third data chunk of the ready data chunks,
the third data chunk is stored in a fourth zone storage device corresponding to a fourth data zone of the data zones; and
the fourth zone storage device is not the same zone storage device as the first zone storage device, second zone storage device, or third zone storage device.
5. The system of claim 1 , wherein a difference between the number of data zones and the count of ready data chunks is one.
6. The system of claim 1 , wherein a difference between the number of data zones and the count of ready data chunks is greater than one.
7. The system of claim 1 , wherein the first combined data chunk comprises a time stamp value to enable determining an age of the first combined data chuck, wherein the time stamp value facilitates formation of a subsequent data chunk at a time in the future, wherein the subsequent data chunk is a combination of the first combined data chunk and another data chunk or another combined data chunk, and wherein the first combined data chunk is selected for combination with the other data chunk or the other combined data chunk based on the age of the first combined data chunk.
8. The system of claim 1 , wherein the first combined data chunk comprises a zone identifier value to enable determining identities of data zones corresponding to the first and second data chunks combined into the first combined data chuck to facilitate formation of a subsequent data chunk at a time in the future, wherein the subsequent data chunk is a combination of the first combined data chunk and another data chunk or another combined data chunk, and wherein the first combined data chunk is selected for combination with the other data chunk or the other combined data chunk based on the zone identifier value.
9. The system of claim 8 , wherein the first combined data chunk is selected for combination with the other data chunk or the other combined data chunk based on an identity of a data zone of the data zones determined from the zone identifier value.
10. The system of claim 8 , wherein the first combined data chunk is selected for combination with the other data chunk or the other combined data chunk based on a count of zones represented in the first combined data chunk, and wherein the count is determined from the zone identifier value.
11. A first zone storage device, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
determining a number of data zones comprising a distributed storage construct;
determining that a count of ready data chunks is less than the number of data zones, wherein the ready data chunks comprise a first data chunk stored in the first zone storage device corresponding to a first data zone of the data zones and a second data chunk stored in a second zone storage device corresponding to a second zone of the data zones;
enabling combining the first data chunk and the second data chunk resulting in a first combined data chunk; and
enabling storing of the first combined data chunk on a third zone storage device, wherein the first zone storage device is not a same zone storage device as the second or third zone storage device, wherein the second zone storage device is not a same zone storage device as the first or third zone storage device, and wherein the third zone storage device is not a same zone storage device as the first or second zone storage device.
12. The first zone storage device of claim 11 , wherein the operations further comprise:
determining that a third data chunk stored on a fourth zone storage device is available for back up,
wherein the enabling combining comprises combining the first, second, and third data chunk into the first combined data chunk,
wherein the first zone storage device is not a same zone storage device as the second, third, or fourth zone storage device,
wherein the second zone storage device is not a same zone storage device as the first, third, or fourth zone storage device,
wherein the third zone storage device is not a same zone storage device as the first, second, or fourth zone storage device, and
wherein the fourth zone storage device is not a same zone storage device as the first, second, or third zone storage device.
13. The first zone storage device of claim 11 , wherein the enabling the combining comprises combining the first data chunk and the second data chunk into the first combined data chunk by the first zone storage device.
14. The first zone storage device of claim 11 , wherein the enabling the combining comprises allowing access to the first data chunk to enable the first data chunk and the second data chunk to be combined into the first combined data chunk by a device other than the first zone storage device.
15. The first zone storage device of claim 14 , wherein the device other than the first zone storage device is the third zone storage device.
16. The first zone storage device of claim 14 , wherein the device other than the first zone storage device is also not the second zone storage device or the third zone storage device.
17. A method, comprising:
determining, by a system comprising a processor, a number of data zones comprising a distributed storage construct;
determining, by the system, that a count of ready data chunks is less than the number of data zones, wherein the ready data chunks comprise a first data chunk stored in a first zone storage device corresponding to a first data zone of the data zones and a second data chunk stored in a second zone storage device corresponding to a second zone of the data zones;
combining, by the system via an exclusive-or operation, the first data chunk and the second data chunk resulting in a first combined data chunk; and
storing, by the system, the first combined data chunk at a third zone storage device, wherein the first zone storage device is a different zone storage device from the second or third zone storage device, wherein the second zone storage device is a different zone storage device from the first or third zone storage device, and wherein the third zone storage device is a different zone storage device from the first or second zone storage device.
18. The method of claim 17 , wherein the combining comprises performing the exclusive-or operation by the first zone storage device.
19. The method of claim 17 , wherein the combining comprises performing the exclusive-or operation by the third zone storage device.
20. The method of claim 17 , wherein the combining comprises performing the exclusive-or operation by a device other than the first zone storage device, the second zone storage device, or the third zone storage device.