Zone storage—resilient and efficient storage transactions
A distributed storage network (DSN) includes a DSN memory and a distributed storage (DS) processing unit. The DS processing unit determines a particular revision of source data for persistence, and generates a protocol message associated with the particular revision of source data. The protocol message is generated based on a balance between durability and persistence associated with the particular revision. The protocol message is transmitted from the DS processing unit to the DSN memory, and indicates to the DSN memory a particular persistence protocol. The DSN memory process data slices corresponding to the particular revision of source data in accordance with the particular persistence protocol.
1. A method for use in a distributed storage network (DSN) including a DSN memory and a distributed storage (DS) processing unit, the method comprising:
receiving, at the DSN memory, a protocol message transmitted by the DS processing unit, the protocol message indicating a particular persistence protocol to be applied to a particular revision of source data, wherein the particular persistence protocol is selected from among of a plurality of different persistence protocols implementing different balances between durability and persistence;
obtaining, at the DSN memory, write data having the particular revision of source data indicated by the protocol message; and
storing the write data using the particular persistence protocol as indicated by the protocol message.
2. The method of claim 1 , wherein the particular persistence protocol includes:
information instructing the DSN memory to make the particular revision of source data visible to subsequent requests without guaranteeing persistence of the particular revision of source data.
3. The method of claim 1 , wherein the protocol message includes:
a dispersal encoded data slice associated with the particular revision of source data.
4. The method of claim 1 , wherein the particular persistence protocol includes:
information instructing the DSN memory to make the particular revision of source data fully durable.
5. The method of claim 4 , wherein the protocol message includes:
a versioned slice name of a dispersal encoded data slice associated with the particular revision of source data; and
information instructing the DSN memory to transmit an acknowledgement message to the DS processing unit indicating that the particular revision of source data has been flushed to persistent storage.
6. The method of claim 5 , wherein the protocol message further includes:
information instructing the DSN memory to remove data slices associated with other revisions of the source data, wherein the other revisions have been stored in a cache memory.
7. The method of claim 1 , wherein the particular persistence protocol includes:
information instructing the DSN memory to:
remove previously stored versions of the source data, other than the particular revision of source data; and
clean up temporary transactions related to the particular revision of source data.
8. A distributed storage network (DSN) memory comprising:
a processor;
memory operably associated with the processor;
a program of instructions configured to be stored in the memory and executed by the processor, the program of instructions including:
at least one instruction to receive, at the DSN memory, a protocol message transmitted by a distributed storage (DS) processing unit, the protocol message indicating a particular persistence protocol to be applied to a particular revision of source data, wherein the particular persistence protocol is selected from among of a plurality of different persistence protocols implementing different balances between durability and persistence;
at least one instruction to obtain, at the DSN memory, write data having the particular revision of source data indicated by the protocol message; and
at least one instruction to store the write data using the particular persistence protocol as indicated by the protocol message.
9. The DSN memory of claim 8 , wherein the particular persistence protocol includes:
information instructing the DSN memory to make the particular revision of source data visible to subsequent requests without guaranteeing persistence of the particular revision of source data.
10. The DSN memory of claim 8 , wherein the protocol message includes:
a dispersal encoded data slice associated with the particular revision of source data.
11. The DSN memory of claim 8 , wherein the particular persistence protocol includes:
information instructing the DSN memory to make the particular revision of source data fully durable.
12. The DSN memory of claim 11 , wherein the protocol message includes:
a versioned slice name of a dispersal encoded data slice associated with the particular revision of source data; and
information instructing the DSN memory to transmit an acknowledgement message to the DS processing unit indicating that the particular revision of source data has been flushed to persistent storage.
13. The DSN memory of claim 12 , wherein the protocol message further includes:
information instructing the DSN memory to remove data slices associated with other revisions of the source data, wherein the other revisions have been stored in a cache memory.
14. The DSN memory of claim 8 , wherein the particular persistence protocol includes:
information instructing the DSN memory to:
remove previously stored versions of the source data, other than the particular revision of source data; and
clean up temporary transactions related to the particular revision of source data.
15. A distributed storage network (DSN) comprising:
a DSN memory including a plurality of storage units and a first computing core;
a distributed storage (DS) processing unit coupled to the DSN memory via a communications network, and configured transmit, to the DSN memory, a protocol message indicating a particular persistence protocol to be applied to a particular revision of source data, wherein the particular persistence protocol is selected from among of a plurality of different persistence protocols implementing different balances between durability and persistence;
the DSN memory configured to:
receive the protocol message;
obtain write data having the particular revision of source data indicated by the protocol message; and
store the write data using the particular persistence protocol as indicated by the protocol message.
16. The DSN of claim 15 , wherein the particular persistence protocol includes:
information instructing the DSN memory to make the particular revision of source data visible to subsequent requests without guaranteeing persistence of the particular revision of source data.
17. The DSN of claim 15 , wherein the protocol message includes:
a dispersal encoded data slice associated with the particular revision of source data.
18. The DSN of claim 15 , wherein the particular persistence protocol includes:
information instructing the DSN memory to make the particular revision of source data fully durable.
19. The DSN of claim 18 , wherein the protocol message includes:
a versioned slice name of a dispersal encoded data slice associated with the particular revision of source data; and
information instructing the DSN memory to transmit an acknowledgement message to the DS processing unit indicating that the particular revision of source data has been flushed to persistent storage.
20. The DSN of claim 19 , wherein the protocol message further includes:
information instructing the DSN memory to remove data slices associated with other revisions of the source data, wherein the other revisions have been stored in a cache memory.