Transaction interlocks for a distributed system
A method for a transactional commit in a storage unit is provided. The method includes receiving a logical record from a storage node into a transaction engine of a storage unit of the storage node and writing the logical record into a data structure of the transaction engine. The method includes writing, to a command queue of the transaction engine, an indication to perform an atomic update using the logical record and transferring each portion of the logical record from the data structure of the transaction engine to non-persistent memory of the storage unit as a committed transaction. A storage unit for a storage system is also provided.
1 . A method, comprising:
writing data into a first memory portion of solid state memory of a storage node;
writing an indication to perform an update associated with the data into a second memory portion of the solid state memory, the indication comprising one or more pointers to the data in the first memory portion, wherein the writing the data and the writing the indication are managed by a processing device of the storage node;
performing the update; and
writing an image of the data to persistent solid state memory of the storage node upon a determination that the update is complete.
2 . The method of claim 1 , wherein one of a power loss, an operating system crash, or a software process crash triggers the writing the image of the data.
3 . The method of claim 1 , wherein writing the indication comprises writing to a queue of the second memory portion a timestamp indicating portions of the data have been written to the first memory.
4 . The method of claim 1 , wherein writing the image is supported by an energy reserve.
5 . The method of claim 1 , wherein the first memory portion and the second memory portion are non-persistent memory.
6 . The method of claim 1 , wherein writing the indication comprises:
writing a description of a transaction to the second memory, wherein the description of the transaction includes a sequence number and wherein writing the description of the transaction to the second memory records a transactional commit characterized by transferring an entirety of the data to the first memory.
7 . The method of claim 1 , wherein the first memory portion, the second memory portion, and the persistent memory are within a solid state storage device of the storage node, and wherein a plurality of storage nodes are operatively coupled together.
8 . A non-transitory computer readable storage medium comprising instructions that, when executed by a processing device, cause the processing device of a storage node to:
write data into a first memory portion of solid state memory of the storage node;
write an indication to perform an update associated with the data into a second memory portion of the solid state memory, the indication comprising one or more pointers to the data in the first memory portion;
perform the update; and
write an image of the data to persistent solid state memory of the storage node upon a determination that the update is complete.
9 . The non-transitory computer readable storage medium of claim 8 , wherein one of a power loss, an operating system crash, or a software process crash triggers the writing the image of the data.
10 . The non-transitory computer readable storage medium of claim 8 , wherein writing the indication comprises writing to a queue of the second memory portion a timestamp indicating portions of the data have been written to the first memory.
11 . The non-transitory computer readable storage medium of claim 8 , wherein writing the image is supported by an energy reserve.
12 . The non-transitory computer readable storage medium of claim 8 , wherein the first memory portion and the second memory portion are non-persistent memory.
13 . The non-transitory computer readable storage medium of claim 8 , wherein writing the indication comprises:
writing a description of a transaction to the second memory, wherein the description of the transaction includes a sequence number and wherein writing the description of the transaction to the second memory records a transactional commit characterized by transferring an entirety of the data to the first memory.
14 . The non-transitory computer readable storage medium of claim 8 , wherein the first memory portion, the second memory portion, and the persistent memory are within a solid state storage device of the storage node, and wherein a plurality of storage nodes are operatively coupled together.
15 . A storage system, comprising:
a plurality of storage nodes coupled together, at least one of the plurality of storge nodes comprising non-persistent solid state memory and persistent solid state memory; and
a processing device of the at least one of the plurality of storge nodes, operatively coupled to the non-persistent solid state memory and the persistent memory, the processing device configured to:
write data into a first memory portion of solid state memory of the storage node;
write an indication to perform an update associated with the data into a second memory portion of the solid state memory, the indication comprising one or more pointers to the data in the first memory portion;
performing the update; and
write an image of the data to persistent solid state memory of the storage node upon a determination that the update is complete.
16 . The storage system of claim 15 , wherein one of a power loss, an operating system crash, or a software process crash triggers the writing the image of the data.
17 . The storage system of claim 15 , wherein writing the indication comprises writing to a queue of the second memory portion a timestamp indicating portions of the data have been written to the first memory.
18 . The storage system of claim 15 , wherein writing the image is supported by an energy reserve.
19 . The storage system of claim 15 , wherein the first memory portion and the second memory portion are non-persistent memory.
20 . The storage system of claim 15 , wherein the first memory portion, the second memory portion, and the persistent memory are within a solid state storage device of the storage node, and wherein a plurality of storage nodes are operatively coupled together.