Storing data with replicated metadata in a scale-out data storage system
Computer-implemented methods for storing data with replicated metadata in a scale-out data storage system are provided. Aspects include receiving, by a first data storage node of the scale-out data storage system, a data item to be stored and storing, by the first data storage node, the data item on a storage area network in communication with the scale-out data storage system. Aspects also include generating, by the first data storage node, a metadata item corresponding to the data item and replicating the metadata item on a second data storage node of the scale-out data storage system.
1. A method for storing data with replicated metadata in a scale-out data storage system, the method comprising:
receiving, by a first data storage node of the scale-out data storage system, a data item to be stored;
storing, by the first data storage node, the data item on a storage area network in communication with the scale-out data storage system;
storing a local copy of the data item on the first data storage node;
generating, by the first data storage node, a metadata item corresponding to the data item, wherein the metadata item includes a file name of the data item, a timestamp corresponding to the data item, and a storage location of the data item in the storage area network; and
replicating only the metadata item to a second data storage node of the scale-out data storage system, wherein the data item is not replicated to the second data storage node.
2. The method of claim 1 , wherein the storage area network includes a plurality of storage devices that are configured as a Redundant Array of Independent Disks.
3. The method of claim 1 , further comprising replicating the metadata item on a third data storage node of the scale-out data storage system.
4. The method of claim 1 , further comprising:
receiving, by the second data storage node of the scale-out data storage system, a request for the data item;
obtaining a storage location of the data item in the storage area network from the metadata item corresponding to the data item; and
obtaining, by the second data storage node of the scale-out data storage system, the data item from the storage location in the storage area network.
5. The method of claim 1 , wherein the data item to be stored is received by a first client device, wherein the first data storage device is designated as a primary data storage node of the scale-out data storage system for the first client device, and wherein the second data storage node is designated as a secondary data storage device of the scale-out data storage system for the first client device.
6. A computing system having a memory having computer readable instructions and one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:
receiving, by a first data storage node of the scale-out data storage system, a data item to be stored;
storing, by the first data storage node, the data item on a storage area network in communication with the scale-out data storage system;
storing a local copy of the data item on the first data storage node;
generating, by the first data storage node, a metadata item corresponding to the data item, wherein the metadata item includes a file name of the data item, a timestamp corresponding to the data item, and a storage location of the data item in the storage area network; and
replicating only the metadata item on to a second data storage node of the scale-out data storage system, wherein the data item is not replicated to the second data storage node.
7. The computing system of claim 6 , wherein the storage area network includes a plurality of storage devices that are configured as a Redundant Array of Independent Disks.
8. The computing system of claim 6 , wherein the operations further comprise replicating the metadata item on a third data storage node of the scale-out data storage system.
9. The computing system of claim 6 , wherein the operations further comprise:
receiving, by the second data storage node of the scale-out data storage system, a request for the data item;
obtaining a storage location of the data item in the storage area network from the metadata item corresponding to the data item; and
obtaining, by the second data storage node of the scale-out data storage system, the data item from the storage location in the storage area network.
10. The computing system of claim 6 , wherein the data item to be stored is received by a first client device, wherein the first data storage device is designated as a primary data storage node of the scale-out data storage system for the first client device, and wherein the second data storage node is designated as a secondary data storage device of the scale-out data storage system for the first client device.
11. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:
receiving, by a first data storage node of the scale-out data storage system, a data item to be stored;
storing, by the first data storage node, the data item on a storage area network in communication with the scale-out data storage system;
storing a local copy of the data item on the first data storage node;
generating, by the first data storage node, a metadata item corresponding to the data item, wherein the metadata item includes a file name of the data item, a timestamp corresponding to the data item, and a storage location of the data item in the storage area network; and
replicating only the metadata item to a second data storage node of the scale-out data storage system, wherein the data item is not replicated to the second data storage node.
12. The computer program product of claim 11 , wherein the operations further comprise replicating the metadata item on a third data storage node of the scale-out data storage system.
13. The computer program product of claim 11 , wherein the operations further comprise:
receiving, by the second data storage node of the scale-out data storage system, a request for the data item;
obtaining a storage location of the data item in the storage area network from the metadata item corresponding to the data item; and
obtaining, by the second data storage node of the scale-out data storage system, the data item from the storage location in the storage area network.