Distributed storage system
A first node group including at least three nodes is predefined in a distributed storage system. Each node of the first node group is configured to send data blocks stored in storage devices managed by the node to other nodes belonging to the first node group. A first node is configured to receive data blocks from two or more other nodes in the first node group. The first node is configured to create a redundant code using a combination of data blocks received from the two or more other nodes and store the created redundant code to a storage device different from storage devices holding the data blocks used to create the redundant code. Combinations of data blocks used to create at least two redundant codes in redundant codes created by the first node are different in combination of logical addresses of constituent data blocks.
1. A distributed storage system comprising:
a plurality of sites communicating via a network,
wherein each of the plurality of sites includes:
a plurality of nodes; and
storage devices for storing data,
wherein a first node of a first site of the plurality of sites is configured to:
receive user data together with a write request from a host and store the received user data in the storage devices of the first site; and
transmit data for redundant data of the user data to a second site of the plurality of sites,
wherein a second node of the second site is configured to receive the data for redundant data from the first node and store the redundant data in the storage devices at the second site, and
wherein the first node is configured to receive a read request for the user data from the host, read the user data from the storage devices of the first site and transmit the user data to the host.
2. The distributed storage system according to claim 1 ,
wherein the data for redundant data transmitted from the first node to the second node is mirror data,
wherein the redundant data stored in the storage devices at the second site is the mirror data, and
wherein the first node is configured to crate parity data from the user data and store the parity data in the storage devices of the first site.
3. The distributed storage system according to claim 1 ,
wherein the second node is configured to create parity data from the data for redundant data received from the first node and store the parity data in the storage devices at the second site.
4. The distributed storage system according to claim 3 ,
wherein the second node is configured to:
receive data from a third node of a third site; and
create parity data from the data for redundant data received from the first node and the data received from the third node, and store the parity data in the storage devices at the second site.
5. The distributed storage system according to claim 3 ,
wherein, in a case where a failure occurs at the first site, the user data stored at the first site is rebuilt based on the parity data stored at the second site and user data used to generate the parity data and stored at a third site.
6. The distributed storage system according to claim 1 , further comprising a plurality of site groups, each of the site groups including a plurality of sites,
wherein the first node is included in a first site group, and
wherein the first node is configured to transmit data for storing redundant data of the user data at a second site group different from the first site group to the second site group.
7. The distributed storage system according to claim 1 , further comprising site state management information indicating states of the plurality of sites,
wherein the second node is configured to:
detect a failure at the first site with reference to the site state management information; and
rebuild the user data stored at the first site using the redundant data stored at the second cited in response to detection of the failure at the first site.
8. The distributed storage system according to claim 1 ,
wherein the first node is configured to transmit the data for redundant data to the second site in synchronization with the receipt of the write request and the user data.
9. The distributed storage system according to claim 1 ,
wherein, in a case where the user data is data for updating existing data, the first node is configured to store the user data in a storage area different from a storage area of the existing data, and
wherein the first node is configured to transmit the data for redundant data to the second site asynchronously with the receipt of the write request and the user data.
10. A method in a distributed storage system comprising:
a plurality of sites communicating via a network,
wherein each of the plurality of sites includes:
a plurality of nodes; and
storage devices for storing data,
the method comprising the steps of:
receiving, by a first node of a first site of the plurality of sites, user data together with a write request from a host and storing the received user data in the storage devices of the first site; and
transmitting, by the first node, data for redundant data of the user data to a second site of the plurality of sites,
receiving, by a second node of the second site, the data for redundant data from the first node and storing the redundant data in the storage devices at the second site, and
receiving, by the first node, a read request for the user data from the host, reading the user data from the storage devices of the first site and transmitting the user data to the host.