Managing data storage in a communications system
Methods and apparatus are provided. In an example aspect, a method of managing data storage in a communication system is provided. The communication system includes a plurality of clusters of network nodes, and the network nodes in each cluster of network node include one or more data storage nodes. The method comprises receiving data to be stored from a data source node, generating, from the data to be stored, a first subset of erasure coded chunks, causing the first subset of erasure coded chunks to be stored in one or more of the data storage nodes in at least one first cluster of the plurality of clusters, and sending, to a second cluster of the plurality of clusters, the data to be stored.
1 . A method of managing data storage in a communication system, wherein the communication system includes a plurality of clusters of network nodes, wherein the network nodes in each cluster of network node include one or more data storage nodes, the method comprising:
receiving data to be stored from a data source node;
generating, from the data to be stored, a first subset of erasure coded chunks;
causing the first subset of erasure coded chunks to be stored in one or more of the data storage nodes in at least one first cluster of the plurality of clusters;
determining whether to send, to a second cluster, the data to be stored or a second subset of erasure coded chunks different to the first subset of erasure coded chunks by determining whether a size of the data to be stored is smaller than a size of the second subset of erasure coded chunks;
sending, to the second cluster, the data to be stored in response to determining that the size of the data to be stored is smaller than the size of the second subset of erasure coded chunks; and
sending, to the second cluster, the second subset of erasure coded chunks in response to determining that the size of the data to be stored is larger than the size of the second subset of erasure coded chunks.
2 . Apparatus for managing data storage in a communication system, wherein the communication system includes a plurality of clusters of network nodes, wherein the network nodes in each cluster of network nodes include one or more data storage nodes, the apparatus comprising a processor and a memory, the memory containing instructions executable by the processor such that the apparatus is operable to:
receive data to be stored from a data source node;
generate, from the data to be stored, a first subset of erasure coded chunks;
cause the first subset of erasure coded chunks to be stored in one or more of the data storage nodes in at least one first cluster of the plurality of clusters;
determine whether to send, to a second cluster, the data to be stored or a second subset of erasure coded chunks different to the first subset of erasure coded chunks by determining whether a size of the data to be stored is smaller than a size of the second subset of erasure coded chunks;
send, to the second cluster, the data to be stored in response to determining that the size of the data to be stored is smaller than the size of the second subset of erasure coded chunks; and
send, to the second cluster, the second subset of erasure coded chunks in response to determining that the size of the data to be stored is larger than the size of the second subset of erasure coded chunks.
3 . The apparatus of claim 2 , wherein the memory contains instructions executable by the processor such that the apparatus is operable to determine whether to send, to the second cluster, the data to be stored or the second subset of erasure coded chunks by receiving an indication of whether to send, to the second cluster, the data to be stored or the second subset of erasure coded chunks from a data storage control node.
4 . The apparatus of claim 3 , wherein the memory contains instructions executable by the processor such that the apparatus is operable to receive, from the data storage control node, an indication identifying the second subset of erasure coded chunks when the indication of whether to send, to in the second cluster, the data to be stored or the second subset of erasure coded chunks comprises an indication to send the second subset of erasure coded chunks.
5 . The apparatus of claim 2 , wherein the memory contains instructions executable by the processor such that the apparatus is operable to receive, from a data storage control node, at least one of:
an indication identifying a data storage handling node in the second cluster;
an indication of the first subset of erasure coded chunks; or
an indication identifying a respective storage node in the at least one first cluster for each erasure coded chunk of the first subset of erasure coded chunks.