Apparatus, system, and method for a front-end, distributed raid
View Patent ↗An apparatus, system, and method are disclosed for a front-end, distributed redundant array of independent drives (“RAID”). A storage request receiver module receives a storage request to store object or file data in a set of autonomous storage devices forming a RAID group. The storage devices independently receive storage requests from a client over a network, and one or more of the storage devices are designated as parity-mirror storage devices for a stripe. The striping association module calculates a stripe pattern for the data. Each stripe includes N data segments, each associated with N storage devices. The parity-mirror association module associates a set of the N data segments with one or more parity-mirror storage devices. The storage request transmitter module transmits storage requests to each storage device. Each storage request is sufficient to store onto the storage device the associated data segments. The storage requests are substantially free of data.
1. A method for providing high performance, distributed storage, comprising:
receiving a storage request at an autonomous storage device in a storage device set comprising a plurality of storage devices, the storage request identifying one or more data segments of a data stripe pattern assigned to the storage device by a front-end controller; and
the autonomous storage device communicating the identified data segments with a storage client independently of the front-end controller.
2. The method of claim 1 , wherein the autonomous storage device communicates data directly with the storage client by way of one of a bus, direct memory access, remote direct memory access, network broadcast, network multicast, network anycast, and network unicast.
3. The method of claim 1 , wherein the identified data segments comprise parity data of the data stripe pattern.
4. The method of claim 1 , wherein the storage device set comprises a redundant array of independent disks (“RAID”) group, the method further comprising:
maintaining indicators of the storage devices in the RAID group on the autonomous storage device; and
reconstructing the RAID group using the indicators of the autonomous storage device.
5. The method of claim 1 , further comprising:
receiving a second, different storage request at the autonomous storage device pertaining to a client storage request that is independent of the storage device set; and
storing data of the second storage request on the autonomous storage device with the identified data segments.
6. The method of claim 1 , further comprising:
receiving a second storage request at the autonomous storage device referencing a second storage device set comprising a different plurality of storage devices, wherein the second storage request identifies one or more second data segments of a second data stripe pattern assigned to the storage device by the front-end controller; and
the autonomous storage device transferring the second identified data segments with a storage client independently of the front-end controller.
7. The method of claim 1 , further comprising:
storing the identified data segments sequentially by order of processing on a solid-state storage media of the autonomous storage device;
marking storage divisions of the solid-state storage media with respective sequence indicators; and
reconstructing an index of data stored on the autonomous storage device based on the sequence indicators.
8. The method of claim 1 , wherein the autonomous storage device comprises a plurality of solid-state storage elements, each solid-state storage element comprising a plurality of storage divisions, the method further comprising storing the identified data segments on two or more of the solid-state storage elements in parallel.
9. The method of claim 1 , further comprising:
including data of the identified data segments in an error-correcting code (ECC) block that comprises an error-correcting code configured to correct an error in the ECC block; and
storing a first portion of the ECC block on a first one of a plurality of solid-state storage elements; and
storing a second portion of the ECC block on a second one of the plurality of solid-state storage elements.
10. An autonomous storage device in storage device set comprising a plurality of storage devices, the autonomous storage device comprising:
a storage request receiver configured to receive a storage request identifying one or more data segments of a data stripe pattern assigned to the autonomous storage device by a front-end controller; and
a storage controller configured to communicate the identified data segments with a storage client independent of the front-end controller.
11. The autonomous storage device of claim 10 , wherein the autonomous storage device communicates data directly with the storage client by way of one of a bus, direct memory access, remote direct memory access, network broadcast, network multicast, network anycast, and network unicast.
12. The autonomous storage device of claim 10 , wherein the identified data segments comprise parity data of the data stripe pattern.
13. The autonomous storage device of claim 10 , wherein the storage device set comprises a redundant array of independent disks (“RAID”) group, and wherein the autonomous storage device maintains indicators of storage devices in the RAID group and is configured to reconstruct the RAID group using the indicators.
14. The autonomous storage device of claim 10 , further comprising a sequential storage module to store the identified data segments on a non-volatile storage media with data that does not pertain to the storage device set.
15. The autonomous storage device of claim 10 , further comprising a sequential storage module to mark storage divisions of a non-volatile storage media of the autonomous storage device with respective sequence indicators to indicate an order of storage operations performed on the autonomous storage device.
16. The autonomous storage device of claim 10 , further comprising:
a plurality of solid-state storage elements, each solid-state storage element comprising a plurality of storage divisions; and
a sequential storage module configured to store the identified data segments on two or more of the solid-state storage elements in parallel.
17. The autonomous storage device of claim 10 , further comprising:
an ECC generator to generate an error-correcting code (ECC) block comprising data of the identified data segments and an error-correcting code; and
a sequential storage module configured to store a first portion of the ECC block on a first one of a plurality of solid-state storage elements and a second portion of the ECC block on a second one of the plurality of solid-state storage elements.
18. A storage system, comprising:
a front-end controller; and
a plurality of autonomous storage devices in a storage device set, each autonomous storage device comprising:
a storage request receiver to receive a storage request identifying one or more data segments of a data stripe pattern that are assigned to the autonomous storage device by a front-end controller, and
a storage controller configured to communicate the identified data segments assigned to the respective autonomous storage device with a storage client independent of the front-end controller.
19. The storage system of claim 18 , wherein the front-end controller operates on one of the autonomous storage devices in the storage device set.
20. The storage system of claim 18 , wherein each of the autonomous storage devices in the storage device set communicate data directly with the storage client in response to a storage request from the front-end controller by way of one of a bus, direct memory access, remote direct memory access, network broadcast, network multicast, network anycast, and network unicast.