Compressor resources for high density storage units
View Patent ↗In various embodiments, a high-density solid-state storage unit includes a plurality of flash cards. Each flash card has a flash controller that incorporates one or more resources for facilitating compression and decompression operations. In one aspect, data reduction and data reconstruction operations can be performed in-line as data is stored to and retrieved from flash memory. In another aspect, data reduction and data reconstruction operations can be performed as a service. Any one of the plurality of flash cards can be used to provide data reduction or data reconstruction services on demand for any type of data, including system data, libraries, and firmware code.
1. A solid-state storage unit comprising:
a plurality of solid-state storage devices configured to store data;
each solid-state storage device comprising a plurality of flash modules, and its own compressor resource and decompressor resource, wherein the compressor resource is configured to perform compressor data services and the decompressor resource is configured to perform decompressor data services;
circuitry configured to store data to and retrieve data from each of the plurality of solid-state storage devices;
wherein the solid state storage unit is configured to at least one of:
in response to at least one of a scheduling algorithm and a load-balancing algorithm for the compressor data services, send data from a computing device to one of the plurality of solid-state storage devices, perform decompressor data services on the data in a different one of the plurality of solid-state storage devices, and store the compressed data in a different one of the plurality of solid-state storage devices; and
in response to at least one of a scheduling algorithm and a load-balancing algorithm for the decompressor data services, retrieve data from one of the plurality of solid-state storage devices, perform decompressor data services on the data in a different one of the plurality of solid-state storage devices, and send the decompressed data to the computing device.
2. The solid-state storage unit of claim 1 wherein the compressor data services include at least one or more of data compression, data reduction and data deduplication.
3. The solid-state storage unit of claim 1 wherein the decompressor data services include at least one or more of data decompression, data reconstruction and data reconstitution.
4. The solid-state storage unit of claim 1 wherein the solid state storage devices are flash cards.
5. A high-density solid-state storage system comprising: a processor;
a plurality of solid-state storage devices, each solid-state storage device having its own controller device and a plurality of flash modules, the controller device configured to control data transfers between the processor and the plurality of flash modules, the controller further configured to provide compressor or decompressor data services to the plurality of flash modules; and
a memory configured to store a set of instructions which when executed by the processor configure the processor to at least one of:
in response to at least one of a scheduling algorithm and a load-balancing algorithm for the compressor data services, send data from the processor to one of the plurality of solid-state storage devices, instruct the controller on the one of the plurality of solid-state storage devices to perform compressor data services on the data, and instruct a different one of the plurality of solid-state storage devices to store the compressed data;
in response to at least one of a scheduling algorithm and a load-balancing algorithm for the decompressor data services, instruct one of the plurality of solid-state storage devices to retrieve data, instruct the controller of a different one of the plurality of solid-state storage devices to perform decompressor data services on the data, and send the decompressed data to the processor.
6. The high-density solid-state storage system of claim 5 wherein the compressor data services provided to the processor include at least one or more of data compression, data reduction and data deduplication.
7. The high-density solid-state storage system of claim 5 wherein the decompressor data services provided to the processor include at least one or more of data decompression, data reconstruction and data reconstitution.
8. The high-density solid-state storage system of claim 5 wherein the solid state storage devices are flash cards.
9. A method comprising:
managing a plurality of solid-state storage devices configured to store data; each solid-state storage devices comprising a plurality of flash modules, and its own compressor resource and decompressor resource, wherein the compressor resource is configured to perform compressor data services and the decompressor resource is configured to perform decompressor data services, wherein each of the plurality of solid-state storage devices is configured to store and retrieve data;
performing at least one of the following:
in response to at least one of a scheduling algorithm and a load-balancing algorithm for the compressor data services, sending data from a processor to one of the plurality of solid-state storage devices, performing compressor data services on the data in the one of the plurality of solid-state storage devices, and storing the compressed data in a different one of the plurality of solid-state storage devices;
in response to at least one of a scheduling algorithm and a load-balancing algorithm for the decompressor data services, retrieving data from one of the plurality of solid-state storage devices, performing decompressor data services on the data in a different one of the plurality of solid-state storage devices, and sending the decompressed data to the processor.
10. The method of claim 9 wherein the compressor data services provided to the processor include at least one or more of data compression, data reduction and data deduplication.
11. The method of claim 9 wherein the decompressor data services provided to the processor include at least one or more of data decompression, data reconstruction and data reconstitution.
12. The method of claim 9 wherein to select one of the plurality of solid-state storage devices the processor is configured to determine availability of the compressor or decompressor data services of each of the plurality of solid-state storage devices.
13. The method of claim 9 wherein the sod state storage devices are flash cards.