Storage system with hybrid logical volumes utilizing in-band hinting
Systems and methods that combine a silicon storage volume with a hard disk drive (HDD) volume in a storage system that uses in band hinting to select the volume for storing actual data and meta data based on the demands of high performance computing are described. A storage system with an application processor, a storage processor, a silicon storage volume including a plurality of SSDs and an HDD with a much larger number of HDDs efficiently handles write requests from a high performance computer. A high performance computing device prepares internal meta data and actual data write requests by specifying in the internal write requests whether the data is actual data or meta data using an existing field. The storage processor receives the internal write requests and manages storage of the meta data in the silicon storage volume and actual data in the HDD volume.
1. A data storage system comprising:
an application processor, a storage processor, and random access memory (RAM) coupled to a bus;
a plurality of solid state drives (SSDs) comprising a silicon storage volume, the silicon storage volume coupled to the bus;
a plurality of hard disk drive (HDD) devices comprising an HDD volume, HDD volume coupled to the bus;
the application processor and the storage processor each having instructions which when executed cause the application processor and storage processor to perform actions including:
the application processor receiving a write request;
the application processor preparing internal write requests based on the write request;
the storage processor processing the internal write request including
checking a known location in the internal write request for a designation of a kind of data,
when the kind of data is actual data, writing the actual data from the write request to the HDD volume,
when the kind of data is meta data, translating a logical block address according to a table and writing the meta data to the SSD.
2. The data storage system of claim 1 wherein the known location is a command descriptor block.
3. The data storage system of claim 1 wherein the storage processor is a Redundant Array of Independent Disks (RAID) processor.
4. The data storage system of claim 1 wherein the silicon storage volume and the HDD volume conform to a Redundant Array of Independent Disks (RAID) configuration.
5. The data storage system of claim 1 wherein the storage processor has software which when executed causes the storage processor to translate a meta data logical block address (LBA) from an HDD volume LBA to an silicon storage volume LBA using a table.
6. The data storage system of claim 1 wherein the SSD volume comprises from one to four SSDs and wherein the HDD volume comprises from 32 to 127 HDDs.
7. A method of processing data write requests comprising:
receiving a write request;
an application processor preparing an internal write request based on the write request;
a storage processor processing the internal write request including writing actual data to a hard disk drive (HDD) volume and meta data to a silicon storage volume according to a kind of data specified in a known location in the write request, wherein the silicon storage volume comprises at least one solid state drive (SSD) and the HDD volume comprises a plurality HDDs.
8. The method of claim 7 wherein the known location is a command descriptor block.
9. The method of claim 7 wherein the storage processor is a Redundant Array of Independent Disks (RAID) processor.
10. The method of claim 7 wherein the silicon storage volume and the HDD volume conform to a Redundant Array of Independent Disks (RAID) configuration.
11. The method of claim 7 further comprising:
the storage processor translating a meta data logical block address (LBA) from an HDD volume LBA to a silicon storage volume LBA using a table.
12. The method of claim 7 wherein the silicon storage volume comprises from one to 64 SSDs and wherein the HDD volume comprises from 1280 to 5660 HDDs.