Logical paths for unified file and block data storage
A file storage application that processes file operations is communicably connected with a block storage application that processes block operations by establishing multiple communication sessions between the file storage application and the block storage application. Multiple logical volumes provided by the block storage application are exposed to the file storage application over the multiple communication sessions established between the file storage application and the block storage application using a total number of logical paths to the logical volumes that is equivalent to the total number of the logical volumes provided by the block storage application to the file storage application.
1. A method comprising:
connecting a file storage application that processes file operations with a block storage application that processes block operations by establishing multiple iSCSI (Internet Small Computer Systems Interface) communication sessions between the file storage application and the block storage application;
exposing multiple logical volumes provided by the block storage application to the file storage application over each one of the multiple iSCSI communication sessions established between the file storage application and the block storage application, using a total number of logical paths to the logical volumes exposed over all the iSCSI communication sessions established between the file storage application and the block storage application that is equal to a total number of the logical volumes provided by the block storage application to the file storage application, wherein each logical path corresponds to a block device defined in an operating system, and wherein exposing the logical volumes to the file storage application includes exposing each individual logical volume to the file storage application through a single corresponding one of the logical paths provided by the block storage application to the file storage application; and
wherein the file storage application executes in a first node of a data storage system and processes file operations received from client machines, and wherein the block storage application executes in a second node of the data storage system and processes block operations received from the client machines.
2. The method of claim 1 , wherein exposing the logical volumes to the file storage application further comprises:
exposing a different subset of the logical volumes to the file storage application over each one of the iSCSI communication sessions.
3. The method of claim 2 , further comprising:
balancing the logical volumes across the multiple iSCSI communication sessions between the file storage application and the block storage application such that the subsets of the logical volumes exposed to the file storage application over the iSCSI communication sessions each contain an equal number of logical volumes.
4. The method of claim 3 , wherein the number of logical volumes contained in each subset of the logical volumes exposed to the file storage application over one of the iSCSI communication sessions is equal to the total number of logical volumes provided by the block storage application to the file storage application divided by a total number of the iSCSI communication sessions established between the file storage application and the block storage application.
5. The method of claim 2 , further comprising:
in response to detecting the creation of a new logical volume provided by the block storage application to the file storage application, exposing the new logical volume to the file storage application over one of the iSCSI communication sessions currently exposing a smallest subset of the logical volumes to the file storage application.
6. The method of claim 3 , further comprising:
wherein the subsets of the logical volumes exposed to the file storage application over the iSCSI communication sessions are balanced across the communication sessions by the block storage application.
7. The method of claim 3 , further comprising:
wherein the subsets of the logical volumes exposed to the file storage application over the iSCSI communication sessions are balanced across the communication sessions by the file storage application.
8. A data storage system comprising:
at least one node including processing circuitry and a memory; and
wherein the memory has program code stored thereon, wherein the program code, when executed by the processing circuitry, causes the processing circuitry to:
connect a file storage application that processes file operations with a block storage application that processes block operations by establishing multiple iSCSI (Internet Small Computer Systems Interface) communication sessions between the file storage application and the block storage application;
expose multiple logical volumes provided by the block storage application to the file storage application over each one of the multiple iSCSI communication sessions established between the file storage application and the block storage application, using a total number of logical paths to the logical volumes exposed over all the iSCSI communication sessions established between the file storage application and the block storage application that is equal to a total number of the logical volumes provided by the block storage application to the file storage application, wherein each logical path corresponds to a block device defined in an operating system, and wherein the logical volumes are exposed to the file storage application by exposing each individual logical volume to the file storage application through a single corresponding one of the logical paths provided by the block storage application to the file storage application; and
wherein the file storage application executes in a first node of the data storage system and processes file operations received from client machines, and wherein the block storage application executes in a second node of the data storage system and processes block operations received from the client machines.
9. The data storage system of claim 8 , wherein the program code, when executed by the processing circuitry, causes the processing circuitry to expose the logical volumes to the file storage application further at least in part by causing the processing circuitry to:
expose a different subset of the logical volumes to the file storage application over each one of the iSCSI communication sessions.
10. The data storage system of claim 9 , wherein the program code, when executed by the processing circuitry, further cause the processing circuitry to:
balance the logical volumes across the multiple iSCSI communication sessions between the file storage application and the block storage application such that the subsets of the logical volumes exposed to the file storage application over the iSCSI communication sessions each contain an equal number of logical volumes.
11. The data storage system of claim 10 , wherein the number of logical volumes contained in each subset of the logical volumes exposed to the file storage application over one of the iSCSI communication sessions is equal to the total number of logical volumes provided by the block storage application to the file storage application divided by a total number of the communication sessions established between the file storage application and the block storage application.
12. The data storage system of claim 9 , wherein the program code, when executed by the processing circuitry, further causes the processing circuitry to:
in response to detecting the creation of a new logical volume provided by the block storage application to the file storage application, expose the new logical volume to the file storage application over one of the iSCSI communication sessions currently exposing a smallest subset of the logical volumes to the file storage application.
13. The data storage system of claim 10 , further comprising:
wherein the subsets of the logical volumes exposed to the file storage application over the iSCSI communication sessions are balanced across the communication sessions by the block storage application.
14. The data storage system of claim 10 , further comprising:
wherein the subsets of the logical volumes exposed to the file storage application over the iSCSI communication sessions are balanced across the communication sessions by the file storage application.
15. A computer program product including a non-transitory computer readable medium having instructions stored thereon, wherein the instructions, when executed on processing circuitry, cause the processing circuitry to perform the steps of:
connecting a file storage application that processes file operations with a block storage application that processes block operations by establishing multiple iSCSI (Internet Small Computer Systems Interface) communication sessions between the file storage application and the block storage application;
exposing multiple logical volumes provided by the block storage application to the file storage application over each one of the multiple iSCSI communication sessions established between the file storage application and the block storage application, using a total number of logical paths to the logical volumes exposed over all the iSCSI communication sessions established between the file storage application and the block storage application that is equal to a total number of the logical volumes provided by the block storage application to the file storage application, wherein each logical path corresponds to a block device defined in an operating system, and wherein exposing the logical volumes to the file storage application includes exposing each individual logical volume to the file storage application through a single corresponding one of the logical paths provided by the block storage application to the file storage application; and
wherein the file storage application executes in a first node of a data storage system and processes file operations received from client machines, and wherein the block storage application executes in a second node of the data storage system and processes block operations received from the client machines.
16. The method of claim 1 , wherein the multiple iSCSI communication sessions between the file storage application and the block storage application are established by a single iSCSI initiator in the file storage application.
17. The method of claim 1 , wherein the multiple iSCSI communication sessions between the file storage application and the block storage application are established by multiple iSCSI initiators in the file storage application, and wherein each one of the iSCSI communication sessions corresponds to and is established by a single one of the iSCSI initiators.
18. The method of claim 1 , wherein the file storage application executes in a first node of a data storage system and the block storage application executes in at least a second node of the data storage system.