Methods and systems for user space storage management
A method for accessing data where the method includes receiving, by an access client executing in user space, a request to read data that includes a file system identifier and an offset, identifying a storage server associated with the data, generating a command to copy the data to memory, and sending the command to the storage server.
1. A method for accessing data, comprising:
receiving, by an access client executing in user space, a request to read data, wherein the request to read data comprises a file system identifier and an offset;
identifying, by the access client, a storage server associated with the data, wherein identifying the storage server comprises:
performing a lookup, in a logical volume layout in the user space, to identify a logical volume associated with the file system identifier;
identifying a block group, in the logical volume, that matches the offset; and
identifying the storage server associated with the block group;
generating, by the access client a command to copy the data to memory;
sending the command directly from the access client to the storage server, and
wherein the logical volume layout comprises a data structure comprising a listing of one or more logical volumes, wherein each listing specifies a volume identifier, one or more block groups, and one or more associated storage server identifiers.
2. The method of claim 1 , wherein the logical volume is an object generated by the access client.
3. The method of claim 1 , wherein the access client is executing on a first node, wherein the first node comprises the memory.
4. The method of claim 3 , wherein the storage server is executing on a second node operatively connected to the first node, and wherein the second node comprises storage, wherein the storage comprises the data.
5. The method of claim 4 , wherein the command to copy the data comprises:
an address of the second node;
an address of the first node; and
the offset.
6. A non-transitory computer readable medium comprising instructions which, when executed by a computer processor, enables the computer processor to perform a method for accessing data, the method comprising:
receiving, by an access client executing in user space, a request to read data, wherein the request to read data comprises a file system identifier and an offset;
identifying, by the access client, a storage server associated with the data, wherein identifying the storage server comprises:
performing a lookup, in a logical volume layout in the user space, to identify a logical volume associated with the file system identifier;
identifying a block group, in the logical volume, that matches the offset; and
identifying the storage server associated with the block group;
generating, by the access client, a command to copy the data to memory;
sending the command directly from the access client to the storage server, and
wherein the logical volume layout comprises a data structure comprising a listing of one or more logical volumes, wherein each listing specifies a volume identifier, one or more block groups, and one or more associated storage server identifiers.
7. The non-transitory computer readable medium of claim 6 , wherein the logical volume is an object generated by the access client.
8. The non-transitory computer readable medium of claim 6 , wherein the access client is executing on a first node, wherein the first node comprises the memory.
9. The non-transitory computer readable medium of claim 8 , wherein the storage server is executing on a second node operatively connected to the first node, and wherein the second node comprises storage, wherein the storage comprises the data.
10. The non-transitory computer readable medium of claim 9 , wherein the command to copy the data comprises:
an address of the second node;
an address of the first node; and
the offset.
11. A node, comprising:
memory; and
a processor, wherein the processor is configured to perform a method, comprising:
receiving, by an access client executing in user space, a request to read data, wherein the request to read data comprises a file system identifier and an offset;
identifying, by the access client, a storage server associated with the data, wherein identifying the storage server comprises:
performing a lookup, in a logical volume layout in the user space, to identify a logical volume associated with the file system identifier;
identifying a block group, in the logical volume, that matches the offset; and
identifying the storage server associated with the block group;
generating, by the access client, a command to copy the data to the memory;
sending the command directly from the access client to the storage server, and
wherein the logical volume layout comprises a data structure comprising a listing of one or more logical volumes, wherein each listing specifies a volume identifier, one or more block groups, and one or more associated storage server identifiers.
12. The node of claim 11 , wherein the logical volume is an object generated by the access client.
13. The node of claim 11 , wherein storage server is executing on a second node operatively connected to the first node, and wherein the second node comprises storage, wherein the storage comprises the data.
14. The node of claim 13 , wherein the command to copy the data comprises:
an address of the second node;
an address of the node; and
the offset.