Method and system for global namespace with consistent hashing

1. A method for writing data to a storage pool, comprising:

receiving a virtual identifier (ID) and an offset for an object, wherein the virtual ID comprises an object ID and a node ID;

obtaining, using the node ID, an object layout (OL) for the object from a first storage server;

generating a value using the object ID and the offset;

identifying a second storage server in the storage pool using a global namespace layout (GL), the OL, and the value; and

issuing a write request to write data to the object in the second storage server, wherein the write request comprises the object ID and the offset.

2. The method of claim 1 , wherein identifying the second storage server comprises using consistent hashing.

3. The method of claim 1 , wherein the storage pool comprises a plurality of storage servers, wherein the GL specifies which of the plurality of storage servers were writeable for each GL sequence number and how writes were distributed across the plurality of storage servers writeable for each GL sequence.

4. The method of claim 1 ,

wherein the OL specifies an OL sequence number, wherein the OL sequence number is set when the object is created, wherein the OL sequence number corresponds to a GL sequence number when the object was created, and

wherein identifying the second storage server in the storage pool comprises:

identifying a GL sequence number from the GL using the OL sequence number;

determining, using the GL, which of the plurality of storage servers was writeable at the GL sequence number to obtain a set of storage servers, and

identifying the second storage server from the set of storage servers.

5. The method of claim 1 , wherein identifying the second storage server in the storage pool comprises using consistent hashing and information from the GL about the how writes were distributed across the storage pool.

6. The method of claim 1 , wherein obtaining the OL from the first storage server comprises:

generating a second value using the virtual ID and a special offset, and

obtaining the OL from the first storage server using the second value.

7. The method of claim 1 , wherein the OL comprises an OL sequence number, the virtual ID, and a stripe width.

8. The method of claim 1 , wherein the GL comprises:

a first server entry for the first storage server comprising:

the node ID identifying the first storage server,

a first node sequence number corresponding to a GL sequence number when the first storage server was added to the storage pool, and

a node point used to determine which write requests are serviced by the first storage server.

9. The method of claim 1 , further comprising:

determining that the second storage server does not include a copy of the OL;

issuing a request to store the OL to the second storage server.

10. The method of claim 1 , further comprising:

receiving a second virtual ID and a second offset for a second object, wherein the virtual ID comprises a second object ID and a second node ID;

obtaining, using the second node ID, a second OL for the second object from the third storage server;

generating a second value using the second object ID and the second offset;

identifying the second storage server in the storage pool using the GL, the second OL, and the second value; and

issuing a second write request to write data to the second object in the second storage server, wherein the second write request comprises the second object ID and the second offset.

11. The method of claim 1 , further comprising:

receiving a second virtual ID and an offset for a second object, wherein the second virtual ID comprises a second object ID and a second node ID;

obtaining, using the second node ID, a second OL for the second object from the second storage server;

generating a second value using the second object ID and the second offset;

identifying the first storage server in the storage pool using the GL, the second OL, and the second value; and

issuing a second write request to write data to the second object in the first storage server, wherein the second write request comprises the second object ID and the second offset.

12. A method for reading data to a storage pool, comprising:

receiving a virtual ID and an offset for an object, wherein the virtual ID comprises a node ID;

obtaining, using the node ID, an object layout (OL) for the object from a first storage server;

generating a value using the object ID and the offset ID;

identifying a second storage server in the storage pool using a global namespace layout (GL), the OL, and the value; and

issuing a read request to read data from the object in the second storage server, wherein the write request comprises the object ID and the offset.

13. The method of claim 12 , wherein the identifying the second storage server comprises:

identifying a set of storage servers from a plurality of storage servers in the storage pool using the GL and an OL sequence number from the OL;

identifying the second storage server from the set of storage servers using the value.

14. The method of claim 12 , wherein generating the value comprises:

generating an offset ID using the offset and a stripe width, wherein the OL comprises the stripe width,

wherein the value is generated using the object ID and the offset ID.

15. The method of claim 12 , wherein identifying the second storage server comprises using consistent hashing.

16. A method for writing data to a storage pool, comprising:

receiving a request for a new object;

selecting a storage server from the storage pool, wherein the storage server is identified using a Node ID;

requesting the storage server to generate a virtual ID, wherein the virtual ID comprises the node ID and an object ID for the object;

generating an object layout (OL) for the object using the virtual ID;

storing the OL in the storage server;

after storing the OL in the storage server:

receiving a write request to write data to the object, wherein the write request comprises the object ID and an offset;

generating a value using the object ID and the offset ID;

identifying a second storage server in the storage pool using a global namespace layout (GL), the OL, and the value; and

issuing a write request to write the data to the object in the second storage server, wherein the write request comprises the object ID and the offset.

17. The method of claim 16 , wherein selecting the storage server from the storage pool comprises using at least one selected from a group consisting of randomly selecting the storage server and selecting the storage server using a round robin algorithm.

18. The method of claim 16 , wherein the node ID uniquely identifies the storage server in the storage pool.

19. The method of claim 16 , wherein storing the OL in the storage server comprises:

generating a second value using the virtual ID and a special offset to obtain a second value; and

storing the OL in the storage server using the second value.

20. The method of claim 16 , wherein generating the OL further comprises using a global sequence number from the GL.