Distributed storage cluster architecture
A network storage system includes a virtual file system (“VFS”) that manages the files of the network storage system, and a storage center that stores the files. The VFS and the storage center are separated, such that a client accesses the VFS to conduct file system operations and the client accesses the storage center to upload/download files. The client accesses the network storage system through one or more storage ports. The storage center includes a plurality of distributed object storage managers (DOSMs) and a storage cluster that includes a plurality of intelligent storage nodes. The network storage system includes additional storage centers at geographically disparate locations. The network storage system uses a multi-cast protocol to maintain file information at the DOSMs regarding files stored in the intelligent storage nodes, including files stored in disparate storage centers.
1. A method comprising:
in response to receiving a download request for an object, parsing a storage resource locator (“SRL”) received with the download request to extract, at the least, an SRL certificate and an encoded request;
calculating a certificate from the encoded request;
comparing the calculated certificate to the SRL certificate; and
if the calculated certificate and the SRL certificate match, then performing the download request to retrieve the object.
2. The method of claim 1 , additionally comprising:
if the calculated certificate and the SRL certificate do not match, then generating an error message.
3. The method of claim 1 , wherein said performing the download request Comprises determining if a location of the object is known, and if the location of the object is known, then a control node of a plurality of control nodes obtaining a connection with one of a plurality of intelligent storage nodes corresponding to the control node, the one intelligent storage node storing the object, end the control node transmitting the object from the intelligent storage node to a requesting node.
4. The method of claim 3 , wherein said determining if the location of the object is known comprises determining if a reference of the control node cross-references the object to at least one of the plurality of intelligent storage nodes.
5. The method of claim 3 , additionally comprising if a location of the object is not known, then the control node broadcasting a request to each of the intelligent storage nodes.
6. The method of claim 5 , additionally comprising if the object is found on one of the intelligent storage nodes, then the one intelligent storage node to broadcast identification information to each of the plurality of control nodes.
7. The method of claim 6 , additionally comprising if the object is not found on one at the intelligent storage nodes, then executing a failover procedure to locate the object on a different one of the plurality of control nodes and corresponding intelligent storage nodes.
8. An article of manufacture having stored thereon instructions, the instructions when executed by a machine, result in the following:
in response to receiving a download request for an object, parsing a storage resource locator (“SRL”) received with the download request to extract, at the least, an SRL certificate and an encoded request;
calculating a certificate from the encoded request;
comparing the calculated certificate to the SRL certificate; and
if the calculated certificate and the SRL certificate match, then performing the download request to retrieve the object.
9. The article of manufacture of claim 8 , the instructions additionally comprising:
generating an error message if the calculated certificate and the SRL certificate do not match.
10. The article of manufacture of claim 8 , wherein said instructions that result in performing the download request comprise instructions to determine that if a location of the object is known, then enabling a control node of a plurality of control nodes to obtain a connection with one of a plurality of intelligent storage nodes corresponding to the control node, the one intelligent storage node storing the object, end the control node transmitting the object from the intelligent storage node to a requesting node.
11. The article of manufacture of claim 10 , the instructions additionally resulting in the control node broadcasting a request to each of the intelligent storage nodes if a location of the object is not known.
12. The article of manufacture of claim 11 , the instructions additionally resulting in determining that if the object is found on one of the intelligent storage nodes, then the instructions resulting in the one intelligent storage node to broadcast identification information to each of the plurality of control nodes.
13. The article of manufacture of claim 12 , the instructions additionally resulting in executing a failover procedure to locate the object on a different one of the plurality of control nodes and corresponding intelligent storage nodes if the object is not found on one of the intelligent storage nodes.