File chunk distribution and ownership determination
A method for accessing a file in a storage system is provided. The method includes determining, for each file chunk of the file, an authority among differing storage nodes of the storage system and receiving from the authority having ownership of the file chunk, location information for the file chunk. The method includes accessing file chunks of the file as directed by each of the determined authorities.
1 . A method, comprising:
determining, for a file chunk of a file stored within a storage system, an authority having ownership of the file chunk from a plurality of authorities, among differing storage nodes of the storage system, wherein the determining comprises performing a hash calculation;
receiving from the authority having ownership of the file chunk, location information for the file chunk; and
accessing the file chunk of the file as directed by the authority having ownership of the file chunk.
2 . The method of claim 1 , wherein the hash calculation is performed on an identifier of the file and an offset of the file chunk.
3 . The method of claim 1 , wherein the file chunk of the file is associated with an offset value and wherein differing authorities are associated with differing file chunks of the file.
4 . The method of claim 1 , wherein:
a result of the hash calculation indicates the authority; and
differing storage nodes of the storage system contain differing authorities for differing file chunks of the file.
5 . The method of claim 1 , wherein determining includes, for each file chunk of the file, performing a hash calculation based on an offset of the file chunk and an inode number of the file, and wherein a result of the hash calculation indicates the authority having ownership of the file chunk.
6 . The method of claim 1 , wherein the authority directs data recovery responsive to a failure of one of the differing storage nodes.
7 . The method of claim 1 , wherein determining an authority for differing file chunks is distributed among the differing storage nodes in the storage system.
8 . A tangible, non-transitory, computer readable medium having instructions thereupon which, when executed by a processing device, cause the processing device to perform a method, comprising:
determining, for a file chunk of a file stored within a storage system, an authority having ownership of the file chunk from a plurality of authorities, among differing storage nodes of the storage system, wherein the determining comprises performing a hash calculation;
receiving from the authority having ownership of the file chunk, location information for the file chunk; and
accessing the file chunk of the file as directed by the authority having ownership of the file chunk.
9 . The computer readable medium of claim 8 , wherein the hash calculation is performed on an identifier of the file and an offset of the file chunk.
10 . The computer readable medium of claim 8 , wherein the file chunk of the file is associated with an offset value and wherein differing authorities are associated with differing file chunks of the file.
11 . The computer readable medium of claim 8 , wherein a result of the hash calculation indicates the authority, and differing storage nodes of the storage system contain differing authorities for differing file chunks of the file.
12 . The computer readable medium of claim 8 , wherein determining an authority for differing file chunks is distributed among the differing storage nodes in the storage system.
13 . The computer readable medium of claim 8 , wherein the authority directs data recovery responsive to a failure of one of the differing storage nodes.
14 . A storage system, comprising:
a plurality of storage nodes coupled as a storage cluster, wherein one of the plurality of storage nodes include a processor configured to;
determine, for a file chunk of a file stored within a storage system, an authority having ownership of the file chunk from a plurality of authorities, among differing storage nodes of the storage system, wherein the determining comprises performing a hash calculation;
receive from the authority having ownership of the file chunk, location information for the file chunk; and
access the file chunk of the file as directed by the authority having ownership of the file chunk.
15 . The storage system of claim 14 , wherein the hash calculation is performed on an identifier of the file and an offset of the file chunk.
16 . The storage system of claim 14 , wherein the file chunk of the file is associated with an offset value and wherein differing authorities are associated with differing file chunks of the file.
17 . The storage cluster of claim 14 , wherein a result of the hash calculation indicates the authority, and differing storage nodes of the storage system contain differing authorities for differing file chunks of the file.
18 . The storage cluster of claim 14 , wherein determining includes, for each file chunk of the file, performing a hash calculation based on an offset of the file chunk and an inode number of the file, and wherein a result of the hash calculation indicates the authority having ownership of the file chunk.
19 . The storage cluster of claim 14 , wherein the authority directs data recovery responsive to a failure of one of the differing storage nodes.
20 . The storage cluster of claim 14 , wherein determining an authority for differing file chunks is distributed among the differing storage nodes in the storage system.