DECENTRALIZING A HADOOP CLUSTER
In some examples, a distributed file system is described. The distributed file system may include multiple data nodes and a director unit. The multiple data nodes may each include one or more data blocks. The director unit may include multiple master nodes configured in a peer-to-peer distributed architecture and operably coupled to the multiple data nodes. Each of the master nodes may be configured to receive a task related to managing data with respect to the distributed file system; to manage a distribution of the task among one or more of the plurality of master nodes; and to communicate a task status and a status of at least a part of the distributed file system to each of the other master nodes.
1 . A distributed file system comprising:
a plurality of data nodes that each comprises one or more data blocks; and
a director unit including a plurality of master nodes configured in a peer-to-peer distributed architecture and operably coupled to the plurality of data nodes, each master node of the plurality of master nodes configured to:
receive a task related to managing data with respect to the distributed file system;
manage a distribution of the task among one or more of the plurality of master nodes; and
communicate a task status and a status of at least a part of the distributed file system to each of the other plurality of master nodes.