System and method for storage system node fencing
A method, computer program product, and computing system for receiving, at a first baseboard management controller (BMC) of a first node, a fence request from a central processing unit (CPU) of the first node. The first BMC of the first node may communicate with a second BMC of a second node, wherein the first node and the second node are communicatively coupled to a plurality of storage drives. The first BMC and the second BMC may determine which node of the first node and the second node to fence from the plurality of storage drives. One of the first node and the second node may be fenced, via one of the first BMC and the second BMC, from the plurality of storage drives, thus defining a fenced node.
1. A computer-implemented method, executed on a computing device, comprising:
detecting a synchronization flow failure between the first node and the second node;
receiving, at a first baseboard management controller (BMC) of a first node, a fence request from a central processing unit (CPU) of the first node in response to detecting the synchronization flow failure;
communicating, via the first BMC of the first node, with a second BMC of a second node, wherein the first node and the second node are communicatively coupled to a plurality of storage drives;
determining, via the first BMC and the second BMC, which node of the first node and the second node to fence from the plurality of storage drives; and
fencing, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives, thus defining a fenced node.
2. The computer-implemented method of claim 1 , wherein determining, via the first BMC and the second BMC, which node of the first node and the second node to fence from the plurality of storage drives includes transmitting, via one of the first BMC and the second BMC, the fence request to the fenced node.
3. The computer-implemented method of claim 1 , wherein the first node, the second node, and the plurality of storage drives are positioned within a disk processor enclosure.
4. The computer-implemented method of claim 3 , wherein fencing, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives includes asserting a reset signal on a plurality of storage drive ports of the plurality of storage drives communicatively coupled to the fenced node.
5. The computer-implemented method of claim 1 , wherein the first node and the second node are positioned within a processor enclosure and the plurality of storage drives are positioned within a disk array enclosure separate from and communicatively coupled to the processor enclosure.
6. The computer-implemented method of claim 5 , wherein fencing, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives includes one or more of:
asserting, via one of the first BMC and the second BMC, a reset signal on a network controller configured to communicatively couple the fenced node to the plurality of storage drives; and
requesting, via one of the first BMC and the second BMC, the network controller to disable communications between the fenced node and the plurality of storage drives.
7. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:
detecting a synchronization flow failure between the first node and the second node;
receiving, at a first baseboard management controller (BMC) of a first node, a fence request from a central processing unit (CPU) of the first node in response to detecting the synchronization flow failure;
communicating, via the first BMC of the first node, with a second BMC of a second node, wherein the first node and the second node are communicatively coupled to a plurality of storage drives;
determining, via the first BMC and the second BMC, which node of the first node and the second node to fence from the plurality of storage drives; and
fencing, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives, thus defining a fenced node.
8. The computer program product of claim 7 , wherein determining, via the first BMC and the second BMC, which node of the first node and the second node to fence from the plurality of storage drives includes transmitting, via one of the first BMC and the second BMC, the fence request to the fenced node.
9. The computer program product of claim 7 , wherein the first node, the second node, and the plurality of storage drives are positioned within a disk processor enclosure.
10. The computer program product of claim 9 , wherein fencing, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives includes asserting a reset signal on a plurality of storage drive ports of the plurality of storage drives communicatively coupled to the fenced node.
11. The computer program product of claim 7 , wherein the first node and the second node are positioned within a processor enclosure and the plurality of storage drives are positioned within a disk array enclosure separate from and communicatively coupled to the processor enclosure.
12. The computer program product of claim 11 , wherein fencing, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives includes one or more of:
asserting, via one of the first BMC and the second BMC, a reset signal on a network controller configured to communicatively couple the fenced node to the plurality of storage drives; and
requesting, via one of the first BMC and the second BMC, the network controller to disable communications between the fenced node and the plurality of storage drives.
13. A computing system comprising:
a memory; and
a processor configured to receive, at a first baseboard management controller (BMC) of a first node, a fence request from a central processing unit (CPU) of the first node, wherein the processor is further configured to communicate, via the first BMC of the first node, with a second BMC of a second node, wherein the first node and the second node are communicatively coupled to a plurality of storage drives and are positioned within a processor enclosure while the plurality of storage drives are positioned within a disk array enclosure separate from and communicatively coupled to the processor enclosure, wherein the processor is further configured to determine, via the first BMC and the second BMC, which node of the first node and the second node to fence from the plurality of storage drives, and wherein the processor is further configured to fence, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives, thus defining a fenced node, wherein fencing one of the first node and the second node from the plurality of storage drives includes one or more of: asserting, via one of the first BMC and the second BMC, a reset signal on a network controller configured to communicatively couple the fenced node to the plurality of storage drives; and requesting, via one of the first BMC and the second BMC, the network controller to disable communications between the fenced node and the plurality of storage drives.
14. The computing system of claim 13 , wherein the processor is further configured to:
detect a synchronization flow failure between the first node and the second node.
15. The computing system of claim 13 , wherein determining, via the first BMC and the second BMC, which node of the first node and the second node to fence from the plurality of storage drives includes transmitting, via one of the first BMC and the second BMC, the fence request to the fenced node.
16. The computing system of claim 13 , wherein the first node, the second node, and the plurality of storage drives are positioned within a disk processor enclosure.
17. The computing system of claim 16 , wherein fencing, via one of the first BMC and the second BMC, one of the first node and the second node from the plurality of storage drives includes asserting a reset signal on a plurality of storage drive ports of the plurality of storage drives communicatively coupled to the fenced node.