Heterogeneous recovery in a redundant memory system
Providing heterogeneous recovery in a redundant memory system that includes a memory controller, a plurality of memory channels in communication with the memory controller, an error detection code mechanism configured for detecting a failing memory channel, and an error recovery mechanism. The error recovery mechanism is configured for receiving notification of the failing memory channel, for performing a recovery operation on the failing memory channel while other memory channels are performing normal system operations, for bringing the recovered channel back into operational mode with the other memory channels for store operations, for continuing to mark the recovered channel to guard against stale data, for removing any stale data after the recovery operation is complete, and for removing the mark on the recovered channel to allow the normal system operations with all of the memory channels, the removing in response to the removing any stale data being complete.
1. A memory system for detecting a failing memory channel and performing a recovery operation on a failing memory channel, comprising:
a memory controller; and
a plurality of memory channels in communication with the memory controller;
the memory system configured to perform a method comprising:
receiving notification of the failing memory channel;
performing the recovery operation on the failing memory channel the recovery operation including performing clock calibration on the failing memory channel while other memory channels of the plurality of memory channels are performing normal system operations, and performing data calibration on the plurality of memory channels based on completion of the clock calibration on the failing memory channel;
bringing the recovered channel back into operational mode with the other memory channels for store operations;
continuing to mark the recovered channel to guard against stale data;
removing any stale data after the recovery operation is complete; and
removing the mark on the recovered channel to allow the normal system operations with all of the memory channels, the removing based on completing the removing any stale data.
2. The memory system of claim 1 , wherein the error detection code mechanism utilizes a cyclical redundancy code as input to the detecting.
3. The memory system of claim 1 , wherein there are five memory channels.
4. The memory system of claim 1 , wherein the recovery operation further comprises performing lane repair on a lane in the failing memory channel.
5. The memory system of claim 1 , wherein the recovery operation further comprises transmitting a failure alert to the memory controller.
6. The memory system of claim 1 , further comprising at least one of a forward progress monitor and an interface monitor for determining actions performed by the recovery operation.
7. A computer program product for detecting a failing memory channel and performing a recovery operation, comprising a non-transitory tangible storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising:
receiving a notification that a memory channel has failed, the memory channel one of a plurality of memory channels in a memory system;
performing the recovery operation on the failing memory channel, the recovery operation including performing clock calibration on the failing memory channel while other memory channels of the plurality of memory channels are performing normal system operations, and performing data calibration on the plurality of memory channels based on completion of the clock calibration on the failing memory channel;
removing any stale data based on the recovery operation being completed, the removing while the other memory channels are performing normal system operations; and
continuing normal system operations with all of the memory channels based on the removing any stale data being completed.
8. The computer program product of claim 7 , wherein there are five memory channels.
9. The computer program product of claim 7 , wherein the recovery operation further comprises performing lane repair on a lane in the failing memory channel.
10. The computer program product of claim 7 , wherein the recovery operation further comprises transmitting a failure alert to the memory controller.
11. The system of claim 1 , wherein the recovery operation further comprises performing a reset of the plurality of memory channels and an operation retry.
12. The computer program product of claim 7 , wherein the recovery operation further comprises performing a reset of the plurality of memory channels and an operation retry.