Managing failover operations on a cluster of computers
Managing failover operations on a cluster of computers, including: identifying, by a failover hold module, a failure to access data storage in the cluster of computers; preventing the execution of all read operations directed to the data storage that were received after the failure to access data storage was identified; executing all write operations directed to the data storage that were received after the failure to access data storage was identified, including writing data to a cache; identifying that a failover to alternative data storage is complete; executing the held read operations, including reading data from the alternative data storage; and copying, from cache to the alternative data storage, the data written to the cache as part of the write operations.
1. An apparatus for managing failover operations on a cluster of computers, the apparatus comprising:
a computer processor; and
a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the computer processor to function by:
identifying, by a failover hold module, a failure to access data storage in the cluster of computers;
in response to identifying the failure to access data storage:
holding all read operations directed to the data storage; and
executing all write operations directed to the data storage by redirecting the write operations to a cache;
identifying that a failover to an alternative data storage is complete;
in response to identifying that the failover to the alternative data storage is complete:
copying, from cache to the alternative data storage, the data written to the cache as part of execution of the write operations; and
executing held read operations by reading data from the alternative data storage instead of the data storage to which the read operation is directed.
2. The apparatus of claim 1 wherein identifying a failure to access data storage includes identifying that a read operation failed.
3. The apparatus of claim 1 wherein identifying a failure to access data storage includes identifying that a write operation failed.
4. The apparatus of claim 1 wherein identifying a failure to access data storage includes identifying a failure to access a file system.
5. The apparatus of claim 1 wherein identifying a failure to access data storage includes identifying a failure to access a database.
6. An apparatus for managing maintenance of a cluster of computers, the apparatus comprising:
a computer processor; and
a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the computer processor to function by:
identifying, by a failover module, one or more scheduled maintenance operations to be executed on the cluster of computers;
initiating the execution of the scheduled maintenance operations;
in response to initiating the execution of the scheduled maintenance operations, holding all received data storage access requests;
determining that the scheduled maintenance operations are complete; and
in response to determining that the scheduled maintenance operations are complete, executing all held data storage access requests including executing all write requests that were received after initiating the execution of the scheduled maintenance operations.
7. The apparatus of claim 6 wherein holding all received data storage access requests further comprises storing, in a cache, all data storage access requests that were received after initiating the execution of the scheduled maintenance operations.
8. The apparatus of claim 6 wherein executing all held data storage access requests includes executing all read requests that were received after initiating the execution of the scheduled maintenance operations.
9. The apparatus of claim 6 wherein the one or more scheduled maintenance operations to be executed on the cluster of computers includes backing up data storage on the cluster of computers.