Method and apparatus for managing storage system
The present invention discloses a method and device for managing a storage system. Specifically, in one embodiment of the present invention, there is proposed a method for managing a storage system, the storage system comprising a buffer device and a plurality of storage devices. The method comprises: receiving an access request with respect to the storage system; determining a storage device among the plurality of storage devices has been failed; and in response to the access request being an access request with respect to the failed storage device, serving the access request with data in the buffer device so as to reduce internal data access in the storage system. In one embodiment of the present invention, there is proposed a device for managing a storage system.
1. A method for managing a storage system, the storage system comprising a buffer device and a plurality of storage devices, the method comprising:
receiving an access request with respect to the storage system;
determining that a storage device among the plurality of storage devices has failed;
in response to the access request being an access request with respect to the failed storage device, serving the access request with data in the buffer device so as to reduce internal data access in the storage system at least in part by:
in response to the access request being a writing request, writing target data associated with the access request to a target page in the buffer device, and
delaying flushing data in the target page to the storage device at least in part by adding the target page to a first waiting queue including a data page associated with the failed storage device, determining a first priority for the first waiting queue, and, in at least one round of flushing, flushing data in a data page in the first waiting queue to a further storage device on the basis of the first priority, wherein flushing data in the data page in the first waiting queue to the further storage device on the basis of the first priority comprises:
in response to the first priority not satisfying a predetermined condition, updating the first priority according to an updating rule, the updating rule making the updated first priority much closer to the predetermined condition than the first priority; and
in response to the first priority satisfying the predetermined condition, flushing data in the data page in the first waiting queue to the further storage device;
determining a second priority for a second waiting queue in the buffer device, the second waiting queue including a data page associated with a second storage device other than the failed storage device; and
in at least one round of flushing, flushing data in the data page in the second waiting queue to the second storage device on the basis of the second priority.
2. The method according to claim 1 , wherein determining the first priority for the first waiting queue comprises:
increasing the first priority on the basis of a response time associated with the failed storage device.
3. The method according to claim 1 , wherein determining the first priority for the first waiting queue comprises:
reducing the first priority on the basis of a usage rate of the buffer device by the failed storage device.
4. The method according to claim 1 , wherein determining the first priority for the first waiting queue comprises:
increasing the first priority on the basis of an access frequency of access requests with respect to the failed storage device.
5. The method according to claim 1 , wherein determining the first priority for the first waiting queue comprises:
setting the first priority on the basis of a response time associated with the failed storage device, a usage rate of the buffer device by the failed storage device, and an access frequency of access requests with respect to the failed storage device.
6. The method according to claim 1 , wherein flushing data in the data page in the second waiting queue to the second storage device on the basis of the second priority comprises:
in response to the second priority not satisfying a second predetermined condition, updating the second priority according to a second updating rule, the second updating rule making the updated second priority much closer to the second predetermined condition than the second priority; and
in response to the second priority satisfying the second predetermined condition, flushing data in the data page in the second waiting queue to the second storage device.
7. The method according to claim 1 , wherein the first waiting queue and the second waiting queue are waiting queues within a plurality of waiting queues;
wherein the plurality of storage devices comprises a Redundant Array of Independent Disks (RAID);
wherein each one of the waiting queues in the plurality of waiting queues is provided for a corresponding one of the plurality of storage devices; and
wherein each waiting queue has a corresponding priority.
8. The method according to claim 1 , further comprising:
flushing data in the data page in the first waiting queue to the further storage device at least in part by selecting the target page from the first waiting queue based on a least recently used standard.
9. A device for managing a storage system, comprising:
one or more processors;
a memory coupled to at least one processor of the one or more processors;
computer program instructions stored in the memory which, when executed by the at least one processor, cause the device to execute a method for managing a storage system, the method comprising:
receiving an access request with respect to the storage system;
determining that a storage device among the plurality of storage devices has failed;
in response to the access request being an access request with respect to the failed storage device, serving the access request with data in the buffer device so as to reduce internal data access in the storage system at least in part by:
in response to the access request being a writing request, writing target data associated with the access request to a target page in the buffer device, and
delaying flushing data in the target page to the storage device at least in part by adding the target page to a first waiting queue including a data page associated with the failed storage device, determining a first priority for the first waiting queue, and, in at least one round of flushing, flushing data in a data page in the first waiting queue to a further storage device on the basis of the first priority, wherein flushing data in the data page in the first waiting queue to the further storage device on the basis of the first priority comprises:
in response to the first priority not satisfying a predetermined condition, updating the first priority according to an updating rule, the updating rule making the updated first priority much closer to the predetermined condition than the first priority; and
in response to the first priority satisfying the predetermined condition, flushing data in the data page in the first waiting queue to the further storage device;
determining a second priority for a second waiting queue in the buffer device, the second waiting queue including a data page associated with a second storage device other than the failed storage device; and
in at least one round of flushing, flushing data in the data page in the second waiting queue to the second storage device on the basis of the second priority.
10. The device according to claim 9 , wherein determining the first priority for the first waiting queue comprises:
increasing the first priority on the basis of a response time associated with the failed storage device.
11. The device according to claim 9 , wherein determining the first priority for the first waiting queue comprises:
reducing the first priority on the basis of a usage rate of the buffer device by the failed storage device.
12. The device according to claim 9 , wherein determining the first priority for the first waiting queue comprises:
increasing the first priority on the basis of an access frequency of access requests with respect to the failed storage device.
13. The device according to claim 9 , wherein determining the first priority for the first waiting queue comprises:
setting the first priority on the basis of a response time associated with the failed storage device, a usage rate of the buffer device by the failed storage device, and an access frequency of access requests with respect to the failed storage device.
14. The device according to claim 9 , wherein flushing data in the data page in the second waiting queue to the second storage device on the basis of the second priority comprises:
in response to the second priority not satisfying a second predetermined condition, updating the second priority according to a second updating rule, the second updating rule making the updated second priority much closer to the second predetermined condition than the second priority; and
in response to the second priority satisfying the second predetermined condition, flushing data in the data page in the second waiting queue to the second storage device.
15. The device according to claim 9 , wherein the first waiting queue and the second waiting queue are waiting queues within a plurality of waiting queues;
wherein the plurality of storage devices comprises a Redundant Array of Independent Disks (RAID);
wherein each one of the waiting queues in the plurality of waiting queues is provided for a corresponding one of the plurality of storage devices; and
wherein each waiting queue has a corresponding priority.