Managing prefetching operations for drives in distributed storage systems
Systems and methods are provided for managing prefetching operations for read requests for drives in a distributed storage system. For example, a system can determine that a first drive of a plurality of drives is powered on. Prior to receiving a read request for reading a first set of data from the first drive, the system can enable a prefetching operation for prefetching the first set of data from the first drive to be written to a cache. The system may power off the first drive. The system may receive a read request for reading the first set of data from the first drive of a plurality of drives. In response to receiving the read request, the system may read the first set of data from the cache.
1. A system comprising:
a processor; and
a memory including instructions that are executable by the processor for causing the processor to:
determine that a first drive of a plurality of drives of a distributed storage system has been powered on after being powered off in an idle state;
prior to receiving a read request for reading a first set of data from the first drive, automatically enable, in response to determining that the first drive has been powered on after being powered off and based on an amount of previously received read requests for the first set of data, a prefetching operation for prefetching the first set of data from the first drive to be written to a cache in the distributed storage system; and
subsequent to automatically enabling the prefetching operation:
power off the first drive to the idle state;
receive the read request for reading the first set of data from the first drive of the plurality of drives; and
in response to receiving the read request, read the first set of data from the cache.
2. The system of claim 1 , wherein the memory further comprises instructions that are executable by the processor for causing the processor to:
determine that the first drive is powered off; and
in response to determining that the first drive is powered off, disable the prefetching operation for prefetching the first set of data from the first drive to be written to the cache prior to receiving the read request for reading the first set of data from the first drive.
3. The system of claim 1 , wherein the memory further comprises instructions that are executable by the processor for causing the processor to:
receive a plurality of write requests for writing a second set of data to the first drive of the plurality of drives, the first drive being powered off in the idle state; and
in response to receiving the plurality of write requests, write the second set of data to the cache.
4. The system of claim 3 , wherein the memory further comprises instructions that are executable by the processor for causing the processor to:
determine that a number of the plurality of write requests exceeds a predetermined write request threshold;
in response to determining that the number of the plurality of write requests exceeds the predetermined write request threshold, power on the first drive from being powered off in the idle state; and
write the second set of data stored in the cache to the first drive.
5. The system of claim 3 , wherein the memory further comprises instructions that are executable by the processor for causing the processor to:
determine that a storage amount in the cache exceeds a predetermined storage threshold;
in response to determining that the storage amount in the cache exceeds the predetermined storage threshold, power on the first drive from being powered off in the idle state; and
write the second set of data stored in the cache to the first drive.
6. The system of claim 5 , wherein the memory further comprises instructions that are executable by the processor for causing the processor to:
in response to determining that the storage amount in the cache exceeds the predetermined storage threshold, write the second set of data stored in the cache to a second drive of the plurality of drives that is powered on;
determine that the first drive is powered on after being powered off in the idle state; and
in response to determining that the first drive is powered on after being powered off in the idle state, write the second set of data stored in the second drive to the first drive.
7. The system of claim 1 , wherein the cache is a battery-backed cache or a nonvolatile random-access memory.
8. A method comprising:
determining, by a processor, that a first drive of a plurality of drives has been powered on after being powered off in an idle state;
prior to receiving a read request for reading a first set of data from the first drive, automatically enabling, by the processor and in response to determining that the first drive has been powered on after being powered off and based on an amount of previously received read requests for the first set of data, a prefetching operation for prefetching the first set of data from the first drive to be written to a cache; and
subsequent to automatically enabling the prefetching operation:
powering off, by the processor, the first drive to the idle state;
receiving, by the processor, the read request for reading the first set of data from the first drive of the plurality of drives; and
in response to receiving the read request, reading, by the processor, the first set of data from the cache.
9. The method of claim 8 , further comprising:
determining that the first drive is powered off; and
in response to determining that the first drive is powered off, disabling the prefetching operation for prefetching the first set of data from the first drive to be written to the cache prior to receiving the read request for reading the first set of data from the first drive.
10. The method of claim 8 , further comprising:
receiving a plurality of write requests for writing a second set of data to the first drive of the plurality of drives, the first drive being powered off in the idle state; and
in response to receiving the plurality of write requests, writing the second set of data to the cache.
11. The method of claim 10 , further comprising:
determining that a number of the plurality of write requests exceeds a predetermined write request threshold;
in response to determining that the number of the plurality of write requests exceeds the predetermined write request threshold, powering on the first drive from being powered off in the idle state; and
writing the second set of data stored in the cache to the first drive.
12. The method of claim 10 , further comprising:
determining that a storage amount in the cache exceeds a predetermined storage threshold;
in response to determining that the storage amount in the cache exceeds the predetermined storage threshold, powering on the first drive from being powered off in the idle state; and
writing the second set of data stored in the cache to the first drive.
13. The method of claim 12 , further comprising:
in response to determining that the storage amount in the cache exceeds the predetermined storage threshold, writing the second set of data stored in the cache to a second drive of the plurality of drives that is powered on;
determining that the first drive is powered on after being powered off in the idle state; and
in response to determining that the first drive is powered on after being powered off in the idle state, writing the second set of data stored in the second drive to the first drive.
14. The method of claim 8 , wherein the cache is a battery-backed cache or a nonvolatile random-access memory.
15. A non-transitory computer-readable medium comprising program code that is executable by a processor for causing the processor to:
determine that a first drive of a plurality of drives has been powered on after being powered off in an idle state;
prior to receiving a read request for reading a first set of data from the first drive, automatically enable, in response to determining that the first drive has been powered on after being powered off and based on an amount of previously received read requests for the first set of data, a prefetching operation for prefetching the first set of data from the first drive to be written to a cache; and
subsequent to automatically enabling the prefetching operation:
power off the first drive to the idle state;
receive the read request for reading the first set of data from the first drive of the plurality of drives; and
in response to receiving the read request, read the first set of data from the cache.
16. The non-transitory computer-readable medium of claim 15 , further comprising program code that is executable by the processor for causing the processor to:
determine that the first drive is powered off; and
in response to determining that the first drive is powered off, disable the prefetching operation for prefetching the first set of data from the first drive to be written to the cache prior to receiving the read request for reading the first set of data from the first drive.
17. The non-transitory computer-readable medium of claim 15 , further comprising program code that is executable by the processor for causing the processor to:
receive a plurality of write requests for writing a second set of data to the first drive of the plurality of drives, the first drive being powered off in the idle state; and
in response to receiving the plurality of write requests, write the second set of data to the cache.
18. The non-transitory computer-readable medium of claim 17 , further comprising program code that is executable by the processor for causing the processor to:
determine that a number of the plurality of write requests exceeds a predetermined write request threshold;
in response to determining that the number of the plurality of write requests exceeds the predetermined write request threshold, power on the first drive from being powered off in the idle state; and
write the second set of data stored in the cache to the first drive.
19. The non-transitory computer-readable medium of claim 17 , further comprising program code that is executable by the processor for causing the processor to:
determine that a storage amount in the cache exceeds a predetermined storage threshold;
in response to determining that the storage amount in the cache exceeds the predetermined storage threshold, power on the first drive from being powered off in the idle state; and
write the second set of data stored in the cache to the first drive.
20. The non-transitory computer-readable medium of claim 19 , further comprising program code that is executable by the processor for causing the processor to:
in response to determining that the storage amount in the cache exceeds the predetermined storage threshold, write the second set of data stored in the cache to a second drive of the plurality of drives that is powered on;
determine that the first drive is powered on after being powered off in the idle state; and
in response to determining that the first drive is powered on after being powered off in the idle state, write the second set of data stored in the second drive to the first drive.