Dynamic scaling of storage volumes for storage client file systems
A network-based data store maintaining storage volumes for file systems at storage clients may implement dynamic storage volume scaling. A scaling event may be detected according to a specified scaling policy for a storage volume maintained at a network-based data store that is mounted at a storage client and configured for a file system. In a least some embodiments, the scaling policy for the storage volume may be received from the storage client. In response to detecting the storage event, storage maintaining the storage volume may be modified according to the scaling policy to scale the storage volume. An indication of the scaling event may be sent to the storage client in order to update the file system at the storage client so that the file system may utilize the scaled storage volume.
1. A method, comprising:
performing, by one or more computer devices in a network-accessible infrastructure provider network:
provisioning, by a storage service of the network-accessible infrastructure provider network, a block-based storage volume for a client, wherein the block-based storage volume includes a plurality of logical blocks stored at one or more storage nodes of the storage service;
hosting, by a virtual compute service of the network-accessible infrastructure provider network, a virtual machine instance on a physical host in the network-accessible infrastructure provider network, wherein the virtual machine attaches the block-based storage volume and implements a file system on the block-based storage volume; and
increasing, by the storage service, a storage capacity of the block-based storage volume, wherein the increase is performed while the block-based storage volume remains online and continues to accept read and write requests from the virtual machine instance.
2. The method of claim 1 , further comprising the storage service:
maintaining mapping information associated with the block-based storage volume that indicates respective locations of the logical blocks on the one or more storage nodes;
allocating one or more new logical blocks to the block-based storage volume to increase the storage capacity; and
updating the mapping information to indicate one or more new locations of the one or more new storage locations.
3. The method of claim 2 , further comprising the storage service:
decreasing the storage capacity of the block-based storage volume; and
updating the mapping information to reclaim storage space allocated to the block-based storage volume.
4. The method of claim 1 , further comprising:
automatically updating the file system to use additional storage capacity of the block-based storage volume in response to the increasing of the storage capacity.
5. The method of claim 1 , wherein the one or more storage nodes are configured to store data on one or more solid state drive (SSD) devices.
6. The method of claim 1 , wherein:
the increasing of the storage capacity of the block-based storage volume is caused by one or more service requests received via a programmatic interface of the storage service.
7. The method of claim 1 , wherein:
the increasing of the storage capacity of the block-based storage volume is caused by one or more service requests received via a user interface of the storage service.
8. The method of claim 7 , wherein the user interface is a graphical user interface.
9. The method of claim 7 , wherein the user interface is configured to receive user input to create, delete, and configure block-based storage volumes managed by the storage service.
10. The method of claim 1 , further comprising the storage service performing replication operations to maintain a mirror volume of the block-based storage volume.
11. A system, comprising:
one or more computer devices of a network-accessible infrastructure provider network, configured to:
provision, by a storage service of the network-accessible infrastructure provider network, a block-based storage volume for a client, wherein the block-based storage volume includes a plurality of logical blocks stored at one or more storage nodes of the storage service;
host, by a virtual compute service of the network-accessible infrastructure provider network, a virtual machine instance on a physical host in the network-accessible infrastructure provider network, wherein the virtual machine attaches the block-based storage volume and implements a file system on the block-based storage volume; and
increase, by the storage service, a storage capacity of the block-based storage volume, wherein the increase is performed while the block-based storage volume remains online and continues to accept read and write requests from the virtual machine instance.
12. The method of claim 1 , further comprising the storage service monitoring the health metrics of the block-based storage volume.
13. The method of claim 1 , wherein access requests to the block-based storage volume are received over an internal network of the network-accessible infrastructure provider network, according to an Internet small computer system interface (iSCSI) protocol.
14. The system of claim 11 , wherein the one or more storage nodes are configured to store data on one or more solid state drive (SSD) devices.
15. The system of claim 11 , wherein the storage service is configured to:
maintain mapping information associated with the block-based storage volume that indicates respective locations of the logical blocks on the one or more storage nodes;
allocate one or more new logical blocks to the block-based storage volume to increase the storage capacity; and
update the mapping information to indicate one or more new locations of the one or more new storage locations.
16. The system of claim 11 , wherein the storage service is configured to:
decrease the storage capacity of the block-based storage volume; and
update the mapping information to reclaim storage space allocated to the block-based storage volume.
17. The system of claim 11 , wherein the file system is automatically updated to use additional storage capacity of the block-based storage volume in response to the increase of the storage capacity.
18. The system of claim 11 , wherein the storage service implements a graphical user interface configured to receive user input to create, delete, and configure block-based storage volumes managed by the storage service.
19. The system of claim 11 , wherein the storage service is configured to perform replication operations to maintain a mirror volume of the block-based storage volume.
20. The system of claim 11 , wherein the storage service is configured to monitor the health metrics of the block-based storage volume.