Total quotas for data storage system
View Patent ↗Quotas are tracked for user usage of hard disk drive space and offline backup storage space. The quota is enforced against the total space utilized by a user, not just high tier hard drive space usage. When data is migrated from hard disk drive space to backup storage space, data metadata is updated to reflect data kept offline for the user. As such, when users request to store new data, the data usage of hard disk space and backup storage space is determined from the metadata that reflects both data types, and the total storage spaced for the user is used to grant or reject the user's request to store more data in the system.
1. A method for managing data storage, comprising:
receiving a request to store data for a user;
determining a total amount of storage space that is currently consumed by the user, wherein the total amount of storage space currently consumed by the user includes storage space at a hard disk system plus storage space at a back-up storage system, wherein the amount of storage space currently storing data from the user at the hard disk system and at the back-up storage system is stored as metadata at kernel layer at the hard disk system;
comparing a total storage space usage of the user to a total amount of storage space allowed for the user, wherein the total storage space usage includes the total amount of storage currently consumed by the user plus an amount of storage space required to store the data from the user request; and
determining that the total storage space usage is less than a hard quota;
writing the data from the user request to the hard disk system; and
updating the metadata at the kernel layer at the hard disk system to include information that identifies an amount of storage used to store the data from the user request.
2. The method of claim 1 , wherein the total amount of storage space currently consumed by the user is determined from metadata retrieved from the hard disk storage system.
3. The method of claim 2 , wherein the metadata includes extents associated with hard disk usage and metadata associated with back-up storage usage.
4. The method of claim 1 , further comprising:
determining that the total amount of storage space currently consumed by the user is larger than a soft quota; and
overwriting the data from the user request stored at the hard disk storage system after a period of time without permission from the user.
5. The method of claim 1 , further comprising:
moving the data from the user request stored at the hard disk system to the back-up storage system; and
replacing data extents associated with the moved data with offline extents.
6. A non-transitory computer readable storage medium having embodied thereon a program the program executable by a processor to perform a method for managing data storage, the method comprising:
receiving a request to store data for a user;
determining a total amount of storage space that is currently consumed by the user, wherein the total amount of storage space currently consumed by the user includes storage space at a hard disk system plus storage space at a back-up storage system, wherein the amount of storage space currently storing data from the user at the hard disk system and at the back-up storage system is stored as metadata at kernel layer at the hard disk system;
comparing a total storage space usage of the user to a total amount of storage space allowed for the user, wherein the total storage space usage includes the total amount of storage currently consumed by the user plus an amount of storage space required to store the data from the user request; and
determining that the total storage space usage is less than a hard quota;
writing the data from the user request to the hard disk system; and
updating the metadata at the kernel layer at the hard disk system to include information that identifies an amount of storage used to store the data from the user request.
7. The non-transitory computer readable storage medium of claim 6 , wherein the total amount of storage space currently consumed by the user is determined from metadata retrieved from the hard disk storage system.
8. The non-transitory computer readable storage medium of claim 7 , wherein the metadata includes extents associated with hard disk usage and metadata associated with back-up storage usage.
9. The non-transitory computer readable storage medium of claim 6 , the program further executable to:
determine that the total amount of storage space currently consumed by the user is larger than a soft quota; and
overwrite the data from the user request stored at the hard disk storage system after a period of time without permission from the user.
10. The non-transitory computer readable storage medium of claim 6 , the program further executable to:
move the data from the user request stored at the hard disk system to the back-up storage system; and
replace data extents associated with the moved data with offline extents.
11. A system for managing data storage, comprising:
a processor;
a memory; and
one or more modules stored in memory and executable by the processor to:
receive a request to store data for a user,
determine a total amount of storage space that is currently consumed by the user, wherein the total amount of storage space currently consumed by the user includes storage space at a hard disk system plus storage space at a back-up storage system, wherein the amount of storage space currently storing data from the user at the hard disk system and at the back-up storage system is stored as metadata at kernel layer at the hard disk system,
compare a total storage space usage of the user to a total amount of storage space allowed for the user, wherein the total storage space usage includes the total amount of storage currently consumed by the user plus an amount of storage space required to store the data from the user request, and
determine that the total storage space usage is less than a hard quota; and
write the data to hard disk storage.
12. The system of claim 11 , wherein the total amount of storage space currently consumed by the user is determined from metadata retrieved from the hard disk storage system.
13. The system of claim 12 , wherein the metadata includes extents associated with hard disk usage and metadata associated with back-up storage usage.
14. The system of claim 11 , the one or more modules further executable to:
determine that the total amount of storage space currently consumed by the user is larger than a soft quota; and
overwrite the data from the user request stored at the hard disk storage system after a period of time without permission from the user.
15. The system of claim 11 , the one or more modules further executable to:
move the data from the user request stored at the hard disk system to the back-up storage system; space; and
replace data extents associated with the moved data with offline extents.