Systems and methods of quota accounting
View Patent ↗Embodiments of the invention relate generally to incremental computing. Specifically, embodiments of the invention include systems and methods that provide for the concurrent processing of multiple, incremental changes to a data value while at the same time monitoring and/or enforcing threshold values for that data value. For example, a method is provided that implements domain quotas within a data storage system.
1. A method of implementing domain quotas within a data storage system, comprising:
receiving at least one quota related to a size of a data domain, wherein the data domain associates a subset of data storage within a data storage system, wherein the size_measures the subset, and wherein the at least one quota defines a threshold size for the data domain;
receiving a data transaction;
computing a domain usage value based on the data transaction in combination with a subset of other pending data transactions;
if the domain usage value, determined by execution of instructions by a processor, passes the at least one quota,
disallowing the data transaction until the other pending data transactions have resolved; and then,
while postponing subsequent data transactions,
permitting the data transaction; and
computing, respectively, a maximum possible size or a minimum possible size of the data domain based on the permitted data transaction, wherein the maximum possible size or the minimum possible size is used for determining whether a subsequent domain usage value based on the subsequent data transactions passes the at least one quota or a different quota.
2. The method of claim 1 , if it is determined that the domain usage value passes the at least one quota, further comprising permitting the data transaction and sending a notification that the at least one quota has been passed.
3. The method of claim 1 , if it is determined that the domain usage value passes the at least one quota, further comprising permitting the data transaction and monitoring a condition associated with the size of the data domain being past the at least one quota.
4. The method of claim 3 , wherein the condition is an amount of time that the size of the data domain is past the at least one quota.
5. The method of claim 1 , if it is determined that the domain usage value passes the at least one quota, further comprising denying the data transaction.
6. The method of claim 1 , wherein the domain usage value comprises a maximum possible size or a minimum possible size of the data domain, the method further comprising comparing the maximum possible size or the minimum possible size to the at least one quota.
7. The method of claim 1 , wherein the data storage system is associated with at least one of the following: a distributed storage system, a file system, and a distributed file system.
8. The method of claim 1 , wherein the data transaction and the other pending data transactions are uncommitted, concurrent transactions.
9. The method of claim 1 , wherein the at least one quota is specific to at least one of the following: whether the data transaction either increments or decrements the size of the data domain, the data domain, a subset of a combination of the data transaction and the other pending data transactions.
10. The method of claim 1 , further comprising, if permitting the data transaction causes the at least one quota to pass the threshold size of the data domain, performing at least one of the following: sending an advisory notice that the threshold has been passed and keeping a reference associated with a time at which the threshold is passed.
11. A non-transitory computer-readable medium having instructions stored thereon for implementing, when the instructions are executed, domain quotas within a data storage system, the non-transitory computer-readable medium comprising_instructions for:
receiving at least one quota related to a size of a data domain, wherein the data domain associates a subset of data storage within a data storage system, wherein the size_measures the subset, and wherein the at least one quota defines a threshold size for the data domain;
receiving a data transaction;
computing a domain usage value based on the data transaction in combination with a subset of other pending data transactions;
if the domain usage value passes the at least one quota,
disallowing the data transaction until the other pending data transactions have resolved; and then,
while postponing subsequent data transactions,
permitting the data transaction; and
computing, respectively, a maximum possible size or a minimum possible size of the data domain based on the permitted data transaction, wherein the maximum possible size or the minimum possible size is used for determining whether a subsequent domain usage value based on the subsequent data transactions passes the at least one quota or a different quota.
12. A system for implementing domain quotas within a data storage system, the system comprising:
a processor configured to execute a quota module;
the quota module configured to:
receive at least one quota related to a size of a data domain, wherein the data domain associates a subset of data storage within a data storage system, wherein the size measures the subset, and wherein the at least one quota defines a threshold size for the data domain;
receive a data transaction;
compute a domain usage value based on the data transaction in combination with a subset of other pending data transactions;
if the domain usage value passes the at least one quota,
disallow the data transaction until the other pending data transactions have resolved; and then,
while postponing subsequent data transactions,
permit the data transaction; and
compute, respectively, a maximum possible size or a minimum possible size of the data domain based on the permitted data transaction, wherein the maximum possible size or the minimum possible size is used to determine whether a subsequent domain usage value based on the subsequent data transactions passes the at least one quota or a different quota.
13. The system of claim 12 , if the domain usage value passes the at least one quota, the quota module further configured to disallow the data transaction until the other pending data transactions have resolved, and then to permit the data transaction and to send an advisory notice that the size of the data domain has passed the at least one quota.
14. The system of claim 12 , if the domain usage value passes the at least one quota, the quota module further configured to disallow the data transaction until the other pending data transactions have resolved, and then to permit the data transaction and to monitor a condition associated with the size of the data domain being past the at least one quota.
15. The system of claim 14 , wherein the condition is an amount of time.
16. The system of claim 12 , if the domain usage value passes the at least one quota, the quota module further configured to permit the data transaction and to determine whether a subsequent domain usage value based on subsequent data transactions passes a different quota from the at least one quota.
17. The system of claim 12 , wherein the system is at least one of the following: a distributed storage system, a file system, and a distributed file system.
18. The system of claim 12 , further comprising:
a persistent storage;
the processor further configured to execute a journal module, the journal module configured to store in the persistent storage the data transaction after determining the domain usage value passes the at least one quota.
19. The system of claim 12 , wherein the data transaction is associated with an incremental value of the size of the data domain, the system further comprising:
a persistent storage;
the processor further configured to execute a journal module, the journal module configured to store in the persistent storage the data transaction until the data transaction either commits or aborts,
wherein the quota module is further configured to compute a maximum possible size or a minimum possible size of the data domain based on the incremental value of the data transaction that committed or aborted.