Rule based data transfer model to cloud
A data management device includes a persistent storage and a processor. The persistent storage includes client data. The processor obtains a data storage trend that specifies a rate of storing the client data in the persistent storage over a predetermined period of time; matches the persistent storage trend to a rule based on the data storage trend; and applies the matched rule to a manager of the persistent storage.
1. A data management device, comprising:
a persistent storage; and
a processor programmed to:
obtain a data storage trend from a cloud storage gateway that specifies a rate of storing client data in a persistent storage over a predetermined period of time, wherein the client data is initially received from a client and stored in a storage node of the data management device prior to being stored in the persistent storage, wherein the persistent storage is located on the cloud storage gateway, wherein the storage node is interposed between the client and the cloud storage gateway;
match a persistent storage trend to a rule based on the data storage trend, wherein the rule is stored in the storage node; and
meet a quality of storage service required for the client data by applying the matched rule to a manager of the persistent storage, wherein the manager receives a message containing the matched rule and wherein the manager is located on the storage node,
wherein the matched rule specifies a modification to an amount of computing resources allocated for storing the client data,
wherein the quality of storage service required for the client data specifies a maximum amount of time before the client data must be available to be retrieved from the persistent storage.
2. The data management device of claim 1 , wherein the processor is further programmed to:
obtain a set of rules comprising the matched rule, wherein each rule of the set of rules comprises a trigger condition and a modification to a transfer characteristic associated with the persistent storage.
3. The data management device of claim 2 , wherein the trigger condition of a rule of the set of rules specifies a predetermined increase in the rate of storing the client data over the predetermined period of time when compared to a prior rate of storing the client data over a prior predetermined period of time.
4. The data management device of claim 3 , wherein the predetermined period of time comprises less than one hour.
5. The data management device of claim 4 , wherein the predetermined period of time comprises more than fifteen minutes.
6. The data management device of claim 2 , wherein the trigger condition of a rule of the set of rules specifies a predetermined decrease in the rate of storing the client data over the predetermined period of time when compared to a prior rate of storing the client data over a prior predetermined period of time.
7. The data management device of claim 1 , further comprising:
a buffer that obtains the client data before the client data is stored in the persistent storage.
8. The data management device of claim 7 , wherein the matched rule specifies an increase in a quantity of the buffer allocated for the client data.
9. The data management device of claim 7 , wherein the matched rule specifies a purge of the buffer.
10. The data management device of claim 7 , wherein the matched rule specifies a decrease in a quantity of the buffer allocated for the client data.
11. The data management device of claim 1 , further comprising:
a data storage, shared with a second data management device, that stores additional client data,
wherein the data storage is a higher performance storage than the persistent storage.
12. The data management device of claim 11 , wherein the matched rule specifies that the data management device accesses the data storage using file level sharing.
13. The data management device of claim 12 , wherein the file level sharing is performed using a common internet file system protocol.
14. The data management device of claim 11 , wherein the matched rule specifies that the data management device accesses the data storage using block level sharing.
15. The data management device of claim 14 , wherein the block level sharing is performed using an internet small computer systems interface.
16. The data management device of claim 1 , wherein the processor is further programmed to:
obtain a set of rules comprising the matched rule, wherein the set of rules specify modifications of transfer characteristics associated with the persistent storage as a function of a relative change in the rate of storing the client data in the persistent storage from a prior predetermined period of time.
17. The data management device of claim 1 , further comprising:
a buffer that obtains the client data before the client data is stored in the persistent storage; and
a data storage, shared with a second data management device, that stores high priority client data having an access priority that is greater than an access priority of the client data stored in the persistent storage.
18. A method of operating a data management device, comprising:
obtaining, by the data management device, a data storage trend from a cloud storage gateway that specifies a rate of storing client data in a persistent storage over a predetermined period of time, wherein the client data is initially received from a client and stored in a storage node of the data management device prior to being stored in the persistent storage, wherein the persistent storage is located on the cloud storage gateway, wherein the storage node is interposed between the client and the cloud storage gateway;
matching, by the data management device, a persistent storage trend to a rule based on the data storage trend, wherein the rule is stored in the storage node; and
meeting a quality of storage service required for the client data by applying, by the data management device, the matched rule to a manager of the persistent storage that manages the persistent storage, wherein the manager receives a message containing the matched rule and wherein the manager is located on the storage node,
wherein the matched rule specifies a modification to an amount of computing resources allocated for storing the client data,
wherein the quality of storage service required for the client data specifies a maximum amount of time before the client data must be available to be retrieved from the persistent storage.
19. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for operating a data management device, the method comprising:
obtaining, by the data management device, a data storage trend from a cloud storage gateway that specifies a rate of storing client data in a persistent storage over a predetermined period of time, wherein the client data is initially received from a client and stored in a storage node of the data management device prior to being stored in the persistent storage, wherein the persistent storage is located on the cloud storage gateway, wherein the storage node is interposed between the client and the cloud storage gateway;
matching, by the data management device, a persistent storage trend to a rule based on the data storage trend, wherein the rule is stored in the storage node; and
meeting a quality of storage service required for the client data by applying, by the data management device, the matched rule to a manager of the persistent storage that manages the persistent storage, wherein the manager receives a message containing the matched rule and wherein the manager is located on the storage node,
wherein the matched rule specifies a modification to an amount of computing resources allocated for storing the client data,
wherein the quality of storage service required for the client data specifies a maximum amount of time before the client data must be available to be retrieved from the persistent storage.