System and method for data orchestration for non-relational databases and key-value storage in multiple computing environments
A method for managing data includes obtaining, by a database proxy server, a document manifest, wherein the document manifest specifies a plurality of queries, wherein each of the plurality of queries specifies data and a policy to be implemented on the data, wherein the data is stored in a central database, and processing the plurality of queries.
1. A method for managing data, the method comprising:
obtaining, by a database proxy server, a document manifest, wherein the document manifest specifies a plurality of queries, wherein each of the plurality of queries specifies data and a policy to be implemented on the data, wherein the data is stored in a central database; and
processing the plurality of queries, wherein processing the plurality of queries comprises:
selecting a query of the plurality of queries;
based on the query specifying a watch policy, caching a document identifier of the data in the database proxy server; and
maintaining a continuous synchronization of the data in the central database with a copy of the data in a local database.
2. The method of claim 1 , wherein processing the plurality of queries further comprises:
selecting a second query of the plurality of queries; and
based on the second query specifying a read policy, initiating a transfer of a copy of the data from the central database to a local database.
3. The method of claim 1 , wherein processing the plurality of queries further comprises:
selecting a second query of the plurality of queries;
based on the second query specifying a write policy, performing a locking mechanism to the data in the central database; and
after performing the locking mechanism, initiating a transfer of a copy of the data from the central database to a local database.
4. The method of claim 3 , further comprising:
obtaining a second document manifest, wherein the second document manifest specifies a third query, wherein the third query specifies a policy for synchronizing the copy of the data to the central database; and
based on the third query, synchronizing the copy of the data in the local database with the data in the central database.
5. The method of claim 4 , further comprising:
after synchronizing the copy of the data in the local database with the data in the central database, performing an unlocking mechanism to the data in the central database.
6. The method of claim 1 , wherein processing the plurality of queries comprises:
selecting a second query of the plurality of queries; and
based on the second query specifying a lazy policy, initiating a transfer of metadata of the data from the central database to a local database.
7. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing data, the method comprising:
obtaining, by a database proxy server, a document manifest, wherein the document manifest specifies a plurality of queries, wherein each of the plurality of queries specifies data and a policy to be implemented on the data, wherein the data is stored in a central database; and
processing the plurality of queries, wherein processing the plurality of queries comprises:
selecting a query of the plurality of queries;
based on the query specifying a watch policy, caching a document identifier of the data in the database proxy server; and
maintaining a continuous synchronization of the data in the central database with a copy of the data in a local database.
8. The non-transitory computer readable medium of claim 7 , wherein processing the plurality of queries further comprises:
selecting a second query of the plurality of queries; and
based on the second query specifying a read policy, initiating a transfer of a copy of the data from the central database to a local database.
9. The non-transitory computer readable medium of claim 7 , wherein processing the plurality of queries further comprises:
selecting a second query of the plurality of queries;
based on the second query specifying a write policy, performing a locking mechanism to the data in the central database; and
after performing the locking mechanism, initiating a transfer of a copy of the data from the central database to a local database.
10. The non-transitory computer readable medium of claim 9 , the method further comprising:
obtaining a second document manifest, wherein the second document manifest specifies a third query, wherein the third query specifies a policy for synchronizing the copy of the data to the central database; and
based on the third query, synchronizing the copy of the data in the local database with the data in the central database.
11. The non-transitory computer readable medium of claim 10 , the method further comprising:
after synchronizing the copy of the data in the local database with the data in the central database, performing an unlocking mechanism to the data in the central database.
12. The non-transitory computer readable medium of claim 7 , the method wherein processing the plurality of queries further comprises:
selecting a second query of the plurality of queries; and
based on the second query specifying a lazy policy, initiating a transfer of metadata of the data from the central database to a local database.
13. A system comprising:
a processor; and
memory comprising instructions, which when executed by the processor, perform a method comprising:
obtaining, by a database proxy server, a document manifest, wherein the document manifest specifies a plurality of queries, wherein each of the plurality of queries specifies data and a policy to be implemented on the data, wherein the data is stored in a central database; and
processing the plurality of queries, wherein processing the plurality of queries comprises:
selecting a query of the plurality of queries;
based on the query specifying a watch policy, caching a document identifier of the data in the database proxy server; and
maintaining a continuous synchronization of the data in the central database with a copy of the data in a local database.
14. The system of claim 13 , wherein processing the plurality of queries further comprises:
selecting a second query of the plurality of queries; and
based on the second query specifying a read policy, initiating a transfer of a copy of the data from the central database to a local database.
15. The system of claim 13 , the method further comprising:
selecting a second query of the plurality of queries;
based on the second query specifying a write policy, performing a locking mechanism to the data in the central database; and
after performing the locking mechanism, initiating a transfer of a copy of the data from the central database to a local database.
16. The system of claim 15 , the method further comprising:
obtaining a second document manifest, wherein the second document manifest specifies a third query, wherein the third query specifies a policy for synchronizing the copy of the data to the central database;
based on the third query, synchronizing the copy of the data in the local database with the data in the central database; and
after synchronizing the copy of the data in the local database with the data in the central database, performing an unlocking mechanism to the data in the central database.
17. The system of claim 13 , wherein processing the plurality of queries further comprises:
selecting a second query of the plurality of queries; and
based on the second query specifying a lazy policy, initiating a transfer of metadata of the data from the central database to a local database.