Methods and systems for using script files to obtain, format and transport data
Embodiments of the invention can include a system and method for managing a plurality of data feeds to be loaded into a database. The method includes obtaining a script which specifies a query. The method includes executing the query against a source to extract a result set and consulting the script to determine a format for the data feed. The method also includes converting the result set in accordance with the format to create the data feed and transporting the data feed to be loaded into the database.
1. A method for managing a plurality of data feeds to a user device from a database, the method comprising:
obtaining, by a database server, a script file for a received request for a data feed from a user device, wherein the obtained script file comprises one or more instructions for searching, formatting, and forwarding the requested data feed, and the obtained script further comprises one or more resource allocation instructions to prevent a deadlock condition;
sending, by the database server, one or more SQL instructions to a data server to obtain a result dataset for the received request for the data feed based on the obtained script file;
receiving, by the database server, the result dataset from the data server, wherein the result dataset is obtained from one or more data sources by executing at least one of the sent one or more SQL instructions;
formatting, by the database server, the received dataset based on the obtained script file; and
sending, by the database server, the formatted received dataset as the data feed to the user device.
2. The method as set forth in claim 1 wherein the obtained script file is a JAVA properties file.
3. The method as set forth in claim 1 further comprising, determining, by the database server, when to format the received dataset based on the obtained script file.
4. The method as set forth in claim 1 further comprising, determining, by the database server, when to edit the received dataset based on the obtained script file.
5. The method as set forth in claim 4 further comprising, editing, by the database server, the received dataset when the received dataset is required to be edited.
6. The method as set forth in claim 1 further comprising, sending, by the database server, the formatted received dataset to a database provided in the obtained script file.
7. A database server comprising:
a processor;
a memory, wherein the memory coupled to the processor which are configured to execute programmed instructions stored in the memory comprising:
obtaining a script file for a received request for a data feed from a user device, wherein the obtained script file comprises one or more instructions for searching, formatting, and forwarding the requested data feed, and the obtained script further comprises one or more resource allocation instructions to prevent a deadlock condition;
sending one or more SQL instructions to a data server to obtain a result dataset for the received request for the data feed based on the obtained script file;
receiving the result dataset from the data server, wherein the result dataset is obtained from one or more data sources by executing at least one of the sent one or more SQL instructions;
formatting the received dataset based on the obtained script file; and
sending the formatted received dataset as the data feed to the user device.
8. The server as set forth in claim 7 wherein the obtained script file is a JAVA properties file.
9. The server as set forth in claim 7 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising determining when to format the received dataset based on the obtained script file.
10. The server as set forth in claim 7 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising determining when to edit the received dataset based on the obtained script file.
11. The server as set forth in claim 10 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising editing the received dataset when the received dataset is required to be edited.
12. The server as set forth in claim 7 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising sending the formatted received dataset to a database provided in the obtained script file.
13. A non-transitory computer readable medium having stored thereon instructions for managing a plurality of data feeds to a user device from a database comprising machine executable code which when executed by at least one processor, causes the processor to perform steps comprising:
obtaining a script file for a received request for a data feed from a user device, wherein the obtained script file comprises one or more instructions for searching, formatting, and forwarding the requested data feed, and the obtained script further comprises one or more resource allocation instructions to prevent a deadlock condition;
sending one or more SQL instructions to a data server to obtain a result dataset for the received request for the data feed based on the obtained script file;
receiving the result dataset from the data server, wherein the result dataset is obtained from one or more data sources by executing at least one of the sent one or more SQL instructions;
formatting the received dataset based on the obtained script file; and
sending the formatted received dataset as the data feed to the user device.
14. The medium as set forth in claim 13 wherein the obtained script file is a JAVA properties file.
15. The medium as set forth in claim 13 further comprising determining when to format the received dataset based on the obtained script file.
16. The medium as set forth in claim 13 further comprising determining when to edit the received dataset based on the obtained script file.
17. The medium as set forth in claim 16 further comprising editing the received dataset when the received dataset is required to be edited.
18. The medium as set forth in claim 13 further comprising sending the formatted received dataset to a database provided in the obtained script file.