Extensible platform for orchestration of data with built-in scalability and clustering
In a computer system, an orchestration platform includes extensible components that interact with external systems and technology. The platform scales by way of a plurality of application servers using a clustering architecture.
1. A computer system platform for data orchestration comprising:
a platform core with an application stack and a database stack;
an extension server, remote from the platform core;
a probe comprising a standalone software component, installed on the extension server and in communication with the platform core by way of one or more connector;
wherein the extension server with the installed probe is located proximate to a target system and wherein the target system is external to the platform core and comprises a datastore and a library corresponding to a programming language;
the probe is configured to execute scripts that request data from the datastore in the programming language of the target system;
a plurality of application servers in communication with the platform core, including a collector server; and
wherein the target system further comprises an application program interface (“API”) connected to the library and the probe is configured to expose the API to make the library available to the platform core on-demand and receive data from the datastore at the platform core via the collector server.
2. The system of claim 1 wherein the plurality of application servers further includes at least two of a portal server, web server, and a job server.
3. The system of claim 1 wherein the plurality of application servers includes a portal server, web server, job server, and the collector server.
4. The system of claim 1 wherein the plurality of application servers includes a portal server in reverse proxy configuration, a web server, job server, and the collector server.
5. The system of claim 1 wherein the plurality of application servers includes a portal server in a reverse proxy configuration.
6. The system of claim 1 wherein the plurality of application servers includes a web server in a reverse proxy configuration.
7. A method of orchestrating data in a computer system comprising a platform core with an application stack and a database stack, an extension server, and an external target system, the method comprising:
installing a probe comprising a standalone software component on the extension server at a remote location;
configuring the probe to connect with the platform core, wherein the probe is installed on the extension server is in communication with the platform core by way of one or more connectors;
wherein the extension server with the installed probe is located proximate to the external target system and wherein the external target system is external to the platform core;
wherein the external target system comprises a datastore and a library corresponding to a programming language;
wherein the probe is configured to execute scripts that request data from the datastore in the programming language of the external target system;
configuring a plurality of application servers in communication with the platform core, including a collector server; and
wherein the target system comprises an application program interface (“API”) connected to the library and the probe is configured to expose the API and the library to the platform core on-demand and receive data from the datastore at the platform core via the collector server.
8. The method of claim 7 wherein the plurality of application servers further includes at least two of a portal server, web server, and a job server.
9. The method of claim 7 wherein the plurality of application servers includes a portal server, web server, job server, and the collector server.
10. The method of claim 7 wherein the plurality of application servers includes a portal server in reverse proxy configuration, a web server, job server, and the collector server.
11. The method of claim 7 wherein the plurality of application servers includes a portal server in a reverse proxy configuration.
12. The method of claim 7 wherein the plurality of application servers includes a web server in a reverse proxy configuration.
13. A computer system platform for data orchestration, the system comprising:
an extension server, remote from a platform core;
a probe comprising a standalone software component, installed on the extension server and in communication with the platform core by way of one or more connectors;
wherein the extension server with the installed probe is located proximate to an external target system and wherein the external target system remote from the platform core and comprises a datastore and a library corresponding to a programming language;
wherein the probe is configured to execute scripts that request data from the datastore in the programming language of the external target system;
a plurality of application servers in communication with the probe, including a collector server; and
wherein the external target system comprises an application program interface (“API”) connected to the library and the probe is configured to expose the API and the library to the platform core on-demand and receive data from the datastore at the platform core via the collector server.
14. The system of claim 13 wherein the plurality of application servers further includes at least two of a portal server, web server, and a job server.
15. The system of claim 13 wherein the plurality of application servers includes a portal server, web server, job server, and the collector server.
16. The system of claim 13 wherein the plurality of application servers includes a portal server in reverse proxy configuration, web server, job server, and the collector server.
17. The system of claim 13 wherein the plurality of application servers includes a portal server in a reverse proxy configuration.
18. The system of claim 13 wherein the plurality of application servers includes a web server in a reverse proxy configuration.
19. The system of claim 17 wherein the plurality of application servers further includes a web server in a reverse proxy configuration.
20. The system of claim 17 wherein collector server comprises nodes subscribed to probe data receiver queues, and the queues are configured to serve round-robin data to the platform core via the collector server.