Metadata driven real-time analytics framework
Methods, systems, and computer program products are provided for developing application definition packages, and deploying the application definition packages at cloud services to produce real-time data analytics applications. In one implementation, a selection is received of an application definition package that defines a real-time data analytics application. The application definition package indicates an application name and includes at least one payload definition, reference data definition, and query definition. A domain name is provided for the real-time data analytics application, and a cloud service is generated that is associated with the domain name. The application definition package is applied to an application template to generate a finalized real-time data analytics package. The finalized real-time data analytics package is instantiated in the cloud service to create a network-accessible instance of the real-time data analytics application.
1. A real-time data analytics service executed by a processor in at least one server, comprising:
a data analytics application framework that is configurable to generate a real-time data analytics application, the data analytics application framework including an event collector, a reference data service, and a data analytics processing engine; and
a network-based service that executes on the processor in the at least one server, the network-based service configured to provide network access for the real-time data analytics application;
the event collector configured to receive at least one payload definition that defines real-time data to be received by the event collector;
the reference data service configured to receive at least one reference data definition that defines reference data to be provided by the reference data service; and
the data analytics processing engine configured to receive at least a query definition that defines at least one query, the data analytics processing engine configured to process the real-time data and the reference data according to the at least one query to generate output data for the real-time analytics application.
2. The real-time data analytics service of claim 1 , wherein the configurable data analytics application framework further comprises:
a state engine configured to receive at least one control flow definition.
3. The real-time data analytics service of claim 2 , further comprising:
a user dashboard that is network accessible by a computing device to display the output data to a user of the computing device.
4. The real-time data analytics service of claim 3 , wherein during operation, the event collector receives real-time data formatted according to the at least one payload definition, the data analytics processing engine executes the at least one query to generate the output data based on the received real-time data and reference data received from the reference data service, and the user dashboard receives the output data for display.
5. The real-time data analytics service of claim 4 , wherein during operation, the state engine synchronizes the output data according to the at least one control flow definition.
6. The real-time data analytics service of claim 1 , wherein the configurable data analytics application framework further comprises:
an authentication module that is configurable according to a received authentication type to perform an authentication service for the real-time data analytics application.
7. The real-time data analytics service of claim 1 , wherein the configurable data analytics application framework further comprises:
an authorization module that is configurable according to a received authorization policy to perform an authorization service for the real-time data analytics application.
8. The real-time data analytics service of claim 1 , further comprising:
an application monitor configured to monitor a health of the real-time data analytics application.
9. A computer-readable program storage memory having program logic encoded thereon that, when executed by a processing system, performs a method for a real-time data analytics service, the method comprising:
generating a real-time data analytics application according to a data analytics application framework, the data analytics application framework including an event collector, a reference data service, and a data analytics processing engine;
executing, by the processing system, a network-based service configured to provide network access for the real-time data analytics application;
receiving, by the event collector, at least one payload definition that defines real-time data to be received by the event collector;
receiving, by the reference data service, at least one reference data definition that defines reference data to be provided by the reference data service;
receiving, by the data analytics processing engine, at least a query definition that defines at least one query; and
processing, by the data analytics processing engine, the real-time data and the reference data according to the at least one query to generate output data for the real-time analytics application.
10. The computer-readable program storage memory of claim 9 , the method further comprising:
receiving, by a state engine, at least one control flow definition.
11. The computer-readable program storage memory of claim 10 , further comprising:
displaying, by a user dashboard that is network accessible by a computing device, the output data to a user of the computing device.
12. The computer-readable program storage memory of claim 11 , the method further comprising:
receiving, by the event collector, real-time data formatted according to the at least one payload definition;
executing, by the data analytics processing engine, the at least one query to generate the output data based on the received real-time data and reference data received from the reference data service; and
receiving the output data for display by the user dashboard.
13. The computer-readable program storage memory of claim 12 , the method further comprising:
synchronizing, by the state engine, the output data according to the at least one control flow definition.
14. The computer-readable program storage memor of claim 9 , the method further comprising:
performing, by an authentication module that is configurable according to a received authentication type, an authentication service for the real-time data analytics application.
15. The computer-readable program storage memory of claim 9 , the method further comprising:
performing, by an authorization module that is configurable according to a received authorization policy, an authorization service for the real-time data analytics application.
16. The computer-readable program storage memory of claim 9 , the method further comprising:
monitoring, by an application monitor, a health of the real-time data analytics application.
17. A method for a real-time data analytics service executed by at least one processor of a processing system, the method comprising:
executing, by the at least one processor of the processing system, a network-based service configured to provide network access for a real-time data analytics application;
receiving, by an event collector, at least one payload definition that defines real-time data to be received by the event collector;
receiving, by a reference data service, at least one reference data definition that defines reference data to be provided by the reference data service;
receiving, by a data analytics processing engine, at least a query definition that defines at least one query; and
processing, by the data analytics processing engine, the real-time data and the reference data according to the at least one query to generate output data for the real-time analytics application.
18. The method of claim 17 , the method further comprising:
receiving, by a state engine, at least one control flow definition; and
synchronizing, by the state engine, the output data according to the at least one control flow definition.
19. The method of claim 18 , the method further comprising:
receiving, by the event collector, real-time data formatted according to the at least one payload definition; and
executing, by the data analytics processing engine, the at least one query to generate the output data based on the received real-time data and reference data received from the reference data service.
20. The method of claim 17 , the method further comprising at least one of:
performing, by an authentication module that is configurable according to a received authentication type, an authentication service for the real-time data analytics application; or
performing, by an authorization module that is configurable according to a received authorization policy, an authorization service for the real-time data analytics application.