CloudLake real-time single operational view query and resource monitoring
A data warehouse executes as at least one of a plurality of processes on a primary cluster. The data warehouse issues executable steps to processes executing on a compute cluster. The data warehouse receives a performance monitoring (PM) query from a client requesting data warehouse performance monitoring information. A single operational view performance monitoring application program interface (SOVPMAPI) executing on the primary cluster converts the performance monitoring query into a call to a federator application program interface (FAPI) to gather data warehouse performance monitoring information requested in the performance monitoring query. The FAPI requests database performance monitoring information from fast path performance monitoring application program interfaces (FPPMAPIs) executing on the primary cluster and the compute cluster, receives the requested data warehouse information, compiles a response to the call from the SOVPMAPI, and sends the compiled response to the SOVPMAPI, which prepares a result set and provides it to the client.
1 . A method comprising:
executing a plurality of processes in a CloudLake tenant,
wherein the CloudLake tenant includes:
a primary cluster executing a single operational view performance monitoring application program interface (SOVPMAPI),
a compute cluster,
a federator compute cluster executing a federator application program interface (FAPI), and
a cloud object storage;
wherein the primary cluster and the compute cluster each execute a fast path performance monitoring application program interface (FPPMAPI), wherein each FPPMAPI provides performance monitoring information regarding only the respective cluster it is executing on;
a data warehouse executing as at least one of a plurality of processes on the primary cluster;
the data warehouse configured to issue executable steps to processes executing as part of the data warehouse on the compute cluster,
the data warehouse receiving a performance monitoring (PM) query from a client requesting data warehouse performance monitoring information;
the SOVPMAPI converting the performance monitoring query into a call to the FAPI to gather the data warehouse performance monitoring information requested in the performance monitoring query;
the FAPI requesting database performance monitoring information from the FPPMAPIs, receiving the requested data warehouse performance monitoring information, compiling a response to the call from the SOVPMAPI, and sending the compiled response to the SOVPMAPI; and
the SOVPMAPI preparing a result set and providing it to the client.
2 . The method of claim 1 further comprising a POD Agent that, upon request from the FAPI, provides a layout of the compute clusters.
3 . The method of claim 1 further comprising the data warehouse receiving a business request to execute and executing the business request on the CloudLake tenant, wherein execution of the PM query begins after execution of the business request.
4 . The method of claim 3 wherein the result set prepared by the SOVPMAPI includes information regarding execution of the business request.
5 . The method of claim 4 wherein the data warehouse adjusts execution of the business request in real time while the business request is executing in response to the performance information gathered by the PM query.
6 . The method of claim 1 wherein the data warehouse adjusts the CloudLake tenant in response to the performance information gathered by the PM query.
7 . The method of claim 6 wherein the data warehouse adjusts the CloudLake tenant by redistributing data among the primary cluster and the compute cluster to address issues identified in the performance information gathered by the PM query.
8 . The method of claim 6 wherein the data warehouse adjusts the CloudLake tenant by changing resource allocations among the primary cluster and the compute cluster to address issues identified in the performance information gathered by the PM query.
9 . The method of claim 1 where in the performance monitoring query is a Structured Query Language (SQL) query.
10 . A non-transitory computer-readable tangible medium, on which is recorded a computer program, the computer program comprising executable instructions, that, when executed, perform a method comprising:
executing a plurality of processes in a CloudLake tenant,
wherein the CloudLake tenant includes:
a primary cluster executing a single operational view performance monitoring application program interface (SOVPMAPI),
a compute cluster,
a federator compute cluster executing a federator application program interface (FAPI), and
a cloud object storage;
wherein the primary cluster and the compute cluster each execute a fast path performance monitoring application program interface (FPPMAPI), wherein each FPPMAPI provides performance monitoring information regarding only the respective cluster it is executing on;
a data warehouse executing as at least one of a plurality of processes on the primary cluster;
the data warehouse configured to issue executable steps to processes executing as part of the data warehouse on the compute cluster,
the data warehouse receiving a performance monitoring (PM) query from a client requesting data warehouse performance monitoring information;
the SOVPMAPI converting the performance monitoring query into a call to the FAPI to gather the data warehouse performance monitoring information requested in the performance monitoring query;
the FAPI requesting database performance monitoring information from the FPPMAPIs, receiving the requested data warehouse performance monitoring information, compiling a response to the call from the SOVPMAPI, and sending the compiled response to the SOVPMAPI; and
the SOVPMAPI preparing a result set and providing it to the client.
11 . The non-transitory computer-readable tangible medium of claim 10 , wherein the method further comprising a POD Agent that, upon request from the FAPI, provides a layout of the compute clusters.
12 . The non-transitory computer-readable tangible medium of claim 10 , wherein the method further comprising the data warehouse receiving a business request to execute and executing the business request on the CloudLake tenant, wherein execution of the PM query begins after execution of the business request.
13 . The non-transitory computer-readable tangible medium of claim 12 wherein the result set prepared by the SOVPMAPI includes information regarding execution of the business request.
14 . The non-transitory computer-readable tangible medium
of claim 12 wherein the data warehouse adjusts execution of the business request in real time while the business request is executing in response to the performance information gathered by the PM query.
15 . The non-transitory computer-readable tangible medium
of claim 10 wherein the data warehouse adjusts the CloudLake tenant in response to the performance information gathered by the PM query.
16 . The non-transitory computer-readable tangible medium of claim 15 wherein the data warehouse adjusts the CloudLake tenant by redistributing data among the primary cluster and the compute cluster to address issues identified in the performance information gathered by the PM query.
17 . The non-transitory computer-readable tangible medium of claim 15 wherein the data warehouse adjusts the CloudLake tenant by changing resource allocations among the primary cluster and the compute cluster to address issues identified in the performance information gathered by the PM query.
18 . The non-transitory computer-readable tangible medium of claim 10 wherein the performance monitoring query is a Structured Query Language (SQL) query.
19 . A system comprising:
a CloudLake tenant executing a plurality of processes,
wherein the CloudLake tenant includes:
a primary cluster executing a single operational view performance monitoring application program interface (SOVPMAPI),
a compute cluster,
a federator compute cluster executing a federator application program interface (FAPI), and
a cloud object storage;
wherein the primary cluster and the compute cluster each execute a fast path performance monitoring application program interface (FPPMAPI), wherein each FPPMAPI provides performance monitoring information regarding only the respective cluster it is executing on;
a data warehouse executing as at least one of a plurality of processes on the primary cluster;
the data warehouse configured to issue executable steps to processes executing as part of the data warehouse on the compute cluster,
the data warehouse receiving a performance monitoring (PM) query from a client requesting data warehouse performance monitoring information;
the SOVPMAPI converting the performance monitoring query into a call to the FAPI to gather the data warehouse performance monitoring information requested in the performance monitoring query;
the FAPI requesting database performance monitoring information from the FPPMAPIs, receiving the requested data warehouse performance monitoring information, compiling a response to the call from the SOVPMAPI, and sending the compiled response to the SOVPMAPI; and
the SOVPMAPI preparing a result set and providing it to the client.
20 . The system of claim 19 further comprising the data warehouse receiving a business request to execute and executing the business request on the CloudLake tenant, wherein execution of the PM query begins after execution of the business request.