Automated plan upgrade system for backing services
Embodiments allow automated provisioning of a plan upgrade for databases hosted in storage environments. A database is hosted in a shared storage environment according an existing plan, based upon consumption of available system resources (e.g., processing, I/O, memory, disk). An agent periodically issues requests for information relevant to database behavior (e.g., performance metrics, query logs, and/or knob settings). The agent collects the received information (e.g., via a domain socket), performing analysis thereon to predict whether future database activity is expected remain within the existing plan. Such analysis can include but is not limited to compiling statistics, and calculating values such as entropy, information divergence, and/or adjusted settings for database knobs. Based upon this analysis, the agent communicates a recommendation including a plan update and supporting statistics. Embodiments can reduce the effort/cost of the database administrator in having to manually predict future estimated database resource consumption and generate a plan update.
1. A computer-implemented method comprising:
periodically issuing a request for information from a database in a container of a shared database environment;
collecting the information via a domain socket;
receiving the information in response to the request;
compiling from the information, statistics of current resource consumption by the database;
performing an analysis of the information to calculate a value comprising an entropy representing predicted future resource consumption by the database;
generating a plan update recommendation based upon the value; and
communicating the plan update recommendation including the statistics,
wherein the information comprises a sampling of a query log based upon a classification and a hash table built from the sampling, and
the entropy is calculated using the hash table.
2. The method of claim 1 wherein the container comprises a Virtual Machine (VM) container.
3. The method of claim 1 wherein:
the database is controlled by a knob; and
the value further comprises an adjusted setting of the knob.
4. The method of claim 3 wherein the knob comprises a memory knob.
5. The method of claim 1 wherein the information is collected from the database by a common file descriptor.
6. The method of claim 1 wherein:
the database comprises an in-memory database; and
an in-memory database engine of the in-memory database is configured to perform the analysis.
7. A non-transitory computer readable storage medium embodying a computer program for performing a method, said method comprising:
periodically issuing a request for information from a database in a container of a shared database environment, the database controlled by a memory knob;
collecting the information via a domain socket;
receiving the information in response to the request;
compiling from the information, statistics of current resource consumption by the database;
performing an analysis of the information to calculate an adjusted entropy value representing predicted future resource consumption by the database;
generating a plan update recommendation based upon the value; and
communicating the plan update recommendation including the statistics,
wherein the information comprises a sampling of a query log based upon a classification and a hash table built from the sampling, and
the entropy is calculated using the hash table.
8. The non-transitory computer readable storage medium of claim 7 wherein the container comprises a Virtual Machine (VM) container.
9. The non-transitory computer readable storage medium of claim 7 wherein the information is collected from the database by a common file descriptor.
10. The non-transitory computer readable storage medium of claim 7 wherein:
the database comprises an in-memory database; and
an in-memory database engine of the in-memory database is configured to perform the analysis.
11. A computer system comprising:
one or more processors;
a software program, executable on said computer system, the software program configured to cause an in-memory database engine of an in-memory database to:
periodically issue a request for information from the in-memory database in a container of a shared database environment;
collect the information via a domain socket;
receive the information in response to the request;
compile from the information, statistics of current resource consumption by the database;
perform an analysis of the information to calculate an entropy value representing predicted future resource consumption by the in-memory database;
generate a plan update recommendation based upon the value; and
communicate the plan update recommendation including the statistics,
wherein the information comprises a sampling of a query log based upon a classification and a hash table built from the sampling, and
the entropy is calculated using the hash table.
12. The computer system of claim 11 wherein the information is collected from the in-memory database by a common file descriptor.
13. The computer system of claim 11 wherein:
the in-memory database is controlled by a knob; and
the value further comprises an adjusted setting of the knob.
14. The computer system of claim 13 wherein the knob comprises a memory knob.