Methods and systems for making effective use of system resources
Methods and systems for making effective use of system resources. A plurality of requests for access to a resource are received. Each request has an associated group of features. The group of features for each request is analyzed to collect observations about the plurality of requests. A function to predict an outcome of a subsequent request is generated based on the observations. Resources are allocated to service the subsequent request based on the function.
1. A method comprising:
receiving a plurality of requests for access to a resource of a database system, each request having an associated group of features;
analyzing the group of features for each request with a training module to collect observations about the plurality of requests, wherein the training module generates a statistical model for at least one database of the database system;
generating a function to predict an execution time and a number of rows for a subsequent request based on the observations; and
allocating resources in the database system to service the subsequent request based on the function.
2. The method of claim 1 wherein the plurality of requests comprises database queries.
3. The method of claim 1 wherein the group of features comprises:
a number of nested joins in the request;
a number of hash joins in the request; and
a sum of cardinalities for hash joins in the request.
4. The method of claim 1 wherein the group of features comprises:
a cardinality estimate of a main table;
a storage count of the main table; and
a selectivity estimate of the main table.
5. The method of claim 1 wherein the group of features comprises a number of secondary queries in the request.
6. The method of claim 1 wherein the group of features comprises:
an application server processor state; and
an application server memory state.
7. The method of claim 1 wherein the group of features comprises:
a database processor state; and
a number of tables used.
8. A non-transitory computer readable medium having stored there on instructions that, when executed, cause one or more processors to:
receive a plurality of requests for access to a resource of a database system, each request having an associated group of features;
analyze the group of features for each request with a training module to collect observations about the plurality of requests, wherein the training module generates a statistical model for at least one database of the database system;
generate a function to predict an execution time and a number of rows for a subsequent request based on the observations; and
allocate resources in the database system to service the subsequent request based on the function.
9. The article of claim 8 wherein the plurality of requests comprises database queries.
10. The article of claim 8 wherein the group of features comprises:
a number of nested joins in the request;
a number of hash joins in the request; and
a sum of cardinalities for hash joins in the request.
11. The article of claim 8 wherein the group of features comprises:
a cardinality estimate of a main table;
a storage count of the main table; and
a selectivity estimate of the main table.
12. The article of claim 8 wherein the group of features comprises a number of secondary queries in the request.
13. The article of claim 8 wherein the group of features comprises:
an application server processor state; and
an application server memory state.
14. The article of claim 8 wherein the group of features comprises:
a database processor state; and
a number of tables used.
15. A system comprising:
one or more user systems;
one or more firewalls; and
one or more server systems communicatively coupled with the one or more user systems and the one or more firewalls, the server system to provide a multitenant environment, wherein the multitenant environment includes data for multiple client entities, each identified by a tenant identifier (ID) having one or more users associated with the tenant ID, users of each of multiple client identities can only access data identified by a tenant ID associated with the respective client entity, and the multitenant environment is at least a hosted database provided by an entity separate from the client entities, and provides on-demand database service to the client entities, the one or more server systems to receive a plurality of requests for access to a resource of a database system, each request having an associated group of features, to analyze the group of features for each request with a training module to collect observations about the plurality of requests, wherein the training module generates a statistical model for at least one database of the database system, to generate a function to predict an execution time and a number of rows for a subsequent request based on the observations, and to allocate resources in the database system to service the subsequent request based on the function.
16. The system of claim 15 wherein the plurality of requests comprises database queries.
17. The system of claim 15 wherein the group of features comprises:
a number of nested joins in the request;
a number of hash joins in the request; and
a sum of cardinalities for hash joins in the request.
18. The system of claim 15 wherein the group of features comprises:
a cardinality estimate of a main table;
a storage count of the main table; and
a selectivity estimate of the main table.
19. The system of claim 15 wherein the group of features comprises a number of secondary queries in the request.