Resource provisioning systems and methods
A method and apparatus managing a set of processors for a set of queries is described. In an exemplary embodiment, a device receives a set of queries for a data warehouse, the set of queries including one or more queries to be processed by the data warehouse. The device further provisions a set of processors from a first plurality of processors, where the set of processors to process the set of queries, and a set of storage resources to store data for the set of queries. In addition, the device monitors a utilization of the set of processors as the set of processors processes the set of queries. The device additionally updates a number of the processors in the set of processors provisioned based on the utilization/Furthermore, the device processes the set of queries using the updated set of processors.
1. A non-transitory computer-readable medium storing instructions which, when executed by one or more second processors of a computing device, cause the one or more second processors to:
provision a set of processors from a first plurality of processors, the set of processors to process a set of queries, a set of storage resources shared by each of the set of processors to store data for the set of queries;
change a number of the processors in the set of processors and monitor a utilization of the set of processors as the set of processors that are processing the set of queries, wherein the changing of the number of processors is independent to a change in the set of storage resources; and
process the set of queries using the changed set of processors.
2. The non-transitory computer-readable medium of claim 1 , wherein the changing the number of processors includes increasing the number of processors in the set of processors.
3. The non-transitory computer-readable medium of claim 1 , wherein the changing the number of processors includes decreasing the number of processors in the set of processors.
4. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more second processors to:
monitor a utilization of the set of processors as the set of queries are processed.
5. The non-transitory computer-readable medium of claim 4 , wherein the utilization is selected from the group consisting of a number of queries running concurrently, a percentage of maximum load, and query processing delay.
6. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more second processors to:
receive an additional query for the set of queries.
7. The non-transitory computer-readable medium of claim 5 , determining a change in the set of processors in response to receiving the additional query.
8. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more second processors to:
optimize at least one of the queries in the set of queries.
9. The non-transitory computer-readable medium of claim 1 , wherein the set of queries are queries for a relational database.
10. The non-transitory computer-readable medium of claim 9 , wherein the relational database is a structured query language database.
11. A method comprising:
provisioning a set of processors from a first plurality of processors, the set of processors to process a set of queries, a set of storage resources shared by each of the set of processors to store data for the set of queries;
changing a number of the processors in the set of processors and monitor a utilization of the set of processors as the set of processors that are processing the set of queries, wherein the changing of the number of processors is independent to a change in the set of storage resources; and
processing the set of queries using the changed set of processors.
12. The method of claim 11 , wherein the changing the number of processors includes increasing the number of processors in the set of processors.
13. The method of claim 11 , wherein the changing the number of processors includes decreasing the number of processors in the set of processors.
14. The method of claim 11 , further comprising:
monitoring a utilization of the set of processors as the set of queries are processed.
15. The method of claim 14 , wherein the utilization is selected from the group consisting of a number of queries running concurrently, a percentage of maximum load, and query processing delay.
16. The method of claim 11 , further comprising:
receiving an additional query for the set of queries.
17. The method of claim 16 , determining a change in the set of processors in response to receiving the additional query.
18. The method of claim 11 , further comprising:
optimizing at least one of the queries in the set of queries.
19. The method of claim 11 , wherein the set of queries are for a relational database.
20. The method of claim 19 , wherein the relational database is a structured query language database.
21. A system comprising:
a set of storage resources;
a resource manager to:
provision the set of storage resources from a plurality of storage resources, the set of storage resources shared by each of a set of processors to store data for a set of queries;
and
change an amount of the storage resources in the set of storage resources and monitor a utilization of the storage capacity of the set of storage resources as the set of storage resources that are used in processing the set of queries, wherein the changing of the set of storage resources is independent to a change in a number of processors in the set of processors; and
the set of processors to process the set of queries using the changed amount of storage resources.
22. The system of claim 21 , wherein the resource manager changes the amount of storage resources by increasing the amount of storage resources in the set of storage resources.
23. The system of claim 21 , wherein the resource manager changes the amount of storage resources by decreasing the amount of storage resources in the set of storage resources.
24. The system of claim 21 , wherein the resource manager further to:
monitor a utilization of the set of storage resources as the set of queries are processed.
25. The system of claim 24 , wherein the utilization is selected from the group consisting of a number of queries running concurrently, a percentage of maximum load, and query processing delay.
26. The system of claim 21 , wherein the resource manager further to receive an additional query for the set of queries.
27. The system of claim 26 , wherein the resource manager determines a change in the set of storage resources in response to receiving the additional query.
28. The system of claim 21 , wherein the resource manager further to optimize at least one of the queries in the set of queries.
29. The system of claim 21 , wherein the set of queries are for a relational database.
30. The system of claim 29 , wherein the relational database is a structured query language database.