Resource provisioning systems and methods
A method and apparatus managing a set of processors for a set of queries is described. In an exemplary embodiment, a device receives a set of queries for a data warehouse, the set of queries including one or more queries to be processed by the data warehouse. The device further provisions a set of processors from a first plurality of processors, where the set of processors to process the set of queries, and a set of storage resources to store data for the set of queries. In addition, the device monitors a utilization of the set of processors as the set of processors processes the set of queries. The device additionally updates a number of the processors in the set of processors provisioned based on the utilization/Furthermore, the device processes the set of queries using the updated set of processors.
1. A non-transitory computer-readable medium storing instructions which, when executed by one or more second processors of a computing device, cause the one or more second processors to:
provision a set of processors from a first plurality of processors, the set of processors to process a set of queries, a set of storage resources shared by each of the set of processors to store data for the set of queries;
change an amount of the processor resources in the set of processors using a utilization of the set of processors as the set of processors that are processing the set of queries, wherein changing of the set of storage resources is independent to the change in the number of processors resources; and
process the set of queries using the changed set of processors.
2. The non-transitory computer-readable medium of claim 1 , wherein the changing the amount of processor resources includes at least one of increasing the number of processors in the set of processors or decreasing the amount of processor resources in the set of processors.
3. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more second processors to:
monitor a utilization of the set of storage resources as the set of queries are processed, and
update an amount of the storage resources in the set of storage resources provisioned based on the utilization, wherein the updating of the set of storage resources is independent to the change in the amount of processor resources.
4. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more second processors to:
monitor a utilization of the set of processors as the set of queries are processed.
5. The non-transitory computer-readable medium of claim 4 , wherein the utilization is selected from the group consisting of a number of queries running concurrently, a percentage of maximum load, and query processing delay.
6. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more second processors to:
receive an additional query for the set of queries.
7. The non-transitory computer-readable medium of claim 6 , determining a change in the set of processors in response to receiving the additional query.
8. The non-transitory computer-readable medium of claim 1 , wherein the instructions further cause the one or more second processors to:
optimize at least one of the queries in the set of queries.
9. The non-transitory computer-readable medium of claim 1 , wherein the set of queries are queries for a relational database.
10. The non-transitory computer-readable medium of claim 8 , wherein the relational database is a structured query language database.
11. A method comprising:
provisioning a set of processors from a first plurality of processors, the set of processors to process a set of queries, a set of storage resources shared by each of the set of processors to store data for the set of queries;
changing an amount of the processor resources in the set of processors using a utilization of the set of processors as the set of processors that are processing the set of queries, wherein changing of a set of storage resources is independent to the change in the processor resources; and
processing the set of queries using the changed set of processors.
12. The method of claim 11 , wherein the changing the amount of processor resources includes at least one of increasing the amount of processor resources in the set of processors or decreasing the amount of processor resources in the set of processors.
13. The method of claim 11 , further comprising:
monitoring a utilization of the set of storage resources as the set of queries are processed by, and
updating an amount of the storage resources in the set of storage resources provisioned based on the utilization, wherein the updating of the set of storage resources is independent to the change in the amount of processor resources.
14. The method of claim 11 , further comprising:
monitoring a utilization of the set of processors as the set of queries are processed.
15. The method of claim 14 , wherein the utilization is selected from the group consisting of a number of queries running concurrently, a percentage of maximum load, and query processing delay.
16. The method of claim 11 , further comprising:
receiving an additional query for the set of queries.
17. The method of claim 15 , determining a change in the set of processors in response to receiving the additional query.
18. The method of claim 11 , further comprising:
optimizing at least one of the queries in the set of queries.
19. The method of claim 11 , wherein the set of queries are for a relational database.
20. The method of claim 18 , wherein the relational database is a structured query language database.
21. A system comprising:
a set of storage resources;
a resource manager to:
provision the set of storage resources from a plurality of storage resources, the set of storage resources shared by each of a set of plurality of processing units to store data for the set of queries; and
change an amount of the storage resources in the set of storage resources using a utilization of the storage capacity of the set of storage resources as the set of storage resources that are used in processing the set of queries, wherein the changing of the set of storage resources is independent to a change in an amount of processor resources in the plurality of processors and
the plurality of processing units to process the set of queries using the changed amount of storage resources.
22. The system of claim 21 , wherein the resource manager changes the amount of storage resources by increasing the amount of storage resources in the set of storage resources.
23. The system of claim 21 , wherein the resource manager changed the amount of storage resources by decreasing the amount of storage resources in the set of storage resources.
24. The system of claim 21 , wherein the resource manager further to:
monitor a utilization of the set of storage resources as the set of queries are processed.
25. The system of claim 21 , wherein the utilization is selected from the group consisting of a number of queries running concurrently, a percentage of maximum load, and query processing delay.
26. The system of claim 21 , wherein the resource manager further to receive an additional query for the set of queries.
27. The system of claim 25 , wherein the resource manager determines a change in the set of storage resources in response to receiving the additional query.
28. The system of claim 21 , wherein the resource manager further to optimize at least one of the queries in the set of queries.
29. The system of claim 21 , wherein the set of queries are for a relational database.
30. The system of claim 28 , wherein the relational database is a structured query language database.