Resource management systems and methods
Example resource management systems and methods are described. In one implementation, a resource manager is to be coupled to one or more virtual data warehouse instances that each comprise a plurality of computing resources. A resource manager receives a query directed to database data. The resource manager determines a task associated with the query. The resource manager distributes the task to a first virtual data warehouse instance of the plurality of virtual data warehouse instances. The resource manager determines that the first virtual data warehouse instance of the plurality of virtual data warehouse instances no longer accesses the database data. The resource manager reconfigures the first virtual data warehouse instance to delete a communication between the first virtual data warehouse instance and the database.
1 . A system, comprising:
a resource manager comprising a software program stored in memory and executed by a processing device, the resource manager to be coupled to a plurality of virtual data warehouse instances that each comprise a plurality of computing resources, the plurality of virtual data warehouse instances to be coupled to a database, the resource manager configured to:
receive a query directed to database data stored in the database;
determine a task associated with the query;
distribute the task to a first virtual data warehouse instance of the plurality of virtual data warehouse instances;
determine that the first virtual data warehouse instance of the plurality of virtual data warehouse instances no longer accesses the database data;
reconfigure the first virtual data warehouse instance to delete a communication between the first virtual data warehouse instance and the database;
maintain a logical mapping between the plurality of virtual data warehouse instances and the database, and
dynamically modify the logical mapping based on access patterns of the virtual data warehouse instances.
2 . The system of claim 1 , wherein the database is stored in a data store comprising a plurality of storage devices.
3 . The system of claim 2 , wherein the data store further comprises a virtual database.
4 . The system of claim 1 , wherein the resource manager is external to and separate from the computing resources of the plurality of virtual data warehouse instances.
5 . The system of claim 1 , wherein each of the plurality of computing resources comprises at least one processor.
6 . The system of claim 1 , wherein the query is in a form of one or more SQL statements.
7 . The system of claim 6 , wherein the resource manager is further configured to identify at least one storage device that is associated with database data identified in the query.
8 . The system of claim 1 , wherein the resource manager to:
configure, on demand, a computing resource of the plurality of virtual data warehouse instances.
9 . The system of claim 8 , wherein the resource manager to at least one of:
configure a number of processors of the computing resource;
configure a storage capacity of a cache memory of the computing resource; or
configure a number of processors of the computing resource, and configure a size of the cache memory of the computing resource; and wherein the number of processors and the size of the cache memory are configured independently of each other.
10 . A method, comprising:
receiving, by a processing device, a query directed to database data, the processing device to be coupled to a plurality of virtual data warehouse instances that each comprise a plurality of computing resources, the plurality of virtual data warehouse instances to be coupled to a database;
determining a task associated with the query stored in the database;
distributing the task to a first virtual data warehouse instance of the plurality of virtual data warehouse instances;
determining that the first virtual data warehouse instance of the plurality of virtual data warehouse instances no longer accesses the database data;
reconfiguring the first virtual data warehouse instance to delete a communication between the first virtual data warehouse instance and the database;
maintaining a logical mapping between the plurality of virtual data warehouse instances and the database, and
dynamically modifying the logical mapping based on access patterns of the virtual data warehouse instances.
11 . The method of claim 10 , wherein the database is stored in a data store comprising a plurality of storage devices.
12 . The method of claim 11 , wherein the data store further comprises a virtual database.
13 . The method of claim 10 , wherein the processing device is external to and separate from the computing resources of the plurality of virtual data warehouse instances.
14 . The method of claim 10 , wherein each of the plurality of computing resources comprises at least one processor.
15 . The method of claim 10 , wherein the query is in a form of one or more SQL statements.
16 . The method of claim 15 , further comprising:
identifying at least one storage device that is associated with database data identified in the query.
17 . The method of claim 10 , further comprising:
configuring, on demand, a computing resource of the plurality of virtual data warehouse instances.
18 . The method of claim 17 , further comprising at least one of:
configuring a number of processors of the computing resource;
configuring a storage capacity of a cache memory of the computing resource; or
configuring a number of processors of the computing resource, and configuring a size of the cache memory of the computing resource; and wherein the number of processors and the size of the cache memory are configured independently of each other.
19 . A non-transitory computer-readable medium storing instructions that, when executed by a processing device, cause the processing device to:
receive, by the processing device, a query directed to database data, the processing device to be coupled to a plurality of virtual data warehouse instances that each comprise a plurality of computing resources, the plurality of virtual data warehouse instances to be coupled to a database;
determine a task associated with the query;
distribute the task to a first virtual data warehouse instance of the plurality of virtual data warehouse instances;
determine that the first virtual data warehouse instance of the plurality of virtual data warehouse instances no longer accesses the database data; and
reconfigure the first virtual data warehouse instance to delete a communication between the first virtual data warehouse instance and the database;
maintain a logical mapping between the plurality of virtual data warehouse instances and the database, and
dynamically modify the logical mapping based on access patterns of the virtual data warehouse instances.
20 . The non-transitory computer-readable medium of claim 19 , wherein the database is stored in a data store comprising a plurality of storage devices.
21 . The non-transitory computer-readable medium of claim 20 , wherein the data store further comprises a virtual database.
22 . The non-transitory computer-readable medium of claim 19 , wherein the processing device is external to and separate from the computing resources of the plurality of virtual data warehouse instances.
23 . The non-transitory computer-readable medium of claim 19 , wherein each of the plurality of computing resources comprises at least one processor.
24 . The non-transitory computer-readable medium of claim 19 , wherein the query is in a form of one or more SQL statements.
25 . The non-transitory computer-readable medium of claim 24 , wherein the processing device is further to:
identify at least one storage device that is associated with database data identified in the query.
26 . The non-transitory computer-readable medium of claim 19 , wherein the processing device is further to:
configure, on demand, a computing resource of the plurality of virtual data warehouse instances.
27 . The non-transitory computer-readable medium of claim 26 , wherein the processing device is further to at least one of:
configure a number of processors of the computing resource;
configure a storage capacity of a cache memory of the computing resource; or
configure a number of processors of the computing resource, and configure a size of the cache memory of the computing resource; and wherein the number of processors and the size of the cache memory are configured independently of each other.