Monitoring resources of a virtual data warehouse
Example resource management systems and methods are described. The method includes providing a plurality of processors and a plurality of cache memories in association with a virtual data warehouse management system, wherein each of the plurality of processors is associated with a stateless node. The method includes monitoring a performance of at least one processor of the plurality of processors to process database data. The method includes detecting a failure associated with the stateless node to process the database data responsive to monitoring the performance of the at least one processor of the plurality of processors to process the database data. The method includes replacing the stateless node with a different node without recreating a particular state.
1 . A virtual data warehouse management system, comprising:
a database manager executable by the one or more processors; and
a plurality of processors operatively coupled to the database manager, wherein:
each processor of the plurality of processors is associated with a stateless node that is not associated with state information indicative of either a particular state of the stateless node or data being cached by the stateless node, and
the database manager further to:
monitor a performance of at least one processor of the plurality of processors to process database data;
detect a failure associated with the stateless node to process the database data responsive to monitoring the performance of the at least one processor of the plurality of processors to process the database data; and
replace the stateless node with a different node without recreating a particular state.
2 . The virtual data warehouse management system of claim 1 , wherein the database data is stored in one or more cache memories and further comprising a metadata manager to determine an organization of the database data within the one or more cache memories based on metadata associated with the database data.
3 . The virtual data warehouse management system of claim 2 , wherein the database manager to:
allocate work to the at least one processor of the plurality of processors to process the database data.
4 . The virtual data warehouse management system of claim 3 , wherein the work is allocated to the at least one processor of the plurality of processors based on how frequently the database data is accessed.
5 . The virtual data warehouse management system of claim 3 , wherein the database manager to allocate the work to a plurality of virtual data warehouse instances to process a query.
6 . The virtual data warehouse management system of claim 2 , wherein the plurality of processors is coupled to one or more storage devices, which are external to and separate from the plurality of processors.
7 . The virtual data warehouse management system of claim 6 , wherein the one or more storage devices comprise a virtual database.
8 . The virtual data warehouse management system of claim 1 , wherein the database manager is external to and separate from computing resources of the plurality of processors.
9 . The virtual data warehouse management system of claim 1 , wherein the one or more storage devices comprise a plurality of virtual data stores.
10 . The virtual data warehouse management system of claim 9 , wherein the one or more storage devices comprise a logical mapping between the plurality of virtual data stores.
11 . A method, comprising:
providing a plurality of processors and a plurality of cache memories in association with a virtual data warehouse management system, wherein each of the plurality of processors is associated with a stateless node that is not associated with state information indicative of either a particular state of the stateless node or data being cached by the stateless node;
monitoring a performance of at least one processor of the plurality of processors to process database data;
detecting a failure associated with the stateless node to process the database data responsive to monitoring the performance of the at least one processor of the plurality of processors to process the database data; and
replacing the stateless node with a different node without recreating a particular state.
12 . The method of claim 11 , wherein the database data is stored in one or more cache memories and further comprising:
determining an organization of the database data within the one or more cache memories based on metadata associated with the database data.
13 . The method of claim 12 , further comprising:
allocating work to the at least one processor of the plurality of processors to process the database data.
14 . The method of claim 13 , wherein the work is allocated to the at least one processor of the plurality of processors based on how frequently the database data is accessed.
15 . The method of claim 13 , further comprising allocating the work to a plurality of virtual data warehouse instances to process a query.
16 . The method of claim 11 , wherein the plurality of processors is coupled to one or more storage devices, and wherein the one or more storage devices are external to and separate from the plurality of processors.
17 . The method of claim 16 , wherein the one or more storage devices comprise a virtual database.
18 . The method of claim 11 , wherein the allocating work to the plurality of processors is performed by a database manager that is external to and separate from computing resources of the plurality of processors.
19 . The method of claim 11 , wherein the one or more storage devices comprise a plurality of virtual data stores.
20 . The method of claim 19 , wherein the one or more storage devices comprise a logical mapping between the plurality of virtual data stores.
21 . A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor, cause the processor to:
provide a plurality of processors in association with a virtual data warehouse management system, wherein each of the plurality of processors is associated with a stateless node that is not associated with state information indicative of either a particular state of the stateless node or data being cached by the stateless node;
monitor a performance of at least one processor of the plurality of processors to process database data;
detect a failure associated with the stateless node to process the database data responsive to monitoring the performance of the at least one processor of the plurality of processors to process the database data; and
replace the stateless node with a different node without recreating a particular state.
22 . The non-transitory computer-readable medium of claim 21 , wherein the database data is stored in one or more cache memories and wherein the processor is further to determine an organization of the database data within the one or more cache memories based on metadata associated with the database data.
23 . The non-transitory computer-readable medium of claim 22 , wherein the processor is further to allocate work to the at least one processor of the plurality of processors to process the database data.
24 . The non-transitory computer-readable medium of claim 23 , wherein the work is allocated to the at least one processor of the plurality of processors based on how frequently the database data is accessed.
25 . The non-transitory computer-readable medium of claim 23 , wherein the processor is to allocate the work to a plurality of virtual data warehouse instances to process a query.
26 . The non-transitory computer-readable medium of claim 21 , wherein the plurality of processors is coupled to one or more storage devices, and wherein the one or more storage devices are external to and separate from the plurality of processors.
27 . The non-transitory computer-readable medium of claim 26 , wherein the one or more storage devices comprise a virtual database.
28 . The non-transitory computer-readable medium of claim 21 , wherein to allocate the work to the plurality of processors, the processor uses a database manager that is external to and separate from computing resources of the plurality of processors.
29 . The non-transitory computer-readable medium of claim 21 , wherein the one or more storage devices comprise a plurality of virtual data stores.
30 . The non-transitory computer-readable medium of claim 29 , wherein the one or more storage devices comprise a logical mapping between the plurality of virtual data stores.