Adjusting processing times in data warehouses to user-defined levels
A system and method of scaling capacity of data warehouses to user-defined levels. The method includes monitoring a processing of one or more queries by a data warehouse, the data warehouse including one or more processing resources and a storage platform. The method includes receiving a request to process database data stored on the storage platform. The method includes determining a performance of the processed request as observed by a user device. The method includes adjusting, by a processing device, a timing associated with the processing of the one or more queries based on the performance of the processed request.
1. A method comprising:
monitoring a processing of one or more queries by a data warehouse, the data warehouse comprising one or more processing resources and a storage platform;
receiving a request to process database data stored on the storage platform;
determining a performance of the processed request as observed by a user device; and
adjusting, by a processing device based on the performance of the processed request, a timing associated with the processing of the one or more queries to adjust a different timing associated with processing the request.
2. The method of claim 1 , further comprising:
adding at least one additional processor to the data warehouse; or
adding at least one additional storage device to the data warehouse.
3. The method of claim 2 , further comprising:
determining that the at least one additional processor is no longer needed; and
removing the at least one additional processor from the data warehouse.
4. The method of claim 2 , wherein adding the at least one additional processor to the data warehouse is accomplished without affecting a storage capacity of the storage platform.
5. The method of claim 1 , wherein adjusting the timing associated with the processing of the one or more queries based on the performance of the processed request comprises:
delaying the timing associated with the processing of the one or more queries.
6. The method of claim 1 , wherein adjusting, by the processing device, the timing associated with the processing of the one or more queries based on the performance of the processed request comprises determining that a current query processing delay would exceed a threshold delay.
7. The method of claim 1 , wherein each processing resource of the one or more processing resources comprises a plurality of processors each comprising a data cache.
8. The method of claim 1 , wherein the storage platform is physically separate from the one or more processing resources of the data warehouse.
9. The method of claim 1 , wherein the request comprises a data retrieval request or a data storage request.
10. A system, comprising:
a memory; and
a processing device, operatively coupled to the memory, to:
monitor a processing of one or more queries by a data warehouse, the data warehouse comprising one or more processing resources and a storage platform;
receive a request to process database data stored on the storage platform;
determine a performance of the processed request as observed by a user device; and
adjust, based on the performance of the processed request, a timing associated with the processing of the one or more queries to adjust a different timing associated with processing the request.
11. The system of claim 10 , wherein the processing device is further to:
add at least one additional processor to the data warehouse; or
add at least one additional storage device to the data warehouse.
12. The system of claim 11 , wherein the processing device is further to:
determine that the at least one additional processor is no longer needed; and
remove the at least one additional processor from the data warehouse.
13. The system of claim 10 , wherein to add the at least one additional processor to the data warehouse is accomplished without affecting a storage capacity of the storage platform.
14. The system of claim 10 , wherein to adjust the timing associated with the processing of the one or more queries based on the performance of the processed request, the processing device is further to:
delay the timing associated with the processing of the one or more queries.
15. The system of claim 10 , wherein to adjust, by the processing device, the timing associated with the processing of the one or more queries based on the performance of the processed request, the processing device is further to determine that a current query processing delay would exceed a threshold delay.
16. The system of claim 10 , wherein each processing resource of the one or more processing resources comprises a plurality of processors each comprising a data cache.
17. The system of claim 10 , wherein the storage platform is physically separate from the one or more processing resources of the data warehouse.
18. The system of claim 10 , wherein the request comprises a data retrieval request or a data storage request.
19. A non-transitory computer-readable medium storing instructions that, when executed by a processing device, cause the processing device to:
monitor a processing of one or more queries by a data warehouse, the data warehouse comprising one or more processing resources and a storage platform;
receive a request to process database data stored on the storage platform;
determine a performance of the processed request as observed by a user device; and
adjust, by the processing device based on the performance of the processed request, a timing associated with the processing of the one or more queries to adjust a different timing associated with processing the request.
20. The non-transitory computer-readable medium of claim 19 , wherein the instructions, when executed by the processing device, further cause the processing device to:
add at least one additional processor to the data warehouse; or
add at least one additional storage device to the data warehouse.
21. The non-transitory computer-readable medium of claim 20 , wherein the instructions, when executed by the processing device, further cause the processing device to:
determine that the at least one additional processor is no longer needed; and
remove the at least one additional processor from the data warehouse.
22. The non-transitory computer-readable medium of claim 21 , wherein adding the at least one additional processor to the data warehouse is accomplished without affecting a storage capacity of the storage platform.
23. The non-transitory computer-readable medium of claim 20 , wherein the instructions, when executed by the processing device, further cause the processing device to:
delay the timing associated with the processing of the one or more queries.
24. The non-transitory computer-readable medium of claim 19 , wherein the instructions, when executed by the processing device, further cause the processing device to:
determine that a current query processing delay would exceed a threshold delay.
25. The non-transitory computer-readable medium of claim 19 , wherein each processing resource of the one or more processing resources comprises a plurality of processors each comprising a data cache.
26. The non-transitory computer-readable medium of claim 19 , wherein the storage platform is physically separate from the one or more processing resources of the data warehouse.
27. The non-transitory computer-readable medium of claim 19 , wherein the request comprises a data retrieval request or a data storage request.