Systems and methods for archiving time-series data during high-demand intervals
View Patent ↗In one embodiment, a method includes continuously receiving time-series data for end-user transactions occurring on one or more monitored systems. The method further includes continuously processing and storing the time-series data in a plurality of virtual machines. In addition, the method includes, responsive to a determined time-series-data burst, spawning one or more temporary virtual machines. Moreover, the method includes, during the determined time-series-data burst, continuously processing and storing the time-series data in the plurality of virtual machines and in the one or more temporary virtual machines. The method also includes, responsive to a determined conclusion of the determined time-series-data burst, causing the one or more temporary virtual machines to transition to a passive state in which the one or more temporary virtual machines cease processing and storing new time-series data but make previously-stored time-series data available for access.
1. A method comprising, by a computer system:
continuously receiving time-series data for end-user transactions occurring on one or more monitored systems;
continuously processing and storing the time-series data in a plurality of virtual machines;
responsive to a determined time-series-data burst, spawning one or more temporary virtual machines;
during the determined time-series-data burst, continuously processing and storing the time-series data in the plurality of virtual machines and in the one or more temporary virtual machines; and
responsive to a determined conclusion of the determined time-series-data burst, causing the one or more temporary virtual machines to transition to a passive state in which the one or more temporary virtual machines cease processing and storing new time-series data but make previously-stored time-series data available for access.
2. The method of claim 1 , comprising, responsive to an expiration of a configurable period of time after the determined conclusion, tearing down the one or more temporary virtual machines such that the previously-stored time-series data is no longer available for access.
3. The method of claim 1 , comprising:
responsive to a subsequent time-series-data burst while the one or more temporary virtual machines are in the passive state, reactivating the one or more temporary virtual machines; and
wherein, once reactivated, the one or more temporary virtual machines resume processing and storing time-series data.
4. The method of claim 1 , comprising, maintaining a time map indicative of one or more periods during which the one or more temporary virtual machines are processing and storing time-series data for end-user transactions.
5. The method of claim 4 , comprising:
receiving a data query request;
identifying a set of virtual machines that potentially have responsive data based, at least in part, on the time map;
wherein the set of virtual machines is identified from among the plurality of virtual machines and the one or more temporary virtual machines;
executing a distributed query across the set of virtual machines; and
receiving data responsive to the distributed query from the set of virtual machines.
6. The method of claim 5 , wherein the identifying comprises excluding any of the one or more temporary virtual machines that, as indicated by the time map, were not processing and storing time-series data during a time period specified by the data query request.
7. The method of claim 1 , wherein:
the one or more temporary virtual machines comprise a set of one or more priority virtual machines and a set of one or more standard virtual machines; and
the priority virtual machines have greater storage capacity than the standard virtual machines.
8. The method of claim 7 , comprising processing and storing time-series data for one or more selected tenants in the priority virtual machines.
9. The method of claim 1 , wherein the one or more monitoring systems comprise a plurality of monitoring systems for a plurality of tenants.
10. The method of claim 1 , comprising periodically summarizing the time-series data in a data store.
11. An information handling system comprising:
at least one hardware processor, wherein the processor is operable to implement a method comprising:
continuously receiving time-series data for end-user transactions occurring on one or more monitored systems;
continuously processing and storing the time-series data in a plurality of virtual machines;
responsive to a determined time-series-data burst, spawning one or more temporary virtual machines;
during the determined time-series-data burst, continuously processing and storing the time-series data in the plurality of virtual machines and in the one or more temporary virtual machines; and
responsive to a determined conclusion of the determined time-series-data burst, causing the one or more temporary virtual machines to transition to a passive state in which the one or more temporary virtual machines cease processing and storing new time-series data but make previously-stored time-series data available for access.
12. The information handling system of claim 11 , the method comprising, responsive to an expiration of a configurable period of time after the determined conclusion, tearing down the one or more temporary virtual machines such that the previously-stored time-series data is no longer available for access.
13. The information handling system of claim 11 , the method comprising:
responsive to a subsequent time-series-data burst while the one or more temporary virtual machines are in the passive state, reactivating the one or more temporary virtual machines; and
wherein, once reactivated, the one or more temporary virtual machines resume processing and storing time-series data.
14. The information handling system of claim 11 , the method comprising maintaining a time map indicative of one or more periods during which the one or more temporary virtual machines are processing and storing time-series data for end-user transactions.
15. The information handling system of claim 14 , the method comprising:
receiving a data query request;
identifying a set of virtual machines that potentially have responsive data based, at least in part, on the time map;
wherein the set of virtual machines is identified from among the plurality of virtual machines and the one or more temporary virtual machines;
executing a distributed query across the set of virtual machines; and
receiving data responsive to the distributed query from the set of virtual machines.
16. The information handling system of claim 15 , wherein the identifying comprises excluding any of the one or more temporary virtual machines that, as indicated by the time map, were not processing and storing time-series data during a time period specified by the data query request.
17. The information handling system of claim 11 , wherein:
the one or more temporary virtual machines comprise a set of one or more priority virtual machines and a set of one or more standard virtual machines; and
the priority virtual machines have greater storage capacity than the standard virtual machines.
18. The information handling system of claim 17 , the method comprising processing and storing time-series data for one or more selected tenants in the priority virtual machines.
19. The information handling system of claim 11 , the method comprising periodically summarizing the time-series data in a data store.
20. A computer-program product comprising a non-transitory computer-usable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed to implement a method comprising:
continuously receiving time-series data for end-user transactions occurring on one or more monitored systems;
continuously processing and storing the time-series data in a plurality of virtual machines;
responsive to a determined time-series-data burst, spawning one or more temporary virtual machines;
during the determined time-series-data burst, continuously processing and storing the time-series data in the plurality of virtual machines and in the one or more temporary virtual machines; and
responsive to a determined conclusion of the determined time-series-data burst, causing the one or more temporary virtual machines to transition to a passive state in which the one or more temporary virtual machines cease processing and storing new time-series data but make previously-stored time-series data available for access.