Dynamic compression of systems management data
View Patent ↗A method, system, and medium for compressing systems management information in a historical data store. Dynamically determining the appropriate compression algorithm to apply based on the type of data being compressed and stored. As further input is received for any particular measurement, the appropriate compression algorithm will be automatically selected from the set of available compression algorithms or be defined by a user configuration parameter. The amount of historical data stored with the minimal amount of data loss is optimized by the system dynamically changing the compression algorithm used for the given input data over a particular time span. The system engineer is therefore presented with the pertinent information for monitoring, administrating and diagnosing system activities.
1. A system management data compression method, comprising:
receiving metric data used in management of a computing system;
evaluating the metric data with one or more rules before compressing the metric data;
selecting a first data compression algorithm based on the evaluation;
compressing the metric data with the selected compression algorithm;
selecting a second data compression algorithm based on the evaluation;
switching from the first algorithm to the second algorithm using an input data point as both a last data point for a current compression sequence and a first data point for a subsequent compression sequence; and
storing the compressed metric data in a repository.
2. The method of claim 1 , further comprising analyzing operations of one or more system components associated with the compressed metric data by using the compressed metric data.
3. The method of claim 1 , wherein selecting the first data compression algorithm based on the evaluation comprises dynamically adjusting settings used in the selected compression algorithm for the metric data.
4. The method of claim 3 , wherein dynamically adjusting settings comprises using a tolerance band defined by a relative precision applied to each data point value of the metric data.
5. The method of claim 1 , wherein the one or more rules include switching of compression algorithms at a designated time.
6. The method of claim 1 , wherein switching of compression algorithms is delayed until the received metric data justifies the switching of algorithms.
7. The method of claim 1 , wherein evaluating the metric data with one or more rules before compressing the metric data comprises applying the one or more rules to data point values of the metric data.
8. The method of claim 1 , wherein evaluating the metric data with one or more rules before compressing the metric data comprises applying the one or more rules to metadata associated with or contained in the metric data.
9. The method of claim 1 , wherein evaluating the metric data with one or more rules before compressing the metric data comprises:
receiving feedback information from a compressor; and
applying the one or more rules to the received feedback information.
10. The method of claim 1 , wherein selecting the second data compression algorithm based on the evaluation comprises selecting a null compressor when metric data crosses a threshold value associated with a parameter being measured.
11. The method of claim 1 , further comprising dynamically tuning the first data compression algorithm before switching to the second data compression algorithm by using previous data values or data types.
12. The method of claim 1 , wherein compressing the metric data with either the first or the second selected compression algorithm comprises discarding any of the received metric data contained within a tolerance band and storing any of the received metric data outside a tolerance band.
13. A program storage device, readable by a programmable control device, comprising instructions stored thereon for causing the programmable control device to perform acts in accordance with claim 1 .
14. A system management data compression method, comprising:
receiving metric data used in management of a computing system;
compressing a first data of the metric data with a first compression algorithm;
evaluating a second data of the metric data with one or more rules;
switching to a second compression algorithm based on the evaluation using an input data point as both a last data point for a first compression sequence and a first data point for a subsequent compression sequence;
compressing the second data with the second compression algorithm; and
storing the compressed data in a repository.
15. The method of claim 14 , wherein switching to a second compression algorithm based on the evaluation comprises automatically adjusting a tolerance band used in the second compression algorithm.
16. The method of claim 15 , wherein automatically adjusting a tolerance band comprises using a tolerance band defined by a relative precision applied to each data point value of the second data.
17. The method of claim 15 , wherein the switching of compression algorithms is delayed by the compressor until the received metric data confirms the switching of algorithms.
18. The method of claim 14 , wherein evaluating the first data with one or more rules comprises applying the one or more rules to one or more of: data point values of the first data, metadata associated with the first data, metadata contained in the first data, and feedback information from the compressor.
19. The method of claim 14 , wherein switching to a second compression algorithm based on the evaluation comprises switching to a null compressor when the received metric data crosses a threshold value associated with a parameter being measured.
20. The method of claim 14 , further comprising dynamically tuning the data compression before switching the compression algorithm by using previous data values or data value types.
21. A program storage device, readable by a programmable control device, comprising instructions stored thereon for causing the programmable control device to perform acts in accordance with claim 14 .
22. A compression system, comprising:
an interface receiving metric data used in management of a computing system;
memory having a data store, a plurality of rules, and a plurality of compression algorithms; and
a processor operatively coupled to the interface and the memory, the processor programmed to perform acts in accordance with claim 1 .