Backup and tiered policy coordination in time series databases
A data protection system configured to backup a time series database is provided. The data protection system may be integrated with or have access to consolidation policies of the time series database. The backup policy and backup retention policy are set by monitoring the consolidation policy and adjusting the backup policy to ensure that the data in the time series database is protected prior to being downscaled, discarded or otherwise consolidated.
1. A computer-implemented method for backing up a time series database, the method comprising:
monitoring, by a data protection system that includes one or more processors, a consolidation policy of the time series database, wherein the consolidation policy includes consolidation data that identifies when data in the time series database is downscaled or discarded, the data including time series data, wherein the data in the time series database loses resolution when the data is downscaled;
defining, by the one or more processors, a backup policy of the data protection system based on the consolidation policy of the time series database;
generating, by the one or more processors, backups of the data in the time series database in accordance with the backup policy by the data protection system, wherein the backup policy ensures that the backups are generated before the data in the time series database is downscaled or discarded such that the backups contain full resolution copies of the time series data, wherein the backups further include backups of downscaled versions of the data in the time series database, wherein the downscaled versions have different resolutions of the data in the time series database;
updating, by the one or more processors, a catalog that identifies where the backups are stored and resolutions of the backups;
detecting, by the one or more processors, a change in the consolidation policy; and
dynamically, by the one or more processors, adjusting the backup policy whenever the consolidation policy changes in order to accommodate the detected change to the consolidation policy.
2. The method of claim 1 , further comprising setting a retention period for the backups.
3. The method of claim 2 , further comprising monitoring usage of the backups and adjusting the retention period based on the monitored usage.
4. The method of claim 2 , further comprising basing the retention period on user preferences, wherein the user preferences express a boundary for the retention period.
5. The method of claim 1 , further comprising creating a catalog to include in the backups, wherein the catalog identifies locations of the data and a resolution of the data.
6. The method of claim 1 , wherein the backups are stored on a tier of storage that is less expensive and is associated with the time series database.
7. The method of claim 1 , wherein the backups include full resolutions of the data stored in the time series database.
8. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
monitoring, by a data protection system, a consolidation policy of a time series database, wherein the consolidation policy includes consolidation data that identifies when data in the time series database is downscaled or discarded, the data including time series data, wherein the data in the time series database loses resolution when the data is downscaled;
defining a backup policy of the data protection system based on the consolidation policy of the time series database;
generating backups of the data in the time series database in accordance with the backup policy by the data protection system, wherein the backup policy ensures that the backups are generated before the data in the time series database is downscaled or discarded such that the backups contain full resolution copies of the time series data, wherein the backups further include backups of downscaled versions of the data in the time series database, wherein the downscaled versions have different resolutions of the data in the time series database;
updating a catalog that identifies where the backups are stored and resolutions of the backups;
detecting a change in the consolidation policy; and
dynamically adjusting the backup policy whenever the consolidation policy changes in order to accommodate the detected change to the consolidation policy.
9. The non-transitory storage medium of claim 8 , the operations further comprising setting a retention period for the backups.
10. The non-transitory storage medium of claim 9 , the operations further comprising monitoring usage of the backups and adjusting the retention period based on the monitored usage.
11. The non-transitory storage medium of claim 9 , the operations further comprising basing the retention period on user preferences, wherein the user preferences express a boundary for the retention period.
12. The non-transitory storage medium of claim 8 , the operations further comprising creating a catalog to include in the backups, wherein the catalog identifies locations of the data and a resolution of the data.
13. The non-transitory storage medium of claim 8 , wherein the backups are stored on a tier of storage that is less expensive and is associated with the time series database.
14. The non-transitory storage medium of claim 8 , wherein the backups include full resolutions of the data stored in the time series database.