Automated data backup
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for backing up data. One of the methods includes, as part of a data backup process for a plurality of data objects, determining, for each of two or more data objects from the plurality of data objects and using metadata for the respective data object, a backup score that indicates an importance of the respective data object; determining different priority levels for two or more subsets of the plurality of data objects based at least in part on the backup scores; and backing up at least one of the subsets of the plurality of data objects according to the respective priorities of the subsets.
1 . A method comprising:
as part of a data backup process for a plurality of data objects:
receiving, from data storage, a schema that indicates relationships between different types of data objects in the plurality of data objects and is separate data from the plurality of data objects;
calculating, for each of two or more data objects from the plurality of data objects and using metadata for a respective data object that includes one or more relationships from the received schema, a backup score that indicates an importance of the respective data object, wherein using the metadata includes calculating, based on one or more relationships from the received schema, an impact ratio of the respective data object and an entity rank of an entity corresponding to the data object;
determining different priority levels for two or more subsets of the plurality of data objects based at least in part on the backup scores; and
backing up at least one of the subsets of the plurality of data objects according to the respective priority levels of the subsets.
2 . The method of claim 1 , wherein the impact ratio is calculated based on change data of the respective data object indicating two or more changes previously made to the respective data object, and wherein the impact ratio is calculated by applying different weights to different types of changes included in the two or more changes.
3 . The method of claim 1 , wherein the impact ratio of the respective data object is calculated based on a relationship between a total number of changes for a given entity corresponding to the respective data object divided by the total number of changes corresponding to the plurality of data objects.
4 . The method of claim 1 , wherein the different types of data objects comprise at least one of different types of tables or different types of fields.
5 . The method of claim 1 , further comprising, as part of the data backup process:
backing up the schema.
6 . The method of claim 1 , wherein the backup score is further calculated based at least in part on how many changes to the respective data object were made within a time period.
7 . The method of claim 1 , wherein the backup score is further calculated based at least in part on how many references to the respective data object are included in other data objects in the plurality of data objects.
8 . The method of claim 7 , further comprising:
determining a number of references to the respective data object that are included in the other data objects in the plurality of data objects, wherein the number of references is based at least in part on one or more artifacts for the other data objects that do not include content of the other data objects.
9 . The method of claim 1 , wherein the backup score is further calculated based on:
determining, for a child object of the respective data object in the plurality of data objects, a child backup score.
10 . The method of claim 1 , wherein the backup score is further calculated based on:
determining child backup scores for all children of the respective data object; and
determining a combination score from the child backup scores.
11 . The method of claim 10 , wherein determining the combination score from the child backup scores comprises:
obtaining a discount factor based on at least the impact ratio or the entity rank of the respective data object; and
applying the discount factor to a summation of the child backup scores.
12 . The method of claim 1 , wherein the backup score is further calculated based on determining a number of references to the respective data object.
13 . The method of claim 12 , wherein the respective data object is a data field.
14 . The method of claim 12 , further comprising:
determining that the backup score of the respective data object satisfies a score threshold; and
in response to the determination, configuring backup monitoring for the respective data object.
15 . The method of claim 1 , wherein calculating the backup score is further performed using a backup score determined for a previously backed up instance of the respective data object.
16 . The method of claim 1 , further comprising, prior to backing up at least one of the subsets of the plurality of data objects:
determining using the backup scores, (1) a frequency for backing up at least one of the subsets of the plurality of data objects and (2) a location for backing up at least one of the subsets of the plurality of data objects, wherein backing up at least one of the subsets of the plurality of data objects is performed at the frequency and in the location.
17 . The method of claim 16 , wherein the location for storing a portion of the plurality of data objects indicates a type, from a plurality of types, of computer memory to use for backup.
18 . The method of claim 1 , wherein the entity rank is calculated based on reference data indicating one or more references to or from the respective data object, wherein a greater number of references to or from a first respective data object results in a greater entity rank for the first respective data object than one or more other respective data objects.
19 . The method of claim 1 , further comprising:
backing up, based at least in part on the backup scores, one or more of the plurality of data objects to a first location and a different second location.
20 . One or more computer-readable storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform, as part of a data backup process for a plurality of data objects, operations comprising:
receiving, from data storage, a schema that indicates relationships between different types of data objects in the plurality of data objects and is separate data from the plurality of data objects;
calculating, for each of two or more data objects from the plurality of data objects and using metadata for a respective data object that includes one or more relationships from the received schema, a backup score that indicates an importance of the respective data object, wherein using the metadata includes calculating, based on one or more relationships from the received schema, an impact ratio of the respective data object and an entity rank of an entity corresponding to the data object;
determining different priority levels for two or more subsets of the plurality of data objects based at least in part on the backup scores; and
backing up at least one of the subsets of the plurality of data objects according to the respective priority levels of the subsets.
21 . A system comprising:
one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform, as part of a data backup process for a plurality of data objects, operations comprising:
receiving, from data storage, a schema that indicates relationships between different types of data objects in the plurality of data objects and is separate data from the plurality of data objects;
calculating, for each of two or more data objects from the plurality of data objects and using metadata for a respective data object that includes one or more relationships from the received schema, a backup score that indicates an importance of the respective data object, wherein using the metadata includes calculating, based on one or more relationships from the received schema, an impact ratio of the respective data object and an entity rank of an entity corresponding to the data object;
determining different priority levels for two or more subsets of the plurality of data objects based at least in part on the backup scores; and
backing up at least one of the subsets of the plurality of data objects according to the respective priority levels of the subsets.