Generating and morphing a collection of databases that collectively has desired dedupability, compression, clustering and commonality
One example method includes receiving a set of database parameters, creating one or more simulated databases based on the database parameters, receiving a set of target characteristics for the database, based on the target characteristics, slicing a datastream into a grouping of data slices, populating the simulated database(s) with the data slices to create the database collection and forward or reverse morphing the database from one generation to another without rewriting the entire database collection.
1. A method, comprising:
receiving a set of parameters;
creating a simulated database based on the parameters, wherein the simulated database has no more than three levels including tables, records, and fields, and one or more simulated records mimic respective real world records;
receiving a set of target characteristics for the simulated database;
based on the set of target characteristics, slicing a datastream into a grouping of data slices, wherein each of the data slices is a size of a respective one of the simulated database;
populating the simulated database with respective data slices to create an actual database in a database collection;
forward or reverse morphing the simulated database from one generation to another without rewriting the database collection; and
testing and evaluating a backup application using the database collection.
2. The method as recited in claim 1 , wherein the set of target characteristics comprises one or more of dedupability, compressibility, commonality, and clustering.
3. The method as recited in claim 1 , wherein the target characteristics are representative of characteristics present in the datastream.
4. The method as recited in claim 1 , wherein the one or more simulated records in the database collection collectively possess the set of target characteristics.
5. The method as recited in claim 1 , wherein the one or more simulated records each comprise one or more fields that include data.
6. The method as recited in claim 1 , wherein both creation of the simulated database and slicing of the datastream are performed on one of a table basis, a record basis, or a field basis.
7. The method as recited in claim 1 , wherein the simulated database is a member of a collection of databases that is morphed.
8. The method as recited in claim 1 , wherein a collective size of data in the simulated database is the same size as a collective size of the data slices taken from the datastream.
9. The method as recited in claim 1 , wherein populating the simulated database with the data slices is performed using a database engine.
10. The method as recited in claim 1 , wherein the morphed database is used to test an operation of the backup application.
11. A non-transitory storage medium having stored therein instructions which are executed by one or more hardware processors to perform operations comprising:
receiving a set of parameters;
creating a simulated database based on the parameters, wherein the simulated database has no more than three levels including tables, records, and fields, and one or more simulated records mimic respective real world records;
receiving a set of target characteristics for the simulated database;
based on the set of target characteristics, slicing a datastream into a grouping of data slices, wherein each of the data slices is a size of a respective one of the simulated database;
populating the simulated database with respective data slices to create an actual database in a database collection;
forward or reverse morphing the simulated database from one generation to another without rewriting the database collection; and
testing and evaluating a backup application using the database collection.
12. The non-transitory storage medium as recited in claim 11 , wherein the set of target characteristics comprises one or more of dedupability, compressibility, commonality, and clustering.
13. The non-transitory storage medium as recited in claim 11 , wherein the target characteristics are representative of characteristics present in the datastream.
14. The non-transitory storage medium as recited in claim 11 , wherein the one or more simulated records in the database collection collectively possess the set of target characteristics.
15. The non-transitory storage medium as recited in claim 11 , wherein the one or more simulated records each comprise one or more fields that include data.
16. The non-transitory storage medium as recited in claim 11 , wherein both creation of the simulated database and slicing of the datastream are performed on one of a table basis, a record basis, or a field basis.
17. The non-transitory storage medium as recited in claim 11 , wherein the simulated database is a member of a collection of databases that is morphed.
18. The non-transitory storage medium as recited in claim 11 , wherein a collective size of data in the simulated database is the same size as a collective size of the data slices taken from the datastream.
19. The non-transitory storage medium as recited in claim 11 , wherein populating the simulated database with the data slices is performed using a database engine.
20. The non-transitory storage medium as recited in claim 11 , wherein the morphed database is used to test an operation of the backup application.