Low-impact refresh mechanism for production databases
View Patent ↗System and method for refreshing databases. A refresh mechanism may allow a data warehouse to remain available to users while the data is being refreshed. Embodiments may be used to perform low impact off-host data loading for databases including, but not limited to, data warehouses and to reduce the data loading window. A checkpoint of the production database may be generated. A database clone may be generated from the checkpoint. In one embodiment, the generated database clone includes references to data in the production database and not the data itself, and is thus storage space-efficient. Data may be loaded to the database clone. The checkpoint may then be switched to be the entry point to the production database after the loading is complete.
1. A system, comprising:
one or more hosts configured to implement:
a production database; and
a refresh mechanism configured to:
generate a storage checkpoint of file system data of the production database;
generate a database clone, wherein data of the database clone comprises data from the storage checkpoint;
load new data to the database clone, wherein said load updates the storage checkpoint, wherein the new data is new with respect to the production database, and wherein the production database is available for access by users during said load; and
after said load, switch from previous file system data of the production database to the storage checkpoint to be the file system data for the production database.
2. The system as recited in claim 1 , wherein the refresh mechanism is further configured to perform post-processing on the database clone prior to said switch.
3. The system as recited in claim 1 , wherein the refresh mechanism is further configured to:
stop the production database prior to said switch; and
start the production database after said switch.
4. The system as recited in claim 1 , wherein the production database is a data warehouse.
5. The system as recited in claim 1 , wherein the generated database clone includes references to data in the production database.
6. The system as recited in claim 1 , wherein the refresh mechanism is configured to perform said loading of new data to the database clone on a different host machine than a host machine hosting the production database.
7. The system as recited in claim 1 , wherein the refresh mechanism is configured to perform said loading of new data to the database clone on a host machine hosting the production database.
8. A system, comprising:
means for generating a storage checkpoint of file system data of a production database;
means for generating a database clone of a production database, wherein data of the database clone comprises data from the storage checkpoint;
means for loading new data to the database clone, wherein said loading updates the storage checkpoint, wherein the new data is new with respect to the production database, and wherein the production database is available for access by users during said loading; and
means for switching from previous file system data of the production database to the storage checkpoint to be the file system data for the production database, wherein said switching is performed after said loading.
9. A method for refreshing a production database, comprising:
generating a storage checkpoint of file system data of the production database;
generating a database clone of a production database, wherein data of the database clone comprises the storage checkpoint;
loading new data to the database clone, wherein said loading updates the storage checkpoint, wherein the new data is new with respect to the production database, and wherein the production database is available for access by users during said loading; and
after said loading, switching from previous file system data of the production database to the storage checkpoint to be the file system data for the production database.
10. The method as recited in claim 9 , further comprising performing post-processing on the database clone prior to said switching.
11. The method as recited in claim 9 , further comprising:
stopping the production database prior to said switching; and
starting the production database after said switching.
12. The method as recited in claim 9 , wherein the production database is a data warehouse.
13. The method as recited in claim 9 , wherein the generated database clone includes references to data in the production database.
14. The method as recited in claim 9 , wherein said loading new data to the database clone is performed on a different host machine than a host machine hosting the production database.
15. A computer-accessible storage medium comprising program instructions, wherein the program instructions are configured to implement:
generating a storage checkpoint of file system data of the production database;
generating a database clone of a production database, wherein data of the database clone comprises the storage checkpoint;
loading new data to the database clone, wherein said loading updates the storage checkpoint, wherein the new data is new with respect to the production database, and wherein the production database is available for access by users during said loading; and
after said loading, switching from previous file system data of the production database to the storage checkpoint to be the file system data for the production database.
16. The computer-accessible storage medium as recited in claim 15 , wherein the program instructions are further configured to implement performing post-processing on the database clone prior to said switching.
17. The computer-accessible storage medium as recited in claim 15 , wherein the program instructions are further configured to implement:
stopping the production database prior to said switching; and
starting the production database after said switching.
18. The computer-accessible storage medium as recited in claim 15 , wherein the production database is a data warehouse.
19. The computer-accessible storage medium as recited in claim 15 , wherein the generated database clone includes references to data in the production database.
20. The computer-accessible storage medium as recited in claim 15 , wherein said loading new data to the database clone is performed on a different host machine than a host machine hosting the production database.