Methods and apparatus for providing hypervisor level data services for server virtualization
A data center for data backup and replication, including a pool of multiple storage units for storing a journal of I/O write commands issued at respective times, wherein the journal spans a history window of a pre-specified time length, and a journal manager for dynamically allocating more storage units for storing the journal as the journal size increases, and for dynamically releasing storage units as the journal size decreases.
1. A method of data backup from a protected site to a recovery site, comprising:
receiving, by a recovery site computing device, a write request from a protected site computing device;
determining, by the recovery site computing device, that the write request specifies addition of new data to a journal at the recovery site that would cause the journal to exceed a predesignated size;
selecting, by the recovery site computing device, a variable size storage unit from a plurality of variable size storage units to store the new data of the write request, each of the variable size storage units comprising one or more variable size data chunks and each of the one of more variable size data chunks corresponding to a window of time;
adjusting, responsive to determining that the write request specifies addition of the new data to the journal that would cause the journal to exceed the predesignated size, by the recovery site computing device, a size of the variable size storage unit using at least one of the one or more variable size data chunks; and
storing, by the recovery site computing device, the new data in the variable size storage unit of the journal at the recovery site.
2. The method of claim 1 , comprising:
receiving, by the recovery site computing device, data replication journal parameters from an administrative computing device via an administration interface, the administrative interface showing settings for each data replication journal parameter.
3. The method of claim 2 , comprising:
receiving, by the recovery site computing device, the data replication journal parameters from the administrative computing device via the administration interface, the data replication journal parameters specifying at least one of a priority for transferring data to the recovery site computing device, a recovery point objective (RPO) threshold, a maintenance time window, a maximum journal size, a test period for checking integrity of the recovery site, a WAN compression indicator, a host at the recovery site, a data storage at the recovery site, a test network for user during test failover, and a failover network.
4. The method of claim 1 , comprising:
determining, by the recovery site computing device, that the write request specifies the addition of the new data to the journal at the recovery site that would cause the journal to exceed a maximum journal size, the maximum journal size received by the recovery site computing device from an administrative computing device; and
removing, by recovery site computing device, responsive to determining that addition of the new data exceeds the maximum journal size, data from the variable size storage unit.
5. The method of claim 1 , comprising:
determining, by the recovery site computing device, that a time between a previous write request and the write request is within a maintenance history time window; and
saving, by the recovery site computing device, responsive to determining that the time between the previous write request and the write request is within the maintenance history time window, the write request.
6. The method of claim 1 , comprising:
promoting, by the recovery site computing device, responsive to determining that the write request specifies the addition of the new data to the journal at the recovery site that would cause the journal to exceed the predesignated size, journal data from the journal to a recovery disk;
removing, by the computing device, the journal data from the journal; and
storing, by the recovery site computing device, the new data in the variable size storage unit of the journal at the recovery site.
7. The method of claim 1 , comprising:
receiving, by the recovery site computing device, during a test period, test data;
allocating, by the recovery site computing device, during the test period, one or more additional variable size data chunks to the journal;
storing, by the recovery site computing device, during the test period, the test data to the one or more additional variable size data chunks; and
releasing, by the recovery site computing device, subsequent to the test period, the one or more additional variable size data chunks.
8. The method of claim 1 , comprising:
increasing, by the recovery site computing device, the size of the variable size storage unit during a peak period.
9. The method of claim 1 , comprising:
reducing, by the recovery site computing device, the size of the variable size storage unit during an off-peak period.
10. The method of claim 1 , comprising:
adjusting, by the recovery site computing device, the size of the variable size storage unit based on a time period.
11. A system for data backup from a protected site to a recovery site, comprising:
a recovery site computing device that:
receives a write request from a protected site computing device;
determines that the write request specifies addition of new data to a journal at the recovery site that would cause the journal to exceed a predesignated size;
selects a variable size storage unit from a plurality of variable size storage units to store the new data of the write request, wherein each of the variable size storage units comprises one or more variable size data chunks, and each of the one of more variable size data chunks corresponds to a window of time;
adjusts a size of the variable size storage unit using at least one of the one or more variable size data chunks; and
stores the new data in the variable size storage unit of the journal at the recovery site.
12. The system of claim 11 , wherein the recovery site computing device receives data replication journal parameters from an administrative computing device via an administration interface that shows settings for each data replication journal parameter.
13. The system of claim 12 , wherein the data replication journal parameters specifies at least one of a priority for transferring data to the recovery site computing device, a recovery point objective (RPO) threshold, a maintenance time window, a maximum journal size, a test period for checking integrity of the recovery site, a WAN compression indicator, a host at the recovery site, a data storage at the recovery site, a test network for user during test failover, and a failover network.
14. The system of claim 11 , wherein the recovery site computing device:
determines that the write request specifies the addition of the new data to a journal at the recovery site would cause the journal to exceed a maximum journal size, the maximum journal size obtained by the recovery site computing device from an administrative computing device; and
removes, responsive to determining that addition of the new data would exceed the maximum journal size, data from the variable size storage unit.
15. The system of claim 11 , wherein the recovery site computing device:
determines that a time between a previous write request and the write request is within a maintenance history time window, the maintenance history time window received by the recovery site computing device from an administrative computing device; and
saves, responsive to determining that the time between the previous write request and the write request is within the maintenance history time window, the write request.
16. The system of claim 11 , wherein the recovery site computing device:
promotes data from the journal to a recovery disk;
removes the data from the journal; and
stores the new data in the variable size storage unit of the journal at the recovery site.
17. The system of claim 11 , wherein the recovery site computing device:
receives during a test period, test data;
allocates, during the test period, one or more additional variable size data chunks to the journal for storing the test data;
stores, during the test period, the test data to the one or more additional variable size data chunks; and
releases, subsequent to the test period, the one or more additional variable size data chunks.
18. The system of claim 11 , wherein the recovery site computing device increases the size of the variable size storage unit during a peak period.
19. The system of claim 11 , wherein the recovery site computing device reduces the size of the variable size storage unit during an off-peak period.
20. The system of claim 11 , wherein the recovery site computing device adjusts the size of the variable size storage unit based on a time period.