Adjusting replication operations in a distributed environment
Disclosed herein are methods, systems, and processes to adjust replication operations in a distributed environment. A set of replicated data is received from a first appliance as a result of a replication operation. The replication operation is initiated by the first appliance and the set of replicated data includes a first timestamp. A write operation is performed to store the set of replicated data and a second timestamp is recorded. Recovery point information is generated based on the first timestamp and the second timestamp. The recovery point information is configured to be utilized in adjusting replication parameters of a subsequent replication operation.
1. A computer-implemented method comprising:
receiving, at a node at a recovery site, a set of replicated data from a first appliance,
wherein
the set of replicated data is received as a result of a replication operation initiated by the first appliance, and
the set of replicated data comprises a first timestamp recorded by the first appliance indicating a time at which the set of replicated data was transmitted by the first appliance;
performing a write operation on the recovery site, wherein
the write operation comprises
storing the set of replicated data on the recovery site, and
recording a second timestamp that indicates a time at which the write operation was completed on the recovery site;
generating recovery point information, wherein
the recovery point information indicates a lag time, and
the lag time is a difference in time between the time recorded by the first timestamp and the time recorded by the second timestamp;
subsequent to generating the recovery point information, determining whether one or more requirements regarding replication of data generated by a host can be met by a subsequent replication operation, wherein
the determining comprises comparing the recovery point information to a threshold lag time defined in Service Level Agreement (SLA) information,
the SLA information is associated with the host,
the host is communicatively coupled to the first appliance, and
the threshold lag time corresponds to one or more requirements regarding replication of data generated by the host;
in response to a determination that the one or more requirements can be met by the subsequent replication operation, sending the recovery point information to the first appliance, wherein
the lag time is configured to be utilized in adjusting one or more replication parameters of the subsequent replication operation, wherein
the one or more replication parameters comprises
a network bandwidth associated with the first appliance, and
an input/output (I/O) bandwidth associated with the recovery site; and
in response to a determination that the one or more requirements cannot be met by the subsequent replication operation,
determining whether the one or more requirements cannot be met because of either an in-flight data backlog on the first appliance or a replicated data backlog on the recovery site, and
sending a notification with one or more instructions to adjust at least one of the one or more replication parameters, wherein
in response to a determination that the one or more requirements cannot be met because of an in-flight data backlog on the first appliance, the one or more instructions comprise instructions to increase the network bandwidth associated with the first appliance, and
in response to a determination that the one or more requirements cannot be met because of a replicated data backlog on the recovery site, the one or more instructions comprise instructions to increase the I/O bandwidth associated with the recovery site.
2. The computer-implemented method of claim 1 , further comprising:
transmitting the recovery point information to the first appliance, wherein
the recovery point information is configured to be utilized by the first appliance to adjust the one or more replication parameters.
3. The computer-implemented method of claim 2 , wherein
the recovery point information comprises the second timestamp.
4. The computer-implemented method of claim 2 , wherein
the time corresponds to the host,
the host is one of one or more hosts,
the one or more hosts are communicatively coupled to the first appliance, and
the one or more hosts generate data that is part of the set of replicated data stored by the write operation.
5. The computer-implemented method of claim 4 , further comprising:
receiving updates to a log, wherein
the first appliance updates the log upon receiving the recovery point information,
the log comprises a plurality of recovery point information associated with the one or more hosts, and
the updates are received as part of the subsequent replication operation.
6. The computer-implemented method of claim 4 , wherein
the data generated by the host is part of the set of replicated data, and
the set of replicated data is written to a secondary storage device as part of the write operation.
7. The computer-implemented method of claim 6 , wherein
the first appliance is a premise appliance, wherein
the premise appliance stores in-flight data generated by the one or more hosts; and the secondary storage device is associated with a second appliance, wherein
the second appliance is a cloud appliance, and
the cloud appliance stores the in-flight data as part of the set of replicated data.
8. The computer-implemented method of claim 1 , wherein
the SLA information represents one or more service level objectives.
9. A non-transitory computer readable storage medium storage program instructions executable to perform a method comprising:
receiving, at a node at a recovery site, a set of replicated data from a first appliance,
wherein
the set of replicated data is received as a result of a replication operation initiated by the first appliance, and
the set of replicated data comprises a first timestamp recorded by the first appliance indicating a time at which the set of replicated data was transmitted by the first appliance;
performing a write operation on the recovery site, wherein
the write operation comprises
storing the set of replicated data on the recovery site, and
recording a second timestamp that indicates a time at which the write operation was completed on the recovery site;
generating recovery point information, wherein
the recovery point information indicates a lag time, and
the lag time is a difference in time between the time recorded by the first timestamp and the time recorded by the second timestamp;
subsequent to generating the recovery point information, determining whether one or more requirements regarding replication of data generated by a host can be met by a subsequent replication operation, wherein
the determining comprises comparing the recovery point information to a threshold lag time defined in Service Level Agreement (SLA) information,
the SLA information is associated with the host,
the host is communicatively coupled to the first appliance, and
the threshold lag time corresponds to one or more requirements regarding replication of data generated by the host;
in response to a determination that the one or more requirements can be met by the subsequent replication operation, sending the recovery point information to the first appliance, wherein
the lag time is configured to be utilized in adjusting one or more replication parameters of the subsequent replication operation, wherein
the one or more replication parameters comprises
a network bandwidth associated with the first appliance, and
an input/output (I/O) bandwidth associated with the recovery site;
in response to a determination that the one or more requirements cannot be met by the subsequent replication operation,
determining whether the one or more requirements cannot be met because of either an in-flight data backlog on the first appliance or a replicated data backlog on the recovery site, and
sending a notification with one or more instructions to adjust at least one of the one or more replication parameters, wherein
in response to a determination that the one or more requirements cannot be met because of an in-flight data backlog on the first appliance, the one or more instructions comprise instructions to increase the network bandwidth associated with the first appliance, and
in response to a determination that the one or more requirements cannot be met because of a replicated data backlog on the recovery site, the one or more instructions comprise instructions to increase the I/O bandwidth associated with the recovery site.
10. The non-transitory computer readable storage medium of claim 9 , wherein the method further comprises:
transmitting the recovery point information to the first appliance, wherein
the recovery point information is configured to be utilized by the first appliance to adjust the one or more replication parameters.
11. The non-transitory computer readable storage medium of claim 10 , wherein
the recovery point information comprises the second timestamp.
12. A system comprising:
one or more processors; and
a memory coupled to the one or more processors, wherein the memory stores program instructions executable by the one or more processors to perform a method comprising:
receiving, at a node at a recovery site, a set of replicated data from a first appliance,
wherein
the set of replicated data is received as a result of a replication operation initiated by the first appliance, and
the set of replicated data comprises a first timestamp recorded by the first appliance indicating a time at which the set of replicated data was transmitted by the first appliance;
performing a write operation on the recovery site, wherein
the write operation comprises
storing the set of replicated data on the recovery site, and
recording a second timestamp that indicates a time at which the write operation was completed on the recovery site;
generating recovery point information, wherein
the recovery point information indicates a lag time,
the lag time is a difference in time between the time recorded by the first timestamp and the time recorded by the second timestamp;
subsequent to generating the recovery point information, determining whether one or more requirements regarding replication of data generated by a host can be met by a subsequent replication operation, wherein
the determining comprises comparing the recovery point information to a threshold lag time defined in Service Level Agreement (SLA) information,
the SLA information is associated with the host,
the host is communicatively coupled to the first appliance, and
the threshold lag time corresponds to one or more requirements regarding replication of data generated by the host;
in response to a determination that the one or more requirements can be met by the subsequent replication operation, sending the recovery point information to the first appliance, wherein
the lag time is configured to be utilized in adjusting one or more replication parameters of the subsequent replication operation, wherein
the one or more replication parameters comprises
a network bandwidth associated with the first appliance, and
an input/output (I/O) bandwidth associated with the recovery site;
in response to a determination that the one or more requirements cannot be met by the subsequent replication operation,
determining whether the one or more requirements cannot be met because of either an in-flight data backlog on the first appliance or a replicated data backlog on the recovery site, and
sending a notification with one or more instructions to adjust at least one of the one or more replication parameters, wherein
in response to a determination that the one or more requirements cannot be met because of an in-flight data backlog on the first appliance, the one or more instructions comprise instructions to increase the network bandwidth associated with the first appliance, and
in response to a determination that the one or more requirements cannot be met because of a replicated data backlog on the recovery site, the one or more instructions comprise instructions to increase the I/O bandwidth associated with the recovery site.
13. The system of claim 12 , wherein the method further comprises:
transmitting the recovery point information to the first appliance, wherein
the recovery point information is configured to be utilized by the first appliance to adjust the one or more replication parameters, and
the recovery point information comprises the second timestamp.