Embedded diagnostic tool for prediction of problems relating to network bandwidth
In one example, a method includes measuring an available bandwidth of a communication path between a server and another entity, listening on a communication port that is connected to the other entity, receiving, from the other entity, a request for a data deduplication rate (DDR) information associated with a particular plugin type, querying a database for the DDR information, and returning the requested DDR information to the other entity.
1. A method, comprising:
checking network connectivity on a communication path between a backup server and a storage server;
determining a path maximum transmission unit (PMTU) size on the communication path between the backup server and the storage server;
measuring an available bandwidth of the communication path between the backup server and the storage server, wherein the measuring generates available bandwidth information;
listening, on a communication port that is connected to the storage server, for a request from the storage server for the available bandwidth information;
receiving, from the storage server, the request for the available bandwidth information;
sending, to the storage server, the available bandwidth information in response to the request for the available bandwidth information;
cooperating with a client to create a backup of client data;
determining a required bandwidth needed to transmit the backup from the backup server to the storage server, and the required bandwidth is expressed at least partly in terms of a data deduplication rate (DDR), and takes the following form:
required bandwidth=(backup size/DDR)/time available for backup,
where DDR is determined by:
calculating preliminary DDR values using each of a plurality of estimation models, wherein the plurality of estimation models includes any two or more of (i) a first moving average estimation model that considers the last ‘n’ backups performed in a network in which the client resides, wherein one or more of the last ‘n’ backups were performed by a client other than the client, (ii) a second moving average estimation model that considers the last ‘n’ backups performed only by the client, and (iii) an averaging model that considers DDR information for a particular time period in which the client and other clients perform respective backups;
comparing each of the preliminary DDR values with actual DDR values of each of a plurality of prior backups; and
selecting as a final DDR, the calculated preliminary DDR value that is closest to the actual DDR values;
determining that (i) the available bandwidth meets or exceeds the required bandwidth and (ii) the PMTU size of the communication path between the backup server and the storage server is adequate to support transmission of the backup from the backup server to the storage server; and
transmitting the backup from the backup server to the storage server by way of the network path.
2. The method as recited in claim 1 , wherein the operations of checking network connectivity, determining a PMTU size, measuring an available bandwidth, listening, receiving the request for the available bandwidth, and sending the available bandwidth information, are performed by a diagnostic tool residing on the backup server.
3. The method as recited in claim 1 , wherein measurement of the available bandwidth is performed in response to the triggering of a backup.
4. The method as recited in claim 1 , further comprising using the available bandwidth information as a basis for increasing the speed with which a hash filesystem check is performed.
5. The method as recited in claim 1 , further comprising: returning requested DDR information to the client.
6. The method as recited in claim 5 , wherein the requested DDR information is associated with a particular plugin that is hosted at the client.
7. A non-transitory storage medium having stored therein computer-executable instructions which, when executed by one or more hardware processors, implement and/or cause the implementation of the following operations:
checking network connectivity on a communication path between a backup server and a storage server;
determining a path maximum transmission unit (PMTU) size on the communication path between the backup server and the storage server;
measuring an available bandwidth of the communication path between the backup server and the storage server, wherein the measuring generates available bandwidth information;
listening, on a communication port that is connected to the storage server, for a request from the storage server for the available bandwidth information;
receiving, from the storage server, the request for the available bandwidth information;
sending, to the storage server, the available bandwidth information in response to the request for the available bandwidth information;
cooperating with a client to create a backup of client data;
determining a required bandwidth needed to transmit the backup from the backup server to the storage server, and the required bandwidth is expressed at least partly in terms of a data deduplication rate (DDR), and takes the following form:
required bandwidth=(backup size/DDR)/time available for backup,
where DDR is determined by:
calculating preliminary DDR values using each of a plurality of estimation models, wherein the plurality of estimation models includes any two or more of (i) a first moving average estimation model that considers the last ‘n’ backups performed in a network in which the client resides, wherein one or more of the last ‘n’ backups were performed by a client other than the client, (ii) a second moving average estimation model that considers the last ‘n’ backups performed only by the client, and (iii) an averaging model that considers DDR information for a particular time period in which the client and other clients perform respective backups;
comparing each of the preliminary DDR values with actual DDR values of each of a plurality of prior backups; and
selecting as a final DDR, the calculated preliminary DDR value that is closest to the actual DDR values;
determining that (i) the available bandwidth meets or exceeds the required bandwidth and (ii) the PMTU size of the communication path between the backup server and the storage server is adequate to support transmission of the backup from the backup server to the storage server; and
transmitting the backup from the backup server to the storage server by way of the network path.
8. The non-transitory storage medium as recited in claim 7 , wherein the operations of checking network connectivity, determining a PMTU size, measuring an available bandwidth, listening, receiving the request for the available bandwidth, and sending the available bandwidth information, are performed by a diagnostic tool residing on the backup server.
9. The non-transitory storage medium as recited in claim 7 , wherein measurement of the available bandwidth is performed in response to the triggering of a backup.
10. The non-transitory storage medium as recited in claim 7 , wherein the operations further comprise: returning requested DDR information to the client.
11. The non-transitory storage medium as recited in claim 10 , wherein the DDR information is associated with a particular plugin hosted at the client.
12. A server, comprising:
one or more hardware processors; and
the non-transitory storage medium as recited in claim 7 .