Embedded diagnostic tool for prediction of problems relating to network bandwidth

1. A method for data management, comprising:

measuring an available bandwidth of a communication path between a client and another entity;

determining a required bandwidth associated with a future transfer of a target dataset between the client and the other entity along the communication path, wherein the required bandwidth is expressed at least partly in terms of a data deduplication rate (DDR), and takes the following form:

required bandwidth=(dataset size/DDR)/time available for backup,

where DDR is determined by:

calculating preliminary DDR values using each of a plurality of estimation models, wherein the plurality of estimation models includes any two or more of (i) a first moving average estimation model that considers the last ‘n’ backups performed in a network in which the client resides, wherein one or more of the last ‘n’ backups were performed by a client other than the client, (ii) a second moving average estimation model that considers the last ‘n’ backups performed only by the client, and (iii) an averaging model that considers DDR information for a particular time period in which the client and other clients perform respective backups;

comparing each of the preliminary DDR values with actual DDR values of each of a plurality of prior backups; and

selecting as a final DDR, the calculated DDR that is closest to the actual DDR values; and

comparing the available bandwidth of the communication path with the required bandwidth of the target dataset, wherein no transfer of the target dataset occurs if the required bandwidth is greater than the available bandwidth.

2. The method as recited in claim 1 , wherein all clients referenced by the first moving average estimation model use the same plugin to access stored data.

3. The method as recited in claim 1 , wherein all clients referenced by the averaging model use the same plugin to access stored data.

4. The method as recited in claim 1 , wherein the other entity is a backup server, and further comprising transferring the target dataset from the client to the backup server if the available bandwidth exceeds the required bandwidth.

5. The method as recited in claim 1 , wherein the other entity is a storage server, and further comprising transferring the target dataset from the storage server to the client when the available bandwidth exceeds the required bandwidth.

6. A non-transitory storage medium having stored therein computer-executable instructions which, when executed by one or more hardware processors, perform the following operations:

measuring an available bandwidth of a communication path between a client and another entity;

determining a required bandwidth associated with a future transfer of a target dataset between the client and the other entity along the communication path, wherein the required bandwidth is expressed at least partly in terms of a data deduplication rate (DDR), and takes the following form:

required bandwidth=(dataset size/DDR)/time available for backup,

where DDR is determined by:

calculating preliminary DDR values using each of a plurality of estimation models, wherein the plurality of estimation models includes any two or more of (i) a first moving average estimation model that considers the last ‘n’ backups performed in a network in which the client resides, wherein one or more of the last ‘n’ backups were performed by a client other than the client, (ii) a second moving average estimation model that considers the last ‘n’ backups performed only by the client, and (iii) an averaging model that considers DDR information for a particular time period in which the client and other clients perform respective backups;

comparing each of the preliminary DDR values with actual DDR values of each of a plurality of prior backups; and

selecting as a final DDR, the calculated DDR that is closest to the actual DDR values; and

comparing the available bandwidth of the communication path with the required bandwidth of the target dataset, wherein no transfer of the target dataset occurs if the required bandwidth is greater than the available bandwidth.

7. A computing device, comprising:

one or more hardware processors; and

the non-transitory storage medium as recited in claim 6 .

8. The non-transitory storage medium as recited in claim 6 , wherein the available bandwidth is measured on one of a communication path between the client and a backup server, or a communication path between the client and a storage server.

9. The non-transitory storage medium as recited in claim 6 , wherein the operations are performed at the client, and the target dataset includes data generated by the client.

10. The non-transitory storage medium as recited in claim 6 , wherein the other entity is a backup server, and the operations further comprise transferring the target dataset from the client to the backup server when the available bandwidth exceeds the required bandwidth.

11. The non-transitory storage medium as recited in claim 6 , wherein the other entity is a storage server, and the operations further comprise transferring the target dataset from the storage server to the client when the available bandwidth exceeds the required bandwidth.

12. The non-transitory storage medium as recited in claim 6 , wherein all clients referenced by the first moving average estimation model use the same plugin to access stored data.

13. The non-transitory storage medium as recited in claim 6 , wherein all clients referenced by the averaging model use the same plugin to access stored data.

14. The method as recited in claim 1 , wherein the available bandwidth is measured on one of a communication path between the client and a backup server, or a communication path between the client and a storage server.

15. The method as recited in claim 1 , wherein the method is performed at the client, and the target dataset includes data generated by the client.

16. The method as recited in claim 1 , wherein the DDR is initially set to a default value.