Systems and methods for adaptive bandwidth throttling
Aspects of the current patent document include systems and methods to adaptive bandwidth throttling, for example, for use in data backup systems and data recovery systems. In embodiments, bandwidth estimation can be performed while sending data. In embodiments, the bandwidth estimation is used in data backups to send data to be backed up. In embodiments, a server performs network bandwidth estimation by receiving relatively small data packets and estimating bandwidth until bandwidth reliability conditions are satisfied.
1. A system configured to receive files from a client device, the system comprising:
a processor; and
a memory storing computer code comprising instructions, the instructions, when executed by the processor, cause the processor to:
receive, from the client device, a first data packet corresponding to one of the files, the first data packet of a first size;
timestamp the first data packet with a first timestamp;
determine, by the processor of the system that receives the first data packet, a first bandwidth estimate associated with the client device based on the first timestamp;
send the first bandwidth estimate to the client device, the client device increasing sizes of subsequent data packets corresponding to the files until the system determining that one or more bandwidth estimate reliability criteria are met, the sizes of the subsequent data packets limited as fractions of subsequent bandwidth estimates;
set a bandwidth limit for transmission of the files, the bandwidth limit being a fraction of a reliable bandwidth estimate.
2. The system of claim 1 , wherein one of the bandwidth estimate reliability criteria is a set of mathematical conditions.
3. The system of claim 1 , wherein one of the bandwidth estimate reliability criteria comprises a condition where the size of one of the subsequent data packets is greater than or equal to a fraction of a length of the data that can be transferred in a second when transferred at a rate equal to an estimated bandwidth.
4. The system of claim 1 , wherein at least one of the sizes of the subsequent data packets is a function of the first data size.
5. The system of claim 1 , wherein each of the subsequent data packets is greater than a preceding one.
6. The system of claim 1 , wherein at least one of the sizes of the subsequent data packets is a function of the first bandwidth estimation.
7. The system of claim 1 , wherein the instructions, when executed, further cause the processor to adjust a transfer limit per second, L, based on a change in bandwidth estimation.
8. The system of claim 1 , wherein the system sets a threshold of a percentage of available bandwidth to be used by an application.
9. The system of claim 1 , wherein the system is used in a data backup system.
10. The system of claim 1 , wherein the system is used in a data recovery system.
11. The system of claim 1 , wherein the system is a backup server, and the files from the client device comprise backup files of the client device.
12. A method comprising:
receiving, by a system from a client device having files, a first data packet corresponding to one of the files, the first data packet of a first data size; and
timestamping the first data packet with a first timestamp;
determining, by the system that receives the first data packet, a first bandwidth estimate associated with the client device based on the first timestamp;
sending the first bandwidth estimate to the client device, the client device increasing sizes of subsequent data packets corresponding to the files until the system determining that one or more bandwidth estimate reliability criteria are met, the sizes of the subsequent data packets limited as fractions of subsequent bandwidth estimates;
setting a bandwidth limit for transmission of the files, the bandwidth limit being a fraction of a reliable bandwidth estimate.
13. The method of claim 12 , wherein one of the bandwidth estimate reliability criteria is a set of mathematical conditions.
14. The method of claim 12 , wherein one of the bandwidth estimate reliability criteria comprises a condition where the size of one of the subsequent data packets is greater than or equal to a fraction of a length of the data that can be transferred in a second when transferred at a rate equal to an estimated bandwidth.
15. The method of claim 12 , wherein at least one of the sizes of the subsequent data packets is a function of the first data size.
16. The method of claim 12 , wherein each of the subsequent data packets is greater than a preceding one.
17. The method of claim 12 , wherein at least one of the sizes of the subsequent data packets is a function of the first bandwidth estimation.
18. The method of claim 12 , further comprising adjusting a transfer limit per second, L, based on a change in bandwidth estimation.
19. The method of claim 12 , further comprising setting a threshold of a percentage of available bandwidth to be used by an application.
20. The method of claim 12 , wherein the system is a backup server, and the files from the client device comprise backup files of the client device.