Capacity agnostic scoring of network path health based on packet loss
A network path scoring system is disclosed herein that scores quality of network paths to facilitate identification of poorly performing circuits for investigation. The scoring system builds a profile with packet loss data in relation to a load corresponding to a network path. The profile indicates the percentiles of packet loss at each bucket or bin of load based on the packet loss data. Using the profile for the network path, the scoring system calculates a capacity agnostic score based on a non-zero boundary in the profile across at least a subset of the load bins.
1 . A method comprising:
grouping values corresponding to packet loss for a network path by percent bandwidth utilization intervals based on time correlations;
for each of the percent bandwidth utilization intervals, determining percentiles of the values within the group corresponding to the percent bandwidth utilization interval;
selecting, from a multi-dimensional array of scoring components predefined across percentiles and bandwidth utilization intervals, a scoring component for each bandwidth utilization interval based, at least in part, on the percentile at which a best value of packet loss occurs; and
scoring the network path based, at least in part, on the selected scoring components.
2 . The method of claim 1 , wherein the multi-dimensional array of scoring components comprises scoring components corresponding to varying degrees of packet loss based network path quality and the scoring components are arranged in the multi-dimensional array to reflect quality across different percent bandwidth utilizations.
3 . The method of claim 1 , wherein scoring the network path comprises aggregating the scoring components.
4 . The method of claim 3 , wherein aggregating the scoring components comprises averaging the scoring components.
5 . The method of claim 1 , wherein scoring the network path comprises scoring the network path also based on a second set of selected scoring components,
wherein the values are percentages of ingress packet loss for the network path,
wherein the second set of selected scoring components were selected from the multi-dimensional array of scoring components based, at least in part, on the percentiles at which a second set of best values of packet loss occurred across the percent bandwidth utilization intervals,
wherein the second set of best values are from egress packet loss data of the network path.
6 . The method of claim 1 , wherein selecting a scoring component for each bandwidth utilization interval based, at least in part, on the percentile at which a best value of packet loss occurs comprises:
identifying a non-zero boundary in the percentiles across the bandwidth utilization intervals; and
selecting the scoring components based on occurrence at locations in the multi-dimensional array of scoring components that correspond to the non-zero boundary.
7 . The method of claim 1 , wherein further comprising:
determining percent bandwidth utilizations of a circuit corresponding to the network path across a plurality of time intervals encompassing the values; and
correlating the percent bandwidth utilizations with the values based, at least in part, on the plurality of time intervals.
8 . One or more non-transitory, machine-readable media having program code stored thereon, the program code comprising instructions to:
obtain first time-series packet loss data of a first network path, wherein the first time-series packet loss data comprise a plurality of values of a packet loss metric across a time window;
determine utilization of bandwidth of the first network path for each time interval of a time granularity within the time window;
build a profile of percentiles of the packet loss metric across ranges of bandwidth utilization for the first network path with the first time-series packet loss data, wherein the ranges of bandwidth utilization encompass the determined bandwidth utilizations;
select, from a matrix of scoring components predefined across percentiles and bandwidth utilization ranges, a subset of predefined scoring components that corresponds to percentiles in the profile with best values of the packet loss metric across the bandwidth utilizations; and
score the first network path based, at least in part, on the subset of predefined scoring components.
9 . The non-transitory, machine-readable media of claim 8 , wherein the instructions to score the first network path comprise instructions to calculate an average of the subset of predefined scoring components and assign the average as the score for the first network path.
10 . The non-transitory, machine-readable media of claim 8 , wherein the instructions to select a subset of predefined scoring components comprise instructions to:
identify a non-zero boundary in the profile; and
select the subset of predefined scoring components based on occurrence at locations in the matrix that correspond to the non-zero boundary in the profile.
11 . The non-transitory, machine-readable media of claim 8 , wherein the instructions to build the profile for the first network path comprise instructions to:
bin values in the first time-series packet loss data by bandwidth utilization; and
determine percentiles of each bandwidth utilization bin of values.
12 . The non-transitory, machine-readable media of claim 11 , wherein the instructions to bin values by bandwidth utilization comprise the instructions to bin based on timestamps of the first time-series packet loss data and timestamps of circuit utilization data.
13 . The non-transitory, machine-readable media of claim 11 , wherein the program code further comprises instructions to order the percentiles per bandwidth utilization bin by bandwidth utilization.
14 . The non-transitory, machine-readable media of claim 8 , wherein the first network path corresponds to a circuit of a software-defined wide area network (SD-WAN) and wherein the instructions to determine utilization of bandwidth of the first network path comprise instructions to determine utilization of bandwidth of the circuit.
15 . The non-transitory, machine-readable media of claim 8 , wherein the matrix of predefined scoring components quantifies quality of a network path across different combinations of percentiles and bandwidth utilizations.
16 . An apparatus comprising:
a processor; and
a computer-readable medium having instructions stored thereon that are executable by the processor to cause the apparatus to,
obtain first time-series packet loss data of a first network path, wherein the first time-series packet loss data comprise a plurality of values of a packet loss metric across a time window;
determine utilization of bandwidth of the first network path for each time interval of a time granularity within the time window;
build a profile of percentiles of the packet loss metric across ranges of bandwidth utilization for the first network path with the first time-series packet loss data, wherein the ranges of bandwidth utilization encompass the determined bandwidth utilizations;
select, from a matrix of scoring components predefined across percentiles and bandwidth utilization ranges, a subset of predefined scoring components that corresponds to percentiles in the profile with best values of the packet loss metric across the bandwidth utilizations; and
score the first network path based, at least in part, on the subset of predefined scoring components.
17 . The apparatus of claim 16 , wherein the instructions to score the first network path comprise the instructions being executable by the processor to cause the apparatus to calculate an average of the subset of predefined scoring components and assign the average as the score for the first network path.
18 . The apparatus of claim 16 , wherein the instructions to select a subset of predefined scoring components comprise the instructions being executable by the processor to cause the apparatus to:
identify a non-zero boundary in the profile; and
select the subset of predefined scoring components based on occurrence at locations in the matrix that correspond to the non-zero boundary in the profile.
19 . The apparatus of claim 16 , wherein the instructions to build the profile for the first network path comprise the instructions being executable by the processor to cause the apparatus to:
bin values in the first time-series packet loss data by bandwidth utilization; and
determine percentiles of each bandwidth utilization bin of values.
20 . The apparatus of claim 19 , wherein the instructions to bin values by bandwidth utilization comprise the instructions being executable by the processor to cause the apparatus to bin based on timestamps of the first time-series packet loss data and timestamps of circuit utilization data.
21 . The apparatus of claim 19 , wherein the computer-readable medium further has stored thereon instructions executable by the processor to cause the apparatus to order the percentiles per bandwidth utilization bin by bandwidth utilization.
22 . The apparatus of claim 16 , wherein the first network path corresponds to a circuit of a software-defined wide area network (SD-WAN) and wherein the instructions to determine utilization of bandwidth of the first network path comprise the instructions being executable by the processor to cause the apparatus to determine utilization of bandwidth of the circuit.
23 . The apparatus of claim 16 , wherein the matrix of predefined scoring components quantifies quality of a network path across different combinations of percentiles and bandwidth utilizations.