Monitoring quality of service in packet-based communications
View Patent ↗A method of monitoring quality of service in communications over a packet-based network, involves transmitting test packets across the network and monitoring transmission characteristics such as packet loss and transmission delay for the test packets. A measure of network performance is then dynamically calculated from the transmission characteristics, and is displayed at the endpoint as a dynamic indication of the network performance.
1. A method of monitoring quality of service in telephony communications over a packet-based network between two points, at least one of which is an endpoint,
wherein said endpoint is a telephony device having an interface which is accessible to a user to enable said user to participate in a telephony session over the network;
said telephony device further having an output for presenting information to said user;
the method comprising the steps of:
transmitting test packets across the network while a telephony session including said telephony device is in progress and monitoring transmission characteristics of said test packets, said test packets including a first series of test packets which issue from a source location to a destination location and a second series of test packets which issue from said destination location to said source location in response to said first series of test packets;
dynamically calculating from said transmission characteristics a measure of network performance comprising a measure of packet loss by comparing the packets issued from the source location and the packets received back at the source location,
using the measure of packet loss and the identity of the communications codec being employed by the endpoint to calculate an equipment impairment factor (Ie); and
providing at said output of said telephony device a dynamic indication of said equipment impairment factor (Ie) during said telephony session.
2. A method according to claim 1 , wherein said transmission characteristics are selected from packet loss, transmission delay, and a combination thereof.
3. A method according to claim 2 , wherein said transmission characteristics include both packet loss and transmission delay.
4. A method according to claim 1 , wherein the indication of the network performance is provided by means of a visual display associated with the endpoint.
5. A method according to claim 1 , wherein the indication of the network performance is provided by means of an aural signal provided to the endpoint.
6. A method according to claim 5 , wherein the aural indication of the network performance is provided as a discrete signal emitted at the endpoint when the value of the metric passes a predetermined point.
7. A method according to claim 1 , wherein the first series of test packets include local source timestamp information and wherein the second series of test packets include local destination timestamp information, the difference between said local source timestamp information and local destination timestamp information being used to calculate a delay characteristic of the network.
8. A method according to claim 7 , wherein the delay characteristic is the absolute delay in echo-free connections (Ta) between the source and destination locations over the network.
9. A method according to claim 1 , wherein the calculation of Ie is made by looking up the measured packet loss in a stored table which correlates values of Ie with packet loss values for the codec being used.
10. A method according to claim 1 , wherein the calculated value of Ta is used to calculate a delay impairment factor.
11. A method according to claim 10 , wherein the delay impairment factor (Idd) is given by the formulae:
(i) for Ta<100 ms,
Idd=0; and
(ii) for Ta=>100 ms,
Idd= 25*((1 +X 6)⅙−3*(1+( X/ 3)6)⅙+2)
Where X =(log( Ta/ 100))/log(2).
12. A method according to claim 11 , wherein a transmission rating factor R is calculated from the formula R=Y−Idd−Ie, where Y is a constant which has been predetermined for the network and the equipment being used on the network, and wherein Ie is an equipment impairment factor calculated from the measure of packet loss and the identity of the communications codec being employed by the endpoint.
13. A method according to claim 12 , wherein the calculation of Ie is made by looking up the measured packet loss in a stored table which correlates values of Ie with packet loss values for the codec being used.
14. A method according to claim 13 , wherein the value of Y is from about 92 to about 97.
15. A method according to claim 14 , wherein the value of Y is from about 93 to about 95.
16. A method according to claim 15 , wherein the value of Y is about 94.5.
17. A method according to claim 12 , wherein the calculated value of R is correlated to a subjective metric for the quality of service, and wherein an indication of the value of said subjective metric is provided at the endpoint to a user.
18. A method according to claim 17 , wherein said metric is a mean opinion score (MOS) and is calculated according to the formula:
MOS=1+0.035 R+R ( R− 60)(100 −R )(7×10−6).
19. A method according to claim 18 , wherein said MOS is further adjusted before being provided as an indication at the endpoint, by normalising acceptable values of MOS to a different scale.
20. A method according to claim 17 , wherein the indication of the value of the subjective metric is provided by means of a visual display associated with the endpoint.
21. A method according to claim 17 , wherein the indication of the value of the subjective metric is provided by means of an aural signal provided to the endpoint.
22. A method according to claim 21 , wherein the aural indication is provided as a discrete signal emitted at the endpoint when the value of the metric passes a predetermined point.
23. A method according to claim 1 , wherein the step of providing a dynamic indication of the network performance includes providing, at the request of a user, an indication of one or more of said transmission characteristics.
24. A method according to claim 23 , wherein the request of the user is made by means of an input device associated with the endpoint and the indication is provided by means of a display device associated with the endpoint.
25. A method according to claim 1 , further comprising the step of logging the network transmission characteristics.
26. A method according to claim 1 , further comprising the step of logging the results of said calculation.
27. A method according to claim 26 , wherein the step of logging the results of said calculation occurs only when said results are within a predetermined range.
28. A method of monitoring quality of service in telephony communications over a packet-based network between two points, at least one of which is an endpoint,
wherein said endpoint is a telephony device having an interface which is accessible to a user to enable said user to participate in a telephony session over the network;
said telephony device further having an output for presenting information to said user;
the method comprising the steps of:
transmitting test packets across the network while a telephony session including said telephony device is in progress and monitoring transmission characteristics of said test packets;
dynamically calculating from said transmission characteristics a measure of network performance;
providing at said output of said telephony device a dynamic indication of the network performance based on said calculation during said telephony session; and
logging the results of said calculation including logging the fact that a communications connection over the network has been lost.
29. A method according to claim 1 , further comprising the step of adjusting a billing record for a user in dependence on the results of said calculation.
30. A non-transitory computer-readable medium encoded with a data structure or computer program to perform a method which, when executed on a processor associated with an endpoint connected to a packet-based network, said endpoint being a telephony device having an interface which is accessible to a user to enable said user to participate in a telephony session over said network, said telephony device further having an output for presenting information to said user, cause said processor to:
monitor transmission characteristics of test packets transmitted across the network while a telephony session including said telecommunications device is in progress;
dynamically calculate from said transmission characteristics a measure of network performance;
provide to said user at said output of said endpoint a dynamic indication of the network performance based on said calculation during said telephony session; and
logging the results of said calculation including logging the fact that a communications connection over the network has been lost.
31. A non-transitory computer-readable medium according to claim 30 , wherein said transmission characteristics are selected from packet loss, transmission delay, and a combination thereof.
32. A non-transitory computer-readable medium according to claim 31 , wherein the transmission characteristics include the absolute delay in echo-free connections (Ta) between source and destination locations over the network, obtained by comparing local timestamp information from source and destination locations on the network and a measure of packet loss obtained by comparing the packets issued from the source location and the packets received back at the source location.
33. A non-transitory computer-readable medium according to claim 32 , wherein the measure of packet loss and the identity of the communications codec being employed by the endpoint are used to calculate an equipment impairment factor (Ie).
34. A non-transitory computer-readable medium according to claim 33 , wherein a delay impairment factor (Idd) is given by the formulae:
(i) for Ta<100 ms,
Idd=0; and
(ii) for Ta=>100 ms,
Idd= 25*((1 +X 6)⅙−3*(1+( X/ 3)6)⅙+2)
Where X =(log( Ta/ 100))/log(2).
35. A non-transitory computer-readable medium according to claim 34 , wherein a transmission rating factor R is calculated from the formula R=Y−Idd−Ie, where Y is a constant which has been predetermined for the network and the equipment being used on the network, and wherein Ie is an equipment impairment factor calculated from the measure of packet loss and the identity of the communications codec being employed by the endpoint.
36. A non-transitory computer-readable medium according to claim 35 , wherein the value of Y is from about 92 to about 97.
37. A non-transitory computer-readable medium according to claim 36 , wherein the value of Y is from about 93 to about 95.
38. A non-transitory computer-readable medium according to claim 37 , wherein the value of Y is about 94.5.
39. A non-transitory computer-readable medium according to claim 35 , wherein the calculated value of R is correlated to a subjective metric for the quality of service, and wherein an indication of the value of said subjective metric is provided at the endpoint to a user.
40. A non-transitory computer-readable medium according to claim 30 , wherein provision of a dynamic indication of the network performance includes providing, at the request of a user, an indication of one or more of said transmission characteristics.
41. A non-transitory computer-readable medium according to claim 30 , further comprising instructions which when executed cause a computer to log the network transmission characteristics.
42. A non-transitory computer-readable medium according to claim 30 , further comprising instructions which when executed cause a computer to log the results of said calculation.
43. A non-transitory computer-readable medium according to claim 30 , further comprising instructions which when executed cause a computer to adjust a billing record for the a in dependence on the results of said calculation.
44. A system for monitoring quality of service in communications over a packet-based network, comprising:
a source endpoint connected to the network via which a user may transmit communication signals as part of a telephony session over the network wherein said source endpoint is a telephony device having an interface which is accessible to a user to enable said user to participate in a telephony session over the network;
a test packet generator for transmitting a first series of test packets across the network during said telephony session
a test packet receiver for receiving a second series of test packets from the network during said telephony session in response to said first series of test packets;
a processor for measuring transmission characteristics of said test packets and for calculating from said transmission characteristics a measure of network performance comprising a measure of packet loss by comparing the packets issued from the source location and the packets received back at the source location, and for using the measure of packet loss and the identity of the communications codec being employed by the endpoint to calculate an equipment impairment factor (Ie); and
an output associated with said telecommunications device for providing a dynamic indication of said equipment impairment factor (Ie) to said user during said telephony session.
45. A system according to claim 44 , wherein said test packet generator includes a timestamp generator for adding a local source timestamp to said test packets.
46. A system according to claim 45 , further comprising a destination endpoint with which said source endpoint is in communication over the network, said destination endpoint having associated therewith: a test packet receiver for receiving test packets from the network; a timestamp generator for adding a local destination timestamp to said received test packets; and a test packet re-transmitter for re-transmitting said received test packets with said local destination timestamp back to their source.
47. A system according to claim 46 , further comprising a centralized time server in communication with the network for generating a standardized time and providing same to said source and destination endpoints.
48. A method of monitoring quality of service in communications over a packet-based network between two points, at least one of which is an endpoint, comprising the steps of:
transmitting a first series of test packets location across the network from a source location to a destination, said first series of test packets including local source timestamp information;
transmitting a second series of test packets location across the network from said destination to said source location in response to the first series, said second series of test packets including local destination timestamp information;
measuring the difference between said local source timestamp information and local destination timestamp information; and
calculating from said measured difference the absolute delay in echo-free connections (Ta) between the source and destination locations over the network and thereby calculating a delay impairment factor;
providing at said endpoint a dynamic indication of the network performance based on said delay impairment factor.