IP Library Granted Patent US 12,483,913
Granted Patent B2
US 12,483,913 · App. 18/093,909 · Granted Nov 25, 2025

Method for evaluating network service, electronic device and storage medium

Inventors: Weiwei Yang (Guangdong, CN); Yizhong Zhan (Guangdong, CN)
Assignee: ZTE CORPORATION
H04W24/08H04M3/2218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,483,913
App. No.
18/093,909
Granted
Nov 25, 2025
Kind
B2
Abstract

Embodiments of the present application relate to the field of communications, and provide a method for evaluating a network service, an electronic device and a storage medium. The method for evaluating a network service comprises: performing statistical analysis on each key quality indicator (KQI) according to call detail record (CDR) data in a first cycle, to obtain a first threshold of each KQI; obtaining a second threshold of each KQI according to the first threshold of each KQI in a second cycle, wherein, the second cycle comprises at least one first cycle; and obtaining a perception score of the network service according to the second threshold of each KQI and CDR data in a third cycle. The method is applied to the process of evaluating the network service.

Claims (46)

1 . A method for evaluating a network service, comprising:

obtaining, by an electronic device, call detail record (CDR) data collected from a user plane S1-U interface by a probe arranged between a wireless base station and a service gateway:

performing, by the electronic device, statistical analysis on each key quality indicator (KQI) according to call detail record data in a first cycle, to obtain a first threshold of each KQI;

obtaining, by the electronic device, a second threshold of each KQI according to the first threshold of each KQI in a second cycle, wherein, the second cycle comprises at least one first cycle; and

obtaining, by the electronic device, a perception score of the network service according to the second threshold of each KQI and CDR data in a third cycle; wherein the perception score of the network service quantifies user-perceived service quality;

outputting, by the electronic device, the perception score for visualization or diagnostic analysis.

2 . The method according to claim 1 , wherein, before the performing statistical analysis on each KQI according to CDR data in a first cycle, to obtain a first threshold of each KQI, further comprising:

setting the first cycle, the second cycle and the third cycle;

dividing the CDR data of the S1-U interface according to the type of the network service and the first cycle, to obtain the CDR data in the first cycle; and

dividing the CDR data of the S1-U interface according to the type of the network service and the third cycle, to obtain the CDR data in the third cycle.

3 . The method according to claim 1 , wherein, the performing statistical analysis on each KQI according to CDR data in a first cycle, to obtain a first threshold of each KQI comprising:

obtaining each KQI value of each user according to the CDR data in the first cycle;

counting the number of users at different values of each KQI, to obtain a probability density curve of each KQI; and

analyzing the probability density curve of each KQI, to obtain the first threshold of each KQI.

4 . The method according to claim 2 , wherein, the performing statistical analysis on each KQI according to CDR data in a first cycle, to obtain a first threshold of each KQI comprising:

obtaining each KQI value of each user according to the CDR data in the first cycle;

counting the number of users at different values of each KQI, to obtain a probability density curve of each KQI; and

analyzing the probability density curve of each KQI, to obtain the first threshold of each KQI.

5 . The method according to claim 3 , wherein, the analyzing the probability density curve of each KQI, to obtain the first threshold of each KQI comprising:

setting a first threshold quantile and a second threshold quantile for each KQI, wherein the first threshold quantile is smaller than the second threshold quantile; and

obtaining the first threshold of each KQI according to the change characteristic of each KQI, the probability density curve of each KQI, the first threshold quantile and the second threshold quantile, wherein, the first threshold of each KQI comprises a high-quality threshold and a low-quality threshold.

6 . The method according to claim 4 , wherein, the analyzing the probability density curve of each KQI, to obtain the first threshold of each KQI comprising:

setting a first threshold quantile and a second threshold quantile for each KQI, wherein the first threshold quantile is smaller than the second threshold quantile; and

obtaining the first threshold of each KQI according to the change characteristic of each KQI, the probability density curve of each KQI, the first threshold quantile and the second threshold quantile, wherein, the first threshold of each KQI comprises a high-quality threshold and a low-quality threshold.

7 . The method according to claim 5 , wherein, the obtaining the first threshold of each KQI according to the change characteristic of each KQI, the probability density curve of each KQI, the first threshold quantile and the second threshold quantile, wherein, the first threshold of each KQI comprises a high-quality threshold and a low-quality threshold comprising:

if the change characteristic of the KQI is that the larger the value is, the better the quality of the network service is, the KQI value corresponding to the first threshold quantile on the probability density curve is the low-quality threshold, and the KQI value corresponding to the second threshold quantile on the probability density curve is the high-quality threshold; and

if the change characteristic of the KQI is that the smaller the value is, the better the quality of the network service is, the KQI value corresponding to the first threshold quantile on the probability density curve is the high-quality threshold, and the KQI value corresponding to the second threshold quantile on the probability density curve is the low-quality threshold.

8 . The method according to claim 6 , wherein, the obtaining the first threshold of each KQI according to the change characteristic of each KQI, the probability density curve of each KQI, the first threshold quantile and the second threshold quantile, wherein, the first threshold of each KQI comprises a high-quality threshold and a low-quality threshold comprising:

if the change characteristic of the KQI is that the larger the value is, the better the quality of the network service is, the KQI value corresponding to the first threshold quantile on the probability density curve is the low-quality threshold, and the KQI value corresponding to the second threshold quantile on the probability density curve is the high-quality threshold; and

if the change characteristic of the KQI is that the smaller the value is, the better the quality of the network service is, the KQI value corresponding to the first threshold quantile on the probability density curve is the high-quality threshold, and the KQI value corresponding to the second threshold quantile on the probability density curve is the low-quality threshold.

9 . The method according to claim 1 , wherein, the obtaining a second threshold of each KQI according to the first threshold of each KQI in a second cycle, wherein, the second cycle comprises at least one first cycle comprising:

averaging all the first thresholds of each KQI in the second cycle, to obtain the second threshold of each KQI.

10 . The method according to claim 1 , wherein, the obtaining a perception score of the network service according to the second threshold of each KQI and CDR data in a third cycle comprising:

classifying the CDR data in the third cycle, to obtain the KQI of each type of CDR data;

averaging the KQI of each type of CDR data respectively, to obtain an average of each KQI in the third cycle;

determining a scoring function of each KQI according to the second threshold of each KQI;

determining the evaluation score of each KQI according to the average of each KQI and the scoring function of each KQI; and

performing weighted averaging on the evaluation scores of the KQIs in the same network service according to preset weights, to obtain the perception score of the network service.

11 . The method according to claim 1 , wherein, before the obtaining a perception score of the network service according to the second threshold of each KQI and CDR data in a third cycle, further comprising:

adjusting the second cycle from small to large; and

updating the second threshold of each KQI according to the adjusted second cycle.

12 . An electronic device, comprising:

at least one processor; and

a memory in communication connection with the at least one processor; wherein,

the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the method for evaluating the network service according to claim 1 .

13 . A non-transitory computer readable storage medium, storing a computer program, wherein, when the computer program is executed by a processor, the method for evaluating the network service according to claim 1 is implemented.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2023
From: YANG, WEIWEI; ZHAN, YIZHONG
To: ZTE CORPORATION
Reel/Frame 062303/0334 →
Priority Claims (1)
CN 202011155978.7 · Oct 26, 2020 · national
Continuity (2)
Continuation PCTCN2021125784 · Oct 22, 2021
Related Publication 20230156499A1 · May 18, 2023
References Cited (16)
US 9087176B1 · Chang · 2015 [cited by examiner]
US 11546234B2 · Xue et al. · 2023 [cited by applicant]
US 20140337871A1 · Garcia De Blas · 2014 [cited by examiner]
US 20170364819A1 · Yang · 2017 [cited by examiner]
US 20180006957A1 · Ouyang · 2018 [cited by examiner]
US 20180225617A1 · Leung et al. · 2018 [cited by applicant]
US 20190173898A1 · Bharrat et al. · 2019 [cited by applicant]
CN 102104900A · 2011 [cited by applicant]
CN 103840978 · 2014 [cited by applicant]
CN 104378220 · 2015 [cited by applicant]
CN 104410516A · 2015 [cited by applicant]
CN 105554782A · 2016 [cited by applicant]
CN 101562830 · 2019 [cited by applicant]
International search report of the corresponding PCT Application No. PCT/CN2021/125784 mailed on Dec. 24, 2021 along with English translation thereof. [cited by applicant]
Office action of the corresponding IN Patent Application No. 202317000259 (with English translation thereof) issued on Nov. 23, 2023. [cited by applicant]
Dr Irina Cotanis Infovista USA: “Draft New Recommendation” Statistical Framework for network end to end benchmarking scoring and ranking“(E.NetPerfRank) (for consent); TD438R1”, ITU-T Draft; Study Period 2017-2020; Stud… [cited by applicant]