IP Library › Granted Patent US 12,273,744
Granted Patent B2
US 12,273,744 · App. 17/814,186 · Granted Apr 8, 2025

Automatically using configuration management analytics in cellular networks

Inventors: Mehmet N. Kurt (New York, NY); Samuel Albert (Robbinsville, NJ); Yan Xin (Princeton, NJ); Russell Douglas Ford (San Jose, CA); Jianzhong Zhang (Dallas, TX)
Assignee: Samsung Electronics Co., Ltd.
H04W24/02H04L41/0823H04L41/5009
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,273,744
App. No.
17/814,186
Granted
Apr 8, 2025
Kind
B2
Abstract

A method includes partitioning a set of configuration management (CM) data for one or more cellular network devices into multiple distinct time intervals, each time interval associated with a distinct set of CM settings at the one or more cellular network devices, the CM data comprising multiple CM parameters. The method also includes determining a regression model based on the set of CM data. The method also includes applying the regression model to compute a distinct set of scores and compare the set of scores to estimate whether a performance of the one or more cellular network devices has changed during a second time interval relative to a first time interval.

Claims (46)

1. A method comprising:

partitioning a set of configuration management (CM) data for one or more cellular network devices into multiple distinct time intervals, each time interval associated with a distinct set of CM settings at the one or more cellular network devices, the CM data comprising multiple CM parameters;

determining a regression model based on the set of CM data; and

applying the regression model to compute a distinct set of scores and compare the set of scores to estimate whether a performance of the one or more cellular network devices has changed during a second time interval relative to a first time interval.

2. The method of claim 1 , further comprising:

in response to estimating that the performance of the one or more cellular network devices has degraded during the second time interval, performing root cause analysis (RCA) including statistically analyzing behavior of a network cell before and after a CM change to determine whether the degradation in the performance of the one or more cellular network devices is attributable to the CM change.

3. The method of claim 1 , further comprising:

determining at least one recommended parameter configuration to optimize a target key performance indicator (KPI) or key quality indicator (KQI).

4. The method of claim 3 , further comprising:

performing parameter sensitivity analysis comprising computing a respective sensitivity of each CM parameter of the set of CM data based on an average impact of that CM parameter on the target KPI or KQI while maintaining at least some other factors.

5. The method of claim 1 , wherein determining the regression model comprises:

selecting one or more regressor key performance indicators (KPIs) for the regression model to avoid masking one or more CM parameter effects.

6. The method of claim 1 , further comprising:

performing at least one of multiple data preprocessing operations on the set of CM data, the multiple data preprocessing operations comprising (i) removing invalid data samples, (ii) normalizing or scaling the CM data, (iii) removing trends or seasonality in the CM data, (iv) generating additional synthetic features from existing KPIs in the CM data, and (v) selecting a subset of the CM data associated with a specific timeframe or a specific group of the cellular network devices.

7. The method of claim 1 , wherein the regression model comprises a one-group regression or a two-group regression.

8. A device comprising:

a transceiver configured to transmit and receive information; and

a processor operably connected to the transceiver, the processor configured to:

partition a set of configuration management (CM) data for one or more cellular network devices into multiple distinct time intervals, each time interval associated with a distinct set of CM settings at the one or more cellular network devices, the CM data comprising multiple CM parameters;

determine a regression model based on the set of CM data; and

apply the regression model to compute a distinct set of scores and compare the set of scores to estimate whether a performance of the one or more cellular network devices has changed during a second time interval relative to a first time interval.

9. The device of claim 8 , wherein the processor is further configured to:

in response to estimating that the performance of the one or more cellular network devices has degraded during the second time interval, perform root cause analysis (RCA) including statistically analyzing behavior of a network cell before and after a CM change to determine whether the degradation in the performance of the one or more cellular network devices is attributable to the CM change.

10. The device of claim 8 , wherein the processor is further configured to:

determine at least one recommended parameter configuration to optimize a target key performance indicator (KPI) or key quality indicator (KQI).

11. The device of claim 10 , wherein the processor is further configured to:

perform parameter sensitivity analysis in which the processor computes a respective sensitivity of each CM parameter of the set of CM data based on an average impact of that CM parameter on the target KPI or KQI while maintaining at least some other factors.

12. The device of claim 8 , wherein to determine the regression model, the processor is further configured to:

select one or more regressor key performance indicators (KPIs) for the regression model to avoid masking one or more CM parameter effects.

13. The device of claim 8 , wherein the processor is further configured to:

perform at least one of multiple data preprocessing operations on the set of CM data, the multiple data preprocessing operations comprising (i) removing invalid data samples, (ii) normalizing or scaling the CM data, (iii) removing trends or seasonality in the CM data, (iv) generating additional synthetic features from existing KPIs in the CM data, and (v) selecting a subset of the CM data associated with a specific timeframe or a specific group of the cellular network devices.

14. The device of claim 8 , wherein the regression model comprises a one-group regression or a two-group regression.

15. A non-transitory computer readable medium comprising program code that, when executed by a processor of a device, causes the device to:

partition a set of configuration management (CM) data for one or more cellular network devices into multiple distinct time intervals, each time interval associated with a distinct set of CM settings at the one or more cellular network devices, the CM data comprising multiple CM parameters;

determine a regression model based on the set of CM data; and

apply the regression model to compute a distinct set of scores and compare the set of scores to estimate whether a performance of the one or more cellular network devices has changed during a second time interval relative to a first time interval.

16. The non-transitory computer readable medium of claim 15 , further comprising program code that, when executed by the processor of the device, causes the device to:

in response to estimating that the performance of the one or more cellular network devices has degraded during the second time interval, perform root cause analysis (RCA) including statistically analyzing behavior of a network cell before and after a CM change to determine whether the degradation in the performance of the one or more cellular network devices is attributable to the CM change.

17. The non-transitory computer readable medium of claim 15 , further comprising program code that, when executed by the processor of the device, causes the device to:

determine at least one recommended parameter configuration to optimize a target key performance indicator (KPI) or key quality indicator (KQI).

18. The non-transitory computer readable medium of claim 17 , further comprising program code that, when executed by the processor of the device, causes the device to:

perform parameter sensitivity analysis in which the processor computes a respective sensitivity of each CM parameter of the set of CM data based on an average impact of that CM parameter on the target KPI or KQI while maintaining at least some other factors.

19. The non-transitory computer readable medium of claim 15 , wherein the program code that causes the device to determine the regression model comprises program code that causes the device to:

select one or more regressor key performance indicators (KPIs) for the regression model to avoid masking one or more CM parameter effects.

20. The non-transitory computer readable medium of claim 15 , further comprising program code that, when executed by the processor of the device, causes the device to:

perform at least one of multiple data preprocessing operations on the set of CM data, the multiple data preprocessing operations comprising (i) removing invalid data samples, (ii) normalizing or scaling the CM data, (iii) removing trends or seasonality in the CM data, (iv) generating additional synthetic features from existing KPIs in the CM data, and (v) selecting a subset of the CM data associated with a specific timeframe or a specific group of the cellular network devices.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THIRD ASSIGNOR'S NAME PREVIOUSLY RECORDED AT REEL: 060585 FRAME: 0400. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 17, 2023
From: KURT, MEHMET N.; ALBERT, SAMUEL; XIN, YAN; FORD, RUSSELL DOUGLAS; ZHANG, JIANZHONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 063690/0210 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 21, 2022
From: KURT, MEHMET N.; ALBERT, SAMUEL; YAN, YAN; FORD, RUSSELL DOUGLAS; ZHANG, JIANZHONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 060585/0400 →
Continuity (2)
Provisional Application 63228481 · Aug 2, 2021
Related Publication 20230047057A1 · Feb 16, 2023
References Cited (47)
US 9119086B1 · Ouyang · 2015 [cited by examiner]
US 9204319B2 · Ouyang et al. · 2015 [cited by applicant]
US 9503919B2 · Sofuoglu et al. · 2016 [cited by applicant]
US 9538401B1 · Ouyang · 2017 [cited by examiner]
US 10735287B1 · Soundrarajan · 2020 [cited by applicant]
US 10785101B2 · Li et al. · 2020 [cited by applicant]
US 10832087B1 · Wang · 2020 [cited by examiner]
US 20100153543A1 · Lee et al. · 2010 [cited by applicant]
US 20130196685A1 · Griff · 2013 [cited by examiner]
US 20150289149A1 · Ouyang · 2015 [cited by examiner]
US 20170064569A1 · Martone · 2017 [cited by examiner]
US 20170272319A1 · Sheen · 2017 [cited by examiner]
US 20170290024A1 · Ouyang · 2017 [cited by examiner]
US 20180006957A1 · Ouyang · 2018 [cited by examiner]
US 20180227930A1 · Ouyang · 2018 [cited by examiner]
US 20180324199A1 · Crotinger · 2018 [cited by examiner]
US 20190028357A1 · Kokkula · 2019 [cited by examiner]
US 20190102276A1 · Dang · 2019 [cited by examiner]
US 20190159048A1 · Feldkamp · 2019 [cited by examiner]
US 20190306023A1 · Vasseur · 2019 [cited by examiner]
US 20200012917A1 · Pham et al. · 2020 [cited by applicant]
US 20200084087A1 · Sharma · 2020 [cited by examiner]
US 20200117580A1 · Lekivetz · 2020 [cited by examiner]
US 20200127901A1 · Hariharan · 2020 [cited by examiner]
US 20200134441A1 · Suthar · 2020 [cited by examiner]
US 20200148395A1 · Zhang · 2020 [cited by examiner]
US 20200322661A1 · Korte et al. · 2020 [cited by applicant]
US 20200382361A1 · Chandrasekhar et al. · 2020 [cited by applicant]
US 20210029557A1 · Zeng et al. · 2021 [cited by applicant]
US 20210351973A1 · Ford et al. · 2021 [cited by applicant]
US 20220022066A1 · Anand Pushkala · 2022 [cited by examiner]
US 20230164029A1 · Mermoud · 2023 [cited by examiner]
US 20240211768A1 · Rydén et al. · 2024 [cited by examiner]
US 20240357379A1 · Gullberg · 2024 [cited by examiner]
WO 2020239203A1 · 2020 [cited by applicant]
International Search Report and Written Opinion issued Oct. 26, 2022 regarding International Application No. PCT/KR2022/011315, 8 pages. [cited by applicant]
Priyadharshini et al., “Regression model for handover control parameter configuration in LTE-A networks”, Computers and Electrical Engineering, No. 72, Jan. 2018, pp. 877-893. [cited by applicant]
Extended European Search Report issued May 31, 2024 regarding Application No. 22853396.4, 14 pages. [cited by applicant]
Wikipedia, “Coefficient of determination”, downloaded Jul. 8, 2022, 13 pgs. https://en.wikipedia.org/wiki/Coefficient_of_determination. [cited by applicant]
Wikipedia, “Welch's t-test”, downloaded Jul. 8, 2022, 4 pgs. https://en.wikipedia.org/wiki/Welch's_t-test. [cited by applicant]
Engineering Statistics Handbook, “1.3.5.3. Two-Sample t-Test for Equal Means”, downloaded Jul. 8, 2022, 4 pgs. https://www.itl.nist.gov/div898/handbook/eda/section3/eda353.htm. [cited by applicant]
Wikipedia, “Kullback-Leibler divergence”, downloaded Jul. 8, 2022, 21 pgs. https://en.wikipedia.org/wiki/Kullback%E2%80%93Leibler_divergence. [cited by applicant]
Wikipedia, “Random forest”, downloaded Jul. 8, 2022, 12 pgs. https://en.wikipedia.org/wiki/Random_forest. [cited by applicant]
Scikit-Learn, “Machine Learning in Python”, downloaded Jul. 8, 2022, 2 pgs. https://scikit-learn.org/stable/. [cited by applicant]
Small Cell Forum, “SCF market forecast”, document 050.10.6, Jul. 2022, 31 pgs. smallcellforum.org/scf-market-forecast. [cited by applicant]
Y. Cui et al., “Class-Balanced Loss Based on Effective Number of Samples”, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, 10 pgs. [cited by applicant]
C. Zhang et al., “Association Rule Mining: Models and Algorithms”, vol. 2307, Springer, 2003, 248 pgs. [cited by applicant]