IP Library Granted Patent US 12,476,721
Granted Patent B2
US 12,476,721 · App. 18/325,941 · Granted Nov 18, 2025

Generating a test case associated with a test radio access network (RAN) based on key performance indicators associated with a production ran of a wireless telecommunication network

Inventors: Sharath Somashekar (Overland Park, KS); Akriti Kumar (Ashburn, VA); Rashmi Kumar (Herndon, VA); Diego Estrella Chavez (Tysons, VA)
Assignee: T-Mobile USA, Inc.
H04B17/14H04L43/55
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,476,721
App. No.
18/325,941
Granted
Nov 18, 2025
Kind
B2
Abstract

The system obtains KPIs of the production RAN of the network and capabilities of multiple UEs interacting with the test RAN. The system creates a test case based on the KPIs and the capabilities of the multiple UEs interacting with the test RAN by: adjusting a type of traffic associated with the test RAN, adjusting traffic characteristics, and adjusting the capabilities of the multiple UEs interacting with the test RAN. The system runs a simulation of the test case interacting with the test RAN to obtain simulation KPIs. The system determines whether the simulation KPIs correspond to the KPIs associated with the production RAN. Upon determining that the simulation KPIs correspond to the KPIs of the production RAN, the system stores the test case in a database. Upon determining that the simulation KPIs do not correspond to the KPIs of the production RAN, the system adjusts the test case.

Claims (89)

1 . At least one non-transitory computer-readable storage medium storing instructions to generate a test case associated with a test radio access network (RAN) of a wireless telecommunication network based on key performance indicators (KPIs) associated with a production RAN of the wireless telecommunication network, which, when executed by at least one data processor of a system, cause the system to:

obtain the KPIs associated with the production RAN of the wireless telecommunication network;

transform the KPIs into relevant variables including a type of traffic associated with the production RAN, traffic characteristics associated with the production RAN, types of multiple mobile devices interacting with the production RAN, user traffic characteristics, and a number of each type of the multiple mobile devices interacting with the production RAN;

obtain capabilities of multiple mobile devices interacting with the test RAN;

create the test case based on the relevant variables and the capabilities of the multiple mobile devices interacting with the test RAN by:

adjusting a type of traffic associated with the test RAN,

wherein the type of traffic includes data, voice, short message service (SMS), and a direction including upload and download;

adjusting traffic characteristics including call duration and traffic load; and

adjusting the capabilities of the multiple mobile devices interacting with the test RAN to match the types of the multiple mobile devices interacting with the production RAN and the number of each type of the multiple mobile devices interacting with the production RAN;

run a simulation of the test case interacting with the test RAN to obtain simulation KPIs;

determine whether the simulation KPIs correspond to the KPIs associated with the production RAN;

upon determining that the simulation KPIs correspond to the KPIs associated with the production RAN, store the test case in a database; and

upon determining that the simulation KPIs do not correspond to the KPIs associated with the production RAN, adjust the test case.

2 . The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

obtain a software version associated with the production RAN, and a software version associated with an experimental RAN;

store the software version associated with the production RAN, the software version associated with the experimental RAN, and the simulation KPIs;

detect a change in the software version associated with the production RAN or a change in the software version associated with the experimental RAN;

run a second simulation of the test case interacting with the test RAN to obtain second simulation KPIs;

determine whether a significant difference exists between the simulation KPIs and the second simulation KPIs; and

upon determining that the significant difference exists, create a notification of the significant difference.

3 . The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

obtain a software version associated with the production RAN and a software version associated with an experimental RAN; and

store the software version associated with the production RAN, the software version associated with the experimental RAN, and relevant KPIs including the KPIs associated with the production RAN or the simulation KPIs.

4 . The at least one non-transitory computer-readable storage medium of claim 1 , wherein the types of multiple mobile devices interacting with the production RAN and the number of each type of the multiple mobile devices interacting with the production RAN include a number of radio resource control (RRC) users connected, a number of voice over LTE (VoLTE) users, a number of voice over new radio (VoNR) users, and a tonnage.

5 . The at least one non-transitory computer-readable storage medium of claim 1 , wherein the multiple mobile devices interacting with the test RAN include a physical mobile device or a mobile device simulator.

6 . The at least one non-transitory computer-readable storage medium of claim 1 , wherein the instructions to obtain capabilities of multiple mobile devices interacting with the test RAN comprise instructions to:

obtain layer 3 messages indicating band, bandwidth, physical cell identifier (PCI), single-sideband modulation (SSB), and System Information Blocks (SIBs); and

obtain a chipset type associated with the multiple mobile devices interacting with the test RAN and a feature associated with the chipset type.

7 . The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

upon determining that the simulation KPIs do not correspond to the KPIs associated with the production RAN, run a subsequent simulation to obtain subsequent KPIs and adjust the test case until the subsequent KPIs correspond to the KPIs associated with the production RAN.

8 . A system comprising:

at least one hardware processor; and

at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:

obtain key performance indicators (KPIs) associated with a production radio access network (RAN) of a wireless telecommunication network, and traffic characteristics associated with multiple user equipment (UEs);

obtain capabilities of the multiple UEs interacting with a test RAN;

create a test case based on the KPIs and the capabilities of the multiple UEs interacting with the test RAN by:

adjusting a type of traffic associated with the test RAN,

wherein the type of traffic includes data, voice, short message service (SMS), and a direction including upload and download;

adjusting traffic characteristics including call duration and traffic load; and

adjusting the capabilities of the multiple UEs interacting with the test RAN to match types of multiple UEs interacting with the production RAN and a number of each type of the multiple UEs interacting with the production RAN;

run a simulation of the test case interacting with the test RAN to obtain simulation KPIs;

determine whether the simulation KPIs correspond to the KPIs associated with the production RAN;

upon determining that the simulation KPIs correspond to the KPIs associated with the production RAN, store the test case in a database; and

upon determining that the simulation KPIs do not correspond to the KPIs associated with the production RAN, adjust the test case.

9 . The system of claim 8 , comprising instructions to:

obtain a software version associated with the production RAN and a software version associated with an experimental RAN;

store the software version associated with the production RAN, the software version associated with the experimental RAN and the simulation KPIs;

detect a change in the software version associated with the production RAN or a change in the software version associated with the experimental RAN;

run a second simulation of the test case interacting with the test RAN to obtain second simulation KPIs;

determine whether a significant difference exists between the simulation KPIs and the second simulation KPIs; and

upon determining that the significant difference exists, create a notification of the significant difference.

10 . The system of claim 8 , comprising instructions to:

obtain a software version associated with the production RAN and a software version associated with an experimental RAN; and

store the software version associated with the production RAN, the software version associated with the experimental RAN and relevant KPIs including the KPIs associated with the production RAN or the simulation KPIs.

11 . The system of claim 8 , wherein the KPIs associated with the production RAN indicate a type of traffic associated with the production RAN, traffic characteristics associated with the production RAN, a number of radio resource control (RRC) users connected, a number of voice over LTE (VoLTE) users, a number of voice over new radio (VoNR) users, and a tonnage.

12 . The system of claim 8 , wherein the multiple UEs interacting with the test RAN include a physical UE or a UE simulator.

13 . The system of claim 8 , wherein the instructions to obtain capabilities of multiple UEs interacting with the test RAN comprise instructions to:

obtain layer 3 messages indicating band, bandwidth, physical cell identifier (PCI), single-sideband modulation (SSB), and System Information Blocks (SIBs); and

obtain a chipset type associated with the multiple UEs interacting with the test RAN and a feature associated with the chipset type.

14 . The system of claim 8 , comprising instructions to:

upon determining that the simulation KPIs do not correspond to the KPIs associated with the production RAN, run a subsequent simulation to obtain subsequent KPIs and adjust the test case until the subsequent KPIs correspond to the KPIs associated with the production RAN.

15 . A method comprising:

obtaining key performance indicators (KPIs) associated with a production radio access network (RAN) of a wireless telecommunication network;

obtaining capabilities of multiple user equipment (UEs) interacting with a test RAN;

creating a test case based on the KPIs and the capabilities of the multiple UEs interacting with the test RAN by:

adjusting a type of traffic associated with the test RAN,

wherein the type of traffic includes data, voice, short message service (SMS), and a direction including upload and download;

adjusting traffic characteristics including call duration and traffic load; and

adjusting the capabilities of the multiple UEs interacting with the test RAN to match types of multiple UEs interacting with the production RAN and a number of each type of the multiple UEs interacting with the production RAN;

running a simulation of the test case interacting with the test RAN to obtain simulation KPIs;

determining whether the simulation KPIs correspond to the KPIs associated with the production RAN;

upon determining that the simulation KPIs correspond to the KPIs associated with the production RAN, storing the test case in a database; and

upon determining that the simulation KPIs do not correspond to the KPIs associated with the production RAN, adjusting the test case.

16 . The method of claim 15 , comprising:

obtaining a software version associated with the production RAN and a software version associated with an experimental RAN;

storing the software version associated with the production RAN, the software version associated with the experimental RAN and the simulation KPIs;

detecting a change in the software version associated with the production RAN or a change in the software version associated with the experimental RAN;

running a second simulation of the test case interacting with the test RAN to obtain second simulation KPIs;

determining whether a significant difference exists between the simulation KPIs and the second simulation KPIs; and

upon determining that the significant difference exists, creating a notification of the significant difference.

17 . The method of claim 15 , comprising:

obtaining a software version associated with the production RAN and a software version associated with an experimental RAN; and

storing the software version associated with the production RAN, the software version associated with the experimental RAN and relevant KPIs including the KPIs associated with the production RAN or the simulation KPIs.

18 . The method of claim 15 , wherein the KPIs associated with the production RAN indicate a type of traffic associated with the production RAN, traffic characteristics associated with the production RAN, types of multiple UEs interacting with the production RAN, a number of radio resource control (RRC) users connected, a number of voice over LTE (VoLTE) users, a number of voice over new radio (VoNR) users, and a tonnage.

19 . The method of claim 15 , wherein obtaining the capabilities of the multiple UEs interacting with the test RAN comprises:

obtaining layer 3 messages indicating band, bandwidth, physical cell identifier (PCI), single-sideband modulation (SSB), and System Information Blocks (SIBs); and

obtaining a chipset type associated with the multiple UEs interacting with the test RAN and a feature associated with the chipset type.

20 . The method of claim 15 , comprising:

upon determining that the simulation KPIs do not correspond to the KPIs associated with the production RAN, running a subsequent simulation to obtain subsequent KPIs and adjusting the test case until the subsequent KPIs correspond to the KPIs associated with the production RAN.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2023
From: SOMASHEKAR, SHARATH; KUMAR, AKRITI; KUMAR, RASHMI; ESTRELLA CHAVEZ, DIEGO
To: T-MOBILE USA, INC.
Reel/Frame 063804/0875 →
Continuity (1)
Related Publication 20240405897A1 · Dec 5, 2024
References Cited (86)
US 7929512B2 · Malomsoky et al. · 2011 [cited by applicant]
US 8130655B2 · Foottit et al. · 2012 [cited by applicant]
US 9615272B2 · Morad et al. · 2017 [cited by applicant]
US 9655020B2 · Wegmann et al. · 2017 [cited by applicant]
US 9774618B2 · Sundhar et al. · 2017 [cited by applicant]
US 9883378B2 · Mildh et al. · 2018 [cited by applicant]
US 9929908B2 · Ketheesan et al. · 2018 [cited by applicant]
US 9955381B2 · Koskinen et al. · 2018 [cited by applicant]
US 9986432B2 · Fransen · 2018 [cited by applicant]
US 10243810B2 · Kumar et al. · 2019 [cited by applicant]
US 10299119B2 · Fransen · 2019 [cited by applicant]
US 10320621B1 · Neisinger · 2019 [cited by applicant]
US 10498610B1 · Kenig et al. · 2019 [cited by applicant]
US 10548002B2 · Mildh et al. · 2020 [cited by applicant]
US 10659960B2 · Fransen · 2020 [cited by applicant]
US 10841302B2 · Hahn et al. · 2020 [cited by applicant]
US 10917819B2 · Shetty et al. · 2021 [cited by applicant]
US 10958631B2 · Fransen · 2021 [cited by applicant]
US 11146978B2 · Bodiga et al. · 2021 [cited by applicant]
US 11405806B2 · Takla · 2022 [cited by examiner]
US 11412396B2 · Jackson · 2022 [cited by examiner]
US 11483226B2 · Menon · 2022 [cited by examiner]
US 11509542B2 · Shirazipour et al. · 2022 [cited by applicant]
US 11533247B2 · Saxena · 2022 [cited by examiner]
US 11540170B2 · Krishnaswamy · 2022 [cited by examiner]
US 11997512B2 · Li · 2024 [cited by examiner]
US 12069494B2 · Chenumolu · 2024 [cited by examiner]
US 12086038B2 · Yeddu · 2024 [cited by examiner]
US 12127059B2 · Melodia · 2024 [cited by examiner]
US 12216738B2 · Cmielowski · 2025 [cited by examiner]
US 12273748B2 · Eleftheriadis · 2025 [cited by examiner]
US 12289137B2 · Vaez-Ghaemi · 2025 [cited by examiner]
US 12302157B2 · Malboubi · 2025 [cited by examiner]
US 12348401B2 · Ramesh · 2025 [cited by examiner]
US 20150146616A1 · Báder · 2015 [cited by applicant]
US 20180220312A1 · Guttenfelder · 2018 [cited by examiner]
US 20200015154A1 · Pateromichelakis et al. · 2020 [cited by applicant]
US 20200120489A1 · Mildh et al. · 2020 [cited by applicant]
US 20210289376A1 · Chou et al. · 2021 [cited by applicant]
US 20220138081A1 · Varma · 2022 [cited by examiner]
US 20230032390A1 · Chandramouli et al. · 2023 [cited by applicant]
US 20230037228A1 · Panigrahi et al. · 2023 [cited by applicant]
US 20230083011A1 · Krishnan · 2023 [cited by examiner]
US 20240244125A1 · Muhammad · 2024 [cited by examiner]
US 20240284298A1 · Yang · 2024 [cited by examiner]
US 20240340929A1 · Narayanan Thangaraj · 2024 [cited by examiner]
US 20240349082A1 · Li · 2024 [cited by examiner]
US 20240373263A1 · Baker · 2024 [cited by examiner]
US 20240378506A1 · D'Oro · 2024 [cited by examiner]
US 20240380532A1 · Gad · 2024 [cited by examiner]
US 20240406768A1 · Rodriguez Gomez · 2024 [cited by examiner]
US 20250030607A1 · Báder · 2025 [cited by examiner]
US 20250063431A1 · Ali · 2025 [cited by examiner]
CN 105393585A · 2016 [cited by applicant]
CN 105830476B · 2020 [cited by applicant]
CN 112534963A · 2021 [cited by applicant]
CN 110463245B · 2022 [cited by applicant]
CN 111699658B · 2023 [cited by applicant]
EP 2706775A1 · 2014 [cited by applicant]
EP 2566205B1 · 2019 [cited by applicant]
EP 3087770B1 · 2020 [cited by applicant]
EP 3375247B1 · 2020 [cited by applicant]
EP 3735012A1 · 2020 [cited by applicant]
EP 3138311B1 · 2022 [cited by applicant]
JP 4612050B2 · 2010 [cited by applicant]
JP 5801963B2 · 2015 [cited by applicant]
JP 2016509801A · 2016 [cited by applicant]
JP 2017520203A · 2017 [cited by applicant]
JP 6518345B2 · 2019 [cited by applicant]
JP 6526176B2 · 2019 [cited by applicant]
KR 20110126123A · 2011 [cited by applicant]
KR 20190084142A · 2019 [cited by applicant]
KR 102000508B1 · 2019 [cited by applicant]
KR 20210060586A · 2021 [cited by applicant]
WO 2011127775A1 · 2011 [cited by applicant]
WO 2012022188A1 · 2012 [cited by applicant]
WO 2012107002A1 · 2012 [cited by applicant]
WO 2013020584A1 · 2013 [cited by applicant]
WO 2015026334A1 · 2015 [cited by applicant]
WO 2015097223A1 · 2015 [cited by applicant]
WO 2015166099A1 · 2015 [cited by applicant]
WO 2017081696A1 · 2017 [cited by applicant]
WO 2017182057A1 · 2017 [cited by applicant]
WO 2018103855A1 · 2018 [cited by applicant]
WO 2018166614A1 · 2018 [cited by applicant]
WO WO2025079976A2 · 2025 [cited by examiner]