IP Library › Granted Patent US 12,367,031
Granted Patent B2
US 12,367,031 · App. 18/323,372 · Granted Jul 22, 2025

Intelligent method and systems for automated radio network performance evaluation of a wireless telecommunication network

Inventors: Sharath Somashekar (Overland Park, KS); Diego Estrella Chavez (Tysons, VA); Rashmi Kumar (Herndon, VA); Jennifer Feria Reyes (Bothell, WA)
Assignee: T-Mobile USA, Inc.
G06F8/65H04W24/02H04W24/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,367,031
App. No.
18/323,372
Granted
Jul 22, 2025
Kind
B2
Abstract

The system scans a RAN associated with a wireless telecommunication network to obtain an indication of a hardware status and a software status associated with the RAN. The system determines whether there is an update to the hardware or software status associated with the RAN. Upon determining there is the update, the system obtains from a first database an indication of a remote radio head configured to test the update. Based on the indication of the remote radio head, the system obtains from a second database multiple UEs configured to test the update. The system tests the update by causing the remote radio head to send a communication to a UE among the multiple UEs. The system obtains logs associated with the communication and, based on the logs, determines whether the update passes the tests.

Claims (89)

1. At least one non-transitory computer-readable storage medium storing instructions to test an update associated with a radio access network (RAN) of a wireless telecommunication network, which, when executed by at least one data processor of a system, cause the system to:

periodically scan the RAN of the wireless telecommunication network to obtain an indication of a hardware status associated with the RAN and a software status associated with the RAN,

wherein the RAN includes a gNodeB, an eNodeB, and an open radio access network (ORAN);

determine whether there is the update to the hardware status associated with the RAN or the software status associated with the RAN;

upon determining there is the update to the hardware status associated with the RAN or the software status associated with the RAN, obtain from a first database an indication of a remote radio head configured to test the update;

based on the indication of the remote radio head, obtain from a second database multiple mobile devices configured to test the update;

test the update by causing the remote radio head to send a communication to a mobile device among the multiple mobile devices;

obtain logs associated with the communication,

wherein the logs are generated by a component of the wireless telecommunication network and the mobile device among the multiple mobile devices; and

based on the logs, determine whether the update passes the test.

2. The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

based on the update, determine a first subset of mobile devices among the multiple mobile devices configured to test the update;

based on the update, obtain from a third database multiple test cases associated with the RAN,

wherein the multiple test cases are configured to test the update,

wherein the multiple test cases include a band and a generation of wireless technology; and

based on the multiple test cases and the first subset of mobile devices, select a subset of the multiple test cases to run, thereby reducing a number of test cases to run.

3. The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

translate the logs from a machine-readable format to a human-readable format; and

store the human-readable format.

4. The at least one non-transitory computer-readable storage medium of claim 1 , wherein the instructions to periodically scan the RAN comprise instructions to:

directly access a node associated with the RAN; or

query a database associated with the RAN.

5. The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

determine that a component of the wireless telecommunication network has failed, wherein the failure prevents testing of the update; and

store an indication of the update for testing when the failure is resolved.

6. The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

based on the update, determine a subset of mobile devices among the multiple mobile devices configured to test the update.

7. The at least one non-transitory computer-readable storage medium of claim 1 , comprising instructions to:

obtain a first indication to test the multiple mobile devices, wherein the first indication includes a generation of wireless technology and a band;

obtain a second indication to test the multiple mobile devices, wherein the second indication includes the generation of wireless technology; and

based on the first indication and the second indication, select the multiple mobile devices, wherein a number of the selected multiple mobile devices is less than a number of multiple mobile devices selected based on only the first indication or only the second indication.

8. A method comprising:

scanning a RAN associated with a wireless telecommunication network to obtain an indication of a hardware status associated with the RAN and a software status associated with the RAN,

wherein the RAN includes a gNodeB, an eNodeB, and an open radio access network (ORAN);

determining whether there is an update to the hardware status associated with the RAN or the software status associated with the RAN;

upon determining there is the update to the hardware status associated with the RAN or the software status associated with the RAN, obtaining from a first database an indication of a remote radio head configured to test the update;

based on the indication of the remote radio head, obtaining from a second database multiple user equipment (UEs) configured to test the update;

testing the update by causing the remote radio head to send a communication to a UE among the multiple UEs;

obtaining logs associated with the communication,

wherein the logs are generated by a component of the wireless telecommunication network and the UE among the multiple UEs; and

based on the logs, determining whether the update passes the test.

9. The method of claim 8 , comprising:

based on the update, determining a first subset of UEs among the multiple UEs configured to test the update;

based on the update, obtaining from a third database multiple test cases associated with the RAN,

wherein the multiple test cases are configured to test the update,

wherein the multiple test cases include a band and a generation of wireless technology; and

based on the multiple test cases and the first subset of UEs, determining a subset of the multiple test cases to run, thereby reducing a number of test cases to run.

10. The method of claim 8 , comprising:

translating the logs from a machine-readable format to a human-readable format; and

storing the human-readable format.

11. The method of claim 8 , wherein scanning the RAN comprises:

directly accessing a node associated with the RAN; or

querying a database associated with the RAN.

12. The method of claim 8 , comprising:

determining that a component of the wireless telecommunication network has failed, wherein the failure prevents testing of the update; and

storing an indication of the update for testing when the failure is resolved.

13. The method of claim 8 , comprising:

based on the update, determining a subset of UEs among the multiple UEs configured to test the update.

14. The method of claim 8 , comprising:

obtaining a first indication to test the multiple UEs, wherein the first indication includes a generation of wireless technology and a band;

obtaining a second indication to test the multiple UEs, wherein the second indication includes the generation of wireless technology; and

based on the first indication and the second indication, selecting the multiple UEs, wherein a number of the selected multiple UEs is less than a number of multiple UEs selected based on only the first indication or only the second indication.

15. A system comprising:

a radio equipment software scanner configured to initiate a software trigger,

wherein the software trigger is configured to periodically scan a hardware state and a software state associated with a RAN of a wireless telecommunication network;

a first controller configured to:

receive a trigger indicating a radio associated with the RAN is updated,

query a first database to obtain an indication of a remote radio head configured to test an update,

wherein the remote radio head is configured to operate at a particular frequency band and a particular generation of wireless technology;

multiple UEs configured to operate at multiple frequency bands, associated with multiple generations of wireless technology, and manufactured by multiple manufacturers; and

a second controller configured to:

control the multiple UEs,

await a first trigger message from the radio equipment software scanner and a second trigger message from the first controller, and

upon receiving the first trigger message and the second trigger message, select a subset of the multiple UEs.

16. The system of claim 15 , the second controller configured to:

based on the second trigger message, query a second database mapping a UE among the multiple UEs to a frequency band to determine a first subset of the multiple UEs;

based on the first trigger message, determine a second subset of multiple devices from the first subset of multiple devices, wherein the second subset of multiple devices is smaller than the first subset of multiple devices;

based on the first trigger message and the second trigger message, query a third database including multiple test cases to obtain a test case configured to test the update; and

based on the multiple test cases and the second subset of multiple devices, determine a subset of test cases among the multiple test cases to run, thereby reducing a number of test cases to run.

17. The system of claim 15 , the second controller configured to:

collect logs from the multiple UEs;

translate the logs from a machine-readable format to a human-readable format; and

store the human-readable format in a database.

18. The system of claim 15 , comprising the software trigger configured to periodically scan the RAN by directly accessing a node associated with the RAN or by querying a database associated with the RAN.

19. The system of claim 15 , the radio equipment software scanner configured to trigger an automation stream upon detecting a change associated with the hardware state or the software state associated with the RAN,

wherein the automation stream is configured to be triggered by a CRON method with a set periodicity or by an external trigger from the radio equipment software scanner.

20. The system of claim 15 , the second controller configured to:

based on the second trigger message, query a second database mapping a UE among the multiple UEs to a frequency band to determine a first subset of the multiple UEs; and

based on the first trigger message, determine a second subset of multiple devices from the first subset of multiple devices, wherein the second subset of multiple devices is smaller than the first subset of multiple devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2023
From: SOMASHEKAR, SHARATH; ESTRELLA CHAVEZ, DIEGO; KUMAR, RASHMI; REYES, JENNIFER FERIA
To: T-MOBILE USA, INC.
Reel/Frame 063756/0673 →
Continuity (1)
Related Publication 20240394034A1 · Nov 28, 2024
References Cited (63)
US 8060084B2 · Buckley et al. · 2011 [cited by applicant]
US 8976677B2 · Novak et al. · 2015 [cited by applicant]
US 9814021B2 · Himayat et al. · 2017 [cited by applicant]
US 9872197B2 · Himayat et al. · 2018 [cited by applicant]
US 9900845B2 · Cui et al. · 2018 [cited by applicant]
US 9918267B2 · Plestid et al. · 2018 [cited by applicant]
US 10083073B2 · Ambichl · 2018 [cited by examiner]
US 20130040634A1 · Johansson et al. · 2013 [cited by applicant]
US 20150341802A1 · Chiang · 2015 [cited by examiner]
US 20220104050A1 · Liu et al. · 2022 [cited by applicant]
US 20220167447A1 · Liu et al. · 2022 [cited by applicant]
US 20220303168A1 · Mdini · 2022 [cited by examiner]
US 20230032088A1 · Goswami · 2023 [cited by examiner]
US 20230153188A1 · Shrivastava · 2023 [cited by examiner]
US 20230337170A1 · Stjernholm · 2023 [cited by examiner]
CN 105340327A · 2016 [cited by applicant]
CN 105659657B · 2019 [cited by applicant]
CN 105592460B · 2019 [cited by applicant]
CN 110024427A · 2019 [cited by applicant]
CN 111903147A · 2020 [cited by applicant]
CN 112204914A · 2021 [cited by applicant]
CN 112586036A · 2021 [cited by applicant]
CN 113170366A · 2021 [cited by applicant]
CN 113475157A · 2021 [cited by applicant]
CN 111279749B · 2022 [cited by applicant]
CN 110574431B · 2022 [cited by applicant]
EP 2272291A1 · 2011 [cited by applicant]
EP 2620010A1 · 2013 [cited by applicant]
EP 2820883A2 · 2015 [cited by applicant]
EP 2989830A1 · 2016 [cited by applicant]
EP 3033904A1 · 2016 [cited by applicant]
EP 2620028B1 · 2020 [cited by applicant]
JP 2007529132A · 2007 [cited by applicant]
JP 2017225146A · 2017 [cited by applicant]
JP 7110187B2 · 2022 [cited by applicant]
JP 7237087B2 · 2023 [cited by applicant]
KR 20130083383A · 2013 [cited by applicant]
KR 20150020557A · 2015 [cited by applicant]
KR 20150120485A · 2015 [cited by applicant]
KR 101749641B1 · 2017 [cited by applicant]
KR 102099526B1 · 2020 [cited by applicant]
KR 20200139151A · 2020 [cited by applicant]
KR 20210014661A · 2021 [cited by applicant]
WO 2010048834A1 · 2010 [cited by applicant]
WO 2011139045A2 · 2011 [cited by applicant]
WO 2012037637A1 · 2012 [cited by applicant]
WO 2012037670A1 · 2012 [cited by applicant]
WO 2013020519A1 · 2013 [cited by applicant]
WO WO2013125919A1 · 2013 [cited by examiner]
WO 2013129994A2 · 2013 [cited by applicant]
WO 2013140207A1 · 2013 [cited by applicant]
WO 2014176106A1 · 2014 [cited by applicant]
WO 2015023253A1 · 2015 [cited by applicant]
WO 2015153145A1 · 2015 [cited by applicant]
WO 2016146145A1 · 2016 [cited by applicant]
WO 2018063268A1 · 2018 [cited by applicant]
WO 2019195456A1 · 2019 [cited by applicant]
WO 2020117121A1 · 2020 [cited by applicant]
WO 2021020190A1 · 2021 [cited by applicant]
D'Oro et al., “OrchestRAN: Network Automation through Orchestrated Intelligence in the Open RAN,” IEEE, 2022, 10pg. (Year: 2022). [cited by examiner]
Kvalbein et al., “The Nornet Edge platform for mobile broadband measurements,” Elsevier, 2012, 14pg. (Year: 2012). [cited by examiner]
Polese et al., “Understanding O-RAN: Architecture, Interfaces, Algorithms, Security, and Research Challenges,” IEEE, 2023, 36pg. (Year: 2023). [cited by examiner]
Zhang et al., “Non-Intrusive Failure Reproduction for Distributed Systems using the Partial Trace Principle,” ACM, 2017, 14pg. (Year: 2017). [cited by examiner]