IP Library Granted Patent US 11,146,978
Granted Patent B2
US 11,146,978 · App. 16/783,006 · Granted Oct 12, 2021

KPI anomaly detection for radio access networks

Inventors: Prem Kumar Bodiga (Bellevue, WA); Norlinda Langub (Mill Creek, WA); Adam Lemow (Seattle, WA); Hermie Padua (Seattle, WA); John Carlo Ventura (Sammamish, WA); Ariz Jacinto (Bellevue, WA)
Assignee: T-Mobile USA, Inc.
H04W24/08H04W24/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,146,978
App. No.
16/783,006
Granted
Oct 12, 2021
Kind
B2
Abstract

An analyzer configured to monitor a radio access network (RAN) of a cellular network is provided. The RAN includes multiple clusters that each includes multiple sites and multiple cells. The analyzer receives a multiple key performance indicator (KPI) measurements from the multiple clusters. Each KPI measurements generated for one of several KPI types. The analyzer receives information identifying anomalous KPI measurements in the received KPI measurements. For a cluster of the RAN, the analyzer identifies one or more common anomalous KPI types that satisfy a ubiquity criterion. The analyzer ranks the identified common anomalous KPI types for the cluster based on an anomaly metric that is derived from the anomalous KPI measurements generated for each identified common anomalous KPI type. The analyzer outputs a list of common anomalous KPI types for the cluster based on the ranking.

Claims (71)

1. A computing device operating as a network node in a core network of a cellular network, the computing device being configured to monitor a radio access network (RAN) of the cellular network, the RAN comprising a plurality of clusters, each cluster comprising a plurality of sites and a plurality of cells, each site communicates over one or more frequency or time divisions with cellular devices that are located in one or more cells, the computing device comprising:

one or more processors; and

a computer-readable medium storing a plurality of computer-executable components that are executable by the one or more processors to perform a plurality of actions, the plurality of actions comprising:

receiving a plurality of key performance indicator (KPI) measurements from the plurality of clusters, each of the plurality of KPI measurements generated for one of a plurality of KPI types;

receiving information identifying anomalous KPI measurements in the received KPI measurements;

for a cluster of the RAN, identifying one or more common anomalous KPI types that satisfy a ubiquity criterion, wherein a particular KPI type satisfies the ubiquity criterion when more than a threshold percentage of the sites in the cluster have anomalous KPI measurements generated for the particular KPI type;

determining, for each of the identified common anomalous KPI types for the cluster, a classification from a group of classifications, wherein at least one classification corresponds to two or more of the identified common anomalous KPI types;

ranking the identified common anomalous KPI types for the cluster based on an anomaly metric that is derived from the anomalous KPI measurements generated for each identified common anomalous KPI type;

outputting a list of sites of the cluster that are ranked based on anomaly metrics that are derived from the anomalous KPI measurements for the sites of the cluster;

receiving a selection of a site from the list of sites;

outputting a list of KPI types for the selected site that is ranked based on anomaly metrics that are derived from the anomalous KPI measurements of the plurality of KPI types for the site; and

outputting a list of common anomalous KPI types and corresponding classifications for the cluster based on the ranking.

2. The computing device of claim 1 , wherein the plurality of actions further comprises:

receiving a selection of a KPI type from the identified common anomalous KPI types of the cluster; and

outputting one or more sites having anomalous KPI measurements of the selected KPI type.

3. The computing device of claim 1 , wherein the plurality of actions further comprises:

outputting a list of cells of the cluster that is ranked based on anomaly metrics that are derived from the anomalous KPI measurements for the cells of the cluster.

4. The computing device of claim 1 , wherein the plurality of actions further comprises:

receiving a predefined set of KPI types; and

for each cluster of a set of clusters in the RAN:

determining an anomaly metric that is derived from the anomalous KPI measurements for each KPI type of the predefined set of KPI types; and

indicating a KPI status for each KPI type of the predefined set of KPI types based on the determined anomaly metric.

5. The computing device of claim 4 , wherein the plurality of actions further comprises:

receiving a selection of a KPI type in the predefined set of KPI types; and

outputting an additional list of sites of the cluster that is ranked based on an anomaly metric that is derived from the anomalous KPI measurements of the selected KPI type from each site.

6. A computer-implemented method for monitoring a radio access network (RAN) comprising a plurality of clusters, each cluster comprising a plurality of sites and a plurality of cells, each site communicating over one or more frequency or time divisions with cellular devices that are located in one or more cells, the method comprising:

receiving, at a network node of a core network associated with the RAN, a plurality of key performance indicator (KPI) measurements from the plurality of clusters, each of the plurality of KPI measurements generated for one of a plurality of KPI types;

receiving information identifying anomalous KPI measurements in the received KPI measurements;

for a cluster of the RAN, identifying one or more common anomalous KPI types that satisfy a ubiquity criterion, wherein a particular KPI type satisfies the ubiquity criterion when more than a threshold percentage of the sites in the cluster have anomalous KPI measurements generated for the particular KPI type;

determining, for each of the identified common anomalous KPI types for the cluster, a classification from a group of classifications, wherein at least one classification corresponds to two or more of the identified common anomalous KPI types;

ranking the identified common anomalous KPI types for the cluster based on an anomaly metric that is derived from the anomalous KPI measurements generated for each identified common anomalous KPI type;

outputting a list of sites of the cluster that are ranked based on anomaly metrics that are derived from the anomalous KPI measurements for the sites of the cluster;

receiving a selection of a site from the list of sites;

outputting a list of KPI types for the selected site that is ranked based on anomaly metrics that are derived from the anomalous KPI measurements of the plurality of KPI types for the site; and

outputting a list of common anomalous KPI types and corresponding classifications for the cluster based on the ranking.

7. The computer-implemented method of claim 6 , further comprising:

receiving a selection of a KPI type from the identified common anomalous KPI types of the cluster; and

outputting one or more sites having anomalous KPI measurements of the selected KPI type.

8. The computer-implemented method of claim 6 , further comprising:

outputting a list of cells of the cluster that is ranked based on anomaly metrics that are derived from the anomalous KPI measurements for the cells of the cluster.

9. The computer-implemented method of claim 6 , further comprising:

receiving a predefined set of KPI types; and

for each cluster of a set of clusters in the RAN:

determining an anomaly metric that is derived from the anomalous KPI measurements for each KPI type of the predefined set of KPI types; and

indicating a KPI status for each KPI type of the predefined set of KPI types based on the determined anomaly metric.

10. The computer-implemented method of claim 9 , further comprising:

receiving a selection of a KPI type in the predefined set of KPI types;

outputting an additional list of sites of the cluster that is ranked based on an anomaly metric that is derived from the anomalous KPI measurements of the selected KPI type from each site.

11. One or more non-transitory computer storage media of a computing device storing computer-executable instructions for monitoring a radio access network (RAN) comprising a plurality of clusters, each cluster comprising a plurality of sites and a plurality of cells, each site communicating over one or more frequency or time divisions with cellular devices that are located in one or more cells, wherein upon execution the computer-executable instructions causing one or more processors to perform acts comprising:

receiving, at a network node of a core network associated with the RAN, a plurality of key performance indicator (KPI) measurements from the plurality of clusters, each of the plurality of KPI measurements generated for one of a plurality of KPI types;

receiving information identifying anomalous KPI measurements in the received KPI measurements;

for a cluster of the RAN, identifying one or more common anomalous KPI types that satisfy a ubiquity criterion, wherein a particular KPI type satisfies the ubiquity criterion when more than a threshold percentage of the sites in the cluster have anomalous KPI measurements generated for the particular KPI type;

determining, for each of the identified common anomalous KPI types for the cluster, a classification from a group of classifications, wherein at least one classification corresponds to two or more of the identified common anomalous KPI types;

ranking the identified common anomalous KPI types for the cluster based on an anomaly metric that is derived from the anomalous KPI measurements generated for each identified common anomalous KPI type;

outputting a list of sites of the cluster that are ranked based on anomaly metrics that are derived from the anomalous KPI measurements for the sites of the cluster;

receiving a selection of a site from the list of sites;

outputting a list of KPI types for the selected site that is ranked based on anomaly metrics that are derived from the anomalous KPI measurements of the plurality of KPI types for the site; and

outputting a list of common anomalous KPI types and corresponding classifications for the cluster based on the ranking.

12. The one or more non-transitory computer-readable media of claim 11 , wherein the acts further comprise:

receiving a selection of a KPI type from the identified common anomalous KPI types of the cluster; and

outputting one or more sites having anomalous KPI measurements of the selected KPI type.

13. The one or more non-transitory computer-readable media of claim 11 , wherein the acts further comprise:

outputting a list of cells of the cluster that is ranked based on anomaly metrics that are derived from the anomalous KPI measurements for the cells of the cluster.

14. The one or more non-transitory computer-readable media of claim 11 , wherein the acts further comprise:

receiving a predefined set of KPI types; and

for each cluster of a set of clusters in the RAN:

determining an anomaly metric that is derived from the anomalous KPI measurements for each KPI type of the predefined set of KPI types; and

indicating a KPI status for each KPI type of the predefined set of KPI types based on the determined anomaly metric.

15. The one or more non-transitory computer-readable media of claim 11 , wherein the acts further comprise:

receiving a selection of a KPI type in the predefined set of KPI types;

outputting an additional list of sites of the cluster that is ranked based on an anomaly metric that is derived from the anomalous KPI measurements of the selected KPI type from each site.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Aug 23, 2022
From: DEUTSCHE BANK TRUST COMPANY AMERICAS
To: IBSV LLC; LAYER3 TV, LLC; PUSHSPRING, LLC; T-MOBILE CENTRAL LLC; T-MOBILE USA, INC.; ASSURANCE WIRELESS USA, L.P.; BOOST WORLDWIDE, LLC; CLEARWIRE COMMUNICATIONS LLC; CLEARWIRE IP HOLDINGS LLC; SPRINTCOM LLC; SPRINT COMMUNICATIONS COMPANY L.P.; SPRINT INTERNATIONAL INCORPORATED; SPRINT SPECTRUM LLC
Reel/Frame 062595/0001 →
SECURITY AGREEMENT Recorded Apr 2, 2020
From: T-MOBILE USA, INC.; ISBV LLC; T-MOBILE CENTRAL LLC; LAYER3 TV, INC.; PUSHSPRING, INC.; BOOST WORLDWIDE, LLC; CLEARWIRE COMMUNICATIONS LLC; CLEARWIRE IP HOLDINGS LLC; CLEARWIRE LEGACY LLC; SPRINT COMMUNICATIONS COMPANY L.P.; SPRINT INTERNATIONAL INCORPORATED; SPRINT SPECTRUM L.P.; ASSURANCE WIRELESS USA, L.P.
To: DEUTSCHE BANK TRUST COMPANY AMERICAS
Reel/Frame 053182/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 5, 2020
From: BODIGA, PREM KUMAR; LANGUB, NORLINDA; LEMOW, ADAM; PADUA, HERMIE; VENTURA, JOHN CARLO; JACINTO, ARIZ
To: T-MOBILE USA, INC.
Reel/Frame 051732/0001 →
Continuity (1)
Related Publication 20210243623A1 · Aug 5, 2021
Cited By (1)
US 12,476,721