IP Library Granted Patent US 11,558,271
Granted Patent B2
US 11,558,271 · App. 16/560,748 · Granted Jan 17, 2023

System and method of comparing time periods before and after a network temporal event

Inventors: Javier Cruz Mota (Lussy-sur-Morges, CH); Erwan Barry Tarik Zerhouni (Zurich, CH); Abhishek Kumar (Vancouver, CA)
Assignee: Cisco Technology, Inc.
H04L43/067H04L43/045H04L43/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,558,271
App. No.
16/560,748
Granted
Jan 17, 2023
Kind
B2
Abstract

The present technology pertains to a system, method, and non-transitory computer-readable medium for evaluating the impact of network changes. The technology can detect a temporal event, wherein the temporal event is associated with a change in a network configuration, implementation, or utilization. The technology defines, based on a nature of the temporal event, a first period prior to the temporal event or a second period posterior to the temporal event. The technology compares network data collected in the first period and network data collected in the second period.

Claims (56)

1. A method comprising:

detecting a temporal event, wherein the temporal event is associated with a change in a network configuration, implementation, or utilization;

defining a first period prior to the temporal event and a second period posterior to the temporal event, wherein a duration of one of the first period or the second period is determined based on a characteristic of the temporal event; and

comparing network data collected in the first period and network data collected in the second period.

2. The method of claim 1 , wherein the comparing the network data collected in the first period and the network data collected in the second period comprises:

selecting at least one network entity as a focus of the comparing and at least one key performance indicator used to perform the comparing;

separating, by the first period and the second period, data from the at least one network entity; and

determining, from the first period to the second period, a change in the distribution of the at least one key performance indicator in the data from the at least one network entity.

3. The method of claim 2 , wherein the at least one key performance indicator comprises at least two key performance indicators, comprising:

clustering data from the at least one network entity during the first and second periods by at least one primary key performance indicator;

separating, by the first period and the second period, data from the at least one network component within each primary key performance indicator cluster,

determining, for each primary key performance indicator cluster, from the first period to the second period, a change in the distribution of at least one secondary key performance indicator in the data from the at least one network entity.

4. The method of claim 2 , the method comprising:

identifying at least one subset of the at least one network entities where the change in the distribution of data relative to at least one key performance indicator exceeds a threshold; and

forwarding data and analysis of the at least one subset of the at least one network entities for review.

5. The method of claim 4 , wherein the forwarding comprises displaying data and analysis on a graphical user interface.

6. The method of claim 1 , wherein the temporal event is automatically detected.

7. The method of claim 1 , wherein the first period and the second period are automatically defined.

8. A system comprising:

a processor; and

a computer-readable storage memory storing instructions which, when executed by the processor, cause the processor to perform operations comprising:

detecting, via a temporal event detector, a temporal event in a network, wherein the temporal event is associated with a change in a network configuration, implementation, or utilization;

defining, via a data delimiter, a first period prior to the temporal event and a second period posterior to the temporal event, wherein a duration of one of the first period or the second period is determined based on a characteristic of the temporal event; and

comparing, via an evaluator, network data collected in the first period and network data collected in the second period.

9. The system of claim 8 , wherein the evaluator is configured to:

select at least one network entity as a focus of the comparing and at least one key performance indicator used to perform the comparing;

separate, by the first period and the second period, data from the at least one network entity; and

determine, from the first period to the second period, a change in the distribution of the at least one key performance indicator in the data from the at least one network entity.

10. The system of claim 9 , wherein the at least one key performance indicator comprises at least two key performance indicators, wherein the evaluator is configured to:

cluster data from the at least one network entity during the first and second periods by at least one primary key performance indicator;

separate, by the first period and the second period, data from the at least one network component within each primary key performance indicator cluster,

determine, for each primary key performance indicator cluster, from the first period to the second period, a change in the distribution of at least one secondary key performance indicator in the data from the at least one network entity.

11. The system of claim 9 , wherein the evaluator is configured to:

identify at least one subset of the at least one network entities where the change in the distribution of data relative to at least one key performance indicator exceeds a threshold; and

forward data and analysis of the at least one subset of the at least one network entities for review.

12. The system of claim 11 , wherein the computer-readable storage memory stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:

displaying, via a graphical user interface, data and analysis of the at least one subset of the at least one network entities for review.

13. The system of claim 8 , wherein the temporal event detector is configured to automatically detect the temporal event.

14. The system of claim 8 , wherein the data delimiter is configured to automatically define the first period and the second period.

15. A non-transitory computer readable medium comprising instructions that when executed cause at least one processor to:

detect a temporal event, wherein the temporal event is associated with a change in a network configuration, implementation, or utilization;

define a first period prior to the temporal event and a second period posterior to the temporal event, wherein a duration of one of the first period or the second period is determined based on a characteristic of the temporal event; and

compare network data collected in the first period and network data collected in the second period.

16. The non-transitory computer readable medium of claim 15 , comprising in instructions that:

select at least one network entity as a focus of the comparing and at least one key performance indicator used to perform the comparing;

separate, by the first period and the second period, data from the at least one network entity; and

determine, from the first period to the second period, a change in the distribution of the at least one key performance indicator in the data from the at least one network entity.

17. The non-transitory computer readable medium of claim 16 , wherein the at least one key performance indicator comprises at least two key performance indicators, comprising instructions that:

cluster data from the at least one network entity during the first and second periods by at least one primary key performance indicator;

separate, by the first period and the second period, data from the at least one network component within each primary key performance indicator cluster,

determine, for each primary key performance indicator cluster, from the first period to the second period, a change in the distribution of at least one secondary key performance indicator in the data from the at least one network entity.

18. The non-transitory computer readable medium of claim 16 , comprising instructions that:

identify at least one subset of the at least one network entities where the change in the distribution of data relative to at least one key performance indicator exceeds a threshold; and

forward data and analysis of the at least one subset of the at least one network entities for review.

19. The non-transitory computer readable medium of claim 15 , wherein the temporal event is automatically detected.

20. The non-transitory computer readable medium of claim 15 , wherein the first period and the second period are automatically defined.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2019
From: MOTA, JAVIER CRUZ; ZERHOUNI, ERWAN BARRY TARIK; KUMAR, ABHISHEK
To: CISCO TECHNOLOGY, INC.
Reel/Frame 050268/0755 →
Continuity (1)
Related Publication 20210067430A1 · Mar 4, 2021