IP Library › Granted Patent US 12,068,937
Granted Patent B2
US 12,068,937 · App. 17/874,557 · Granted Aug 20, 2024

Key performance indicator recommendations based on relevancy ranking

Inventors: Siva Sunil Kumar Matham (Fremont, CA); Selvakumaran N. Subramanian (Pleasanton, CA)
Assignee: CISCO TECHNOLOGY, INC.
H04L43/091H04L41/5009
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,068,937
App. No.
17/874,557
Granted
Aug 20, 2024
Kind
B2
Abstract

Presented herein are embodiments for quickly identifying and recommending key performance indicators (KPIs) for network devices based on the type of network device and/or role of the device. The type or configuration of the network device may be obtained and compared to the capabilities of the network device. Operational or performance information of the network device, represented by strings, may be obtained based on the configuration information. Operational information that is not relevant to the configuration of the network device may be filtered out. The remaining operational information may be ranked as KPIs based on a relevance of the operational information with respect to the configuration information.

Claims (78)

1. A method comprising:

obtaining, at a server, configuration information for each network device of a plurality of network devices;

clustering the plurality of network devices into one or more groups;

obtaining, at the server, operational information of a select network device of a group of the one or more groups;

comparing the configuration information for the select network device with the operational information of the select network device;

determining one or more key performance indicators (KPIs) of the select network device based on the comparing; and

monitoring the group with the one or more KPIs of the select network device to determine operational performance of each network device corresponding to the group.

2. The method of claim 1 , further comprising:

obtaining, at the server, particular configuration information and particular operational information of another network device of another group of the one or more groups,

comparing the particular configuration information of said another network device with the particular operational information of said another network device;

determining one or more KPIs of said another network device based on the comparing; and

monitoring said another group with the one or more KPIs of said another network device to determine operational performance of each network device corresponding to said another group.

3. The method of claim 1 , wherein the configuration information for each network device is represented by a respective first plurality of strings having tokens, and the operational information of the select network device is represented by a second plurality of strings having tokens.

4. The method of claim 3 , wherein clustering the plurality of network devices into the one or more groups comprises:

comparing the respective first plurality of strings for each network device to each other; and

grouping particular network devices having substantially similar strings into a particular group.

5. The method of claim 4 , further comprising:

comparing the respective first plurality of strings for each particular network device of the particular group to each other;

ranking the particular network devices based on comparing the respective first plurality of strings for each particular network device of the particular group to each other, wherein a highest ranked particular device has a highest number of tokens that substantially match tokens corresponding to the respective first pluralities of strings of all of the particular network devices; and

setting the highest ranked particular network device as the select network device.

6. The method of claim 3 , wherein determining the one or more KPIs of the select network device comprises:

comparing the tokens of the second plurality of strings to the tokens of the respective first plurality of strings.

7. The method of claim 6 , wherein determining the one or more KPIs of the select network device comprises:

assigning weights to each token of the second plurality of strings based on the comparing, a position of the token within a string of the second plurality of strings, and a length of the string;

scoring each string of the second plurality of strings based on the weights assigned to each token; and

ranking the second plurality of strings based on the scoring.

8. The method of claim 6 , wherein comparing the tokens of the second plurality of strings to the tokens of the respective first plurality of strings comprises:

generating a penalty list comprising tokens from the second plurality of strings not found in the respective first plurality of strings.

9. A method comprising:

obtaining, at a server, first configuration information of a first network device that represents operational configurations of the first network device in a network, wherein the first configuration information is represented by a first plurality of strings having tokens;

obtaining, at the server, operational information of the first network device that represents operational performance of the first network device, wherein the operational information is represented by a second plurality of strings having tokens;

comparing the tokens of the second plurality of strings to the tokens of the first plurality of strings;

assigning weights to each token of the second plurality of strings based on the comparing, a position of the token within a string of the second plurality of strings, and a length of the string;

scoring each string of the second plurality of strings based on the weights assigned to each token;

ranking the second plurality of strings based on the scoring;

determining one or more key performance indicators (KPIs) of the first network device based on the ranking;

obtaining, at the server, particular configuration information of particular network devices that substantially matches the first configuration information of the first network device; and

monitoring the first network device and the particular network devices with the one or more KPIs to determine operational performance of the first network device and the particular network devices in the network.

10. The method of claim 9 , wherein obtaining the particular configuration information of the particular network devices that substantially matches the first configuration information of the first network device comprises:

obtaining second configuration information of second network devices in the network, wherein the second configuration information is represented by a third plurality of strings having tokens.

11. The method of claim 10 , wherein obtaining the particular configuration information of the particular network devices that substantially matches the first configuration information of the first network device further comprises:

comparing the tokens of the third plurality of strings to the tokens of the first plurality of strings;

assigning weights to each token of each string of the third plurality of strings based on the comparing, a position of the token within each string of the third plurality of strings, and a length of each string;

scoring each string of the third plurality of strings based on the weights assigned to the tokens; and

clustering the particular network devices of the second network devices into a particular group based on the scoring.

12. The method of claim 11 wherein clustering the particular network devices of the second network devices into the particular group based on the scoring comprises:

comparing the scores of each string of the third plurality of strings to a criteria; and

clustering the particular network devices with scores of strings that meet the criteria.

13. A system comprising:

a database configured to store key performance indicators (KPIs) for network devices in a network; and

a server configured to:

obtain configuration information for each network device of a plurality of network devices;

cluster the plurality of network devices into one or more groups;

obtain operational information of a select network device of a group of the one or more groups;

compare the configuration information for the select network device with the operational information of the select network device;

determine one or more KPIs of the select network device based on the comparing; and

monitor the group with the one or more KPIs of the select network device to determine operational performance of each network device corresponding to the group.

14. The system of claim 13 , wherein the server is further configured to:

obtain particular configuration information and particular operational information of another network device of another group of the one or more groups;

compare the particular configuration information of said another network device with the particular operational information of said another network device;

determine one or more KPIs of said another network device based on the comparing; and

monitor said another group with the one or more KPIs of said another network device to determine operational performance of each network device corresponding to said another group.

15. The system of claim 13 , wherein the configuration information for each network device is represented by a respective first plurality of strings having tokens, and the operational information for the select network device is represented by a second plurality of strings having tokens.

16. The system of claim 15 , wherein, to cluster the plurality of network devices into the one or more groups, the server is further configured to:

compare the respective first plurality of strings for each network device to each other; and

group particular network devices having substantially similar strings into a particular group.

17. The system of claim 16 , wherein the server is further configured to:

compare the respective first plurality of strings for each particular network device of the particular group to each other;

rank the particular network devices based on comparing the respective first plurality of strings for each particular network device of the particular group to each other, wherein a highest ranked particular device has a highest number of tokens that substantially match tokens corresponding to the respective first pluralities of strings of all of the particular network devices; and

set the highest ranked particular network device as the select network device.

18. The system of claim 15 , wherein, to determine the one or more KPIs of the select network device, the server is further configured to:

compare the tokens of the second plurality of strings to the tokens of the respective first plurality of strings.

19. The system of claim 18 , wherein, to determine the one or more KPIs of the select network device, the server is further configured to:

assign weights to each token of the second plurality of strings based on the comparing, a position of the token within a string of the second plurality of strings, and a length of the string;

score each string of the second plurality of strings based on the weights assigned to each token; and

rank the second plurality of strings based on the scoring.

20. The system of claim 18 , wherein, to compare the tokens of the second plurality of strings to the tokens of the respective first plurality of strings, the server is further configured to:

generate a penalty list comprising tokens from the second plurality of strings not found in the respective first plurality of strings.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2022
From: MATHAM, SIVA SUNIL KUMAR; SUBRAMANIAN, SELVAKUMARAN N.
To: CISCO TECHNOLOGY, INC.
Reel/Frame 060642/0103 →
Continuity (3)
Continuation In Part 16872537 · May 12, 2020
Provisional Application 62846919 · May 13, 2019
Related Publication 20220360513A1 · Nov 10, 2022