IP Library Granted Patent US 10,152,302
Granted Patent B2
US 10,152,302 · App. 15/404,599 · Granted Dec 11, 2018

Calculating normalized metrics

Inventors: Gabriel Dayan (Yehud, IL); Eli Revach (Yehud, IL); Pavel Danichev (Yehud, IL); Avihay Mor (Yehud, IL)
Assignee: ENTIT SOFTWARE LLC
G06F5/01G06F7/544G06F17/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,152,302
App. No.
15/404,599
Granted
Dec 11, 2018
Kind
B2
Abstract

Examples relate to calculating normalize metrics. The examples disclosed herein calculate respective normalized first metric values for each of a plurality of first metric values that are on a time scale and respective normalized second metric values for each of the plurality of raw second metric values that are on the time scale, where the plurality of first metric values are associated with a first metric, and the plurality of second metric values are associated with a second metric. An extremum of the normalized first metric value and the normalized second metric value at each time of the time scale is averaged to calculate a plurality of extremum baseline values. Examples herein calculate a plurality of sleeve values of the plurality of extremum baseline values based on a standard deviation of the plurality of extremum baseline values.

Claims (67)

1. A method executed by a computing device, comprising:

calculating respective normalized first metric values for each of a plurality of first metric values that are on a time scale and respective normalized second metric values for each of a plurality of second metric values that are on the time scale, wherein the plurality of first metric values are associated with a first metric, and the plurality of second metric values are associated with a second metric;

identifying an extremum of the normalized first metric value and the normalized second metric value at each time of the time scale to determine a plurality of extremum baseline values;

determining a plurality of sleeve values of the plurality of extremum baseline values;

identifying an anomaly in a computing system based on the plurality of extremum baseline values and the plurality of sleeve values; and

in response to the identifying of the anomaly, performing an automated remedial action to address the anomaly in the computing system.

2. The method of claim 1 , further comprising identifying an outlier value by identifying at least one of the plurality of extremum baseline values that is beyond a threshold value of the sleeve value at a corresponding time of the time scale.

3. The method of claim 2 , further comprising identifying a problematic metric based on the outlier value, the problematic metric corresponding to the anomaly.

4. The method of claim 2 , wherein:

the plurality of extremum baseline values comprises a maximum of the normalized first metric value and the normalized second metric value at each time of the time scale;

the plurality of sleeve values comprises a plurality of upper sleeve values; and

the outlier value is identified by identifying at least one of the plurality of maximum baseline values that is greater than the upper sleeve value at a corresponding time of the time scale.

5. The method of claim 2 , wherein:

the plurality of extremum baseline values comprises a minimum of the normalized first metric value and the normalized second metric value at each time of the time scale;

the plurality of sleeve values comprises a plurality of lower sleeve values; and

the outlier value is identified by identifying at least one of the plurality of minimum baseline values that is less than the lower sleeve value at a corresponding time of the time scale.

6. The method of claim 1 , wherein:

calculating each normalized first metric value is based on comparing a difference between a first metric value and an average first metric value with a standard deviation of the plurality of first metric values;

calculating each normalized second metric value is based on comparing a difference between a second metric value and an average second metric value with a standard deviation of the plurality of second metric values; and

the average first metric value and the average second metric value are calculated based on a forgetting factor.

7. The method of claim 6 , wherein:

the standard deviation of the plurality of first metric values is calculated based on a square of the average first metric value and an average of squares of the plurality of first metric values; and

the standard deviation of the plurality of second metric values is calculated based on a square of the average second metric value and an average of squares of the plurality of second metric values.

8. The method of claim 1 , further comprising:

in addition to performing the automated remedial action, presenting the plurality of extremum baseline values and the plurality of sleeve values to a user.

9. The method of claim 8 , further comprising generating a graphical representation comprising the plurality of extremum baseline values and the plurality of sleeve values aligned with a first axis representing the time scale and a second axis representing normalized metric values.

10. The method of claim 1 , wherein the first metric is a first computer performance metric and the second metric is a second computer performance metric.

11. A non-transitory machine-readable storage medium encoded with instructions that upon execution cause a computing device to:

calculate respective normalized first metric values for each of a plurality of first metric values that are on a time scale and respective normalized second metric values for each of a plurality of second metric values that are on the time scale, wherein the plurality of first metric values are associated with a first computing metric, and the plurality of second metric values are associated with a second computing metric;

identify an extremum of the normalized first metric value and the normalized second metric value at each time of the time scale to determine a plurality of extremum baseline values; and

determine a plurality of sleeve values of the plurality of extremum baseline values;

identify an outlier value by identifying at least one of the plurality of extremum baseline values that is beyond a threshold value of the sleeve value at a corresponding time of the time scale;

identify a problematic metric based on the outlier value, the problematic metric representing an anomaly in a computing system; and

cause performance of an automated remedial action to address the anomaly in the computing system.

12. The non-transitory machine-readable storage medium of claim 11 , wherein:

the plurality of extremum baseline values comprises a maximum of the normalized first metric value and the normalized second metric value at each time of the time scale;

the plurality of sleeve values comprises a plurality of upper sleeve values; and

the outlier value is identified by identifying at least one of the plurality of maximum baseline values that is greater than the upper sleeve value at a corresponding time of the time scale.

13. The non-transitory machine-readable storage medium of claim 11 , wherein:

the plurality of extremum baseline values comprises a minimum of the normalized first metric value and the normalized second metric value at each time of the time scale;

the plurality of sleeve values comprises a plurality of lower sleeve values; and

the outlier value is identified by identifying at least one of the plurality of minimum baseline values that is less than the lower sleeve value at a corresponding time of the time scale.

14. The non-transitory machine-readable storage medium of claim 11 , wherein:

each normalized first metric value is calculated based on comparing a difference between a first metric value and an average first metric value with a standard deviation of the plurality of first metric values;

each normalized second metric value is calculated based on comparing a difference between a second metric value and an average second metric value with a standard deviation of the plurality of second metric values; and

the average first metric value and the average second metric value are calculated based on a forgetting factor.

15. The non-transitory machine-readable storage medium of claim 14 , wherein:

the standard deviation of the plurality of first metric values is calculated based on a square of the average first metric value and an average of squares of the plurality of first metric values; and

the standard deviation of the plurality of second metric values is calculated based on a square of the average second metric value and an average of squares of the plurality of second metric values.

16. The non-transitory machine-readable storage medium of claim 11 , wherein the instructions upon execution cause the computing device to generate a graphical representation comprising the plurality of extremum baseline values and the plurality of sleeve values aligned with a first axis representing the time scale and a second axis representing normalized metric values.

17. A computing device comprising:

a processor; and

a non-transitory storage medium storing instructions executable on the processor to:

calculate respective normalized first metric values for each of a plurality of first metric values that are on a time scale and respective normalized second metric values for each of a plurality of second metric values that are on the time scale, wherein the plurality of first metric values are associated with a first metric, and the plurality of second metric values are associated with a second metric;

identify extremum of the normalized first metric value and the normalized second metric value at each time of the time scale to determine a plurality of extremum baseline values; and

calculate a plurality of sleeve values of the plurality of extremum baseline values;

identify an outlier value by identifying at least one of the plurality of minimum baseline values that is beyond the sleeve value at a corresponding time of the time scale;

identify a problematic metric based on the outlier value, the problematic metric representing an anomaly in a computing system; and

cause performance of an automated remedial action to address the anomaly in the computing system.

18. The computing device of claim 17 , wherein:

each normalized first metric value is calculated based on comparing a difference between a first metric value and an average first metric value with a standard deviation of the plurality of first metric values;

each normalized second metric value is calculated based on comparing a difference between a second metric value and an average second metric value with a standard deviation of the plurality of second metric values; and

the average first metric value and the average second metric value are calculated based on a forgetting factor.

19. The computing device of claim 18 , wherein:

the standard deviation of the plurality of first metric values is calculated based on a square of the average first metric value and an average of squares of the plurality of first metric values; and

the standard deviation of the plurality of second metric values is calculated based on a square of the average second metric value and an average of squares of the plurality of second metric values.

20. The computing device of claim 17 , wherein the instructions are executable on the processor to generate a graphical representation comprising the plurality of extremum baseline values and the plurality of sleeve values aligned with a first axis representing the time scale and a second axis representing normalized metric values.

Assignments (7)
RELEASE OF SECURITY INTEREST REEL/FRAME 044183/0718 Recorded Feb 2, 2023
From: JPMORGAN CHASE BANK, N.A.
To: MICRO FOCUS LLC (F/K/A ENTIT SOFTWARE LLC); BORLAND SOFTWARE CORPORATION; MICRO FOCUS (US), INC.; SERENA SOFTWARE, INC; ATTACHMATE CORPORATION; MICRO FOCUS SOFTWARE INC. (F/K/A NOVELL, INC.); NETIQ CORPORATION
Reel/Frame 062746/0399 →
RELEASE OF SECURITY INTEREST REEL/FRAME 044183/0577 Recorded Feb 2, 2023
From: JPMORGAN CHASE BANK, N.A.
To: MICRO FOCUS LLC (F/K/A ENTIT SOFTWARE LLC)
Reel/Frame 063560/0001 →
CHANGE OF NAME Recorded Aug 8, 2019
From: ENTIT SOFTWARE LLC
To: MICRO FOCUS LLC
Reel/Frame 050004/0001 →
SECURITY INTEREST Recorded Oct 11, 2017
From: ENTIT SOFTWARE LLC; ARCSIGHT, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 044183/0577 →
SECURITY INTEREST Recorded Oct 11, 2017
From: ATTACHMATE CORPORATION; BORLAND SOFTWARE CORPORATION; NETIQ CORPORATION; MICRO FOCUS (US), INC.; MICRO FOCUS SOFTWARE, INC.; ENTIT SOFTWARE LLC; ARCSIGHT, LLC; SERENA SOFTWARE, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 044183/0718 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2017
From: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP
To: ENTIT SOFTWARE LLC
Reel/Frame 042746/0130 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: DAYAN, GABRIEL; REVACH, ELI; DANICHEV, PAVEL; MOR, AVIHAY
To: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP
Reel/Frame 040974/0548 →
Continuity (1)
Related Publication 20180196637A1 · Jul 12, 2018