IP Library Granted Patent US 10,586,189
Granted Patent B2
US 10,586,189 · App. 14/014,637 · Granted Mar 10, 2020

Data metric resolution ranking system and method

Inventors: Oren Tibi Solomon (Modi'in, IL); Israel Kalush (Kiriat Ono, IL)
Assignee: Quest Software Inc.
G06Q10/06312G06N5/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,586,189
App. No.
14/014,637
Granted
Mar 10, 2020
Kind
B2
Abstract

In one embodiment, a method includes identifying a plurality of period combinations for a metric of interest. Each period combination comprises one or more time periods and each of the one or more time periods comprises one or more segments. The method further includes, for each period combination of the plurality of period combinations and each historical value of a plurality of historical values of the metric of interest, incrementally inserting the historical value into corresponding segments of the one or more time periods. Moreover, the method includes ranking the plurality of period combinations based on comparisons of the plurality of historical values to sets of corresponding predicted values. The method also includes selecting a highest-ranked period combination as best characterizing the metric of interest.

Claims (94)

1. A method comprising:

collecting over time, by a computer system comprising computer hardware, time-variable values of a performance metric of a computer resource;

identifying, by the computer system, a plurality of alternative period-combination data structures that each represent a same set of the collected time-variable values of the performance metric of the computer resource over a same period of time;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures:

the period-combination data structure comprises a different selection of two or more time periods of a plurality of time periods;

each time period of the two or more time periods comprises segments corresponding to divisions of said same period of time; and

the two or more time periods each span said same period of time at a different sampling rate, such that each of the two or more time periods includes a different number of segments;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures, the two or more time periods comprises a plurality of hierarchical time periods;

for each period-combination data structure of the plurality of alternative period-combination data structures and each time-variable value of the time-variable values of the performance metric, the computer system incrementally inserting the time-variable value into corresponding segments of the two or more time periods;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures, the incrementally inserting comprises, for each time period of the two or more time periods, iterating from highest-frequency time period to lowest-frequency time period:

identifying a corresponding segment of the time period for the time-variable value;

computing a predicted value for the corresponding segment;

adapting the time-variable value based on any higher-frequency time periods of the period-combination data structure;

wherein, if the time period is the highest-frequency time period of the two or more time periods, the adapted time-variable value comprises the time-variable value;

wherein, if the time period is not the highest-frequency time period of the two or more time periods, the adapted time-variable value comprises a difference between the adapted time-variable value and the predicted value for the corresponding segment of the immediately higher-frequency time period; and

inserting the adapted time-variable value for the time period into the corresponding segment of the time period;

ranking, by the computer system, the plurality of alternative period-combination data structures based on comparisons of the time-variable values to sets of corresponding predicted values;

selecting, by the computer system, a highest-ranked period-combination data structure as best characterizing the performance metric; and

the computer system predicting a future value of the performance metric for a specified future time point using the incrementally inserted time-variable values of the highest-ranked period-combination data structure;

the computer system alerting a user regarding the future value at the specified future time point; and

receiving a computer-system reconfiguration responsive to the alerting.

2. The method of claim 1 , comprising:

performing the identifying, the incrementally inserting, the ranking, and the selecting for each of a plurality of prediction algorithms;

assessing each highest ranked period-combination data structure; and

based on the assessment, selecting a particular prediction algorithm for the performance metric.

3. The method of claim 2 , wherein, for each prediction algorithm of the plurality of prediction algorithms, the computing of the predicted value comprises utilizing the prediction algorithm.

4. The method of claim 1 , wherein the ranking comprises, for each period-combination data structure of the plurality of alternative period-combination data structures:

comparing the time-variable values to a set of corresponding predicted values;

computing a score based on the comparison; and

ranking the period-combination data structure according to its score.

5. The method of claim 1 , comprising aggregating new time-variable values of the performance metric into corresponding segments of the highest-ranked period-combination data structure.

6. The method of claim 1 , wherein the ranking comprises, for each period-combination data structure of the plurality of alternative period-combination data structures:

calculating a linear correlation of a set of predicted values to a set of historical values;

computing a prediction interval;

performing prediction interval validation;

computing an outside area;

determining a score for the period-combination data structure based on the linear correlation, the prediction interval validation, and the outside area; and

ranking the period-combination data structure according to its score.

7. The method of claim 1 , comprising performing noise filtering of values of the time-variable values.

8. The method of claim 1 , comprising, for at least one time period of the highest-ranked period-combination data structure, performing noise filtering of the segments.

9. The method of claim 8 , wherein the performing of noise filtering of the segments comprises, for each segment of the segments:

dividing the segment into subsegments;

computing a segment noise value for each potential pairing of one of the subsegments with another of the subsegments;

selecting a maximum segment noise value; and

responsive to the maximum segment noise value exceeding a threshold, filtering the segment from the at least one time period.

10. An information handling system comprising at least one computer processor, wherein the at least one computer processor is operable to implement a method comprising:

identifying a plurality of alternative period-combination data structures that each represent a same set of the collected time-variable values of the performance metric of the computer resource over a same period of time;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures:

the period-combination data structure comprises a different selection of two or more time periods of a plurality of time periods;

each time period of the two or more time periods comprises segments corresponding to divisions of said same period of time; and

the two or more time periods each span said same period of time at a different sampling rate, such that each of the two or more time periods includes a different number of segments;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures, the two or more time periods comprises a plurality of hierarchical time periods;

for each period-combination data structure of the plurality of alternative period-combination data structures and each time-variable value of the time-variable values of the performance metric, incrementally inserting the time-variable value into corresponding segments of the two or more time periods;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures, the incrementally inserting comprises, for each time period of the two or more time periods, iterating from highest-frequency time period to lowest-frequency time period:

identifying a corresponding segment of the time period for the time-variable value;

computing a predicted value for the corresponding segment;

adapting the time-variable value based on any higher-frequency time periods of the period-combination data structure;

wherein, if the time period is the highest-frequency time period of the two or more time periods, the adapted time-variable value comprises the time-variable value;

wherein, if the time period is not the highest-frequency time period of the two or more time periods, the adapted time-variable value comprises a difference between the adapted time-variable value and the predicted value for the corresponding segment of the immediately higher-frequency time period; and

inserting the adapted time-variable value for the time period into the corresponding segment of the time period;

ranking the plurality of alternative period-combination data structures based on comparisons of the time-variable values to sets of corresponding predicted values;

selecting a highest-ranked period-combination data structure as best characterizing the performance metric; and

predicting a future value of the performance metric for a specified future time point using the incrementally inserted time-variable values of the highest-ranked period-combination data structure;

alerting a user regarding the future value at the specified future time point; and

receiving a computer-system reconfiguration responsive to the alerting.

11. The information handling system of claim 10 , comprising:

performing the identifying, the incrementally inserting, the ranking, and the selecting for each of a plurality of prediction algorithms;

assessing each highest ranked period-combination data structure; and

based on the assessment, selecting a particular prediction algorithm for the performance metric.

12. The information handling system of claim 10 , wherein the adapted time-variable value of a highest-frequency period of the plurality of hierarchical time periods comprises the time-variable value.

13. The information handling system of claim 10 , wherein the ranking comprises, for each period-combination data structure of the plurality of alternative period-combination data structures:

comparing the time-variable values to a set of corresponding predicted values;

computing a score based on the comparison; and

ranking the period-combination data structure according to its score.

14. A computer-program product comprising a non-transitory computer-usable medium having computer-readable program code embodied therein, the computer-readable program code adapted to be executed to implement a method comprising:

identifying a plurality of alternative period-combination data structures that each represent a same set of the collected time-variable values of the performance metric of the computer resource over a same period of time;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures:

the period-combination data structure comprises a different selection of two or more time periods of a plurality of time periods;

each time period of the two or more time periods comprises segments corresponding to divisions of said same period of time; and

the two or more time periods each span said same period of time at a different sampling rate, such that each of the two or more time periods includes a different number of segments;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures, the two or more time periods comprises a plurality of hierarchical time periods;

for each period-combination data structure of the plurality of alternative period-combination data structures and each time-variable value of the time-variable values of the performance metric, incrementally inserting the time-variable value into corresponding segments of the two or more time periods;

wherein, for each period-combination data structure of the plurality of alternative period-combination data structures, the incrementally inserting comprises, for each time period of the two or more time periods, iterating from highest-frequency time period to lowest-frequency time period:

identifying a corresponding segment of the time period for the time-variable value;

computing a predicted value for the corresponding segment;

adapting the time-variable value based on any higher-frequency time periods of the period-combination data structure;

wherein, if the time period is the highest-frequency time period of the two or more time periods, the adapted time-variable value comprises the time-variable value;

wherein, if the time period is not the highest-frequency time period of the two or more time periods, the adapted time-variable value comprises a difference between the adapted time-variable value and the predicted value for the corresponding segment of the immediately higher-frequency time period; and

inserting the adapted time-variable value for the time period into the corresponding segment of the time period;

ranking the plurality of alternative period-combination data structures based on comparisons of the time-variable values to sets of corresponding predicted values;

selecting a highest-ranked period-combination data structure as best characterizing the performance metric; and

predicting a future value of the performance metric for a specified future time point using the incrementally inserted time-variable values of the highest-ranked period-combination data structure;

alerting a user regarding the future value at the specified future time point; and

receiving a computer-system reconfiguration responsive to the alerting.

Assignments (26)
RELEASE OF SECURITY INTEREST Recorded Nov 19, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: QUEST SOFTWARE INC.; ANALYTIX DATA SERVICES INC.; BINARYTREE.COM LLC; ERWIN, INC.
Reel/Frame 073606/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 18, 2025
From: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
To: QUEST SOFTWARE INC.; ANALYTIX DATA SERVICES INC.; BINARYTREE.COM LLC; ERWIN, INC.
Reel/Frame 073613/0326 →
SECURITY INTEREST Recorded Jun 8, 2025
From: QUEST SOFTWARE INC.; ANALYTIX DATA SERVICES INC.; ERWIN, INC.
To: ALTER DOMUS (US) LLC
Reel/Frame 071527/0649 →
SECURITY INTEREST Recorded Jun 8, 2025
From: QUEST SOFTWARE INC.; ANALYTIX DATA SERVICES INC.; ERWIN, INC.
To: ALTER DOMUS (US) LLC
Reel/Frame 071527/0001 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Feb 2, 2022
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: QUEST SOFTWARE INC.
Reel/Frame 059105/0479 →
FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Feb 2, 2022
From: QUEST SOFTWARE INC.; ANALYTIX DATA SERVICES INC.; BINARYTREE.COM LLC; ERWIN, INC.; ONE IDENTITY LLC; ONELOGIN, INC.; ONE IDENTITY SOFTWARE INTERNATIONAL DESIGNATED ACTIVITY COMPANY
To: GOLDMAN SACHS BANK USA
Reel/Frame 058945/0778 →
SECOND LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Feb 2, 2022
From: QUEST SOFTWARE INC.; ANALYTIX DATA SERVICES INC.; BINARYTREE.COM LLC; ERWIN, INC.; ONE IDENTITY LLC; ONELOGIN, INC.; ONE IDENTITY SOFTWARE INTERNATIONAL DESIGNATED ACTIVITY COMPANY
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 058952/0279 →
RELEASE OF SECOND LIEN SECURITY INTEREST IN PATENTS Recorded Feb 2, 2022
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: QUEST SOFTWARE INC.
Reel/Frame 059096/0683 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jun 7, 2018
From: QUEST SOFTWARE INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 046327/0347 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jun 7, 2018
From: QUEST SOFTWARE INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 046327/0486 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS RECORDED AT R/F 040581/0850 Recorded May 22, 2018
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
To: QUEST SOFTWARE INC. (F/K/A DELL SOFTWARE INC.); AVENTAIL LLC
Reel/Frame 046211/0735 →
CHANGE OF NAME Recorded Dec 6, 2017
From: DELL SOFTWARE INC.
To: QUEST SOFTWARE INC.
Reel/Frame 044719/0565 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED AT REEL: 040587 FRAME: 0624. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Nov 28, 2017
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: QUEST SOFTWARE INC. (F/K/A DELL SOFTWARE INC.); AVENTAIL LLC
Reel/Frame 044811/0598 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Nov 10, 2016
From: DELL SOFTWARE INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040587/0624 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Nov 9, 2016
From: DELL SOFTWARE INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040581/0850 →
RELEASE OF SECURITY INTEREST Recorded Oct 31, 2016
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: AVENTAIL LLC; DELL PRODUCTS, L.P.; DELL SOFTWARE INC.
Reel/Frame 040521/0467 →
RELEASE OF SECURITY INTEREST IN CERTAIN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040039/0642) Recorded Oct 31, 2016
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVENTAIL LLC; DELL PRODUCTS L.P.; DELL SOFTWARE INC.
Reel/Frame 040521/0016 →
SECURITY AGREEMENT Recorded Sep 14, 2016
From: AVENTAIL LLC; DELL PRODUCTS, L.P.; DELL SOFTWARE INC.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040030/0187 →
RELEASE OF SECURITY INTEREST Recorded Sep 14, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELL MARKETING L.P.; ASAP SOFTWARE EXPRESS, INC.; APPASSURE SOFTWARE, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL PRODUCTS L.P.; DELL USA L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040040/0001 →
RELEASE OF SECURITY INTEREST Recorded Sep 14, 2016
From: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: DELL MARKETING L.P.; ASAP SOFTWARE EXPRESS, INC.; APPASSURE SOFTWARE, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL PRODUCTS L.P.; DELL USA L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040065/0618 →
SECURITY AGREEMENT Recorded Sep 14, 2016
From: AVENTAIL LLC; DELL PRODUCTS L.P.; DELL SOFTWARE INC.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040039/0642 →
RELEASE OF SECURITY INTEREST Recorded Sep 13, 2016
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: DELL MARKETING L.P.; ASAP SOFTWARE EXPRESS, INC.; APPASSURE SOFTWARE, INC.; COMPELLANT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL PRODUCTS L.P.; DELL USA L.P.; DELL SOFTWARE INC.; FORCE10 NETWORKS, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040065/0216 →
PATENT SECURITY AGREEMENT (TERM LOAN) Recorded Jan 2, 2014
From: DELL INC.; APPASSURE SOFTWARE, INC.; ASAP SOFTWARE EXPRESS, INC.; BOOMI, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL USA L.P.; FORCE10 NETWORKS, INC.; GALE TECHNOLOGIES, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 031899/0261 →
PATENT SECURITY AGREEMENT (ABL) Recorded Jan 2, 2014
From: DELL INC.; APPASSURE SOFTWARE, INC.; ASAP SOFTWARE EXPRESS, INC.; BOOMI, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL USA L.P.; FORCE10 NETWORKS, INC.; GALE TECHNOLOGIES, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 031898/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Jan 2, 2014
From: APPASSURE SOFTWARE, INC.; ASAP SOFTWARE EXPRESS, INC.; BOOMI, INC.; COMPELLENT TECHNOLOGIES, INC.; CREDANT TECHNOLOGIES, INC.; DELL INC.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL USA L.P.; FORCE10 NETWORKS, INC.; GALE TECHNOLOGIES, INC.; PEROT SYSTEMS CORPORATION; SECUREWORKS, INC.; WYSE TECHNOLOGY L.L.C.
To: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS FIRST LIEN COLLATERAL AGENT
Reel/Frame 031897/0348 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2013
From: SOLOMON, OREN TIBI; KALUSH, ISRAEL
To: DELL SOFTWARE INC.
Reel/Frame 031150/0557 →