System, method, and computer program for predictive autoscaling for faster searches of event logs in a cybersecurity system
The present disclosure describes a system, method, and computer program for predictive autoscaling for faster searches of event logs in a cybersecurity system. In one embodiment, the system receives search-related signals from a plurality of signal sources. The signals are indicative of: (1) a user's intent to perform a search for event logs in a cybersecurity database, (2) how computationally intensive the potential search is likely to be, and (3) the currently available computational resources. The signals are evaluated, and an autoscale prediction score is calculated. The autoscale prediction score reflects the likelihood of a user to submit search, the computational resources required for the potential search, and the currently available computational resources. The system scales computational resources in accordance with the autoscale prediction score. These steps are performed before any search is submitted by the user in a search user interface.
1. A non-transitory computer-readable medium comprising a computer program, that, when executed by a computer system, enables the computer system to perform the following method for predicting autoscaling requirements for query searches on a database of event logs in a cybersecurity system, the method comprising:
receiving a signal indicative of a user's intent to perform a search for event logs in the cybersecurity system;
calculating an autoscale prediction score for a potential search based on the signal; and
making an autoscale decision for the potential search based on the autoscale prediction score, wherein the autoscale decision for the potential search is made before the potential search becomes a submitted search for event logs in the cybersecurity system, and wherein the autoscale decision is to make computational resources available for the potential search, if and when the potential search becomes a submitted search.
2. The non-transitory computer-readable medium of claim 1 , wherein:
a plurality of signals is received from a plurality of different signal sources for use in calculating the autoscale prediction score;
the plurality of signals includes the signal indicative of the user's intent to submit a query for event logs and a signal indicative of currently available computational resources for performing searches; and
the autoscale prediction score is calculated based on the plurality of signals.
3. The non-transitory computer-readable medium of claim 2 , wherein the plurality of signals also includes a signal indicative of computational resources required for the potential search.
4. The non-transitory computer-readable medium of claim 3 , wherein the signal indicative of the computational resources required for the potential search is one of the following: selection of a query time domain, size of event log database upon which the potential search would be performed, and addition of an indexed field to a query builder.
5. The non-transitory computer-readable medium of claim 2 , wherein the signal indicative of the user's intent to perform the search is one of the following: usage of a query builder for the event log search, selection of a recent query, the user's past patterns of searches, selection of a query time domain, and an addition of an indexed field to a query builder.
6. The non-transitory computer-readable medium of claim 2 , wherein calculating the autoscale prediction score comprises:
assigning a value to each of the plurality of signals; and
calculating a weighted sum of the signal values.
7. The non-transitory computer-readable medium of claim 1 , further comprising:
receiving a new signal related to the potential search after the autoscale prediction score has been calculated for the potential search;
recalculating the autoscale prediction score to factor in the new signal; and
making a new autoscale decision based on the recalculated autoscale prediction score.
8. The non-transitory computer-readable medium of claim 1 , wherein making an autoscale decision comprises adjusting computational resources available for the potential search.
9. The non-transitory computer-readable medium of claim 8 , wherein computational resources are increased as a function of the autoscale prediction score.
10. A computer system for predicting autoscaling requirements for query searches on a database of event logs in a cybersecurity system, the system comprising:
one or more processors;
one or more memory units coupled to the one or more processors, wherein the one or more memory units store instructions that, when executed by the one or more processors, cause the system to perform the operations of:
receiving a signal indicative of a user's intent to perform a search for event logs in the cybersecurity system;
calculating an autoscale prediction score for a potential search based on the signal; and
making an autoscale decision for the potential search based on the autoscale prediction score, wherein the autoscale decision for the potential search is made before the potential search becomes a submitted search for event logs in the cybersecurity system, and wherein the autoscale decision is to make computational resources available for the potential search, if and when the potential search becomes a submitted search.
11. The system of claim 10 , wherein:
a plurality of signals is received from a plurality of different signal sources for use in calculating the autoscale prediction score;
the plurality of signals includes the signal indicative of the user's intent to submit a query for event logs and a signal indicative of currently available computational resources for performing searches; and
the autoscale prediction score is calculated based on the plurality of signals.
12. The system of claim 11 , wherein the plurality of signals also includes a signal indicative of computational resources required for the potential search.
13. The system of claim 12 , wherein the signal indicative of the computational resources required for the potential search is one of the following: selection of a query time domain, size of event log database upon which the potential search would be performed, and addition of an indexed field to a query builder.
14. The system of claim 11 , wherein the signal indicative of the user's intent to perform the search is one of the following: usage of a query builder for the event log search, selection of a recent query, the user's past patterns of searches, selection of a query time domain, and an addition of an indexed field to a query builder.
15. The system of claim 11 , wherein calculating the autoscale prediction score comprises:
assigning a value to each of the plurality of signals; and
calculating a weighted sum of the signal values.
16. The system of claim 10 , further comprising:
receiving a new signal related to the potential search after the autoscale prediction score has been calculated for the potential search;
recalculating the autoscale prediction score to factor in the new signal; and
making a new autoscale decision based on the recalculated autoscale prediction score.
17. The system of claim 10 , wherein making an autoscale decision comprises adjusting computational resources available for the potential search.
18. The system of claim 17 , wherein computational resources are increased as a function of the autoscale prediction score.
19. A method, performed by a computer system, for predicting autoscaling requirements for query searches on a database of event logs in a cybersecurity system, the method comprising:
receiving a signal indicative of a user's intent to perform a search for event logs in the cybersecurity system;
calculating an autoscale prediction score for a potential search based on the signal; and
making an autoscale decision for the potential search based on the autoscale prediction score, wherein the autoscale decision for the potential search is made before the potential search becomes a submitted search for event logs in the cybersecurity system, and wherein the autoscale decision is to make computational resources available for the potential search, if and when the potential search becomes a submitted search.
20. The method of claim 19 , wherein:
a plurality of signals is received from a plurality of different signal sources for use in calculating the autoscale prediction score;
the plurality of signals includes the signal indicative of the user's intent to submit a query for event logs and a signal indicative of currently available computational resources for performing searches; and
the autoscale prediction score is calculated based on the plurality of signals.
21. The method of claim 20 , wherein the plurality of signals also includes a signal indicative of computational resources required for the potential search.