FLASH SYSTEM WITH INTEGRATED LOG ANALYTICS AND ANOMALY DETECTION

1 . A method comprising:

receiving, by a processing device, log data generated by a computing system;

executing an analytics operation on the log data; and

applying pattern recognition associated with the log data to identify anomalous behaviors of the computing system.

2 . The method of claim 1 , wherein applying pattern recognition to the log data comprises comparing the log data to a plurality of stored fingerprints representing known behaviors of the computing system.

3 . The method of claim 1 , further comprising:

receiving unstructured log data from the computing system; and

converting the unstructured log data into a structured dataset prior to executing the analytics operation.

4 . The method of claim 1 , further comprising:

receiving log data from a plurality of data producers; and

allocating separate processing resources to analyze the log data of each data producer.

5 . The method of claim 1 , further comprising:

detecting that execution of the analytics operation has failed; and

reallocating processing resources to continue the analytics operation on the log data.

6 . The method of claim 1 , further comprising:

detecting that additional processing resources are required for the analytics operation; and

allocating the additional processing resources to the analytics operation.

7 . The method of claim 1 , further comprising:

generating auditing information for the analytics operation executed on the log data.

8 . The method of claim 1 , further comprising:

generating trending information associated with the analytics operation executed on the log data.

9 . The method of claim 1 , wherein applying pattern recognition to the log data comprises:

correlating anomalous behaviors identified in the log data with anomalous behaviors identified in other datasets.

10 . The method of claim 1 , further comprising:

determining, based on the log data, a predicted resource requirement for completing the analytics operation; and

allocating processing resources according to the predicted resource requirement.

11 . An apparatus comprising:

a memory; and

a processing device, operatively coupled to the memory, configured to:

receive log data generated by a computing system;

execute an analytics operation on the log data; and

apply pattern recognition associated with the log data to identify anomalous behaviors of the computing system.

12 . The apparatus of claim 11 , wherein applying pattern recognition to the log data comprises comparing the log data to a plurality of stored fingerprints representing known behaviors of the computing system.

13 . The apparatus of claim 12 , wherein the processing device is further configured to:

receive unstructured log data from the computing system; and

convert the unstructured log data into a structured dataset prior to executing the analytics operation.

14 . The apparatus of claim 11 , wherein the processing device is further configured to:

receive log data from a plurality of data producers; and

allocate separate processing resources to analyze the log data of each data producer.

15 . The apparatus of claim 11 , wherein the processing device is further configured to:

detect that execution of the analytics operation has failed; and

reallocate processing resources to continue the analytics operation on the log data.

16 . The apparatus of claim 11 , wherein the processing device is further configured to:

detect that additional processing resources are required for the analytics operation; and

allocate the additional processing resources to the analytics operation.

17 . The apparatus of claim 11 , wherein the processing device is further configured to:

generate auditing information for the analytics operation executed on the log data.

18 . The apparatus of claim 11 , wherein the processing device is further configured to:

generate trending information associated with the analytics operation executed on the log data.

19 . The apparatus of claim 12 , wherein to apply pattern recognition to the log data, the processing device is further configured to:

correlate anomalous behaviors identified in the log data with anomalous behaviors identified in other datasets.

20 . A non-transitory computer readable storage medium storing instructions which, when executed, cause a processing device to:

receive log data generated by a computing system;

execute an analytics operation on the log data; and

apply pattern recognition associated with the log data to identify anomalous behaviors of the computing system.