Content aware heterogeneous log pattern comparative analysis engine
A computer-implemented method, system, and computer program product are provided for content aware heterogeneous log pattern comparative analysis. The method includes receiving, by a processor-device, a plurality of heterogeneous logs. The method also includes extracting, by the processor-device, a plurality of log syntactic patterns from the plurality of heterogenous logs. The method additionally includes generating, by the processor-device, latent representation vectors for each of the plurality of log syntactic patterns. The method further includes predicting, by the processor-device, an anomaly from the clustered latent representation vectors. The method also includes controlling an operation of a processor-based machine to react in accordance with the anomaly.
1. A computer-implemented method for content aware heterogeneous log pattern comparative analysis, the method comprising:
receiving, by a processor-device, a plurality of heterogeneous logs;
extracting, by the processor-device, a plurality of log syntactic patterns from the plurality of heterogenous logs;
generating, by the processor-device, latent representation vectors for each of the plurality of log syntactic patterns;
predicting, by the processor-device, an anomaly from the clustered latent representation vectors; and
controlling an operation of a processor-based machine to react in accordance with the anomaly;
wherein the generating includes obtaining a maximum number of tokens in the plurality of log syntactic patterns and selecting a number of dimensions to represent the maximum number of tokens.
2. A content aware heterogeneous log pattern comparative analysis system, system comprising:
a processing system including a processor and memory coupled to the processor, the processing system programmed to:
receive a plurality of heterogeneous logs;
extract a plurality of log syntactic patterns from the plurality of heterogenous logs;
generate latent representation vectors for each of the plurality of log syntactic patterns;
predict an anomaly from the clustered latent representation vectors; and
control an operation of a processor-based machine to react in accordance with the anomaly;
wherein the processing system is further programmed to obtain a maximum number of tokens in the plurality of log syntactic patterns and selecting a number of dimensions to represent the maximum number of tokens.