IP Library Granted Patent US 12,554,614
Granted Patent B2
US 12,554,614 · App. 17/387,023 · Granted Feb 17, 2026

Method, electronic device, and computer program product for data processing, analysis, and abnormality determination of logs corresponding to operations

Inventors: Weiyang Liu (Shanghai, CN); Lihui Su (Shanghai, CN); Qi Wang (Shanghai, CN); Min Liu (Shanghai, CN); Yujun Liang (Shanghai, CN)
Assignee: EMC IP HOLDING COMPANY LLC
G06F11/3075G06F11/0772G06F11/0775G06F11/3006G06F11/327
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,554,614
App. No.
17/387,023
Granted
Feb 17, 2026
Kind
B2
Abstract

Embodiments of the present disclosure provide a method, an electronic device, and a computer program product for data processing. The method described herein includes determining identification information for an operation, wherein the identification information includes at least one field indicating content of the operation and a field indicating a unique identification of the operation. The method further includes identifying, based on the identification information, log entries for the operation in log files for at least one microservice invoked by the operation. The method further includes determining a log for the operation, wherein the log includes the identified log entries. With the solution for data processing of the present application, it is possible to easily acquire logs for an operation using identification information that includes a field indicating the content of the operation, so as to facilitate targeted analysis of the operation based on the content of the operation.

Claims (84)

1 . A computer-implemented method for data processing, comprising:

identifying, in a computing system, invocation of a microservice by an operation of the computing system;

generating, in response to invocation of the microservice, identification information for the operation by encoding information related to invocation of the microservice into at least one field indicating content of the operation;

recording, in a log file, the identification information for the operation in a log entry corresponding to the operation;

analyzing a plurality of log entries of the computing system to determine a set of identification information for a group of operations corresponding to a type of operation of a target log for a target operation, wherein each identification information in the set of identification information corresponds to a respective operation in the group of operations and each identification information includes at least one field indicating content of the target operation and a field indicating a unique identification of the type of operation, wherein the log entry is included in the plurality of log entries and the operation is included in the group of operations;

identifying, based on the set of identification information, log entries for the group of operations in a plurality of log files for the microservice invoked by the type of operation, wherein the plurality of log files include the log file;

determining a group of logs for the group of operations, the group of logs including a first log for the type of operation and a second log for the type of operation, wherein the first log includes a first portion of the identified log entries corresponding to a first execution of the type of operation and the second log includes a second portion of the identified log entries corresponding to a second execution of the type of operation;

determining, by electronic circuitry implementing a machine learning algorithm, a log pattern corresponding to the group of operations based on pattern matching between at least the first and second logs in the group of logs, wherein the log pattern includes a first pattern of a first corresponding log entry of the first and second logs and a second pattern of a second corresponding log entry of the first and second logs;

determining an abnormality degree for the target operation based on comparison of the log pattern with the target log; and

identifying an abnormal log entry in the target log based on comparison of the abnormality degree for the target operation with a threshold,

wherein the abnormality degree for the target log of the target operation is based on a weight assigned to each respective log entry in the target log and the weight is assigned based on a level of each respective log entry in the target log, and

wherein the level comprises a debug level, an information level, a warning level, an error level, and a fatal error level with the respective weights of 1.0, 1.0, 1.1, 1.2, and 1.3.

2 . The method according to claim 1 , wherein the content of the target operation comprises at least one of:

a property of the target operation;

an action performed by the target operation; and

an object targeted by the target operation.

3 . The method according to claim 1 , wherein the log pattern includes a variable of string type or numeric type, and wherein the method further comprises:

determining, based on a comparison between the target log for the target operation and the log pattern, a value in the target log corresponding to the variable, wherein identification information for the target operation includes the at least one identical field; and

when determining that the value does not satisfy a predefined condition for the variable, determining at least one of the following:

that the target operation is an abnormal operation; and

abnormal log entries in the target log.

4 . The method according to claim 1 , further comprising:

extracting structured data from the target log for the target operation;

based on an analysis of the structured data, performing at least one of:

determining abnormal log entries in the target log; and

predicting an abnormality related to the target operation.

5 . The method according to claim 1 , wherein the abnormal log entry in the target log is identified based on comparison of the first pattern in the log pattern with a corresponding log entry in the target log.

6 . The method according to claim 1 , wherein the log pattern includes at least one string or number included in at least one variable corresponding to unmatched strings or numbers in logs included in the group of logs.

7 . The method according to claim 1 , wherein the abnormality degree for the target operation is determined based on at least one of a length of identical strings between the target log and the log pattern or a number of identical strings between the target log and the log pattern.

8 . The method according to claim 1 , wherein encoding information related to invocation of the microservice into the at least one field indicating content of the operation includes encoding the information into a hexadecimal number.

9 . The method according to claim 1 , further comprising predicting an abnormality with a subsequent execution of the target operation based on the abnormal log entry.

10 . An electronic device, comprising:

a processor; and

a memory coupled to the processor, the memory having instructions stored therein that, when executed by the processor, cause the processor to perform actions, the actions comprising:

identifying, in a computing system, invocation of a microservice by an operation of the computing system;

generating, in response to invocation of the microservice, identification information for the operation by encoding information related to invocation of the microservice into at least one field indicating content of the operation;

recording, in a log file, the identification information for the operation in a log entry corresponding to the operation;

analyzing a plurality of log entries of the computing system to determine a set of identification information for a group of operations corresponding to a type of operation of a target log for a target operation, wherein each identification information in the set of identification information corresponds to a respective operation in the group of operations and each identification information includes at least one field indicating content of the target operation and a field indicating a unique identification of the type of operation, wherein the log entry is included in the plurality of log entries and the operation is included in the group of operations;

identifying, based on the set of identification information, log entries for the group of operations in a plurality of log files for the microservice invoked by the type of operation, wherein the plurality of log files include the log file;

determining a group of logs for the group of operations, the group of logs including a first log for the type of operation and a second a log for the type of operation, wherein the first log includes a first portion of the identified log entries corresponding to a first execution of the type of operation and the second log includes a second portion of the identified log entries corresponding to a second execution of the type of operation;

determining, via a machine learning algorithm, a log pattern corresponding to the group of operations based on pattern matching between at least the first and second logs in the group of logs, wherein the log pattern includes a first pattern of a first corresponding log entry of the first and second logs and a second pattern of a second corresponding log entry of the first and second logs;

determining an abnormality degree for the target operation based on comparison of the log pattern with the target log; and

identifying, via a machine learning algorithm, an abnormal log entry in the target log based on comparison of the abnormality degree for the target operation with a threshold,

wherein the abnormality degree for the target log of the target operation is based on a weight assigned to each respective log entry in the target log and the weight is assigned based on a level of each respective log entry in the target log, and

wherein the level comprises a debug level, an information level, a warning level, an error level, and a fatal error level with the respective weights of 1.0, 1.0, 1.1, 1.2, and 1.3.

11 . The device according to claim 10 , wherein the content of the target operation comprises at least one of:

a property of the target operation;

an action performed by the target operation; and

an object targeted by the target operation.

12 . The device according to claim 10 , wherein the log pattern comprises a variable of string type or numeric type, and wherein the actions further comprise:

determining, based on a comparison between the target log for the target operation and the log pattern, a value in the target log corresponding to the variable, wherein identification information for the target operation comprises the at least one identical field; and

when determining that the value does not satisfy a predefined condition for the variable, determining at least one of the following:

that the target operation is an abnormal operation; and

abnormal log entries in the target log.

13 . The device according to claim 10 , wherein the actions further comprise:

extracting structured data from the target log for the target operation;

based on an analysis of the structured data, performing at least one of:

determining abnormal log entries in the target log; and

predicting an abnormality related to the target operation.

14 . The device according to claim 10 , wherein the log pattern includes at least one string or number included in at least one variable corresponding to unmatched strings or numbers in logs included in the group of logs.

15 . The device according to claim 10 , wherein the abnormality degree for the target operation is determined based on at least one of a length of identical strings between the target log and the log pattern or a number of identical strings between the target log and the log pattern.

16 . A non-transitory computer-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform actions, the actions comprising:

identifying, in a computing system, invocation of a microservice by an operation of the computing system;

generating, in response to invocation of the microservice, identification information for the operation by encoding information related to invocation of the microservice into at least one field indicating content of the operation;

recording, in a log file, the identification information for the operation in a log entry corresponding to the operation;

analyzing a plurality of log entries of the computing system to determine a set of identification information for a group of operations corresponding to a type of operation of a target log for a target operation, wherein each identification information in the set of identification information corresponds to a respective operation in the group of operations and each identification information includes at least one field indicating content of the target operation and a field indicating a unique identification of the type of operation, wherein the log entry is included in the plurality of log entries and the operation is included in the group of operations;

identifying, based on the set of identification information, log entries for the group of operations in a plurality of log files for the microservice invoked by the type of operation, wherein the plurality of log files include the log file;

determining a group of logs for the group of operations, the group of logs including a first log for the type of operation and a second log for the type of operation, wherein the first log includes a first portion of the identified log entries corresponding to a first execution of the type of operation and the second log includes a second portion of the identified log entries corresponding to a second execution of the type of operation;

determining, via a machine learning algorithm, a log pattern corresponding to the group of operations based on pattern matching between at least the first and second logs in the group of logs, wherein the log pattern includes a first pattern of a first corresponding log entry of the first and second logs and a second pattern of a second corresponding log entry of the first and second logs;

determining an abnormality degree for the target operation based on comparison of the log pattern with the target log; and

identifying an abnormal log entry in the target log based on comparison of the abnormality degree for the target operation with a threshold,

wherein the abnormality degree for the target log of the target operation is based on a weight assigned to each respective log entry in the target log and the weight is assigned based on a level of each respective log entry in the target log, and

wherein the level comprises a debug level, an information level, a warning level, an error level, and a fatal error level with the respective weights of 1.0, 1.0, 1.1, 1.2, and 1.3.

17 . The computer-readable medium according to claim 16 , wherein the content of the target operation comprises at least one of:

a property of the target operation;

an action performed by the target operation; and

an object targeted by the target operation.

18 . The computer-readable medium according to claim 16 , wherein the log pattern comprises a variable of string type or numeric type, and wherein the actions further comprise:

determining, based on a comparison between the target log for the target operation and the log pattern, a value in the target log corresponding to the variable, wherein identification information for the target operation comprises the at least one identical field; and

when determining that the value does not satisfy a predefined condition for the variable, determining at least one of the following:

that the target operation is an abnormal operation; and

abnormal log entries in the target log.

19 . The computer-readable medium according to claim 16 , wherein the log pattern includes at least one string or number included in at least one variable corresponding to unmatched strings or numbers in logs included in the group of logs.

20 . The computer-readable medium according to claim 16 , wherein the abnormality degree for the target operation is determined based on at least one of a length of identical strings between the target log and the log pattern or a number of identical strings between the target log and the log pattern.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (058014/0560) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0473 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (057931/0392) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 062022/0382 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (057758/0286) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 061654/0064 →
SECURITY INTEREST Recorded Oct 6, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 058014/0560 →
SECURITY INTEREST Recorded Oct 6, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 057758/0286 →
SECURITY INTEREST Recorded Oct 6, 2021
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 057931/0392 →
SECURITY AGREEMENT Recorded Oct 1, 2021
From: DELL PRODUCTS, L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 057682/0830 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 28, 2021
From: LIU, WEIYANG; SU, LIHUI; WANG, QI; LIU, MIN; LIANG, YUJUN
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 057003/0690 →
Priority Claims (1)
CN 202110681030.3 · Jun 18, 2021 · national
Continuity (1)
Related Publication 20220405184A1 · Dec 22, 2022
References Cited (22)
US 9542255B2 · Fu · 2017 [cited by examiner]
US 9910882B2 · Gnech · 2018 [cited by examiner]
US 10069699B2 · Kimura · 2018 [cited by examiner]
US 10685292B1 · Milo · 2020 [cited by examiner]
US 10831586B2 · Li · 2020 [cited by examiner]
US 10929218B2 · Xu · 2021 [cited by examiner]
US 11194692B2 · Xu · 2021 [cited by examiner]
US 11294754B2 · Xu · 2022 [cited by examiner]
US 11301355B2 · Gong · 2022 [cited by examiner]
US 11307953B2 · Wang · 2022 [cited by examiner]
US 20160124792A1 · Togawa · 2016 [cited by examiner]
US 20170004188A1 · Gupta · 2017 [cited by examiner]
US 20180046529A1 · Togawa · 2018 [cited by examiner]
US 20180060211A1 · Allen · 2018 [cited by examiner]
US 20190095313A1 · Xu · 2019 [cited by examiner]
US 20190370347A1 · Levy · 2019 [cited by examiner]
US 20190372827A1 · Vasseur · 2019 [cited by examiner]
US 20200097579A1 · Manjappa · 2020 [cited by examiner]
US 20210051503A1 · Bodiga · 2021 [cited by examiner]
US 20210097438A1 · Matsumoto · 2021 [cited by examiner]
US 20220171800A1 · Kumaresan · 2022 [cited by examiner]
US 20220368696A1 · Karpovsky · 2022 [cited by examiner]