Identification of behavioral pattern of simulated transaction data

1. A computer implemented method in a data processing system comprising a processor and a memory comprising instructions, which are executed by the processor to cause the processor to implement the method for identifying a behavioral pattern from simulated transaction data, the method comprising:

simulating, by the processor, transaction data using a reinforcement learning model wherein the reinforcement learning model includes an intelligent agent, a policy engine, and an environment;

identifying, by the processor, a behavioral pattern from the simulated transaction data;

providing, by the processor, the behavioral pattern to the reinforcement learning model to generate new simulated transaction data having the behavioral pattern; and

training, by the processor, a predictive model for detecting abnormal customer behaviors, using the new simulated transaction data having the behavioral pattern;

wherein the step of simulating transaction data using the reinforcement learning model further comprises:

providing, by the processor, standard customer transaction data representing a group of customers having similar transaction characteristics as a goal; and

performing, by the processor, a plurality of iterations to simulate the standard customer transaction data, wherein the plurality of iterations is performed until a degree of similarity of simulated customer transaction data relative to the standard customer transaction data is higher than a first predefined threshold;

in each iteration:

conducting, by the intelligent agent, an action including a plurality of simulated transactions;

comparing, by the environment, the action with the goal;

providing by the environment, a feedback associated with the action based on a degree of similarity relative to the goal; and

adjusting, by the policy engine, a policy based on the feedback.

2. The method as recited in claim 1 , further comprising:

determining, by the processor, whether the behavioral pattern indicates a fraudulent behavior.

3. The method as recited in claim 1 , further comprising:

comparing, by the processor, the behavioral pattern with the standard customer transaction data to determine whether the behavioral pattern is present in the standard customer transaction data;

if the behavioral pattern is present in the standard customer transaction data,

determining, by the processor, whether the behavioral pattern indicates a fraudulent behavior.

4. The method as recited in claim 1 , further comprising:

comparing, by the processor, the behavioral pattern with the standard customer transaction data to determine whether the behavioral pattern is present in the standard customer transaction data,

if the behavioral pattern is present in the standard customer transaction data,

providing, by the processor, the behavioral pattern to the reinforcement learning model to generate new simulated transaction data having the behavioral pattern.

5. The method as recited in claim 1 , the step of identifying a behavioral pattern further comprising identifying the behavioral pattern based on a plurality of parameters including behavioral consistency, consistency volatility, and behavior abnormality.

6. The method as recited in claim 1 , wherein the behavioral pattern occurs during exploration in the reinforcement learning model.

7. A computer program product for identifying a behavioral pattern from simulated transaction data, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

simulate transaction data using a reinforcement learning model, wherein the reinforcement learning model includes an intelligent agent, a policy engine, and an environment;

identify a behavioral pattern from the simulated transaction data;

provide the behavioral pattern to the reinforcement learning model to generate new simulated transaction data having the behavioral pattern; and

train a predictive model for detecting abnormal customer behaviors, using the new simulated transaction data having the behavioral pattern;

wherein the step of simulating transaction data using the reinforcement learning model further comprises:

provide standard customer transaction data representing a group of customers having similar transaction characteristics as a goal; and

perform a plurality of iterations to simulate the standard customer transaction data, wherein the plurality of iterations is performed until a degree of similarity of simulated customer transaction data relative to the standard customer transaction data is higher than a first predefined threshold;

in each iteration:

conduct, by the intelligent agent, an action including a plurality of simulated transactions;

compare, by the environment, the action with the goal;

provide, by the environment, a feedback associated with the action based on a degree of similarity relative to the goal; and

adjust, by the policy engine, a policy based on the feedback.

8. The computer program product of claim 7 , wherein the program instructions executable by the processor further cause the processor to:

determine whether the behavioral pattern indicates a fraudulent behavior.

9. The computer program product of claim 7 , wherein the program instructions executable by the processor further cause the processor to:

compare the behavioral pattern with the standard customer transaction data to determine whether the behavioral pattern is present in the standard customer transaction data;

if the behavioral pattern is present in the standard customer transaction data,

determine whether the behavioral pattern indicates a fraudulent behavior.

10. The computer program product of claim 7 , wherein the program instructions executable by the processor further cause the processor to:

compare the behavioral pattern with the standard customer transaction data to determine whether the behavioral pattern is present in the standard customer transaction data,

if the behavioral pattern is present in the standard customer transaction data,

provide the behavioral pattern to the reinforcement learning model to generate new simulated transaction data having the behavioral pattern.

11. The computer program product of claim 7 , wherein the step of identifying a behavioral pattern further comprising identifying the behavioral pattern based on a plurality of parameters including behavioral consistency, consistency volatility, and behavior abnormality.

12. The computer program product of claim 7 , wherein the behavioral pattern occurs during exploration in the reinforcement learning model.

13. A system for identifying a behavioral pattern from simulated transaction data, the system comprising:

a processor configured to:

simulate transaction data using a reinforcement learning model, wherein the reinforcement learning model includes an intelligent agent, a policy engine, and an environment;

identify a behavioral pattern from the simulated transaction data;

provide the behavioral pattern to the reinforcement learning model to generate new simulated transaction data having the behavioral pattern; and

train a predictive model for detecting abnormal customer behaviors, using the new simulated transaction data having the behavioral pattern;

wherein the step of simulating transaction data using the reinforcement learning model further comprises:

provide standard customer transaction data representing a group of customers having similar transaction characteristics as a goal; and

perform a plurality of iterations to simulate the standard customer transaction data, wherein the plurality of iterations is performed until a degree of similarity of simulated customer transaction data relative to the standard customer transaction data is higher than a first predefined threshold;

in each iteration:

conduct, by the intelligent agent, an action including a plurality of simulated transactions;

compare, by the environment, the action with the goal;

provide, by the environment, a feedback associated with the action based on a degree of similarity relative to the goal; and

adjust, by the policy engine, a policy based on the feedback.

14. The system of claim 13 , wherein the program instructions executable by the processor further cause the processor to:

determine whether the behavioral pattern indicates a fraudulent behavior.

15. The system of claim 13 , wherein the program instructions executable by the processor further cause the processor to:

compare the behavioral pattern with the standard customer transaction data to determine whether the behavioral pattern is present in the standard customer transaction data;

if the behavioral pattern is present in the standard customer transaction data,

determine whether the behavioral pattern indicates a fraudulent behavior.

16. The system of claim 13 , wherein the program instructions executable by the processor further cause the processor to:

compare the behavioral pattern with the standard customer transaction data to determine whether the behavioral pattern is present in the standard customer transaction data,

if the behavioral pattern is present in the standard customer transaction data,

provide the behavioral pattern to the reinforcement learning model to generate new simulated transaction data having the behavioral pattern.

17. The system of claim 13 , the step of identifying a behavioral pattern further comprising identifying the behavioral pattern based on a plurality of parameters including behavioral consistency, consistency volatility, and behavior abnormality.