Process understanding for robotic process automation (RPA) using sequence extraction

1. A computing device comprising:

a processor;

a memory; and

the processor is configured to retrieve, from the memory, captured steps of a workflow of an application to utilize a sequencing model for the captured steps, wherein the sequencing model determines a plurality of processes and state transitions for the captured steps;

the processor is configured to identify at least one of a variance, a judgment action, or a rule-based action of the plurality of processes and state transitions based on the sequencing model and changes of a log file of actions in relation to the captured steps;

the processor is configured to generate a hierarchy based on the identified variance, the judgment action, or the rule-based action, wherein the hierarchy is one of an exponentially decaying hierarchy having overlap between functional clusters or flat clusters; and

the processor is configured to automatically generate an automated workflow based on the generated hierarchy for process automation by a robot and control the process automation based on the generated automated workflow.

2. The computing device of claim 1 , wherein the sequence model identifies a sub-sequence or sub-pattern appearing greater than a predetermined number of times in a row.

3. The computing device of claim 1 , wherein the captured steps are randomized and the sequencing model identifies a process that occurs more than a predetermined number of times.

4. The computing device of claim 1 , wherein telemetry data is utilized by the sequencing model.

5. The computing device of claim 1 , wherein the variance, judgment action, or rule-based action are visualized for verification.

6. The computing device of claim 1 , wherein each identified process of the plurality of processes is labeled.

7. The computing device of claim 1 , wherein the actions include one of a screenshot, tree data, domain object model (DOM) data, a user interface element, a selector, an action type, clipboard content, or computing activity.

8. The computing device of claim 7 , wherein the actions are arranged in rows that are clustered based on repetition or ranking.

9. A method performed by a computing system, the method comprising:

retrieving, by a processor of the computing system, captured steps of a workflow of an application to utilize a sequencing model for the captured steps, wherein the sequencing model determines a plurality of processes and state transitions for the captured steps;

identifying, by the processor, at least one of a variance, a judgment action, or a rule-based action of the plurality of processes and state transitions based on the sequencing model and changes of a log file of actions in relation to the captured steps;

generating, by the processor, a hierarchy based on the identified variance, the judgment action, or the rule-based action, wherein the hierarchy is one of an exponentially decaying hierarchy having overlap between functional clusters or flat clusters; and

generating, automatically, by the processor, an automated workflow based on the generated hierarchy for process automation by a robot and controlling the process automation based on the generated automated workflow.

10. The method of claim 9 , wherein the sequence model identifies a sub-sequence or sub-pattern appearing greater than a predetermined number of times in a row.

11. The method of claim 9 , wherein the captured steps are randomized and the sequencing model identifies a process that occurs more than a predetermined number of times.

12. The method of claim 9 , wherein telemetry data is utilized by the sequencing model.

13. The method of claim 9 , wherein the variance, judgment action, or rule-based action are visualized for verification.

14. The method of claim 9 , wherein each identified process of the plurality of processes is labeled.

15. The method of claim 9 , wherein the actions include one of a screenshot, tree data, domain object model (DOM) data, a user interface element, a selector, an action type, clipboard content, or computing activity.

16. The method of claim 15 , wherein the actions are arranged in rows that are clustered based on repetition or ranking.

17. A computing device comprising:

a processor; and

a memory; and

the processor is configured to retrieve, from the memory, captured steps of a workflow of an application to utilize a sequencing model for the captured steps, wherein the sequencing model determines state transitions for the captured steps;

the processor is configured to identify a variance of the state transitions based on the sequencing model and changes of a log file of actions in relation to the captured steps;

the processor is configured to generate a hierarchy based on the identified variance, wherein the hierarchy is one of an exponentially decaying hierarchy having overlap between functional clusters or flat clusters; and

the processor is configured to automatically generate an automated workflow based on the generated hierarchy for process automation by a robot and control the process automation based on the generated automated workflow.

18. The computing device of claim 17 , wherein the sequence model identifies a sub-sequence or sub-pattern appearing greater than a predetermined number of times in a row.

19. The computing device of claim 17 , wherein the captured steps are randomized and the sequencing model identifies a process that occurs more than a predetermined number of times.

20. The computing device of claim 17 , wherein telemetry data is utilized by the sequencing model.