Workflow analyzer system and methods

1. A method of analyzing a workflow process using a plurality of screen captures, the method comprising:

recording the plurality of screen captures in real-time to generate a plurality of raw recordings, the plurality of screen captures occurring in series, and each of the plurality of screen captures occurring on a control business application;

generating, using a processor, a workflow data file based on the plurality of raw recordings, the workflow data file including a graphical representation of steps in a sequential order for performing the workflow process, the workflow data file being compatible with a workflow application;

capturing user-interaction based data during the recording of the plurality of screen captures; and

generating an operational metrics report for the workflow process based on said user-interaction based data to assist in establishing priority tasks within an automation roadmap of the workflow process,

wherein the operational metrics report includes one or more of

workflow scope,

workflow metrics,

application inflight time,

platform distribution,

web distribution,

windows distribution,

mainframe distribution,

a time-and-motion study,

wherein the user-interaction based data includes one or more of

a click,

a tab,

a keystroke,

mouse coordinates,

a number of used-control applications,

a number of used-control platforms,

audio,

video, and

wherein the workflow data file is further based on the user-interaction based data.

2. The method of claim 1 , further comprising:

measuring a total number of hours taken to perform the workflow process according to the workflow data file; and

reporting the total number of hours in the operational metrics report.

3. The method of claim 2 , wherein

the operational metrics report further includes one or more of an automation complexity score, feasibility score, and

the generating of the workflow data file includes using one or more of the automation complexity score, the feasibility score.

4. The method of claim 3 , wherein

said workflow scope comprises pre and post activities carried out by a user in order to execute a workflow;

said workflow metrics comprise mathematical indices that are automatically calculated including one or more of

a count of business applications within the workflow,

a number of hops between each application,

a duration of workflow before and after cleanup activities,

a number of activities within the workflow before and after cleanup;

said application inflight time includes an identification of a platform and a time consumed by the user on a business application to identify a potential automation candidate application for consideration to be automated;

said platform distribution comprises an overall time consumed by the user on the platform;

said web distribution comprises a listing of applications that are web based;

said Windows distribution comprises a listing of applications that are windows based; and

said mainframe distribution comprises a listing of mainframe applications.

5. The method of claim 3 , wherein said automation complexity score and said feasibility score are calculated based on a plurality of attributes including one or more of a like automation ID, class name, xpath, cognitive computing required status, robotic processing automation status, structured nature of input format, count of inputs, percentage distribution of types of inputs, underlying technology and platform of business application, real time processing requirements, third party integration, annual volume, database/network access requirements within that workflow, need for standardization of workflow, natural language processing.

6. The method of claim 1 , further comprising:

superimposing multiple graphical representations each corresponding to one of a plurality of linear workflows to generate a merged graphical representation of a common workflow;

identifying one or more activities that are common among said plurality of linear workflows; and

calculating a count of a frequency of occurrence of each activity that is common of said one or more activities among said plurality of linear workflows,

wherein said superimposing comprises superimposing one or more most-visited-paths to identify high-traffic routes of interactions to identify said priority tasks in said automation roadmap.

7. The method of claim 1 , wherein the recording of the plurality of screen captures is selective.

8. The method of claim 1 , wherein

the workflow application is a diagramming and vector graphics application, and

the workflow data file is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

9. The method of claim 1 , wherein

the plurality of screen captures are each in an active-time window, and

the recording of the plurality of screen captures is paused if the active-time window is closed, and resumes if the active-time window is opened.

10. The method of claim 1 , further comprising automatically identifying activity that requires cognitive computing.

11. The method of claim 1 , further comprising generating source code for the workflow data file in at least one software language based on the plurality of raw recordings.

12. The method of claim 1 , wherein the generating of the workflow data file includes encrypting at rest each of the plurality of raw recordings or metadata of the plurality of raw recordings using 2-phase 256 bit encryption to prevent output of the plurality of raw recordings in clear text.

13. The method of claim 1 , further comprising

capturing a technical attribute during the recording of the plurality of screen captures; and

predicting a caption for each of the plurality of screen captures based on one or more of the technical attribute, historical references, and a standardized caption for each of the plurality of screen captures based on similar captions using natural language processing,

wherein the technical attribute includes one or more of a control ID, a control type, a control name, a class name, a control-data value, an x-path, a process name, a process ID, a process description, a name of the control business application, a name of a screen of the control business application.

14. The method of claim 1 , wherein the recording of the plurality of screen captures occurs across two or more computer monitors, wherein the two or more computer monitors comprise different resolutions, and wherein the recording of the plurality of screen captures includes adjusting a resolution of the plurality of raw recordings during the recording to provide uniform resolution among screen captures from said two or more computer monitors.

15. The method of claim 1 , further comprising

recording A/V data associated with the plurality of screen captures during the recording to generate a plurality of A/V raw recordings; and

adjusting a playback rate of the plurality of A/V raw recordings to correspond to a playback rate of the plurality of raw recordings.

16. A system for analyzing a workflow process using a plurality of screen captures, the system comprising:

a recorder configured to record the plurality of screen captures in real-time to generate a plurality of raw recordings, the plurality of screen captures occurring in series, and each of the plurality of screen captures occurring on a control business application;

a processor configured to

generate a workflow data file based on the plurality of raw recordings, the workflow data file including a graphical representation of steps in a sequential order for performing the workflow process, the workflow data file being compatible with a workflow application;

capture user-interaction based data during the recording of the plurality of screen captures; and

generate an operational metrics report for the workflow process based on said user-interaction based data to assist in establishing priority tasks within an automation roadmap of the workflow process,

wherein the operational metrics report includes one or more of workflow scope, workflow metrics, application inflight time, platform distribution, web distribution, windows distribution, mainframe distribution, a time-and-motion study,

wherein the user-interaction based data includes one or more of a click, a tab, a keystroke, mouse coordinates, a number of used-control applications, a number of used-control platforms, audio and video, and

wherein the workflow data file is further based on the user-interaction based data.

17. The system of claim 16 , wherein the processor is further configured to

measure a total number of hours taken to perform the workflow process according to the workflow data file; and

report the total number of hours in the operational metrics report.

18. The system of claim 16 , wherein

the operational metrics report further includes one or more of an automation complexity score, a feasibility score, and

the generate the workflow data file includes using one or more of the automation complexity score, the feasibility score.

19. The system of claim 18 , wherein

said workflow scope comprises pre and post activities carried out by a user in order to execute a workflow;

said workflow metrics comprise mathematical indices that are automatically calculated including one or more of a count of business applications within the workflow, a number of hops between each application, a duration of the workflow before and after cleanup activities, a number of activities within the workflow before and after cleanup;

said application inflight time includes an identification of a platform and a time consumed by the user on a business application to identify a potential automation candidate application for consideration to be automated;

said platform distribution comprises an overall time consumed by the user on the platform;

said web distribution comprises a listing of applications that are web based;

said Windows distribution comprises a listing of applications that are windows based; and

said mainframe distribution comprises a listing of mainframe applications.

20. The system of claim 18 , wherein said automation complexity score and said feasibility score are calculated based on a plurality of attributes including one or more of a like automation ID, class name, xpath, cognitive computing required status, robotic processing automation status, structured nature of input format, count of inputs, percentage distribution of types of inputs, underlying technology and platform of business application, real time processing requirements, third party integration, annual volume, database/network access requirements within that workflow, need for standardization of workflow, natural language processing.

21. The system of claim 16 , wherein the processor is further configured to

superimpose multiple graphical representations each corresponding to one of a plurality of linear workflows to generate a merged graphical representation of a common workflow;

identify one or more activities that are common among said plurality of linear workflows; and

calculate a count of a frequency of occurrence of each activity that is common of said one or more activities among said plurality of linear workflows,

wherein said superimpose comprises superimposing one or more most-visited-paths to identify high-traffic routes of interactions to identify priority tasks in an automation roadmap.

22. The system of claim 16 , wherein the record the plurality of screen captures is selective.

23. The system of claim 16 , wherein

the workflow application is a diagramming and vector graphics application, and

the workflow data file is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

24. The system of claim 16 , wherein

the plurality of screen captures are each in an active-time window, and

the record the plurality of screen captures is paused if the active-time window is closed, and resumes if the active-time window is opened.

25. The system of claim 16 , wherein the processor is further configured to automatically identify activity that requires cognitive computing.

26. The system of claim 16 , wherein the processor is further configured to generate source code for the workflow data file in at least one software language based on the plurality of raw recordings.

27. The system of claim 16 , wherein the generate the workflow data file includes encrypting at rest each of the plurality of raw recordings or metadata of the plurality of raw recordings using 2-phase 256 bit encryption to prevent output of the plurality of raw recordings in clear text.

28. The system of claim 16 , wherein the processor is further configured to

capture a technical attribute during the record the plurality of screen captures; and

predict a caption for each of the plurality of screen captures based on one or more of the technical attribute, historical references, and a standardized caption for each of the plurality of screen captures based on similar captions using natural language processing,

wherein the technical attribute includes one or more of a control ID, a control type, a control name, a class name, a control-data value, an x-path, a process name, a process ID, a process description, a name of the control business application, a name of a screen of the control business application.

29. The system of claim 16 , wherein the record the plurality of screen captures occurs across two or more computer monitors, wherein the two or more computer monitors comprise different resolutions, and wherein the record the plurality of screen captures includes adjusting a resolution of the plurality of raw recordings during the record to provide uniform resolution among screen captures from said two or more computer monitors.

30. The system of claim 16 , wherein the processor is further configured to

record A/V data associated with the plurality of screen captures during the record to generate a plurality of A/V raw recordings; and

adjust a playback rate of the plurality of A/V raw recordings to correspond to a playback rate of the plurality of raw recordings.

31. A non-transitory computer readable medium having instructions embodied thereon that, when executed by a processor, cause the processor to perform operations comprising:

recording a plurality of screen captures in real-time to generate a plurality of raw recordings, the plurality of screen captures occurring in series, and each of the plurality of screen captures occurring on a control business application;

generating, using the processor, a workflow data file based on the plurality of raw recordings, the workflow data file including a graphical representation of steps in a sequential order for performing a workflow process, the workflow data file being compatible with a workflow application;

capturing user-interaction based data during the recording of the plurality of screen captures; and

generating an operational metrics report for the workflow process based on said user-interaction based data to assist in establishing priority tasks within an automation roadmap of the workflow process,

wherein the operational metrics report includes one or more of workflow scope, workflow metrics, application inflight time, platform distribution, web distribution, windows distribution, mainframe distribution, a time-and-motion study,

wherein the user-interaction based data includes one or more of a click, a tab, a keystroke, mouse coordinates, a number of used-control applications, a number of used-control platforms, audio and video, and

wherein the workflow data file is further based on the user-interaction based data.

32. The non-transitory computer readable medium of claim 31 , wherein the operations further comprise

measuring a total number of hours taken to perform the workflow process according to the workflow data file; and

reporting the total number of hours in the operational metrics report.

33. The non-transitory computer readable medium of claim 31 , wherein

the operational metrics report further includes one or more of an automation complexity score, a feasibility score, and

the generating of the workflow data file includes using one or more of the automation complexity score, the feasibility score.

34. The non-transitory computer readable medium of claim 33 , wherein

said workflow scope comprises pre and post activities carried out by a user in order to execute a workflow;

said workflow metrics comprise mathematical indices that are automatically calculated including one or more of a count of business applications within the workflow, a number of hops between each application, a duration of the workflow before and after cleanup activities, a number of activities within the workflow before and after cleanup;

said application inflight time includes an identification of a platform and a time consumed by the user on a business application to identify a potential automation candidate application for consideration to be automated;

said platform distribution comprises an overall time consumed by the user on the platform;

said web distribution comprises a listing of applications that are web based;

said Windows distribution comprises a listing of applications that are windows based; and

said mainframe distribution comprises a listing of mainframe applications.

35. The non-transitory computer readable medium of claim 33 , wherein said automation complexity score and said feasibility score are calculated based on a plurality of attributes including one or more of a like automation ID, class name, xpath, cognitive computing required status, robotic processing automation status, structured nature of input format, count of inputs, percentage distribution of types of inputs, underlying technology and platform of business application, real time processing requirements, third party integration, annual volume, database/network access requirements within that workflow, need for standardization of workflow, natural language processing.

36. The non-transitory computer readable medium of claim 31 , wherein the operations further comprise

superimposing multiple graphical representations each corresponding to one of a plurality of linear workflows to generate a merged graphical representation of a common workflow;

identifying one or more activities that are common among said plurality of linear workflows; and

calculating a count of a frequency of occurrence of each activity that is common of said one or more activities among said plurality of linear workflows,

wherein said superimposing comprises superimposing one or more most-visited-paths to identify high-traffic routes of interactions to identify priority tasks in an automation roadmap.

37. The non-transitory computer readable medium of claim 31 , wherein the recording of the plurality of screen captures is selective.

38. The non-transitory computer readable medium of claim 31 , wherein

the workflow application is a diagramming and vector graphics application, and

the workflow data file is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

39. The non-transitory computer readable medium of claim 31 , wherein

the plurality of screen captures are each in an active-time window, and

the recording of the plurality of screen captures is paused if the active-time window is closed, and resumes if the active-time window is opened.

40. The non-transitory computer readable medium of claim 31 , wherein the operations further comprise automatically identifying activity that requires cognitive computing.

41. The non-transitory computer readable medium of claim 31 , wherein the operations further comprise generating source code for the workflow data file in at least one software language based on the plurality of raw recordings.

42. The non-transitory computer readable medium of claim 31 , wherein the generating of the workflow data file includes encrypting at rest each of the plurality of raw recordings or metadata of the plurality of raw recordings using 2-phase 256 bit encryption to prevent output of the plurality of raw recordings in clear text.

43. The non-transitory computer readable medium of claim 31 , wherein the operations further comprise

capturing a technical attribute during the recording of the plurality of screen captures; and

predicting a caption for each of the plurality of screen captures based on one or more of the technical attribute, historical references, a standardized caption for each of the plurality of screen captures based on similar captions using natural language processing,

wherein the technical attribute includes one or more of a control ID, a control type, a control name, a class name, a control-data value, an x-path, a process name, a process ID, a process description, a name of the control business application, a name of a screen of the control business application.

44. The non-transitory computer readable medium of claim 31 , wherein the recording of the plurality of screen captures occurs across two or more computer monitors, wherein the two or more computer monitors comprise different resolutions, and wherein the recording of the plurality of screen captures includes adjusting a resolution of the plurality of raw recordings during the recording to provide uniform resolution among screen captures from said two or more computer monitors.

45. The non-transitory computer readable medium of claim 31 , wherein the operations further comprise

recording A/V data associated with the plurality of screen captures during the recording to generate a plurality of A/V raw recordings; and

adjusting a playback rate of the plurality of A/V raw recordings to correspond to a playback rate of the plurality of raw recordings.