IP Library Granted Patent US 11,537,497
Granted Patent B2
US 11,537,497 · App. 16/535,884 · Granted Dec 27, 2022

Systems and methods for merging and aggregation of workflow processes

Inventors: Ashok Balasubramanian (Chennai, IN); Girish Chhabra (Maharashtra, IN); Karthikeyan Krishnaswamy Raja (Chennai, IN); Swapnil Shankar Jadhao (Maharashtra, IN); Mohammad Hamza Ansari (Maharashtra, IN)
Assignee: ATOS FRANCE
G06F11/3447G06F8/30G06F9/451G06F11/3423G06F11/3438G06F11/3452G06F21/602G06F40/30G06N20/00G06Q10/0633G06V10/751H04L9/065G11B27/005H04N5/76
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,537,497
App. No.
16/535,884
Granted
Dec 27, 2022
Kind
B2
Abstract

System and method for merging and aggregation of workflow processes by recording a series of screen captures in real-time that can assist in capturing the steps for completing the business workflow process across one or more business applications in a workflow data file. The workflow data file includes a graphical representation of the steps in a sequential order for performing the business workflow process. The workflow data file is compatible with a workflow application.

Claims (121)

1. A method of generating a workflow process using a plurality of screen captures, the method comprising:

recording the plurality of screen captures in real-time to generate a plurality of raw recordings, the plurality of screen captures occurring in series, and each of the plurality of screen captures occurring on a control business application;

generating, using a processor, a workflow data file based on the plurality of raw recordings, the workflow data file including a graphical representation of steps in a sequential order for performing the workflow process, the workflow data file being compatible with a workflow application,

wherein the recording of the plurality of screen captures generates a first set of raw recordings from among the plurality of raw recordings and at least a second set of raw recordings from among the plurality of raw recordings,

wherein the generating of the workflow data file includes

generating a first graphical representation based on the first set of

raw recordings,

generating at least a second graphical representation based on the second set of raw recordings, and

superimposing the first graphical representation and each of the at least the second graphical representation to generate a merged graphical representation; and,

generating an operational metrics report for the workflow process to assist in establishing priority tasks within an automation roadmap of the workflow process,

wherein the operational metrics report displays common

steps in the workflow data file and in at least a second workflow data file that are frequently performed to complete the workflow process,

wherein the operational metrics report comprises one or more of

metadata of the workflow process,

technology stacks of applications in the workflow process,

a time and motion study for the common steps in the workflow process, and

technology and usage metrics of the applications in the workflow process.

2. The method of claim 1 , wherein said superimposing comprises superimposing one or more most-visited-paths to identify high-traffic routes of interactions to identify the priority tasks in the automation roadmap.

3. The method of claim 1 , wherein the merged graphical representation is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

4. The method of claim 1 , wherein

the generating of the workflow data file further includes generating at least one swimlane placeholder in the workflow data file, and

each of the at least one swimlane placeholder represents one selected from a group consisting of the workflow application, a workflow platform, a department and a user role.

5. The method of claim 1 , wherein

in the merged graphical representation, a first workflow path of the first graphical representation and at least a second workflow path of the at least the second graphical representation are each selectively displayable from a merged workflow path, and

the merged workflow path is a combination of the first workflow path and the at least the second workflow path.

6. The method of claim 1 , wherein

the workflow application is a diagramming and vector graphics application, and

the workflow data file is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

7. The method of claim 1 , wherein

the plurality of screen captures are each in an active-time window, and

the recording of the plurality of screen captures is paused if the active-time window is closed, and resumes if the active-time window is opened.

8. The method of claim 1 , further comprising automatically identifying activity that requires cognitive computing.

9. The method of claim 1 , further comprising: generating source code for the workflow data file in at least one software language based on the plurality of raw recordings.

10. The method of claim 1 , wherein the generating of the workflow data file includes encrypting at rest each of the plurality of raw recordings or metadata of the plurality of raw recordings using 2-phase 256 bit encryption to prevent output of the plurality of raw recordings in clear text.

11. The method of claim 1 , further comprising:

capturing a technical attribute during the recording of the plurality of screen captures; and

predicting a caption for each of the plurality of screen captures based on one or more of the technical attribute, historical references, and a standardized caption for each of the plurality of screen captures based on similar captions using natural language processing,

wherein the technical attribute includes at least one of a control ID, a control type, a control name, a class name, a control-data value, an x-path, a process name, a process ID, a process description, a name of the control business application and a name of a screen of the control business application.

12. The method of claim 1 , wherein the recording of the plurality of screen captures occurs across two or more computer monitors, wherein the two or more computer monitors comprise different resolutions, and wherein the recording of the plurality of screen captures includes adjusting a resolution of the plurality of raw recordings during the recording to provide uniform resolution among screen captures from said two or more computer monitors.

13. The method of claim 1 , further comprising:

recording A/V data associated with the plurality of screen captures during the recording to generate a plurality of A/V raw recordings; and

adjusting a playback rate of the plurality of A/V raw recordings to correspond to a playback rate of the plurality of raw recordings.

14. A system for generating a workflow process using a plurality of screen captures, the system comprising:

a recorder configured to record, in real-time, the plurality of screen captures and to generate a plurality of raw recordings from the plurality of screen captures that are recorded, wherein the plurality of screen captures occur in series, and each of the plurality of screen captures occur on a control business application;

a processor configured to generate a workflow data file based on the plurality of raw recordings, the workflow data file including a graphical representation of steps in a sequential order for performing the workflow process, the workflow data file being compatible with a workflow application; and

a process aggregator configured to superimpose or merge related workflow data files, and to compare a control of a workflow with other controls of peer workflows to generate the workflow process,

wherein the record the plurality of screen captures is performed without interacting with the control business application,

wherein the recorder is further configured to record the plurality of screen captures generates a first set of raw recordings from among the plurality of raw recordings and at least a second set of raw recordings from among the plurality of raw recordings wherein to generate of the workflow data file the processor is further configured to

generate a first graphical representation based on the first set of raw recordings,

generate at least a second graphical representation based on the second set of raw recordings, and superimpose the first graphical representation and each of the at least the second graphical representation to generate a merged graphical representation, and

wherein the processor is further configured to generate an operational metrics report for the workflow process to assist in establishing priority tasks within an automation roadmap of the workflow process,

wherein the operational metrics report displays common steps in the workflow data file and in at least a second workflow data file that are frequently performed to complete the workflow process,

wherein the operational metrics report comprises one or more of

metadata of the workflow process,

technology stacks of applications in the workflow process,

a time and motion study for the common steps in the workflow process, and

technology and usage metrics of the applications in the workflow process.

15. The system of claim 14 , wherein said superimpose comprises superimposing one or more most-visited-paths to identify high-traffic routes of interactions to identify the priority tasks in the automation roadmap.

16. The system of claim 14 , wherein the merged graphical representation is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

17. The system of claim 14 , wherein

the processor is further configured to generate the workflow data file by generating at least one swimlane placeholder in the workflow data file, and

each of the at least one swimlane placeholder represents one selected from a group consisting of the workflow application, a workflow platform, a department and a user role.

18. The system of claim 14 , wherein

in the merged graphical representation, a first workflow path of the first graphical representation and at least a second workflow path of the at least the second graphical representation are each selectively displayable from a merged workflow path, and

the merged workflow path is a combination of the first workflow path and the at least the second workflow path.

19. The system of claim 14 , wherein

the workflow application is a diagramming and vector graphics application, and

the workflow data file is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

20. The system of claim 14 , wherein

the plurality of screen captures are each in an active-time window, and

the record of the plurality of screen captures is paused if the active-time window is closed, and resumes if the active-time window is opened.

21. The system of claim 14 , further comprising automatically identifying activity that requires cognitive computing.

22. The system of claim 14 , wherein the processor is further configured to generate source code for the workflow data file in at least one software language based on the plurality of raw recordings.

23. The system of claim 14 , wherein the generate of the workflow data file includes encrypting at rest each of the plurality of raw recordings or metadata of the plurality of raw recordings using 2-phase 256 bit encryption to prevent output of the plurality of raw recordings in clear text.

24. The system of claim 14 , wherein the processor is further configured to capture a technical attribute during the record of the plurality of screen captures; and

predict a caption for each of the plurality of screen captures based on one or more of the technical attribute, historical references, and a standardized caption for each of the plurality of screen captures based on similar captions using natural language processing,

wherein the technical attribute includes at least one of a control ID, a control type, a control name, a class name, a control-data value, an x-path, a process name, a process ID, a process description, a name of the control business application and a name of a screen of the control business application.

25. The system of claim 14 , wherein the recorder is further configured to record the plurality of screen captures occurring across two or more computer monitors, wherein the two or more computer monitors comprise different resolutions, and wherein the record of the plurality of screen captures includes adjusting a resolution of the plurality of raw recordings during the record to provide uniform resolution among screen captures from said two or more computer monitors.

26. The system of claim 14 , wherein the recorder is further configured to

record A/V data associated with the plurality of screen captures during the record to generate a plurality of A/V raw recordings; and

adjust a playback rate of the plurality of A/V raw recordings to correspond to a playback rate of the plurality of raw recordings.

27. A non-transitory computer readable medium having instructions embodied thereon that, when executed by a processor, cause the processor to perform operations comprising:

recording a plurality of screen captures in real-time to generate a plurality of raw recordings, the plurality of screen captures occurring in series, and each of the plurality of screen captures occurring on a control business application; and

generating, using the processor, a workflow data file based on the plurality of raw recordings, the workflow data file including a graphical representation of steps in a sequential order for performing a workflow process, the workflow data file being compatible with a workflow application,

wherein the recording of the plurality of screen captures generates a first set of raw recordings from among the plurality of raw recordings and at least a second set of raw recordings from among the plurality of raw recordings,

wherein the generating of the workflow data file includes

generating a first graphical representation based on the first set of raw recordings,

generating at least a second graphical representation based on the second set of raw recordings, and

superimposing the first graphical representation and each of the at least the second graphical representation to generate a merged graphical representation, and

generating an operational metrics report for the workflow process to assist in establishing priority tasks within an automation roadmap of the workflow process,

wherein the operational metrics report displays common steps in the workflow data file and in at least a second workflow data file that are frequently performed to complete the workflow process,

wherein the operational metrics report comprises one or more of

metadata of the workflow process,

technology stacks of applications in the workflow process,

a time and motion study for the common steps in the workflow process, and

technology and usage metrics of the applications in the workflow process.

28. The non-transitory computer readable medium of claim 27 , wherein said superimposing comprises superimposing one or more most-visited-paths to identify high-traffic routes of interactions to identify the priority tasks in the automation roadmap.

29. The non-transitory computer readable medium of claim 27 , wherein the merged graphical representation is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

30. The non-transitory computer readable medium of claim 27 , wherein

said generating of the workflow data file further includes generating at least one swimlane placeholder in the workflow data file, and

each of the at least one swimlane placeholder represents one selected from a group consisting of the workflow application, a workflow platform, a department and a user role.

31. The non-transitory computer readable medium of claim 27 , wherein

in the merged graphical representation, a first workflow path of the first graphical representation and at least a second workflow path of the at least the second graphical representation are each selectively displayable from a merged workflow path, and

the merged workflow path is a combination of the first workflow path and the at least the second workflow path.

32. The non-transitory computer readable medium of claim 27 , wherein

the workflow application is a diagramming and vector graphics application, and

the workflow data file is in a .bpmn format, a .vsd file format, a vsdx. file format, a .vsdm file format, or a .vdx file format.

33. The non-transitory computer readable medium of claim 27 , wherein

the plurality of screen captures are each in an active-time window, and

the recording of the plurality of screen captures is paused if the active-time window is closed, and resumes if the active-time window is opened.

34. The non-transitory computer readable medium of claim 27 , wherein the operations further comprise automatically identifying activity that requires cognitive computing.

35. The non-transitory computer readable medium of claim 27 , wherein the operations further comprise generating source code for the workflow data file in at least one software language based on the plurality of raw recordings.

36. The non-transitory computer readable medium of claim 27 , wherein the generating of the workflow data file includes encrypting at rest each of the plurality of raw recordings or metadata of the plurality of raw recordings using 2-phase 256 bit encryption to prevent output of the plurality of raw recordings in clear text.

37. The non-transitory computer readable medium of claim 27 , wherein the operations further comprise:

capturing a technical attribute during the recording of the plurality of screen captures; and

predicting a caption for each of the plurality of screen captures based on one or more of the technical attribute, historical references, and a standardized caption for each of the plurality of screen captures based on similar captions using natural language processing,

wherein the technical attribute includes at least one of a control ID, a control type, a control name, a class name, a control-data value, an x-path, a process name, a process ID, a process description, a name of the control business application and a name of a screen of the control business application.

38. The non-transitory computer readable medium of claim 27 , wherein the recording of the plurality of screen captures occurs across two or more computer monitors, wherein the two or more computer monitors comprise different resolutions, and wherein the recording of the plurality of screen captures includes adjusting a resolution of the plurality of raw recordings during the recording to provide uniform resolution among screen captures from said two or more computer monitors.

39. The non-transitory computer readable medium of claim 27 , wherein the operations further comprise:

recording A/V data associated with the plurality of screen captures during the recording to generate a plurality of A/V raw recordings; and

adjusting a playback rate of the plurality of A/V raw recordings to correspond to a playback rate of the plurality of raw recordings.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2022
From: ATOS SYNTEL INC
To: ATOS FRANCE
Reel/Frame 060790/0031 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE SHOULD READ AS "BUSINESS DISTRIBUTION AGREEMENT" PREVIOUSLY RECORDED AT REEL: 055648 FRAME: 0710. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 7, 2022
From: SYNTEL, INC.
To: ATOS SYNTEL INC.
Reel/Frame 060614/0231 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2021
From: SYNTEL, INC.
To: ATOS SYNTEL INC.
Reel/Frame 055648/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2019
From: BALASUBRAMANIAN, ASHOK; CHHABRA, GIRISH; RAJA, KARTHIKEYAN KRISHNASWAMY; JADHAO, SWAPNIL SHANKAR; ANSARI, MOHAMMAD HAMZA
To: ATOS SYNTEL, INC.
Reel/Frame 050064/0775 →
Continuity (2)
Provisional Application 62716069 · Aug 8, 2018
Related Publication 20200050528A1 · Feb 13, 2020