IP Library › Granted Patent US 11,853,270
Granted Patent B2
US 11,853,270 · App. 16/917,861 · Granted Dec 26, 2023

Method and apparatus for visualizing a process map

Inventors: Oleksandr Reminnyi (Vinnytsia, UA); Nataliia Zasoba (Lviv, UA); Volodymyr Skalskyi (Vyshivka, UA); Christian Berg (Seattle, WA); Charles Park (Bellevue, WA); Dmitrii Leonidovich Kondratiuk (Kharkov, UA)
Assignee: UiPath, Inc.
G06F16/212G06F16/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,853,270
App. No.
16/917,861
Granted
Dec 26, 2023
Kind
B2
Abstract

A method for visualizing a process map is executed by a process map server. The method includes receiving a flowchart and a step-by-step recording related to a process. Generating a process map by combining the flowchart and the step-by-step recording and displaying the process map. The process map displays a task, step, and action related to the process. A detail window shows information associated with the process, and portions of the process, in response to user input. The action is based on information from the step-by-step recording.

Claims (62)

1. A method for visualizing a process as a process map, the method comprising:

receiving, at a process map server, a flowchart of the process;

receiving, at the process map server, a step-by-step recording of a user's input to a computer and images the computer displays while the user is performing the process;

generating, by the process map server, metadata based on computer vision analysis of the images;

generating, by the process map server, a process map by combining the flowchart and the step-by-step recording, the process map comprising at least one of the images and a mapping based on clustering of the generated metadata; and

displaying the process map on a display.

2. The method of claim 1 , wherein the displaying the process map comprises:

displaying a task associated with the process.

3. The method of claim 2 , wherein the displaying the process map comprises:

displaying a step associated with the task in response to selection of the task.

4. The method of claim 3 , wherein the displaying the process map comprises:

displaying an action associated with the step in response to selection of the step.

5. The method of claim 1 , further comprising:

receiving a petri net model of the process,

wherein the generating a process map further comprises combining the petri net model with the flowchart and the step-by-step recording.

6. The method of claim 1 , further comprising:

receiving a business process model/notation model of the process,

wherein the generating a process map further comprises combining the business process model/notation model with the flowchart and the step-by-step recording.

7. The method of claim 4 , further comprising:

receiving input requesting collapse of the process map displayed; and

collapsing the process map to display only tasks.

8. An apparatus comprising:

a processor; and

a memory to store computer program instructions, the computer program instructions when executed on the processor cause the processor to perform operations comprising:

receiving, at the processor, a flowchart related to a process;

receiving, at the processor, a step-by-step recording of a user's input to a computer and images the computer displays while the user is performing the process;

generating, by the processor, metadata based on computer vision analysis of the images;

generating, by the processor, a process map by combining the flowchart and the step-by-step recording, the process map comprising at least one of the images and a mapping based on clustering of the generated metadata; and

displaying the process map on a display.

9. The apparatus of claim 8 , wherein the displaying the process map comprises:

displaying a task associated with the process.

10. The apparatus of claim 9 , wherein the displaying the process map comprises:

displaying a step associated with the task in response to selection of the task.

11. The apparatus of claim 10 , wherein the displaying the process map comprises:

displaying an action associated with the step in response to selection of the step.

12. The apparatus of claim 8 , the operations further comprising:

receiving a petri net model of the process,

wherein the generating a process map further comprises combining the petri net model with the flowchart and the step-by-step recording.

13. The apparatus of claim 8 , the operations further comprising:

receiving a business process model/notation model of the process,

wherein the generating a process map further comprises combining the business process model/notation model with the flowchart and the step-by-step recording.

14. The apparatus of claim 11 , the operations further comprising:

receiving input requesting collapse of the process map displayed; and

collapsing the process map to display only tasks.

15. A non-transitory computer readable medium storing computer program instructions, which, when executed on a processor, cause the processor to perform operations comprising:

receiving, at the processor, a flowchart related to a process;

receiving, at the processor, a step-by-step recording of a user's input to a computer and images the computer displays while the user is performing the process;

generating, by the processor, metadata based on computer vision analysis of the images;

generating, by the processor, a process map by combining the flowchart and the step-by-step recording, the process map comprising at least one of the images and a mapping based on clustering of the generated metadata; and

displaying the process map on a display.

16. The non-transitory computer readable medium of claim 15 , wherein the displaying the process map comprises:

displaying a task associated with the process.

17. The non-transitory computer readable medium of claim 16 , wherein the displaying the process map comprises:

displaying a step associated with the task in response to selection of the task.

18. The non-transitory computer readable medium of claim 17 , wherein the displaying the process map comprises:

displaying an action associated with the step in response to selection of the step.

19. The non-transitory computer readable medium of claim 15 , the operations further comprising:

receiving a petri net model of the process,

wherein the generating a process map further comprises combining the petri net model with the flowchart and the step-by-step recording.

20. The non-transitory computer readable medium of claim 15 , the operations further comprising:

receiving a business process model/notation model of the process,

wherein the generating a process map further comprises combining the business process model/notation model with the flowchart and the step-by-step recording.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 4, 2020
From: BERG, CHRISTIAN
To: UIPATH, INC.
Reel/Frame 054263/0161 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2020
From: REMINNYI, OLEKSANDR; ZASOBA, NATALIIA; SKALSKYI, VOLODYMYR; PARK, CHARLES; KONDRATIUK, DMITRII LEONIDOVICH
To: UIPATH, INC.
Reel/Frame 053094/0375 →
Continuity (1)
Related Publication 20210406228A1 · Dec 30, 2021