IP Library › Granted Patent US 11,541,548
Granted Patent B2
US 11,541,548 · App. 17/506,219 · Granted Jan 3, 2023

Artificial intelligence-based process identification, extraction, and automation for robotic process automation

Inventors: Prabhdeep Singh (Bellevue, WA); Christian Berg (Seattle, WA)
Assignee: UiPath, Inc.
B25J13/006G06F16/2379G06N3/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,541,548
App. No.
17/506,219
Filed
Oct 20, 2021
Granted
Jan 3, 2023
Kind
B2
Art Unit
2162
USPC
700/264
Abstract

Artificial intelligence (AI)-based process identification, extraction, and automation for robotic process automation (RPA) is disclosed. Listeners may be deployed to user computing systems to collect data pertaining to user actions. The data collected by the listeners may then be sent to one or more servers and be stored in a database. This data may be analyzed by AI layers to recognize patterns of user behavioral processes therein. These recognized processes may then be distilled into respective RPA workflows and deployed to automate the processes.

Claims (43)

1. A cloud robotic process automation (RPA) system, comprising:

one or more cloud computing systems configured to perform artificial intelligence (AI)-based process identification, extraction, and automation for RPA; and

a plurality of user computing systems comprising respective listener applications, the listener applications configured to generate logs comprising user interactions with respective user computing systems and send log data from the logs to the one or more cloud computing systems, wherein

the one or more cloud computing systems are configured to:

access log data collected from the listeners and run the log data through at least one AI layer, the at least one AI layer configured to process the log data and identify a potential RPA process therein, and

automatically generate an RPA workflow including the identified RPA process.

2. The cloud RPA system of claim 1 , wherein the one or more cloud computing systems are further configured to:

generate an RPA robot implementing the RPA workflow; and

push the generated RPA robot out to the user computing systems to be executed thereon.

3. The cloud RPA system of claim 1 , wherein the at least one AI layer comprises a sequence extraction layer, a clustering detection layer, a visual component detection layer, a text recognition layer, an audio-to-text translation layer, or any combination thereof.

4. The cloud RPA system of claim 1 , wherein

the one or more cloud computing systems comprise a conductor application, and

the log data is sent periodically to the conductor application by the listeners of the plurality of user computing systems as part of a heartbeat message.

5. The cloud RPA system of claim 1 , wherein the log data is sent to the one or more cloud computing systems once a predetermined amount of log data has been collected, after a predetermined time period has elapsed, or both.

6. The cloud RPA system of claim 1 , further comprising:

a database communicably coupled to the one or more cloud computing systems, wherein

the one or more cloud computing systems are configured to store the received log data from the listeners in the database.

7. The cloud RPA system of claim 1 , wherein the one or more cloud computing systems are further configured to:

determine similarities between the identified RPA process and a previously existing RPA process executed by an RPA robot on the user computing systems; and

replace an RPA workflow of the RPA robot executing the previously existing RPA process with the identified RPA process.

8. The cloud RPA system of claim 7 , wherein similarities between the identified RPA process and the previously existing RPA process are determined by a common beginning, a common end, and a predetermined amount of statistical commonality in steps taking in between in the RPA processes.

9. The cloud RPA system of claim 1 , wherein the listeners are configured to record where a user clicks on a screen and in which application, keystrokes, which button was clicked, instances of the user switching between applications, focus changes, that an email was sent and what the email pertains to, or any combination thereof.

10. The cloud RPA system of claim 1 , wherein the listeners are configured to determine which applications users of the user computing systems are using, what percentage of time the users are using a given application, which features within the applications the users are using, which features within the applications that the users are not using, or any combination thereof.

11. A computer program configured to perform artificial intelligence (AI)-based process identification, extraction, and automation for robotic process automation (RPA) embodied on a non-transitory computer-readable medium of a cloud computing system, the computer program configured to cause at least one processor to:

access log data collected via a cloud RPA system from respective listener applications of a plurality of user computing systems;

run the log data through at least one AI layer, the at least one AI layer configured to process the log data and identify a potential RPA process therein, and

automatically generate an RPA workflow including the identified RPA process.

12. The computer program of claim 11 , wherein the computer program is further configured to cause the at least one processor to:

generate an RPA robot implementing the RPA workflow; and

push the generated robot out to the user computing systems, via the cloud RPA system, to be executed thereon.

13. The computer program of claim 11 , wherein the at least one AI layer comprises a sequence extraction layer, a clustering detection layer, a visual component detection layer, a text recognition layer, an audio-to-text translation layer, or any combination thereof.

14. The computer program of claim 11 , wherein the computer program is further configured to cause the at least one processor to:

determine similarities between the identified RPA process and a previously existing RPA process executed by a robot on the user computing systems; and

replace an RPA workflow of the robot executing the previously existing RPA process with the identified RPA process, via the cloud RPA system.

15. The computer program of claim 11 , wherein similarities between the identified RPA process and the previously existing RPA process are determined by a common beginning, a common end, and a predetermined amount of statistical commonality in steps taking in between in the RPA processes.

16. A computer-implemented method for performing artificial intelligence (AI)-based process identification, extraction, and automation for robotic process automation (RPA), comprising:

generating, by a listener, a log comprising user interactions with a user computing system; and

sending log data from the log to one or more cloud computing systems of a cloud RPA system, by the listener, wherein

the log data comprises where a user clicks on a screen and in which application, keystrokes, which button was clicked, instances of the user switching between applications, focus changes, that an email was sent and what the email pertains to, or any combination thereof.

17. The computer-implemented method of claim 16 , wherein the log data is sent periodically to a conductor application of the one or more cloud computing systems, via the cloud RPA system, as part of a heartbeat message.

18. The computer-implemented method of claim 16 , wherein the log data is sent to the one or more cloud computing systems, via the cloud RPA system, once a predetermined amount of log data has been collected, after a predetermined time period has elapsed, or both.

19. The computer-implemented method of claim 16 , wherein the user interactions comprise which applications the user is using, what percentage of time the user is using a given application, which features within the applications the user is using, which features within the applications that the user is not using, or any combination thereof.

20. The computer-implemented method of claim 16 , wherein the user interactions comprise which features within the applications the user is using and which features within the applications that the user is not using.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2021
From: SINGH, PRABHDEEP; BERG, CHRISTIAN
To: UIPATH, INC.
Reel/Frame 057850/0497 →
Continuity (3)
Continuation 16707564 · Dec 9, 2019
Provisional Application 62915340 · Oct 15, 2019
Related Publication 20220032470A1 · Feb 3, 2022