Granted Patent B2

US 12,353,857 · App. 18/498,247 · Granted Jul 8, 2025

Inventor: Mircea Grigore (Bucharest, RO)

Assignee: UiPath, Inc.

G06F8/38G06F8/34G06F9/451

Abstract

Claims (58)

1. A non-transitory computer-readable medium storing a computer program, the computer program configured to cause at least one processor to:

scan a set of projects in a user interface (UI) object repository for one or more robotic process automation (RPA) processes that are using one or more UI descriptors that belong to an application;

detect the one or more RPA processes in the scanned projects that are using the one or more UI descriptors referenced in one or more respective activities of an RPA workflow; and

automatically update at least one of the one or more UI descriptors in the RPA workflows of the one or more detected RPA processes with one or more respective UI descriptors that belong to the application and another application version, wherein

the RPA workflow comprises a plurality of activities that comprise the one or more activities, and

the activities are a set of steps developed in the workflow.

2. The non-transitory computer-readable medium of claim 1 , wherein the computer program is further configured to cause the at least one processor to:

extract at least one UI descriptor from the RPA workflow; and

add the extracted at least one UI descriptor to a structured schema that groups the one or more UI descriptors by UI applications, screens, and graphical elements of the UI.

3. The non-transitory computer-readable medium of claim 1 , wherein

the one or more UI descriptors identify respective graphical elements in the UI for the respective activities in the RPA workflow at runtime,

the UI object repository comprises a plurality of UI descriptors corresponding to one or more screens from multiple application versions of an application, and

the plurality of UI descriptors comprise a UI element selector, an anchor selector, a computer vision (CV) descriptor, a unified target descriptor, a screen image capture, a graphical element image capture, or any combination thereof.

4. The non-transitory computer-readable medium of claim 1 , wherein the one or more UI descriptors are called via one or more web services.

5. The non-transitory computer-readable medium of claim 1 , wherein the RPA workflow comprises a selector-based identification activity, a computer vision (CV)-based identification activity, a unified target identification activity, an image matching identification activity, a selector and optical character recognition (OCR)-based identification activity, or a combination thereof.

6. The non-transitory computer-readable medium of claim 1 , wherein

the UI object repository comprises one or more UI object libraries, and

at least one of the one or more UI object libraries is an encapsulation of UI descriptors grouped by applications, application versions, and screens.

7. The non-transitory computer-readable medium of claim 1 , wherein an application shown in the UI is a web application and the one or more UI descriptors comprise HyperText Markup Language (HTML) paths to the respective graphical elements for the one or more corresponding UI descriptors.

8. A computing system, comprising:

memory storing computer program instructions; and

at least one processor configured to execute the computer program instructions, wherein the computer program instructions are configured to cause the at least one processor to:

scan a set of projects in a user interface (UI) object repository for one or more robotic process automation (RPA) processes that are using one or more UI descriptors that belong to an application;

detect the one or more RPA processes in the scanned projects that are using the one or more UI descriptors referenced in one or more respective activities of an RPA workflow; and

automatically update at least one of the one or more UI descriptors in the RPA workflows of the one or more detected RPA processes with one or more respective UI descriptors that belong to the application and another application version, wherein

the RPA workflow comprises a plurality of activities that comprise the one or more activities, and

the activities are a set of steps developed in the workflow.

9. The computing system of claim 8 , wherein the computer program instructions are further configured to cause the at least one processor to:

extract at least one UI descriptor from the RPA workflow; and

add the extracted at least one UI descriptor to a structured schema that groups the one or more UI descriptors by UI applications, screens, and graphical elements of the UI.

10. The computing system of claim 8 , wherein

the one or more UI descriptors identify respective graphical elements in the UI for the respective activities in the RPA workflow at runtime,

the UI object repository comprises a plurality of UI descriptors corresponding to one or more screens from multiple application versions of an application, and

the plurality of UI descriptors comprise a UI element selector, an anchor selector, a computer vision (CV) descriptor, a unified target descriptor, a screen image capture, a graphical element image capture, or any combination thereof.

11. The computing system of claim 8 , wherein the one or more UI descriptors are called via one or more web services.

12. The computing system of claim 8 , wherein the RPA workflow comprises a selector-based identification activity, a computer vision (CV)-based identification activity, a unified target identification activity, an image matching identification activity, a selector and optical character recognition (OCR)-based identification activity, or a combination thereof.

13. The computing system of claim 8 , wherein

the UI object repository comprises one or more UI object libraries, and

at least one of the one or more UI object libraries is an encapsulation of UI descriptors grouped by applications, application versions, and screens.

14. The computing system of claim 8 , wherein an application shown in the UI is a web application and the one or more UI descriptors comprise HyperText Markup Language (HTML) paths to the respective graphical elements for the one or more corresponding UI descriptors.

15. A computer-implemented method, comprising:

scanning a set of projects in a user interface (UI) object repository for one or more robotic process automation (RPA) processes that are using one or more UI descriptors that belong to an application, by a computing system;

detecting the one or more RPA processes in the scanned projects that are using the one or more UI descriptors referenced in one or more respective activities of an RPA workflow, by the computing system; and

automatically updating at least one of the one or more UI descriptors in the RPA workflows of the one or more detected RPA processes with one or more respective UI descriptors that belong to the application and another application version, by the computing system, wherein

the one or more UI descriptors identify respective graphical elements in the UI for the respective activities in the RPA workflow at runtime,

the UI object repository comprises a plurality of UI descriptors corresponding to one or more screens from multiple application versions of an application,

the plurality of UI descriptors comprise a UI element selector, an anchor selector, a computer vision (CV) descriptor, a unified target descriptor, a screen image capture, a graphical element image capture, or any combination thereof,

the RPA workflow comprises a plurality of activities that comprise the one or more activities, and

the activities are a set of steps developed in the workflow.

16. The computer-implemented method of claim 15 , further comprising:

extracting at least one UI descriptor from the RPA workflow, by the computing system; and

adding the extracted at least one UI descriptor, by the computing system, to a structured schema that groups the one or more UI descriptors by UI applications, screens, and graphical elements of the UI.

17. The computer-implemented method of claim 15 , wherein the one or more UI descriptors are called via one or more web services.

18. The computer-implemented method of claim 15 , wherein the RPA workflow comprises a selector-based identification activity, a computer vision (CV)-based identification activity, a unified target identification activity, an image matching identification activity, a selector and optical character recognition (OCR)-based identification activity, or a combination thereof.

19. The computer-implemented method of claim 15 , wherein

the UI object repository comprises one or more UI object libraries, and

at least one of the one or more UI object libraries is an encapsulation of UI descriptors grouped by applications, application versions, and screens.

20. The computer-implemented method of claim 15 , wherein an application shown in the UI is a web application and the one or more UI descriptors comprise HyperText Markup Language (HTML) paths to the respective graphical elements for the one or more corresponding UI descriptors.

Assignments (1)

Continuity (3)

References Cited (57)