Enhanced target selection for robotic process automation

1. A method comprising employing at least one hardware processor of a computer system to:

in response to receiving a robotic process automation (RPA) script indicating a target element of a target user interface (UI), automatically identify a runtime instance of the target element within a runtime UI exposed by the computer system; and

automatically carry out an operation that reproduces a result of an interaction of a human operator with the runtime instance of the target element, the operation determined according to the RPA script;

wherein automatically identifying the runtime instance of the target element comprises:

determining according to the RPA script whether a multiplicity flag is set;

in response, when the multiplicity flag is set, searching for the runtime instance of the target element within multiple windows exposed by the runtime UI; and

when the multiplicity flag is not set, searching for the runtime instance of the target element within a single window exposed by the runtime UI.

2. The method of claim 1 , wherein:

the RPA script indicates the target element via an element ID comprising a plurality of attribute-value pairs collectively characterizing the target element;

the multiplicity flag comprises a selected attribute-value pair of the element ID; and

wherein the method comprises determining whether the multiplicity flag is set according to a value of an attribute of the selected attribute-value pair.

3. The method of claim 2 , further comprising selecting the single window from a plurality of windows exposed by the runtime UI according to at least one of the plurality of attribute-value pairs.

4. The method of claim 2 , wherein the value indicates a count of the multiple windows to be searched for the runtime instance of the target element.

5. The method of claim 2 , wherein the element ID includes a first set of attribute-value pairs characterizing a window displaying the target element, and a second set of attribute-value pairs characterizing a content of the window, and wherein searching for the runtime instance of the target element comprises:

selecting a candidate window exposed by the runtime UI according to the first set of attribute-value pairs;

selecting a candidate UI element displayed within the candidate window;

determining whether attribute-value pairs characterizing the candidate element matches the second set of attribute-value pairs; and

in response, when yes, identifying the candidate element as the runtime instance of the target element.

6. The method of claim 1 , wherein the interaction comprises an item selected from a group consisting of performing a mouse click on the runtime instance of the target element, pressing a specific combination of keyboard keys, writing a sequence of characters into the runtime instance of the target element, grabbing an on-screen image of the runtime instance of the target element, and grabbing a text displayed by the runtime instance of the target element.

7. The method of claim 1 , wherein the target element comprises an item selected from a group consisting of a UI window, a menu, a button, a text area, and a form field.

8. A computer system comprising at least one hardware processor configured to:

in response to receiving a robotic process automation (RPA) script indicating a target element of a target user interface (UI), automatically identify a runtime instance of the target element within a runtime UI exposed by the computer system; and

automatically carry out an operation that reproduces a result of an interaction of a human operator with the runtime instance of the target element, the operation determined according to the RPA script;

wherein automatically identifying the runtime instance of the target element comprises:

determining according to the RPA script whether a multiplicity flag is set;

in response, when the multiplicity flag is set, searching for the runtime instance of the target element within multiple windows exposed by the runtime UI; and

when the multiplicity flag is not set, searching for the runtime instance of the target element within a single window exposed by the runtime UI.

9. The computer system of claim 8 , wherein:

the RPA script indicates the target element via an element ID comprising a plurality of attribute-value pairs collectively characterizing the target element;

the multiplicity flag comprises a selected attribute-value pair of the element ID; and

wherein the at least one hardware processor is configured to determine whether the multiplicity flag is set according to a value of an attribute of the selected attribute-value pair.

10. The computer system of claim 9 , wherein the at least one hardware processor is configured to select the single window from a plurality of windows exposed by the runtime UI according to at least one of the plurality of attribute-value pairs.

11. The computer system of claim 9 , wherein the value indicates a count of the multiple windows to be searched for the runtime instance of the target element.

12. The computer system of claim 9 , wherein the element ID includes a first set of attribute-value pairs characterizing a window displaying the target element, and a second set of attribute-value pairs characterizing a content of the window, and wherein searching for the runtime instance of the target element comprises:

selecting a candidate window exposed by the runtime UI according to the first set of attribute-value pairs;

selecting a candidate UI element displayed within the candidate window;

determining whether attribute-value pairs characterizing the candidate element matches the second set of attribute-value pairs; and

in response, when yes, identifying the candidate element as the runtime instance of the target element.

13. The computer system of claim 8 , wherein the interaction comprises an item selected from a group consisting of performing a mouse click on the runtime instance of the target element, pressing a specific combination of keyboard keys, writing a sequence of characters into the runtime instance of the target element, grabbing an on-screen image of the runtime instance of the target element, and grabbing a text displayed by the runtime instance of the target element.

14. The computer system of claim 8 , wherein the target element comprises an item selected from a group consisting of a UI window, a menu, a button, a text area, and a form field.

15. A non-transitory computer-readable medium storing instructions which, when executed by at least one hardware processor of a computer system, cause the computer system to:

in response to receiving a robotic process automation (RPA) script indicating a target element of a target user interface (UI), automatically identify a runtime instance of the target element within a runtime UI exposed by the computer system; and

automatically carry out an operation that reproduces a result of an interaction of a human operator with the runtime instance of the target element, the operation determined according to the RPA script;

wherein automatically identifying the runtime instance of the target element comprises:

determining according to the RPA script whether a multiplicity flag is set;

in response, when the multiplicity flag is set, searching for the runtime instance of the target element within multiple windows exposed by the runtime UI; and

when the multiplicity flag is not set, searching for the runtime instance of the target element within a single window exposed by the runtime UI.

16. A computer system comprising at least one hardware processor configured to:

expose a robot design interface to a user, the robot design interface configured to receive a user input indicating a target element of a target user interface (UI) and to expose a control enabling the user to set a multiplicity flag associated with the target element; and

output a robotic process automation (RPA) script comprising a specification of an RPA robot configured to carry out an operation that reproduces a result of an interaction of a human operator with a runtime instance of the target element, the RPA script including the multiplicity flag;

wherein executing the RPA robot on an RPA client causes the RPA client to:

determine according to the RPA script whether the multiplicity flag is set;

in response, when the multiplicity flag is set, search for the runtime instance of the target element within multiple windows of a runtime UI exposed by the RPA client machine; and

when the multiplicity flag is not set, search for the runtime instance of the target element within a single window of the runtime UI.