IP Library Granted Patent US 12,468,557
Granted Patent B2
US 12,468,557 · App. 17/341,534 · Granted Nov 11, 2025

Web-based robotic process automation designer systems and automations for virtual machines, sessions, and containers

Inventor: Mircea Grigore (Bucharest, RO)
Assignee: UiPath, Inc.
G06F9/451G06F8/35G06F9/45558G06F16/95G06Q10/06316G06F2009/45591G06F2009/45595
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,468,557
App. No.
17/341,534
Granted
Nov 11, 2025
Kind
B2
Abstract

Web-based robotic process automation (RPA) designer systems that allow RPA developers to design and implement web serverless automations, user interface (UI) automations, and other automations are disclosed. Such web-based RPA designer systems may allow a developer to sign in through the cloud and obtain a list of template projects, developer-designed projects, services, activities, etc. Thus, RPA development may be centralized and cloud-based, reducing the local processing and memory requirements on a user's computing system and centralizing RPA designer functionality, enabling better compliance. Automations generated by the web-based RPA designer systems may be deployed and executed in virtual machines (VMs), containers, or operating system sessions.

Claims (51)

1 . A system, comprising:

a developer computing system comprising a web browser; and

a development server providing a web-based robotic process automation (RPA) designer application, the web-based RPA designer application configured to facilitate creation and configuration of RPA workflows by a user, wherein

the web-based RPA designer application is configured to cause the web browser to:

download code for the web-based RPA designer application, the downloaded code comprising executable binaries for automation functionality,

load the executable binaries into a tab of the web browser,

display a web interface for the web-based RPA designer application in the tab of the web browser, the web interface configured to provide functionality for the user to create RPA projects and configure RPA workflows,

generate an automation for a configured RPA workflow in the web browser, and

execute and validate the generated automation in the web browser using a browser worker process.

2 . The system of claim 1 , wherein code for executing and validating the generated automation is included in the downloaded code.

3 . The system of claim 1 , wherein the downloaded code is executed as part of a same tab of the web browser as the web interface of the web-based designer application.

4 . The system of claim 1 , wherein the generated automation is configured to be executed at runtime without an RPA robot.

5 . The system of claim 1 , wherein the generated automation is configured to be executed by a production RPA robot at runtime remotely in an operating system session, a virtual machine (VM), or a container.

6 . The system of claim 1 , wherein the generated automation is configured to be executed by a production web browser at runtime remotely in an operating system session, a virtual machine (VM), or a container.

7 . The system of claim 1 , wherein the web-based RPA designer application is configured to retrieve user interface (UI) elements organized according to a taxonomy from a UI object repository.

8 . The system of claim 7 , wherein the UI object repository comprises applications, screens, UI elements, and UI descriptors organized such that the applications group screens, the screens group UI elements, and the UI descriptors enable location of and interaction with the UI elements.

9 . The system of claim 1 , wherein the generated automation is a serverless automation.

10 . The system of claim 1 , wherein the web-based RPA designer application is configured to provide a canvas that facilitates creation and modification of RPA workflows.

11 . The system of claim 1 , wherein the web-based RPA designer application is configured to provide options for how an automation will start.

12 . The system of claim 1 , wherein the web-based RPA designer application is configured to display an empty activity and provide activity categories and actions when a user clicks the empty activity.

13 . The system of claim 1 , wherein the web-based RPA designer application is configured to provide activity configuration options based on a type of the activity.

14 . The system of claim 1 , wherein the web-based RPA designer application is configured to prevent users from publishing or running automations with static code analysis errors in accordance with governance rules.

15 . The system of claim 1 , wherein when the generated automation fails validation, the web-based RPA designer application is configured to require correction of validation errors or compliance with governance rules before publishing the generated automation to a production environment.

16 . A non-transitory computer-readable medium storing a computer program, the computer program configured to cause at least one processor to:

download code for a web-based robotic process automation (RPA) designer application to a web browser, the web-based RPA designer application configured to facilitate creation and configuration of RPA workflows by a user, the downloaded code comprising executable binaries for automation functionality;

load the executable binaries into a tab of the web browser;

display a web interface for the web-based RPA designer application in the tab of the web browser, the web interface configured to provide functionality for the user to create RPA projects and configure RPA workflows;

generate an automation for a configured RPA workflow in the web browser; and

execute and validate the generated automation in the web browser using a browser worker process.

17 . The non-transitory computer-readable medium of claim 16 , wherein code for executing and validating the generated automation is included in the downloaded code.

18 . The non-transitory computer-readable medium of claim 16 , wherein the downloaded code is executed as part of a same tab of the web browser as the web interface of the web-based designer application.

19 . The non-transitory computer-readable medium of claim 16 , wherein the generated automation is configured to be executed at runtime without an RPA robot.

20 . The non-transitory computer-readable medium of claim 16 , wherein the generated automation is configured to be executed by a production RPA robot at runtime remotely in an operating system session, a virtual machine (VM), or a container.

21 . The non-transitory computer-readable medium of claim 16 , wherein the generated automation is configured to be executed by a production web browser at runtime remotely in an operating system session, a virtual machine (VM), or a container.

22 . The non-transitory computer-readable medium of claim 16 , wherein the web-based RPA designer application is configured to prevent users from publishing or running automations with static code analysis errors in accordance with governance rules.

23 . The non-transitory computer-readable medium of claim 16 , wherein when the generated automation fails validation, the web-based RPA designer application is configured to require correction of validation errors or compliance with governance rules before publishing the generated automation to a production environment.

24 . A computer-implemented method, comprising:

downloading code for a web-based robotic process automation (RPA) designer application to a web browser, by a computing system, the web-based RPA designer application configured to facilitate creation and configuration of RPA workflows by a user, the downloaded code comprising executable binaries for automation functionality;

loading the executable binaries into a tab of the web browser, by the computing system;

displaying a web interface for the web-based RPA designer application in the tab of the web browser, by the computing system, the web interface configured to provide functionality for the user to create RPA projects and configure RPA workflows;

generating an automation for a configured RPA workflow in the web browser, by the computing system; and

executing and validating the generated automation in the web browser using a browser worker process, by the computing system, wherein

code for executing and validating the generated automation is included in the downloaded code.

25 . The computer-implemented method of claim 24 , wherein the downloaded code is executed as part of a same tab of the web browser as the web interface of the web-based designer application.

26 . The computer-implemented method of claim 24 , wherein the generated automation is configured to be executed at runtime without an RPA robot.

27 . The computer-implemented method of claim 24 , wherein the generated automation is configured to be executed by a production RPA robot at runtime remotely in an operating system session, a virtual machine (VM), or a container.

28 . The computer-implemented method of claim 24 , wherein the generated automation is configured to be executed by a production web browser at runtime remotely in an operating system session, a virtual machine (VM), or a container.

29 . The computer-implemented method of claim 24 , further comprising:

preventing users from publishing or running automations with static code analysis errors in accordance with governance rules, by the web-based RPA designer application.

30 . The computer-implemented method of claim 24 , further comprising:

requiring correction of validation errors or compliance with governance rules before publishing the generated automation to a production environment, by the web-based RPA designer application.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2021
From: GRIGORE, MIRCEA
To: UIPATH, INC.
Reel/Frame 056464/0556 →
Continuity (2)
Continuation 17340603 · Jun 7, 2021
Related Publication 20220391226A1 · Dec 8, 2022
References Cited (109)
US 5754857A · Gadol · 1998 [cited by examiner]
US 7921372B2 · Sauve et al. · 2011 [cited by applicant]
US 8170901B2 · Shukla et al. · 2012 [cited by applicant]
US 9081595B1 · Delarue et al. · 2015 [cited by applicant]
US 9135151B2 · Betak et al. · 2015 [cited by applicant]
US 9905266B1 · Yen · 2018 [cited by examiner]
US 10846153B2 · Balasubramanian et al. · 2020 [cited by applicant]
US 10958732B1 · Procopio · 2021 [cited by applicant]
US 11100922B1 · Mutagi et al. · 2021 [cited by applicant]
US 11215961B2 · Mehrotra · 2022 [cited by examiner]
US 11301224B1 · Dabhi et al. · 2022 [cited by applicant]
US 20040107415A1 · Melamed · 2004 [cited by examiner]
US 20060069605A1 · Hatoun · 2006 [cited by examiner]
US 20060155740A1 · Chen et al. · 2006 [cited by applicant]
US 20070006153A1 · Sultan · 2007 [cited by applicant]
US 20070150805A1 · Misovski · 2007 [cited by examiner]
US 20080195936A1 · White · 2008 [cited by examiner]
US 20110028145A1 · Marsyla et al. · 2011 [cited by applicant]
US 20110040824A1 · Harm · 2011 [cited by applicant]
US 20150012919A1 · Moss et al. · 2015 [cited by applicant]
US 20150082197A1 · Pearl et al. · 2015 [cited by applicant]
US 20170177171A1 · Won · 2017 [cited by applicant]
US 20170220453A1 · Simons et al. · 2017 [cited by applicant]
US 20180074931A1 · Garcia · 2018 [cited by examiner]
US 20190302981A1 · Storr · 2019 [cited by examiner]
US 20190303585A1 · Ofek · 2019 [cited by examiner]
US 20200034119A1 · McLaughlin · 2020 [cited by examiner]
US 20200034399A1 · Beno et al. · 2020 [cited by applicant]
US 20200050529A1 · Balasubramanian et al. · 2020 [cited by applicant]
US 20200192975A1 · Maes · 2020 [cited by examiner]
US 20200233707A1 · Ramamurthy et al. · 2020 [cited by applicant]
US 20200302542A1 · Yelovitch · 2020 [cited by examiner]
US 20200348964A1 · Anand et al. · 2020 [cited by applicant]
US 20210042104A1 · Tashkandi · 2021 [cited by applicant]
US 20210063986A1 · Mehrotra et al. · 2021 [cited by applicant]
US 20210089358A1 · Yeung-Rhee et al. · 2021 [cited by applicant]
US 20210109767A1 · Cohen et al. · 2021 [cited by applicant]
US 20210117895A1 · Tondevold et al. · 2021 [cited by applicant]
US 20210129325A1 · Yu et al. · 2021 [cited by applicant]
US 20210294732A1 · Underseth · 2021 [cited by applicant]
US 20220027806A1 · Burman · 2022 [cited by examiner]
US 20220107622A1 · Monakova · 2022 [cited by applicant]
US 20220150106A1 · McTaggart et al. · 2022 [cited by applicant]
US 20220237005A1 · Mayer et al. · 2022 [cited by applicant]
CN 111813516A · 2020 [cited by applicant]
CN 112486073A · 2021 [cited by applicant]
JP 2021060936A · 2021 [cited by applicant]
JP 2021072097A · 2021 [cited by applicant]
WO 2021071605A1 · 2021 [cited by applicant]
AssistEdge Cloud RPA page available at https://www.edgeverve.com/assistedge/assistedge-cloud-rpa/ (last accessed Apr. 12, 2021). [cited by applicant]
Automation 360 Platform page available at https://www.automationanywhere.com/products/automation-360 (last accessed Apr. 12, 2021). [cited by applicant]
SAP Intelligent RPA Cloud Studio User Guide Overview available at https://help.sap.com/viewer/8e71b41b9ea043c8bccee01a10d6ba72/Cloud/en-US (last accessed Apr. 12, 2021). [cited by applicant]
Bradford F Wheaton, “Non-Final Office Action”, issued Sep. 16, 2022, U.S. Appl. No. 17/340,603. [cited by applicant]
Kofax, “More Choice, More Value: User Containers to Run Your Kofax Intelligent Automation Project”, 2020. [cited by applicant]
Liang Y Li, “Non-Final Office Action”, issued Jul. 22, 2022, U.S. Appl. No. 17/341,512. [cited by applicant]
Dewar, Craig, “Upgrades for All User Experiences from Everyday Business Users to Professional Developers”, UiPath Blog, May 20, 2021, pp. 2-10 https://www.uipath.com/blog/product-and-updates/upgraded-automation-user-exp… [cited by applicant]
International Search Report & Written Opinion, issued Feb. 23, 2022, PCT Application No. PCT/US21/56929. [cited by applicant]
International Search Report & Written Opinion, issued Feb. 23, 2022, PCT Application No. PCT/US21/56933. [cited by applicant]
International Search Report & Written Opinion, issued Feb. 25, 2022, PCT Application No. PCT/US21/57166. [cited by applicant]
International Search Report & Written Opinion, issued Mar. 2, 2022, PCT Application No. PCT/US21/56926. [cited by applicant]
Osmundsen, et al., “Organizing Robotic Process Automation: Balancing Loose and Tight Coupling”, Proceedings of the 52nd Hawaii International Conference on System Sciences, 2019. [cited by applicant]
Scott, et al., “freedom.js: an Architecture for Serverless Web Applications”, University of Washington, 2013. [cited by applicant]
Scott, et al., “freedom.js: an Architecture for Serverless Web Applications”, UW Technical Report, May 3, 2013, pp. 1, 9, 13; https:norfolk.cs.washington.edu/htbin-post/unrestricted/tr/list.cgi?sortby+date. [cited by applicant]
Bradford F Wheaton, “Advisory Action”, issued May 10, 2023, U.S. Appl. No. 17/340,603. [cited by applicant]
Bradford F Wheaton, “Final Office Action”, issued Feb. 17, 2023, U.S. Appl. No. 17/341,550. [cited by applicant]
Liang Y Li, “Non-Final Office Action”, issued Mar. 31, 2023, U.S. Appl. No. 17/341,512. [cited by applicant]
Bradford F Wheaton, “Final Office Action”, issued Feb. 3, 2023, U.S. Appl. No. 17/340,603. [cited by applicant]
Bradford F Wheaton, “Non-Final Office Action”, issued Nov. 28, 2022, U.S. Appl. No. 17/341,550. [cited by applicant]
Liang Y Li, “Final Office Action”, issued Jan. 9, 2023, U.S. Appl. No. 17/341,512. [cited by applicant]
“Test Automation Best Practice #4: Use Reliable Locators,” May 11, 2018 (May 11, 2018), pp. 1-8, XP093063651, available at https://www.ranorex.com/blog/best-practices-4-use-stable-locators/. [cited by applicant]
Clay Smith, “Running Selenium and Headless Chrome on AWS Lambda,” Jul. 28, 2017 (Jul. 28, 2017), pp. 1-4, XP093061597, available at https://medium.com/clog/running-selenium-and-headless-chrome-on-aws-lambda-fb350458e4df. [cited by applicant]
Himanshu Sheth, “Page Object Model (POM) In Selenium Python,” Mar. 11, 2021 (Mar. 11, 2021), pp. 1-24, XP093063658, available at https://www.lambdatest.com/blog/page-object-model-in-selenium-python/. [cited by applicant]
Himanshu Sheth, “Robot Framework Tutorial with Selenium and Python,” Sep. 16, 2020 (Sep. 16, 2020), pp. 1-23, XP093063203, Lambdatest Website, available at https://www.lambdatest.com/blog/robotframework-tutorial/. [cited by applicant]
Juho Saarinen, “Talk: RPA and automated testing with Robot Framework in Google App Engine,” Mar. 24, 2020 (Mar. 24, 2020), p. 1, XP093063327, available at https://helsinki.serverlessdays.io/speakers/juho/. [cited by applicant]
Kim Schiller, “Why you should care about Robot Framework—Part II,” Oct. 21, 2020 (Oct. 21, 2020), pp. 1-11, XP093063183, https://www.linkedin.com/pulse/why-you-should-care-robot-framework-part-ii-kim-schiller?trk=articl… [cited by applicant]
Nishant Choudhary, “How to Switch Tabs in a Browser Using Selenium Python?,” Dec. 23, 2020 (Dec. 23, 2020), pp. 1-26, XP093061612, available at https://www.lambdatest.com/blog/python-selenium-switch-tabs/. [cited by applicant]
Olawepo Olayemi, “Browsers in containers—executing robot framework tests with selenoid (Part 2),” Nov. 30, 2019 (Nov. 30, 2019), pp. 1-3, XP093063190, https://sejuba.medium.com/browsers-incontainers-executing-robot-fram… [cited by applicant]
Prakash Palanisamy, “Serverless UI testing using Selenium, AWS Lambda, AWS Fargate, and AWS Developer Tools,” Mar. 29, 2021 (Mar. 29, 2021), pp. 1-11, XP093061943, available at https://aws.amazon.com/blogs/devops/server… [cited by applicant]
Selenium (software) Wikipedia Article, Mar. 29, 2021 (Mar. 29, 2021), pp. 1-5, XP093061578, available at https://en.wikipedia.org/w/index.php?title=Selenium_(software)&oldid=1014905597. [cited by applicant]
Supplementary European Search Report issued in EP Application No. 21820858.5 on Jul. 25, 2023. [cited by applicant]
Supplementary European Search Report issued in EP Application No. 21820860.1 on Jul. 24, 2023. [cited by applicant]
Supplementary European Search Report issued in EP Application No. 21820887.4 on Jul. 25, 2023. [cited by applicant]
Supplementary European Search Report issued in EP Application No. 21820893.2 on Jul. 24, 2023. [cited by applicant]
Wikipedia AWS Lambda Page, Jun. 3, 2021 (Jun. 3, 2021), pp. 1-3, XP093061929, available at https://en.wikipedia.org/w/index.php?title=AWS_Lambda&oldid=1026717460. [cited by applicant]
Wikipedia Integrated Development Environment Article, May 28, 2021 (May 28, 2021), pp. 1-4, XP093063760, available at https://en.wikipedia.org/w/index.php?title=Integrated_development_environment&oldid=1025557270. [cited by applicant]
Wikipedia Static Program Analysis Article, Mar. 14, 2021 (Mar. 14, 2021), pp. 1-4, XP093063980,DOI: 10.1049/sej. 1995.0010, available at https://en.wikipedia.org/w/index.php?title=Static_program_analysis&oldid=101209328… [cited by applicant]
U.S. Appl. No. 17/341,512—Final Office Action mailed on Dec. 5, 2023, 19 pages. [cited by applicant]
Office Action issued in Korean Application No. 10-2021-7043185 on Feb. 28, 2024. [cited by applicant]
Office Action issued in Korean Application No. 10-2021-7043188 on Mar. 19, 2024. [cited by applicant]
Bradford F Wheaton, “Non-Final Office Action”, issued Oct. 10, 2023, U.S. Appl. No. 17/340,603. [cited by applicant]
Bradford F Wheaton, “Notice of Allowance”, issued Aug. 3, 2023, U.S. Appl. No. 17/341,550. [cited by applicant]
Bradford F Wheaton, “Notice of Allowance”, issued Apr. 24, 2024, U.S. Appl. No. 17/340,603. [cited by applicant]
Notice of Allowance, issued Dec. 3, 2024, Korean Patent Application No. 10-2021-7043188. [cited by applicant]
Notice of Allowance, issued Dec. 6, 2024, KR Patent Application No. 10-2021-7043170. [cited by applicant]
Office Action, issued Oct. 31, 2024, Korean Patent Application No. 10-2021-7043185. [cited by applicant]
Office Action, issued Sep. 25, 2024, KR Patent Application No. 10-2021-7043170. [cited by applicant]
Examination Report, issued Aug. 7, 2024, EP Patent Application No. 21820858.5. [cited by applicant]
Examination Report, issued Aug. 7, 2024, EP Patent Application No. 21820860.1. [cited by applicant]
Examination Report, issued Aug. 7, 2024, EP Patent Application No. 21820887.4. [cited by applicant]
Examination Report, issued Aug. 7, 2024, EP Patent Application No. 21820893.2. [cited by applicant]
Wikipedia, “Remote Procedure Call”, May 1, 2021, https://en.wikipedia.org/w/index.php?title=remote_procedure_call&oldid=1020915529. [cited by applicant]
Liang Y Li, “Non-Final Office Action”, issued Aug. 15, 2024, U.S. Appl. No. 17/341,512. [cited by applicant]
U I. Vision webpage. Retrieved May 6, 2021. , (Year: 2021). [cited by applicant]
UI.Vision. “Visual UI Testing with the UI Vision RPA Software”. Jul. 23, 2018. ( Year: 2018). [cited by applicant]
Lambdatest, Next-Gen App & Browser Testing Cloud. [cited by applicant]
Office Action, issued Jan. 14, 2025, KR Patent Application No. 10-2021-7043179. [cited by applicant]
Scott, et al., “freedom.js: an Architecture for Serverless Web Applications”, 2013. [cited by applicant]
Liang Y Li, “Final Office Action”, issued Feb. 25, 2025, U.S. Appl. No. 17/341,512. [cited by applicant]
Office Action, issued Jun. 24, 2025, JP Patent Application No. 2021-577299. [cited by applicant]