IP Library Granted Patent US 12,346,713
Granted Patent B1
US 12,346,713 · App. 19/006,539 · Granted Jul 1, 2025

Unified artificial intelligence agent, robotic process automation robot, and agentic orchestration process development applications

Inventors: Victor Vlasceanu (New York, NY); Zach Eslami (New York, NY); Taqi Jaffri (New York, NY); Venkata Syam Prakash Rapaka (New York, NY)
Assignee: UiPath, Inc.
G06F9/453G06F16/3346
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,346,713
App. No.
19/006,539
Granted
Jul 1, 2025
Kind
B1
Abstract

Unified artificial intelligence (AI) agent, robotic process automation (RPA) robot, and agentic orchestration process (AOP) development applications are disclosed. In such embodiments, AI agents “coexist” in tandem with RPA robots that execute RPA automations. Automation developers can provide a natural language description of a process intended to be implemented by an AI agent, as well as prompts for a user. Developers can also select grounding context, service integration tools, RPA robots, and escalation attributes for the AI agent. When executed, the AI agent will implement a dynamic flow and attempt to perform its logic autonomously. If this is not successful, the AI agent can escalate to a human-in-the-loop, and the human resolution may be saved in memory for self-healing purposes. Developers can also develop AOPs that can utilize AI agents and RPA robots via a conductor application as well.

Claims (71)

1. One or more non-transitory computer-readable media storing one or more computer programs, the one or more computer programs configured to cause at least one processor to:

display an artificial intelligence (AI) agent development interface comprising a system prompt, a user prompt, selectable tools that can be employed by the AI agent, context grounding, escalation options, and a field to run queries;

generate an AI agent based on the system prompt, the context grounding, and one or more tools selected from the one or more selectable tools, the AI agent configured to call a generative AI model, provide input to the generative AI model, and receive output from the generative AI model to process queries from the query field; and

execute an agentic automation via the generated AI agent by:

providing a query entered into the query field to the generative AI model as input and receiving results from the generative AI model as output, and

displaying the results from the generative AI model, executing the one or more tools via the generated AI agent, and displaying results of the execution of the one or more tools.

2. The one or more non-transitory computer-readable media of claim 1 , wherein the one or more selectable tools comprise one or more integration service connectors for an external application.

3. The one or more non-transitory computer-readable media of claim 1 , wherein the one or more selectable tools comprise one or more automations executed by one or more robotic process automation (RPA) robots.

4. The one or more non-transitory computer-readable media of claim 1 , wherein the one or more computer programs are further configured to cause the at least one processor to:

display an escalation configuration interface that provides human-in-the-loop configuration options; and

configure the AI agent to utilize the human-in-the-loop configuration options responsive to the AI agent not being able to successfully complete a task requested in the query field.

5. The one or more non-transitory computer-readable media of claim 1 , wherein responsive to the AI agent not being able to successfully complete a task requested in the query field, the one or more computer programs are further configured to cause the at least one processor to:

display an agent handler interface comprising a query from the AI agent for a human-in-the-loop to provide a solution for; and

store a response from the human-in-the-loop in agentic memory of the AI agent, thereby allowing the AI agent to accomplish the task in the future, wherein

the AI agent is configured to search the agentic memory when executing the agentic automation.

6. The one or more non-transitory computer-readable media of claim 1 , wherein the one or more computer programs are further configured to cause the at least one processor to:

display a trace interface from the execution of the agentic automation, the trace interface comprising an execution actions pane and an attributes pane displaying attributes of a selected execution action in the execution actions pane.

7. The one or more non-transitory computer-readable media of claim 6 , wherein the trace interface facilitates debugging of an agentic loop, inputs provided to the one or more tools, and outputs returned from the one or more tools.

8. The one or more non-transitory computer-readable media of claim 1 , wherein the one or more computer programs are further configured to cause the at least one processor to:

display an application orchestration process (AOP) development interface comprising AOP workflow components, selectable AI agents, and selectable robotic process automation (RPA) robots; and

generate an AOP workflow comprising one or more steps that are executed by one or more RPA robots and/or one or more AI agents via a conductor application.

9. The one or more non-transitory computer-readable media of claim 8 , wherein the AOP development interface comprises a field where a user can enter a description of a business process and the one or more computer programs are further configured to cause the at least one processor to:

automatically generate an AOP workflow from the business description process field using the generative AI model or another generative AI model.

10. A computer-implemented method, comprising:

generating an artificial intelligence (AI) agent, by a computing system, based on a system prompt, context grounding, and one or more tools, the AI agent configured to call a generative AI model, provide input to the generative AI model, and receive output from the generative AI model to process queries from a query field; and

executing an agentic automation, by the computing system, via the generated AI agent by:

providing a query entered into a query field to the generative AI model as input and receiving results from the generative AI model as output, and

displaying the results from the generative AI model, executing the one or more tools via the generated AI agent, and displaying results of the execution of the one or more tools.

11. The computer-implemented method of claim 10 , wherein the one or more selectable tools comprise one or more integration service connectors for an external application.

12. The computer-implemented method of claim 10 , wherein the one or more selectable tools comprise one or more automations executed by one or more robotic process automation (RPA) robots.

13. The computer-implemented method of claim 10 , further comprising:

displaying, by the computing system, an escalation configuration interface that provides human-in-the-loop configuration options; and

configuring the AI agent, by the computing system, to utilize the human-in-the-loop configuration options responsive to the AI agent not being able to successfully complete a task requested in the query field.

14. The computer-implemented method of claim 10 , wherein responsive to the AI agent not being able to successfully complete a task requested in the query field, the method further comprises:

displaying, by the computing system, an agent handler interface comprising a query from the AI agent for a human-in-the-loop to provide a solution for; and

storing a response from the human-in-the-loop in agentic memory of the AI agent, by the computing system, thereby allowing the AI agent to accomplish the task in the future, wherein

the AI agent is configured to search the agentic memory when executing the agentic automation.

15. The computer-implemented method of claim 10 , further comprising:

displaying, by the computing system, a trace interface from the execution of the agentic automation, wherein

the trace interface comprises an execution actions pane and an attributes pane displaying attributes of a selected execution action in the execution actions pane, and

the trace interface facilitates debugging of an agentic loop, inputs provided to the one or more tools, and outputs returned from the one or more tools.

16. The computer-implemented method of claim 10 , further comprising:

displaying, by the computing system, an application orchestration process (AOP) development interface comprising AOP workflow components, selectable AI agents, and selectable robotic process automation (RPA) robots; and

generating, by the computing system, an AOP workflow comprising one or more steps that are executed by one or more RPA robots and/or one or more AI agents via a conductor application.

17. The computer-implemented method of claim 10 , wherein the AOP development interface comprises a field where a user can enter a description of a business process and the method further comprises:

automatically generating, by the computing system, an AOP workflow from the business description process field using the generative AI model or another generative AI model.

18. One or more computing systems, comprising:

memory storing computer program instructions; and

at least one processor configured to execute the computer program instructions, wherein the computer program instructions are configured to cause the at least one processor to:

display an artificial intelligence (AI) agent development interface comprising a system prompt, a user prompt, selectable tools that can be employed by the AI agent, context grounding, escalation options, and a field to run queries,

generate an AI agent based on the system prompt, the context grounding, and one or more tools selected from the one or more selectable tools, the AI agent configured to call a generative AI model, provide input to the generative AI model, and receive output from the generative AI model to process queries from the query field, and

execute an agentic automation via the generated AI agent by:

providing a query entered into the query field to the generative AI model as input and receiving results from the generative AI model as output, and

displaying the results from the generative AI model, executing the one or more tools via the generated AI agent, and displaying results of the execution of the one or more tools, wherein

the one or more selectable tools comprise one or more automations executed by one or more robotic process automation (RPA) robots.

19. The one or more computing systems of claim 18 , wherein the computer program instructions are further configured to cause the at least one processor to:

display an escalation configuration interface that provides human-in-the-loop configuration options; and

configure the AI agent to utilize the human-in-the-loop configuration options responsive to the AI agent not being able to successfully complete a task requested in the query field.

20. The one or more computing systems of claim 18 , wherein responsive to the AI agent not being able to successfully complete a task requested in the query field, the computer program instructions are further configured to cause the at least one processor to:

display an agent handler interface comprising a query from the AI agent for a human-in-the-loop to provide a solution for; and

store a response from the human-in-the-loop in agentic memory of the AI agent, thereby allowing the AI agent to accomplish the task in the future, wherein

the AI agent is configured to search the agentic memory when executing the agentic automation.

21. The one or more computing systems of claim 18 , wherein the computer program instructions are further configured to cause the at least one processor to:

display a trace interface from the execution of the agentic automation, wherein

the trace interface comprises an execution actions pane and an attributes pane displaying attributes of a selected execution action in the execution actions pane, and

the trace interface facilitates debugging of an agentic loop, inputs provided to the one or more tools, and outputs returned from the one or more tools.

22. The one or more computing systems of claim 18 , wherein the computer program instructions are further configured to cause the at least one processor to:

display an application orchestration process (AOP) development interface comprising AOP workflow components, selectable AI agents, and selectable robotic process automation (RPA) robots; and

generate an AOP workflow comprising one or more steps that are executed by one or more RPA robots and/or one or more AI agents via a conductor application.

23. The one or more computing systems of claim 22 , wherein the AOP development interface comprises a field where a user can enter a description of a business process and the computer program instructions are further configured to cause the at least one processor to:

automatically generate an AOP workflow from the business description process field using the generative AI model or another generative AI model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2025
From: VLASCEANU, VICTOR; ESLAMI, ZACH; JAFFRI, TAQI; RAPAKA, VENKATA SYAM PRAKASH
To: UIPATH, INC.
Reel/Frame 069898/0732 →
Continuity (1)
Provisional Application 63710548 · Oct 22, 2024
References Cited (75)
US 10654166B1 · Hall · 2020 [cited by applicant]
US 10860905B1 · Gligan et al. · 2020 [cited by applicant]
US 10970109B1 · Berenstein et al. · 2021 [cited by applicant]
US 10990876B1 · Neagovici et al. · 2021 [cited by applicant]
US 11080548B1 · Skarda · 2021 [cited by applicant]
US 11113095B2 · Krishnamurthy et al. · 2021 [cited by applicant]
US 11416740B2 · Nokbak Nyembe et al. · 2022 [cited by applicant]
US 11507259B2 · Dines · 2022 [cited by applicant]
US 11550549B2 · Thangaraj et al. · 2023 [cited by applicant]
US 11571811B2 · Singh et al. · 2023 [cited by applicant]
US 11614730B2 · Amin et al. · 2023 [cited by applicant]
US 11733668B2 · Hall · 2023 [cited by applicant]
US 11738453B2 · Shrivastava et al. · 2023 [cited by applicant]
US 11748069B2 · Grigore · 2023 [cited by applicant]
US 11748479B2 · Seth · 2023 [cited by applicant]
US 11915041B1 · Tanach et al. · 2024 [cited by applicant]
US 11966825B2 · Arcand et al. · 2024 [cited by applicant]
US 12124806B2 · Mayer et al. · 2024 [cited by applicant]
US 12147881B2 · Dines · 2024 [cited by applicant]
US 20210097274A1 · Gligan et al. · 2021 [cited by applicant]
US 20220011732A1 · Hall · 2022 [cited by applicant]
US 20220051136A1 · Côtéet al. · 2022 [cited by applicant]
US 20220150106A1 · Mctaggart et al. · 2022 [cited by applicant]
US 20220300336A1 · Major et al. · 2022 [cited by applicant]
US 20220328164A1 · Rogers et al. · 2022 [cited by applicant]
US 20230107316A1 · Ripa et al. · 2023 [cited by applicant]
US 20230415338A1 · Dines · 2023 [cited by applicant]
US 20230421443A1 · Pirinen et al. · 2023 [cited by applicant]
US 20240001553A1 · Chen et al. · 2024 [cited by applicant]
US 20240210903A1 · Iordan · 2024 [cited by examiner]
US 20240220581A1 · Dines et al. · 2024 [cited by applicant]
US 20240303443A1 · Cheng et al. · 2024 [cited by applicant]
US 20240338248A1 · Bose · 2024 [cited by examiner]
US 20240370764A1 · Goyal et al. · 2024 [cited by applicant]
US 20240419950A1 · Tong et al. · 2024 [cited by applicant]
US 20240427631A1 · Corlatescu et al. · 2024 [cited by applicant]
CN 106453551A · 2017 [cited by applicant]
CN 118691231A · 2024 [cited by applicant]
CN 118819775A · 2024 [cited by applicant]
WO 2020223371A1 · 2020 [cited by applicant]
“Agentic AI in Automation: The Next Generation of Autonomous Intelligence”, Accelirate, https://www.accelirate.com/agentic-ai/. [cited by applicant]
“RPA Project: Process Definition Document—A Comprehensive Guide,” available at https://medium.com/@subhamchand200/rpa-project-process-definition-document-a-comprehensive-guide-d6a894a07695 (Oct. 14, 2024). [cited by applicant]
Adrian White, “LLM Function Calling: When LLMs Call Other LLMs”, Medium, https://medium.com/@adrian.white/llm-function-calling-when-llms-call-other-llms-940c43885639. [cited by applicant]
Ajoy Kumar, “Architectural Approach for Building Generative AI Applications,” available at https://www.bmc.com/blogs/architectural-approach-for-building-generative-ai-applications/ (Feb. 2, 2024). [cited by applicant]
Ashish Kumar, “Function Calling in AI Agents Using Mistral 7B”, Analytics Vidhya, https://www.analyticsvidhya.com/blog/2024/10/function-calling-in-ai-agents-using-mistral-7b/#˜:text=in the scope of Generative, and perfo… [cited by applicant]
Automation Anywhere AI Agent Studio Page, available at https://www.automationanywhere.com/products/ai-agent-studio (last accessed Dec. 29, 2024). [cited by applicant]
Automation Anywhere, “Easily Build AI Agents to Handle Cognitive Tasks”, AI Agent Platform: Build Your Own AI Agents, https://www.automationanywhere.com/products/ai-agent-studio. [cited by applicant]
Cloud Ace Indonesia, “Google Cloud Expands Grounding Capabilities on Vertex AI”, https://id.cloud-ace.com/google-cloud-expands-grounding-capabilities-on-vertex-ai/. [cited by applicant]
Diego Gosmar et al., “Al Multi-Agent Interoperability—Extension for Managing Multiparty Conversations,” available at https://arxiv.org/html/2411.05828v1 (Nov. 5, 2024). [cited by applicant]
Google Cloud Blog, “Build Generative AI Experiences with Vertex AI Agent Builder”, https://cloud.google.com/blog/products/ai-machine-learning/build-generative-ai-experiences-with-vertex-ai-agent-builder. [cited by applicant]
Kumar, Ajoy, BMC Blogs, “Architectural Approach for Building Generative AI Applications”, https://www.bmc.com/blogs/architectural-approach-for-building-generative-ai-applications/. [cited by applicant]
Leeway Hertz, “How to Build an AI Agent System: Exploring Types, Architecture, Tools for Success and Strategic Benefits”, https://www.leewayhertz.com/how-to-build-an-ai-agent/. [cited by applicant]
Project Pro, “How to Build an AI Agent From Scratch?”, https://www.projectpro.io/article/how-to-build-an-ai-agent-from-scratch/1072. [cited by applicant]
Relevance AI, “Build an AI Agent That Can Escalate to Humans and Update its Knowledge”, Relevance Academy, https://www.youtube.com/watch?v=iF-7weFHi2M. [cited by applicant]
Subex, “Generative AI and the Future: Why Agents are the Next Big Leap”, https://www.subex.com/article/generative-ai-and-the-future-why-agents-are-the-next-big-leap/. [cited by applicant]
Tungsten Automation, “Automating with AI Agents”, https://www.tungstenautomation.com/learn/blog/automating-with-ai-agents#:˜: text=AIAgents promise to address, is not configured to handle. [cited by applicant]
UiPath, “Agentic Automation”, On Demand Webinar, https://uipath.com/resources/automation-webinars/the-rise-of-agentic-process-automation. [cited by applicant]
Akhtar, et al., “Process Automation Product Survey: Robotic Process Automation (RPA), Intelligent Document Processing (IDP), and Process Discovery/Mining, Emerging Technology Community of Interest”, Intelligent Automati… [cited by applicant]
Di Xiao, “Non-Final Office Action”, issued Mar. 26, 2025, U.S. Appl. No. 19/006,505. [cited by applicant]
Fan, et al., “Workflow LLM: Enhancing Workflow Orchestration Capability of Large Language Models”, arXiv:2411.0545v1, Nov. 8, 2024. [cited by applicant]
Kurtis Gills, “Non-Final Office Action”, issued Mar. 19, 2025, U.S. Appl. No. 19/006,562. [cited by applicant]
“AutoFlow: Automated Workflow Generation for Large Language Model Agents”, arXiv:2407.12821v1, Jul. 1, 2024. [cited by applicant]
Amaxra, A Comprehensive Guide to Windows Autopilot, https://amaxra.com/articles/windows-autopilot, Jan. 17, 2025. [cited by applicant]
Automation Anywhere, “What is Agentic Process Automation?”, https://www.automationanywhere.com/rpa/agentic-process-automation, Jan. 24, 2025. [cited by applicant]
BA Copilot, “Generate Flowcharts with Al”, Jan. 23, 2025. [cited by applicant]
Kopke, et al., “Introducing the BPMN-Chatbot for Efficient LLM-Based Process Modeling”, GEUR-WS.org, vol. 3758/paper-15.pdf, Jan. 23, 2025. [cited by applicant]
Llm4workflow, Jan. 23, 2025. [cited by applicant]
Mantri, Siddhartha, Windows IT Pro Blog, “New Windows Autopilot Capabilities and Expanded Partner Support Simplify Modern Device Deployment”, https://techcommunity.microsoft.com/blog/windows-itpro-blog/new-windows-autop… [cited by applicant]
Sabatale, “Automate BPMN Diagrams and Note-Taking in Cloud ALM with LLM: AI Text Generation”, Jan. 10, 2024. [cited by applicant]
Schoenwald, Robin, “Generate Process Models with GenAl”, SAP, Jul. 15, 2024. [cited by applicant]
SPAR Solutions, One Unified Platform, Infinite Customer Delight, https://www.sparsolutions.com/services/verint/unified-desktop, Jan. 23, 2025. [cited by applicant]
Teneo Al, “How Agentic Orchestration is Transforming AI in Business”, https://www.teneo.ai/blog/how-agentic-orchestration-is-transforming-ai-in-business, Jan. 24, 2025. [cited by applicant]
Txt2BPMN, Jan. 23, 2025. [cited by applicant]
Visionet, “Unlocking the Future: How Agentic Process Automation Transforms Business Operations”, https://www.visionet.com/blog/unlocking-the-future-how-agentic-process-automation-transforms-business-operations, Jan. 22,… [cited by applicant]
Kurtis Gills, “Notice of Allowance”, issued May 19, 2025, U.S. Appl. No. 19/006,562. [cited by applicant]
Cited By (3)
US 12,613,872 US 12,632,442 US 12,645,674