IP Library › Granted Patent US 12,711,499
Granted Patent B2
US 12,711,499 · App. 18/759,399 · Granted Aug 18, 2026

Multi-agent computer software framework for a conversational artificial intelligence system

Inventors: Soujanya Lanka (Singapore, SG); Guangsen Wang (Singapore, SG); Reyha Verma (Bangalore Urban, IN)
Assignee: PayPal, Inc.
G06Q20/386G06F40/30G06Q10/06393G06Q10/06395H04L51/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,711,499
App. No.
18/759,399
Filed
Jun 28, 2024
Granted
Aug 18, 2026
Kind
B2
Art Unit
2451
USPC
709/206
Abstract

Methods and systems are presented for providing an artificial intelligence (AI)-based conversation system for facilitating a conversation with users and processing transactions for the users. The AI-based conversation system includes an AI model coupled with different backend modules. Based on an utterance submitted by a user during a chat session, the AI model is configured to generate instructions for a backend module to perform a transaction for the user based on a prompt template. The AI model also communicates the instructions to the backend module using a protocol specified in the prompt template. Upon receiving an output from the backend module, the AI model is configured to generate content for the chat session based on the output, and provide the content to the user.

Claims (69)

1 . A system comprising:

a non-transitory memory; and

one or more hardware processors coupled with the non-transitory memory and configured to execute instructions from the non-transitory memory to cause the system to:

receive an utterance from a device via a chat interface during a chat session;

predict, for an artificial intelligence (AI) model, an intent of a user of the device based on the utterance, wherein the AI model is communicatively coupled with a plurality of backend modules, and wherein each backend module in the plurality of backend modules is configured to perform transactions corresponding to a different transaction type;

select, from the plurality of backend modules, a particular backend module for performing a transaction for the user during the chat session based on the intent;

access, from a data storage that stores a plurality of prompt templates corresponding to the plurality of backend modules, a particular prompt template corresponding to the particular backend module;

provide the particular prompt template to the AI model, wherein the particular prompt template enables the AI model to (i) conduct a set of dialogs with the user that prompts the user for data usable by the particular backend module to perform the transaction and (ii) generate instructions for instructing the particular backend module to perform the transaction;

instruct, by the AI model and using the instructions, the particular backend module to perform the transaction for the user based on the utterance and the intent;

generate, by the AI model, content for the chat session based on a result from the particular backend module performing the transaction; and

transmit the content to the device via the chat interface.

2 . The system of claim 1 , wherein executing the instructions further causes the system to:

generate, by the AI model, a first question that prompts the user for the data.

3 . The system of claim 2 , wherein executing the instructions further causes the system to:

determine that a first answer obtained from the device via the chat interface does not correspond to a set of data requirements indicated in the particular prompt template; and

generate, by the AI model, a second question that prompts the user for the data.

4 . The system of claim 3 , wherein the second question has a different syntax than the first question.

5 . The system of claim 1 , wherein executing the instructions further causes the system to:

obtain, by the AI model and from the particular backend module, an output based on the performing the transaction, wherein the content is generated further based on the output.

6 . The system of claim 5 , wherein the output indicates whether the transaction has been completed, has been denied, or requires additional data to complete.

7 . The system for claim 1 , wherein executing the instructions further causes the system to:

format the utterance based on a set of policies; and

provide the formatted utterance to the AI model, wherein the intent is further predicted based on the formatted first utterance.

8 . A method, comprising:

receiving, via a chat interface during a chat session between a device and a computer system, a request for performing a transaction corresponding to a first transaction type;

selecting, from a plurality of modules, a first module for a user of the device based on the first transaction type;

selecting, from a plurality of templates, a first template corresponding to the first module;

providing the first template to an artificial intelligence (AI) model, wherein the first template enables the AI model to generate one or more questions that prompt the user for data usable by the first module to perform the transaction;

transmitting the one or more questions to the device via the chat interface;

generating, by the AI model, instructions for the first module to perform the transaction based on information extracted from the request and the data obtained from the user;

providing, by the AI model, the instructions to the first module;

generating, by the AI model, content for the chat session based on an output produced by the first module; and

providing, by the AI model, the content to the device via the chat interface as a response to the request.

9 . The method of claim 8 , wherein the output comprises second data associated with the computer system obtained from a plurality of data sources, and wherein the content comprises a summary of the second data.

10 . The method of claim 8 ,

wherein the first template indicates a communication protocol for communicating with the first module, and wherein the instructions are generated further based on the first template.

11 . The method of claim 8 , wherein the instructions comprise an application programming interface (API) call, and wherein the method further comprises:

inserting one or more input parameters to the API call based on the extracted information.

12 . The method of claim 8 , wherein the content is first content, and wherein the method further comprises:

subsequent to providing the first content on the device, receiving a second request from the device via the chat interface during the chat session, wherein the second request is for performing a second transaction corresponding to a second transaction type;

selecting, from the plurality of modules, a second module for the user based on the second transaction type;

providing, by the AI model, second instructions to the second module;

generating, by the AI model, second content for the chat session based on a second output produced by the second module; and

providing the second content to the user via the chat interface.

13 . The method of claim 8 , wherein the request comprises an utterance, and wherein the method further comprises:

processing the utterance based on a set of policies; and

providing the processed utterance to the AI model, wherein the instructions are generated further based on the processed utterance.

14 . The method of claim 13 , wherein the processing the utterance comprises:

identifying one or more words associated with a particular word type in the utterance; and

removing the one or more words from the utterance.

15 . A non-transitory machine-readable medium having stored thereon machine-readable instructions executable to cause a machine to perform operations comprising:

in response to receiving a first utterance from a device via a chat interface during a chat session, determining that the first utterance corresponds to a request for performing a transaction of a particular transaction type;

selecting, from a plurality of computer modules, a particular computer module for performing the transaction based on the particular transaction type;

providing a particular prompt template corresponding to the particular computer module to an artificial intelligence (AI) model, wherein the particular prompt template enables the AI model to generate a set of questions that prompts the user for data usable by the particular computer module to perform the transaction;

transmitting the set of questions to the device via the chat interface;

generating, by the AI model, instructions that cause the particular computer module to perform the transaction for a user of the device based on the data obtained from the user;

generating, by the AI model, content for the chat session based on a result from the particular computer module performing the transaction; and

transmitting the content to the device via the chat interface.

16 . The non-transitory machine-readable medium of claim 15 , wherein the operations further comprise:

obtaining additional information via the chat interface, wherein the particular computer module is configured to perform the transaction for the user further based on the additional information.

17 . The non-transitory machine-readable medium of claim 16 , wherein the operations further comprise:

generating, by the AI model, the set of questions for the user based on data types or content required by the particular computer module for performing the transaction; and

obtaining the data from the user via the chat interface.

18 . The non-transitory machine-readable medium of claim 17 , wherein the operations further comprise:

determining the data types or content required by the particular computer module for performing the transaction based on the particular prompt template.

19 . The non-transitory machine-readable medium of claim 15 , wherein the operations further comprise:

detecting that a first language used in the first utterance is incompatible with the AI model; and

translating the first utterance from the first language to a second language that is compatible with the AI model.

20 . The non-transitory machine-readable medium of claim 15 , wherein the result indicates whether the transaction has been completed, has been denied, or requires additional data to complete.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2024
From: LANKA, SOUJANYA; VERMA, REYHA; WANG, GUANGSEN
To: PAYPAL, INC.
Reel/Frame 068600/0141 →
Priority Claims (2)
IN 202341054463 · Aug 14, 2023 · national
IN 202341076442 · Nov 8, 2023 · national
Continuity (1)
Related Publication 20250063003A1 · Feb 20, 2025
References Cited (70)
US 11012381B2 · Chavda · 2021 [cited by applicant]
US 11431660B1 · Leeds et al. · 2022 [cited by applicant]
US 11544475B2 · Mittal et al. · 2023 [cited by applicant]
US 11606463B1 · Yeracaris · 2023 [cited by applicant]
US 11714855B2 · Mahindru et al. · 2023 [cited by applicant]
US 11743378B1 · Johnston et al. · 2023 [cited by applicant]
US 11875240B1 · Bosnjakovic et al. · 2024 [cited by applicant]
US 11936814B1 · Mehta et al. · 2024 [cited by applicant]
US 11960514B1 · Taylert et al. · 2024 [cited by applicant]
US 20140278352A1 · Clark et al. · 2014 [cited by applicant]
US 20140279050A1 · Makar et al. · 2014 [cited by applicant]
US 20160070693A1 · Carrier et al. · 2016 [cited by applicant]
US 20160371703A1 · Monegan et al. · 2016 [cited by applicant]
US 20170324867A1 · Tamblyn et al. · 2017 [cited by applicant]
US 20180052826A1 · Chowdhary · 2018 [cited by examiner]
US 20190155750A1 · Wang et al. · 2019 [cited by applicant]
US 20190206406A1 · Sugiyama et al. · 2019 [cited by applicant]
US 20190286712A1 · Terry et al. · 2019 [cited by applicant]
US 20190311036A1 · Shanmugam et al. · 2019 [cited by applicant]
US 20200099633A1 · D'Agostino · 2020 [cited by examiner]
US 20200117709A1 · Galitsky · 2020 [cited by applicant]
US 20200126540A1 · Panchamgam · 2020 [cited by applicant]
US 20200137002A1 · Chavda · 2020 [cited by applicant]
US 20200143115A1 · Brigham et al. · 2020 [cited by applicant]
US 20200143247A1 · Jonnalagadda et al. · 2020 [cited by applicant]
US 20200143265A1 · Jonnalagadda et al. · 2020 [cited by applicant]
US 20200201913A1 · Terry et al. · 2020 [cited by applicant]
US 20200259891A1 · Abraham · 2020 [cited by applicant]
US 20200342874A1 · Teserra · 2020 [cited by examiner]
US 20200374394A1 · Karp et al. · 2020 [cited by applicant]
US 20210144107A1 · Liang · 2021 [cited by examiner]
US 20210201144A1 · Jonnalagadda · 2021 [cited by applicant]
US 20210374167A1 · Williams et al. · 2021 [cited by applicant]
US 20210397796A1 · Dounis · 2021 [cited by examiner]
US 20220012600A1 · Trim et al. · 2022 [cited by applicant]
US 20220058347A1 · Singaraju · 2022 [cited by applicant]
US 20220107792A1 · Gottschlich · 2022 [cited by applicant]
US 20220245199A1 · Mahindru et al. · 2022 [cited by applicant]
US 20230035306A1 · Liu et al. · 2023 [cited by applicant]
US 20230121355A1 · Srinivasan et al. · 2023 [cited by applicant]
US 20230135179A1 · Mielke · 2023 [cited by applicant]
US 20230245651A1 · Wang · 2023 [cited by applicant]
US 20230259960A1 · Harris · 2023 [cited by applicant]
US 20230274095A1 · Kelkar et al. · 2023 [cited by applicant]
US 20230342557A1 · Hasan · 2023 [cited by applicant]
US 20230351257A1 · Mourya · 2023 [cited by applicant]
US 20240028963A1 · Blinov et al. · 2024 [cited by applicant]
US 20240038226A1 · Nouri et al. · 2024 [cited by applicant]
US 20240062021A1 · Tangari · 2024 [cited by examiner]
US 20240095460A1 · Xu et al. · 2024 [cited by applicant]
US 20240144049A1 · Cheng et al. · 2024 [cited by applicant]
US 20240184991A1 · Mahabaleshwarkar et al. · 2024 [cited by applicant]
US 20240256582A1 · Jain et al. · 2024 [cited by applicant]
US 20240330290A1 · Shrestha et al. · 2024 [cited by applicant]
US 20240370476A1 · Madisetti et al. · 2024 [cited by applicant]
US 20240419710A1 · Matson · 2024 [cited by applicant]
US 20250147887A1 · Srinivasan et al. · 2025 [cited by applicant]
WO 2011089450A2 · 2011 [cited by applicant]
WO 2015089336A2 · 2015 [cited by applicant]
WO 2021108679A1 · 2021 [cited by applicant]
WO 2022043675A2 · 2022 [cited by applicant]
Bunt H., et al., “Semantic and Pragmatic Precision in Conversational AI Systems,” Frontiers in Artificial Intelligence, Mar. 30, 2023, vol. 6, No. 896729, 16 pages. [cited by applicant]
Radziwill N., et al., “Evaluating Quality of Chatbots and Intelligent Conversational Agents,” arXiv preprint arXiv: 1704.04579, 2017, 21 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2024/40299, mailed on Oct. 18, 2024, 14 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2024/040226, mailed on Aug. 30, 2024, 9 pages. [cited by applicant]
Cohen, “Right on Track: NVIDIA Open-Source Software Helps Developers Add Guardrails to AI Chatbots”. [Retrieved from the Internet]. [Retrieved from https://blogs.nvidia.com/blog/2023/04/25/ai-chatbot-guardrails-nemo/ on… [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2025/049084 mailed on Dec. 5, 2025, 20 pages. [cited by applicant]
Guu, Kelvin et al. “REALM: Retrieval-Augmented Language Model Pre-Training,” Feb. 10, 2020, 12 pages, Retrieved from the Internet: URL: https://arxiv.org/pdf/2002.08909.pdf? [retrieved on Feb. 14, 2024]. [cited by applicant]
Jiang, Zhengbao et al. “Active Retrieval Augmented Generation,” May 11, 2023, 24 pages, Retrieved from the Internet: URL: https://arxiv.org/pdf/2305.06983v1 [retrieved on Jun. 23, 2026]. [cited by applicant]
Lewis, Patrick et al. “Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks,” Cornell University Library, Dec. 7, 2020, 19 pages, Ithaca, New York. [cited by applicant]