IP Library Granted Patent US 10,629,191
Granted Patent B1
US 10,629,191 · App. 16/528,926 · Granted Apr 21, 2020

Methods and systems for deploying and managing scalable multi-service virtual assistant platform

Inventors: Fang Cheng (Mountain View, CA); Dennis Wu (Palo Alto, CA); Jian Da Chen (Newark, CA)
Assignee: Linc Global, Inc.
G10L15/1822G06F16/90332G06F17/2705G06N5/04G06N20/00G10L15/18G10L15/22H04L51/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,629,191
App. No.
16/528,926
Granted
Apr 21, 2020
Kind
B1
Abstract

The present invention is a scalable multi-service virtual assistant platform that can construct a fluid and dynamic dialogue by assembling responses to end user utterances from two kinds of agents, information agents and action agents. The information agents and action agents are managed by a masterbot or arbiter. The virtual assistant can gain new skills by getting instructions about a new service expressed in a form of pre-requisites and action combinations; the virtual assistant platform automatically handles dialogue generation, arbitration and optimization to survey prerequisites from the end user, and eventually to take action. The present invention allows a large number of services to implemented using a small number of building blocks. These building blocks can be used to assemble a much larger number of services. In turn, each service can be delivered through a large variety of conversations with end users, enabling a fluid and dynamic dialogue to be seamlessly implemented.

Claims (36)

1. A system for a virtual assistant platform, comprising:

at least one memory device that stores computer-executable instructions; and

at least one processor configured to access the memory device, wherein the processor is configured to execute the computer-executable instructions to:

receive one or more utterances from a user;

generate a parsed user input from the one or more utterances using a natural language understanding (NLU) module;

obtain at least one information value from the parsed user input and/or contextual data using a plurality of information agents;

perform one or more actions in response to the parsed user input, the contextual data, and/or the at least one information value using a plurality of action agents, wherein the plurality of information agents and the plurality of action agents are interrelated via one or more relationship connections, wherein the one or more relationship connections comprises at least a prerequisite connection that activates one or more prerequisite information agents to fulfill one or more prerequisite conditions for a given action agent; and

arbitrate an activation of the plurality of information agents and the plurality of action agents using a masterbot to render a response back to the user.

2. The system of claim 1 , wherein at least one of the plurality of information agents is adapted to understand the parsed user input from the user to extract the information value directly from the parsed user input.

3. The system of claim 1 , wherein at least one of the plurality of information agents is adapted to infer the information value from the parsed user input, wherein the inferring is activated in response to determining that a given information agent cannot obtain the information value by understanding the parsed user input directly.

4. The system of claim 3 , wherein at least one of the plurality of information agents is adapted to infer the information value by accessing one or more contextual data sources for the contextual data and is adapted to infer the information value from the parsed user input and the contextual data.

5. The system of claim 4 , wherein at least one of the plurality of information agents is adapted to query the user for the information value by generating a natural language query using a natural language generation (NLG) module, wherein the querying is activated in response to determining that the information agent cannot obtain the information value by understanding the parsed user input or inferring the information value.

6. The system of claim 1 , wherein at least one of the plurality of information agents is adapted to obtain the information value by activating one or more other information agents, wherein the one or more other information agents are activated in response to determining that the at least one information agent cannot obtain the information value by understanding the parsed user input or inferring the information value.

7. The system of claim 1 , wherein at least one of the plurality of action agents performs the one or more actions by triggering one or more internal services to perform one or more services.

8. The system of claim 7 , wherein at least one of the plurality of action agents performs the one or more actions by accessing one or more Application Programming Interface (API) gateways to external services to perform the one or more services.

9. The system of claim 1 , wherein the masterbot is adapted to activate one or more of the information agents in order to meet one or more prerequisite connections for a given action agent, wherein the given action agent utilizes the one or more activated information agents to obtain one or more information values needed to perform the one or more actions.

10. The system of claim 1 , wherein at least one of the plurality of action agents is adapted to generate a natural language reply to the user using a natural language generation (NLG) module.

11. The system of claim 1 , wherein at least one of the plurality of action agents is adapted to change a system state by setting up a follow-up action agent.

12. The system of claim 1 , wherein the masterbot evaluates a performance of the plurality of information agents and the plurality of action agents using machine learning to adjust the activation of the information agents and the action agents.

13. The system of claim 1 , wherein the masterbot generates the response to the user using a natural language generation (NLG) module from information supplied by the information agents and/or the action agents.

14. The system of claim 1 , wherein the one or more relationship connections are further selected from the group consisting of a set-value connection between an action agent and an information agent, a follow-up connection between two action agents, and an inference connection between two information agents.

15. The system of claim 14 , wherein the set-value connection interrelates the plurality of information agents and the plurality of action agents via a plurality of set-value actions, wherein a given set-value action for a given action agent is used to set an information value for one or more corresponding information agents which are later used by the corresponding information agents.

16. The system of claim 14 , wherein the follow-up connection interrelates the plurality of action agents amongst themselves which determine when a given action agent follows-up after another given action agent terminates.

17. The system of claim 14 , wherein the inference connection interrelates the plurality of information agents amongst themselves which determine when a given information agent activates one or more related information agents in order to fulfill one or more information values of the given information agent which are later used by the given information agent.

18. A non-transitory, computer-readable medium storing computer-executable instructions for a multi-service virtual assistant platform which, when executed by a processor, cause the processor to perform operations comprising steps to:

receive one or more utterances from a user;

generate a parsed user input from the one or more utterances using a natural language understanding (NLU) module;

obtain at least one information value from the parsed user input and/or contextual data using a plurality of information agents;

perform one or more actions in response to the parsed user input, the contextual data, and/or the at least one information value using a plurality of action agents, wherein the plurality of information agents and the plurality of action agents are interrelated via one or more relationship connections, wherein the one or more relationship connections comprises at least a prerequisite connection that activates one or more prerequisite information agents to fulfill one or more prerequisite conditions for a given action agent; and

arbitrate an activation of the plurality of information agents and the plurality of action agents using a masterbot to render a response back to the user.

19. A computer-implemented method for a multi-service virtual assistant platform which, when executed by a processor, causes the processor to perform steps comprising:

receiving one or more utterances from a user;

generating a parsed user input from the one or more utterances using a natural language understanding (NLU) module;

obtaining at least one information value from the parsed user input and/or contextual data using a plurality of information agents;

performing one or more actions in response to the parsed user input, the contextual data, and/or the at least one information value using a plurality of action agents, wherein the plurality of information agents and the plurality of action agents are interrelated via one or more relationship connections, wherein the one or more relationship connections comprises at least a prerequisite connection that activates one or more prerequisite information agents to fulfill one or more prerequisite conditions for a given action agent; and

activating one or more of the plurality of information agents and the plurality of action agents using a masterbot to render a response back to the user.

Assignments (15)
RELEASE OF SECURITY INTEREST Recorded Feb 23, 2026
From: CHICAGO ATLANTIC ADMIN, LLC, AS ADMINISTRATIVE AGENT
To: AI SOFTWARE, LLC; ENVISION TELEPHONY, INC.; EQUALS 3, INC.
Reel/Frame 073860/0079 →
SECURITY INTEREST Recorded Feb 20, 2026
From: AI SOFTWARE, LLC; EQUALS 3, INC.; TEXTEL CX INC.; CREOVAI, INC.
To: MGG INVESTMENT GROUP LP, AS THE COLLATERAL AGENT
Reel/Frame 073851/0014 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 71413 FRAME: 361. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Oct 21, 2025
From: AI SOFTWARE, LLC; ENVISION TELEPHONY, INC.; EQUALS 3, INC.
To: CHICAGO ATLANTIC ADMIN, LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 073150/0484 →
RELEASE OF SECURITY INTEREST Recorded Jul 1, 2025
From: ORIX GROWTH CAPITAL, LLC
To: AI SOFTWARE LLC; TEXTEL CX, INC.; DENIM SOCIAL, LLC; SMARTACTION HOLDINGS, INC.; SMARTACTION LLC
Reel/Frame 071584/0601 →
SECURITY INTEREST Recorded Jun 13, 2025
From: AI SOFTWARE, LLC; ENVISION TELEPHONY, INC.; EQUALS 3, INC.
To: CHICAGO ATLANTIC LOAN ADMIN, LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 071413/0361 →
SECURITY INTEREST Recorded Feb 25, 2025
From: AI SOFTWARE, LLC; TEXTEL CX, INC.; DENIM SOCIAL LLC; SMARTACTION HOLDINGS, INC.; SMARTACTION LLC
To: ORIX GROWTH CAPITAL, LLC
Reel/Frame 070324/0410 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2024
From: RS1NEEDLE, INC.
To: AI SOFTWARE, LLC
Reel/Frame 068816/0936 →
RELEASE OF SECURITY INTEREST Recorded Oct 2, 2024
From: HUMBOLDT LLC
To: RS1NEEDLE, INC.
Reel/Frame 068774/0111 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2024
From: LINC GLOBAL, INC.
To: RS1NEEDLE, INC.
Reel/Frame 068374/0255 →
ASSIGNMENT OF SECURITY INTEREST Recorded Oct 30, 2023
From: MTVL, LLC
To: HUMBOLDT LLC
Reel/Frame 065395/0309 →
ASSIGNMENT OF SECURITY INTEREST Recorded Jul 21, 2020
From: MORNINGSIDE TECHNOLOGY VENTURES LTD.
To: MTVL, LLC
Reel/Frame 053273/0212 →
SECURITY INTEREST Recorded Jun 26, 2020
From: LINC GLOBAL, INC. F/K/A PROXIMIANT, INC.
To: MORNINGSIDE TECHNOLOGY VENTURES LTD.
Reel/Frame 053057/0720 →
RELEASE OF SECURITY INTEREST Recorded Jun 26, 2020
From: MORNINGSIDE TECHNOLOGY VENTURES LTD.
To: LINC GLOBAL, INC. F/K/A PROXIMIANT, INC.
Reel/Frame 053057/0450 →
SECURITY INTEREST Recorded Feb 13, 2020
From: LINC GLOBAL, INC. F/K/A PROXIMIANT, INC.
To: MORNINGSIDE TECHNOLOGY VENTURES LTD.
Reel/Frame 051925/0309 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2019
From: CHENG, FANG; WU, DENNIS; CHEN, JIAN DA
To: LINC GLOBAL, INC.
Reel/Frame 050327/0687 →
Continuity (1)
Provisional Application 62862128 · Jun 16, 2019
Cited By (8)
US 12,218,891 US 12,393,581 US 12,499,317 US 12,626,696 US 12,664,969 US 12,671,664 US 12,681,968 US 12,711,320