IP Library › Granted Patent US 11,356,389
Granted Patent B2
US 11,356,389 · App. 16/908,116 · Granted Jun 7, 2022

Systems and methods for a two-tier machine learning model for generating conversational responses

Inventors: Kunlaya Soiaporn (McLean, VA); Victor Alvarez Miranda (McLean, VA); Pamela Katali (McLean, VA); Arturo Hernandez Zeledon (McLean, VA); Rui Zhang (McLean, VA); Kwan-Yuet Ho (McLean, VA)
Assignee: Capital One Services, LLC
H04L51/02G06K9/6218G06N20/20G10L15/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,356,389
App. No.
16/908,116
Filed
Jun 22, 2020
Granted
Jun 7, 2022
Kind
B2
Art Unit
2443
USPC
709/206
Abstract

Methods and systems are described for generating dynamic conversational responses using two-tier machine learning models. The dynamic conversational responses may be generated in real time and reflect the likely goals and/or intents of a user. The two-tier machine learning model may include a first tier that determines an intent cluster based on a feature input, and a second tier that determines a specific intent from the cluster.

Claims (63)

1. A system for generating dynamic conversational responses using two-tier machine learning models, the system comprising:

cloud-based storage circuitry configured to:

store a first machine learning model, wherein the first machine learning model is trained to select an intent cluster from a plurality of intent clusters based on feature inputs and user actions, and wherein each intent cluster of the plurality of intent clusters corresponds to a respective intent of a user following a first user action; and

store a second machine learning model, wherein the second machine learning model is trained to select a specific intent from a plurality of specific intents of a selected intent cluster based on a first output, and wherein each specific intent of the plurality of specific intents corresponds to a respective specific intent of the user following the first user action;

cloud-based control circuitry configured to:

receive the first user action during a conversational interaction with a user interface;

determine a first feature input based on the first user action in response to receiving the first user action, wherein the first feature input is a conversational detail or information from a user account of the user;

input the first feature input into the first machine learning model;

receive the first output from the first machine learning model, the first output indicative of a selected intent cluster of the plurality of intent clusters;

select the second machine learning model, from a plurality of machine learning models, based on the selected intent cluster, wherein each intent cluster of the plurality of intent clusters corresponds to a respective machine learning model from the plurality of machine learning models;

input the first output in response to receiving, using the control circuitry, a second output from the second machine learning model; and

select a dynamic conversational response from a plurality of dynamic conversational responses based on the second output; and

cloud-based input/output circuitry configured to:

generate the dynamic conversational response during the conversational interaction.

2. A method for generating dynamic conversational responses using two-tier machine learning models, the method comprising:

receiving a first user action during a conversational interaction with a user interface;

in response to receiving the first user action, determining, using control circuitry, a first feature input based on the first user action;

inputting, using the control circuitry, the first feature input into a first machine learning model, wherein the first machine learning model is trained to select an intent cluster from a plurality of intent clusters based on the first feature input and the first user action, and wherein each intent cluster of the plurality of intent clusters corresponds to a respective intent of a user following the first user action;

receiving, using the control circuitry, a first output from the first machine learning model;

inputting, using the control circuitry, the first output into a second machine learning model, wherein the second machine learning model is trained to select a specific intent from a plurality of specific intents of the selected intent cluster based on the first output, and wherein each specific intent of the plurality of specific intents corresponds to a respective specific intent of the user following the first user action;

receiving, using the control circuitry, a second output from the second machine learning model;

selecting, using the control circuitry, a dynamic conversational response from a plurality of dynamic conversational responses based on the second output; and

generating, at the user interface, the dynamic conversational response during the conversational interaction.

3. The method of claim 2 , further comprising of selecting the second machine learning model, from a plurality of machine learning models, based on the intent cluster selected from the plurality of intent clusters, wherein each intent cluster of the plurality of intent clusters corresponds to a respective machine learning model from the plurality of machine learning models.

4. The method of claim 2 , further comprising:

receiving a second user action during the conversational interaction with the user interface;

in response to receiving the second user action, determining a second feature input for the first machine learning model based on the second user action;

inputting the second feature input into the first machine learning model;

receiving a different output from the first machine learning model, wherein the different output corresponds to a different intent cluster from the plurality of intent clusters; and

inputting the different output into the second machine learning model.

5. The method of claim 2 , wherein the first machine learning model is a supervised machine learning model, and wherein the second machine learning model is a supervised machine learning model.

6. The method of claim 2 , wherein the first machine learning model is a factorization machine model, and wherein the second machine learning model is an artificial neural network model.

7. The method of claim 2 , further comprising of clustering available specific intents into the plurality of intent clusters.

8. The method of claim 2 , further comprising:

receiving a first labeled feature input, wherein the first labeled feature input is labeled with a known intent cluster for the first labeled feature input; and

training the first machine learning model to classify the first labeled feature input with the known intent cluster.

9. The method of claim 2 , wherein the first feature input is a conversational detail or information from a user account of the user.

10. The method of claim 2 , wherein the first feature input indicates a time at which the user interface was launched.

11. The method of claim 2 , wherein the first feature input indicates a webpage from which the user interface was launched.

12. A non-transitory computer-readable medium for generating dynamic conversational responses using two-tier machine learning models, comprising of instructions that, when executed by one or more processors, cause operations comprising:

receiving a first user action during a conversational interaction with a user interface;

in response to receiving the first user action, determining a first feature input based on the first user action;

inputting the first feature input into a first machine learning model, wherein the first machine learning model is trained to select an intent cluster from a plurality of intent clusters based on the first feature input and the first user action, and wherein each intent cluster of the plurality of intent clusters corresponds to a respective intent of a user following the first user action;

receiving a first output from the first machine learning model;

inputting the first output into a second machine learning model, wherein the second machine learning model is trained to select a specific intent from a plurality of specific intents of the selected intent cluster based on the first output, and wherein each specific intent of the plurality of specific intents corresponds to a respective specific intent of the user following the first user action;

receiving a second output from the second machine learning model;

selecting a dynamic conversational response from a plurality of dynamic conversational responses based on the second output; and

generating, at the user interface, the dynamic conversational response during the conversational interaction.

13. The non-transitory computer-readable medium of claim 12 , further comprising of instructions that cause further operations comprising of selecting the second machine learning model, from a plurality of machine learning models, based on the intent cluster selected from the plurality of intent clusters, wherein each intent cluster of the plurality of intent clusters corresponds to a respective machine learning model from the plurality of machine learning models.

14. The non-transitory computer-readable medium of claim 12 , further comprising of instructions that cause further operations comprising:

receiving a second user action during the conversational interaction with the user interface;

in response to receiving the second user action, determining a second feature input for the first machine learning model based on the second user action;

inputting the second feature input into the first machine learning model;

receiving a different output from the first machine learning model, wherein the different output corresponds to a different intent cluster from the plurality of intent clusters; and

inputting the different output into the second machine learning model.

15. The non-transitory computer-readable medium of claim 12 , wherein the first machine learning model is a supervised machine learning model, and wherein the second machine learning model is a supervised machine learning model.

16. The non-transitory computer-readable medium of claim 12 , wherein the first machine learning model is a factorization machine model, and wherein the second machine learning model is an artificial neural network model.

17. The non-transitory computer-readable medium of claim 12 , further comprising of instructions that cause further operations comprising of clustering available specific intents into the plurality of intent clusters.

18. The non-transitory computer-readable medium of claim 12 , further comprising of instructions that cause further operations comprising:

receiving a first labeled feature input, wherein the first labeled feature input is labeled with a known intent cluster for the first labeled feature input; and

training the first machine learning model to classify the first labeled feature input with the known intent cluster.

19. The non-transitory computer-readable medium of claim 12 , wherein the first feature input is a conversational detail or information from a user account of the user.

20. The non-transitory computer-readable medium of claim 12 , wherein the first feature input indicates a time at which the user interface was launched or a webpage from which the user interface was launched.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2020
From: SOIAPORN, KUNLAYA; ALVAREZ MIRANDA, VICTOR; KATALI, PAMELA; HERNANDEZ ZELEDON, ARTURO; ZHANG, RUI; HO, KWAN-YUET
To: CAPITAL ONE SERVICES, LLC
Reel/Frame 053003/0599 →
Continuity (1)
Related Publication 20210399999A1 · Dec 23, 2021