Granted Patent B2

US 12,223,276 · App. 18/424,178 · Granted Feb 11, 2025

Inventors: Vishal Vishnoi (Redwood City, CA); Xin Xu (San Jose, CA); Elias Luqman Jalaluddin (Seattle, WA); Srinivasa Phani Kumar Gadde (Belmont, CA); Crystal C. Pan (Palo Alto, CA); Mark Edward Johnson (Castle Cove, AU); Thanh Long Duong (Pointcook, AU); Balakota Srinivas Vinnakota (Sunnyvale, CA); Manish Parekh (San Jose, CA)

Assignee: ORACLE INTERNATIONAL CORPORATION

G06F40/295G06F40/211G06F40/35G06F40/56G06N5/043

Abstract

Claims (56)

1. A computer-implemented method comprising:

receiving an utterance from a user within a chatbot session, wherein a current skill context of the chatbot session is a first skill and a current group context of the chatbot session is a first group;

obtaining, using a candidate skills model for the first group, a ranking of skills within the first group that could potentially process the utterance;

determining, based on the ranking of skills, a second skill is a highest ranked skill for processing the utterance and a third skill is a second highest ranked skill for processing the utterance;

determining both the second skill and the third skill are within a win margin parameter;

changing the current skill context of the chatbot session to the second skill and the third skill;

obtaining, using a candidate flows model for the second skill, a ranking of intents within the second skill that match the utterance;

obtaining, using another candidate flows model for the third skill, a ranking of intents within the third skill that match the utterance; and

determining, based on the ranking of intents within the second skill and the ranking of intents within the third skill, an intent that is a highest ranked intent for processing the utterance.

2. The computer-implemented method of claim 1 , wherein the obtaining the ranking of skills comprises evaluating the utterance and generating confidence scores for the skills within the first group, identifying any skill with a confidence score exceeding a value of a candidate skills confidence threshold routing parameter as a candidate skill for further evaluation, and ranking the candidate skills based on the confidence scores as skills within the first group that could potentially process the utterance.

3. The computer-implemented method of claim 1 , wherein the obtaining the ranking of intents within the second skill and the third skill comprises evaluating the intents and generating confidence scores for the intents within the second skill and the third skill, identifying any intent with a confidence score exceeding a value of a confidence threshold routing parameter as a candidate intent for further evaluation, and ranking the candidate intents based on the confidence scores as intents within the second skill and the third skill that match the utterance.

4. The computer-implemented method of claim 1 , further comprising initiating a conversation flow in the chatbot session with the user based on the intent that is the highest ranked intent for processing the utterance.

5. The computer-implemented method of claim 1 , further comprising:

receiving an initial utterance from a user within the chatbot session, wherein the initial utterance is receive prior to the utterance;

inputting the initial utterance into the candidate skills model;

obtaining, using the candidate skills model, a ranking of skills that could potentially process the initial utterance;

determining, based on the ranking of skills, the first skill is a highest ranked skill for processing the initial utterance; and

assigning the current skill context of the chatbot session to the first skill and the current group context of the chatbot session to the first group, wherein the first group is defined for the first skill, and the assignment of the current group context of the chatbot session to the first group is performed based on the first group being defined for the first skill.

6. A system comprising:

one or more data processors; and

a non-transitory computer readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform actions including:

receiving an utterance from a user within a chatbot session, wherein a current skill context of the chatbot session is a first skill and a current group context of the chatbot session is a first group;

obtaining, using a candidate skills model for the first group, a ranking of skills within the first group that could potentially process the utterance;

determining, based on the ranking of skills, a second skill is a highest ranked skill for processing the utterance and a third skill is a second highest ranked skill for processing the utterance;

determining both the second skill and the third skill are within a win margin parameter;

changing the current skill context of the chatbot session to the second skill and the third skill;

obtaining, using a candidate flows model for the second skill, a ranking of intents within the second skill that match the utterance;

obtaining, using another candidate flows model for the third skill, a ranking of intents within the third skill that match the utterance; and

determining, based on the ranking of intents within the second skill and the ranking of intents within the third skill, an intent that is a highest ranked intent for processing the utterance.

7. The system of claim 6 , wherein the obtaining the ranking of skills comprises evaluating the utterance and generating confidence scores for the skills within the first group, identifying any skill with a confidence score exceeding a value of a candidate skills confidence threshold routing parameter as a candidate skill for further evaluation, and ranking the candidate skills based on the confidence scores as skills within the first group that could potentially process the utterance.

8. The system of claim 6 , wherein the obtaining the ranking of intents within the second skill and the third skill comprises evaluating the intents and generating confidence scores for the intents within the second skill and the third skill, identifying any intent with a confidence score exceeding a value of a confidence threshold routing parameter as a candidate intent for further evaluation, and ranking the candidate intents based on the confidence scores as intents within the second skill and the third skill that match the utterance.

9. The system of claim 6 , wherein the actions further comprise initiating a conversation flow in the chatbot session with the user based on the intent that is the highest ranked intent for processing the utterance.

10. The system of claim 6 , wherein the actions further comprise:

receiving an initial utterance from a user within the chatbot session, wherein the initial utterance is receive prior to the utterance;

inputting the initial utterance into the candidate skills model;

obtaining, using the candidate skills model, a ranking of skills that could potentially process the initial utterance;

determining, based on the ranking of skills, the first skill is a highest ranked skill for processing the initial utterance; and

assigning the current skill context of the chatbot session to the first skill and the current group context of the chatbot session to the first group, wherein the first group is defined for the first skill, and the assignment of the current group context of the chatbot session to the first group is performed based on the first group being defined for the first skill.

11. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause one or more data processors to perform actions including:

receiving an utterance from a user within a chatbot session, wherein a current skill context of the chatbot session is a first skill and a current group context of the chatbot session is a first group;

obtaining, using a candidate skills model for the first group, a ranking of skills within the first group that could potentially process the utterance;

determining, based on the ranking of skills, a second skill is a highest ranked skill for processing the utterance and a third skill is a second highest ranked skill for processing the utterance;

determining both the second skill and the third skill are within a win margin parameter;

changing the current skill context of the chatbot session to the second skill and the third skill;

obtaining, using a candidate flows model for the second skill, a ranking of intents within the second skill that match the utterance;

obtaining, using another candidate flows model for the third skill, a ranking of intents within the third skill that match the utterance; and

determining, based on the ranking of intents within the second skill and the ranking of intents within the third skill, an intent that is a highest ranked intent for processing the utterance.

12. The computer-program product of claim 11 , wherein the obtaining the ranking of skills comprises evaluating the utterance and generating confidence scores for the skills within the first group, identifying any skill with a confidence score exceeding a value of a candidate skills confidence threshold routing parameter as a candidate skill for further evaluation, and ranking the candidate skills based on the confidence scores as skills within the first group that could potentially process the utterance.

13. The computer-program product of claim 11 , wherein the obtaining the ranking of intents within the second skill and the third skill comprises evaluating the intents and generating confidence scores for the intents within the second skill and the third skill, identifying any intent with a confidence score exceeding a value of a confidence threshold routing parameter as a candidate intent for further evaluation, and ranking the candidate intents based on the confidence scores as intents within the second skill and the third skill that match the utterance.

14. The computer-program product of claim 11 , wherein the actions further comprise initiating a conversation flow in the chatbot session with the user based on the intent that is the highest ranked intent for processing the utterance.

15. The computer-program product of claim 11 , wherein the actions further comprise:

receiving an initial utterance from a user within the chatbot session, wherein the initial utterance is receive prior to the utterance;

inputting the initial utterance into the candidate skills model;

obtaining, using the candidate skills model, a ranking of skills that could potentially process the initial utterance;

determining, based on the ranking of skills, the first skill is a highest ranked skill for processing the initial utterance; and

assigning the current skill context of the chatbot session to the first skill and the current group context of the chatbot session to the first group, wherein the first group is defined for the first skill, and the assignment of the current group context of the chatbot session to the first group is performed based on the first group being defined for the first skill.

Assignments (1)

Continuity (3)

References Cited (26)