Dynamic intent classification based on environment variables
To prevent intent classifiers from potentially choosing intents that are ineligible for the current input due to policies, dynamic intent classification systems and methods are provided that dynamically control the possible set of intents using environment variables (also referred to as external variables). Associations between environment variables and ineligible intents, referred to as culling rules, are used.
1. A computing device comprising:
a processor; and
a memory operably coupled to the processor, the memory having computer-executable instructions stored thereon that, when executed by the processor cause the computing device to:
receive, at a natural language understanding (NLU) component, a user input;
pre-process the user input to identify at least one environmental variable;
provide the user input to a trained classifier of the NLU component;
identify an intent subset by culling at least a portion of a plurality of stored intents based at least on the at least one environmental variable;
determine, using the trained classifier, an intent associated with the user input from the intent subset; and
output, by the NLU component and via a display of the computing device, a response to the user input based at least on the determined intent.
2. The computing device of claim 1 , wherein culling at least a portion of the plurality of stored intents comprises applying a masking layer over an output distribution of the trained classifier.
3. The computing device of claim 1 , wherein the computer-executable instructions are further configured to, when executed by the processor, cause the computing device to:
modify the trained classifier based at least on the at least one environmental variable associated with the user input.
4. The computing device of claim 3 , wherein the trained classifier comprises a grammar-based model, and wherein modifying the trained classifier comprises removing grammar associated with a culled intent set.
5. The computing device of claim 1 , wherein the trained classifier comprises a tree-based model, and wherein culling at least a portion of the plurality of stored intents comprises removing at least one node or edge leading to at least one of the plurality of stored intents.
6. The computing device of claim 1 , wherein the computing device comprises a chatbot trained using chat data that is configured to output processed language outputs.
7. The computing device of claim 1 , wherein culling at least a portion of the plurality of stored intents based at least on the at least one environmental variable comprises:
using a rules-based operation to rank the plurality of stored intents; and
identifying a predetermined top number of the plurality of stored intents as the intent subset.
8. The computing device of claim 1 , wherein the plurality of stored intents is stored in a database external to the computing device.
9. A system comprising:
a processor; and
a memory operably coupled to the processor, the memory having computer-executable instructions stored thereon that, when executed by the processor cause the system to:
receive, at a natural language understanding (NLU) component, a user input;
pre-process the user input to identify at least one environmental variable;
provide the user input to a trained classifier of the NLU component;
identify an intent subset by culling at least a portion of a plurality of stored intents based at least on the at least one environmental variable;
determine, using the trained classifier, an intent associated with the user input from the intent subset; and
output, by the NLU component, a response to the user input based at least on the determined intent.
10. The system of claim 9 , wherein culling at least a portion of the plurality of stored intents comprises applying a masking layer over an output distribution of the trained classifier.
11. The system of claim 9 , wherein the computer-executable instructions are further configured to, when executed by the processor, cause the system to:
modify the trained classifier based at least on the at least one environmental variable associated with the user input.
12. The system of claim 11 , wherein the trained classifier comprises a grammar-based model, and wherein modifying the trained classifier comprises removing grammar associated with a culled intent set.
13. The system of claim 9 , wherein the trained classifier comprises a tree-based model, and wherein culling at least a portion of the plurality of stored intents comprises removing at least one node or edge leading to at least one of the plurality of stored intents.
14. The system of claim 9 , further comprising:
a chatbot trained using chat data that is configured to output processed language outputs as the response.
15. The system of claim 9 , wherein culling at least a portion of the plurality of stored intents based at least on the at least one environmental variable comprises:
using a rules-based operation to rank the plurality of stored intents; and
identifying a predetermined top number of the plurality of stored intents as the intent subset.
16. The system of claim 9 , wherein the plurality of stored intents is stored in an external database.
17. A method comprising:
receiving, at a natural language understanding (NLU) component, a user input;
pre-processing the user input to identify at least one environmental variable;
providing the user input to a trained classifier of the NLU component;
identifying an intent subset by culling at least a portion of a plurality of stored intents based at least on the at least one environmental variable;
determining, using the trained classifier, an intent associated with the user input from the intent subset; and
outputting, by the NLU component, a response to the user input based at least on the determined intent.
18. The method of claim 17 , wherein culling at least a portion of the plurality of stored intents comprises applying a masking layer over an output distribution of the trained classifier.
19. The method of claim 17 , further comprising:
modifying the trained classifier based at least on the at least one environmental variable associated with the user input.
20. The method of claim 19 , wherein the trained classifier comprises a grammar-based model, and wherein modifying the trained classifier comprises removing grammar associated with a culled intent set.