Automated dialog method with first and second thresholds for adapted dialog strategy
View Patent ↗This invention concerns a method and system for monitoring an automated dialog system for the automatic recognition of language understanding errors based on a user's input communications. The method illustratively determines whether a probability of understanding the user's input communication exceeds a first threshold. If the first threshold is exceeded, further dialog is conducted with the user. Otherwise, the user may be directed to a human for assistance. The method also illustratively determines whether the probability also exceeds a second threshold, the second threshold being higher than the first. If so, then further dialog is conducted with the user using the current dialog strategy. However, if the probability falls between a first threshold and a second threshold, the dialog strategy may be adapted in order to improve the chances of conducting a successful dialog with the user.
1. A method, for use in an automated dialog system, of identifying a particular task that a user wishes to have performed based on a dialog with the user, the method being performed if the task has not yet been identified, the method comprising
conducting further dialog with the user if a probability of being able to identify the task based on further input communication from the user exceeds a first threshold,
the further dialog being conducted using a current dialog strategy if said probability exceeds a second threshold greater than said first threshold and being conducted using an adapted dialog strategy if said probability exceeds said first threshold but not said second threshold.
2. The method of claim 1 wherein the probability is determined using recognition and understanding data derived from the user's input communication.
3. The method of claim 1 , wherein the adapted dialog strategy includes one of presenting choices to the user.
4. The method of claim 1 , wherein the probability is determined using training data stored in a training database, the training data including at least one of classification models and extracted features.
5. The method of claim 4 , wherein the extracted features are derived from recognition, understanding and dialog data.
6. The method of claim 1 , further comprising:
storing a first dialog exchange in a dialog history database, wherein the first dialog exchange includes a first automated dialog output and the user's first input communication and the further dialog conducted with the user results in a second dialog exchange, wherein the second dialog exchange includes a second dialog output and the user's second input communication; and
determining whether the probability of understanding exceeds the first threshold using the first dialog exchange and the second dialog exchange.
7. The method of claim 6 , wherein the method is recursive in that the determining step determines whether the probability of understanding the user's input exceeds the first threshold using each of the dialog exchanges conducted.