METHOD AND APPARATUS FOR INTENT-GUIDED AUTOMATED SPEECH RECOGNITION
In a method and apparatus for intent-guided automatic speech recognition (ASR) in customer service center environments, the method includes detecting, at a call analytics server (CAS), from a call audio of a call between at least two persons comprising a first person and a second person, an intent expressed by one of the first person or second person. The method further includes verifying that the detected intent is on a predefined list of intents and focusing the range of applicability of a language prediction (LP) module, where the LP module uses one or more language models (LMs), used by the CAS to generate a transcribed text from the call audio, to a conversational domain corresponding to the detected intent.
1 . A computing apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the apparatus to:
detect, at a call analytics server (CAS), from a call audio of a call between at least two persons comprising a first person and a second person, an intent expressed by one of the first person or second person;
verify that the detected intent is on a predefined list of intents;
focus the range of applicability of a language prediction (LP) module, the LP module using one or more language models (LMs), used by the CAS to generate a transcribed text from the call audio, to a conversational domain corresponding to the detected intent.
2 . The computing apparatus of claim 1 , wherein said focusing includes:
substitute a generic LM of the LP module for an intent-specific LM optimized for said conversational domain.
3 . The computing apparatus of claim 1 , wherein said one or more LMs include a transformer-based LM, the transformer LM operable to be selectively biased towards one or more conversational domains corresponding to the predefined list of intents, and wherein said focusing includes:
using said detected intent as an input for said transformer LM, thereby biasing the transformer LM model towards said conversational domain.
4 . The computing apparatus of claim 3 , wherein said detect further includes detecting two or more intents from the predefined list of intents, and wherein said focusing further includes:
using the two or more detected intents as an input for the transformer LM, thereby biasing the transformer LM towards two or more conversational domains simultaneously.
5 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
detect, at a call analytics server (CAS), from a call audio of a call between at least two persons comprising a first person and a second person, an intent expressed by one of the first person or second person;
verify that the detected intent is on a predefined list of intents;
focus the range of applicability of a language prediction (LP) module, the LP module using one or more language models (LMs), used by the CAS to generate a transcribed text from the call audio, to a conversational domain corresponding to the detected intent.
6 . The computer-readable storage medium of claim 5 , wherein said focusing includes:
substitute a generic LM of the LP module for an intent-specific LM optimized for said conversational domain.
7 . The computer-readable storage medium of claim 5 , wherein said one or more LMs include a transformer-based LM, the transformer LM operable to be selectively biased towards one or more conversational domains corresponding to the predefined list of intents, and wherein said focusing includes:
using said detected intent as an input for said transformer LM, thereby biasing the transformer LM model towards said conversational domain.
8 . The computer-readable storage medium of claim 7 , wherein said detect further includes detecting two or more intents from the predefined list of intents, and wherein said focusing further includes:
using the two or more detected intents as an input for the transformer LM, thereby biasing the transformer LM towards two or more conversational domains simultaneously.
9 . A method for automatically generating a call summary, the method comprising:
detecting, at a call analytics server (CAS), from a call audio of a call between at least two persons comprising a first person and a second person, an intent expressed by one of the first person or second person;
verifying that the detected intent is on a predefined list of intents;
focusing the range of applicability of a language prediction (LP) module, the LP module using one or more language models (LMs), used by the CAS to generate a transcribed text from the call audio to a conversational domain corresponding to the detected intent.
10 . The method of claim 9 , wherein said focusing includes:
substituting a generic LM of the LP module for an intent-specific LM optimized for said conversational domain.
11 . The method of claim 9 , wherein said one or more LMs include a transformer-based LM, the transformer LM operable to be selectively biased towards one or more conversational domains corresponding to the predefined list of intents, and wherein said focusing includes:
using said detected intent as an input for said transformer LM, thereby biasing the transformer LM model towards said conversational domain.
12 . The method of claim 11 , wherein said detecting further includes detecting two or more intents from the predefined list of intents, and wherein said focusing further includes:
using the two or more detected intents as an input for the transformer LM, thereby biasing the transformer LM towards two or more conversational domains simultaneously.