System and method for correction of a query using a replacement phrase
Systems and methods are provided for natural language processing using neural network models and natural language virtual assistants. The system and method include receiving a natural language phrase including a word sequence, computing corresponding error probabilities that the words are errors, and for a word with a corresponding error probability above a threshold, then computing a replacement phrase with a low error probability to provide a response from the virtual assistant depending on the replacement phrase.
1. A virtual assistant comprising a trained neural network model, wherein training the model uses queries presented in a short period of time to detect an error and learn to correct the error, for natural language processing to identify errors for a query presented in a natural language form, wherein the virtual assistant calculates a vector distance between a first sentiment vector and a second sentiment vector and computes a transcription error probability and a natural language understanding misinterpretation probability using the trained neural network model, and wherein the transcription error probability and the natural language understanding misinterpretation probability represent an error profile for the query, probabilities being related to the vector distance and inversely related to an edit distance, and the transcription error probability exceeds the natural language understanding misinterpretation probability for large vector distances.
2. A computer-implemented method comprising:
receiving a natural language query and transcribing it into a first word sequence;
using a statistical model, wherein training the model includes using natural language expressions identified as errors, on words within the first word sequence to compute corresponding error probabilities that the words are errors;
deriving a second word sequence having a replacement phrase for a word with a corresponding error probability above a threshold, the replacement phrase having a lower error probability and the replacement phrase is derived from a phonetic closeness score between a candidate replacement phrase and a hypothesized erroneous phrase; and
transmitting a virtual assistant query response depending on the replacement phrase.
3. The method of claim 2 further comprising receiving acoustic model scores for words within the first word sequence, wherein the corresponding error probability is inversely related to the acoustic model score.
4. The method of claim 2 further comprising computing a sentiment vector from the replacement phrase, wherein the virtual assistant query response depends on the sentiment vector.
5. The method of claim 2 further comprising:
computing a sentiment vector from the replacement phrase;
computing the distance between the computed sentiment vector and a sentiment vector from a previous natural language query; and
determining the virtual assistant query response based on the distance being below a threshold.
6. The method of claim 2 further comprising computing an error score by aggregating a plurality of error indicators.
7. The method of claim 6 further comprising normalizing weighting of error indicators using the error score.