MULTI-PARTICIPANT VOICE ORDERING
A voice interface recognizes spoken utterances from multiple users. It responds to the utterances in ways such as modifying the attributes of instances of items. The voice interface computes a voice vector for each utterance and associates it with the item instance that is modified. For following utterances with a closely matching voice vector, the voice interface modifies the same instance. For following utterances with a voice vector that is not a close match to one stored for any item instance, the voice interface modifies a different item instance.
1 . A computer-implemented method comprising:
receiving a first spoken utterance that specifies a type of item to modify;
calculating a first voice feature vector from the first spoken utterance;
in response to the first spoken utterance, modifying a first item of the specified type;
storing the first voice feature vector in relation to the first item;
receiving a second spoken utterance to modify an item of the specified type;
calculating a second voice feature vector from the second spoken utterance;
in response to determining that the second voice feature vector and the first voice feature vector have a difference greater than a threshold, modifying a second item of the specified type; and
outputting an indication of the status of the modified first item and the status of the modified second item.
2 . The method of claim 1 , wherein voice feature vectors are calculated by:
identifying a start of voice activity in audio;
performing automatic speech recognition on the audio to recognize words;
detecting the completion of the utterance by matching the recognized words to a word pattern; and
computing the voice feature vector as a vector of aggregate voice features in the audio between the start of voice activity and the completion of the utterance.
3 . The method of claim 1 , wherein modifying the second item is in response to the second spoken utterance being received within a period of time of receiving the first spoken utterance, the period of time being less than thirty seconds.
4 . The method of claim 1 , wherein the first item and the second item are members of a list.
5 . The method of claim 1 , wherein determining that the second voice feature vector and the first voice feature vector have a difference greater than a threshold comprises:
computing a distance between points represented by the vectors in a multidimensional space; and
determining that the second voice feature and the first voice feature vector have a distance in the vector space greater than a threshold.
6 . A computer-implemented method comprising:
receiving a first spoken utterance that specifies a type of item to order or modify;
calculating a first voice feature signature from the first spoken utterance;
in response to the first spoken utterance, ordering or modifying a first item of the specified type;
storing the first voice feature signature in relation to the first item;
receiving a second spoken utterance to order or modify an item of the specified type;
calculating a second voice feature signature from the second spoken utterance; and
in response to determining that the second voice feature signature and the first voice feature signature have a difference greater than a threshold, ordering or modifying a second item of the specified type.
7 . The method of claim 6 , further comprising the step of outputting an indication of the status of the modified first item and the status of the modified second item.
8 . The method claim 6 , wherein said step of calculating a first voice feature signature from the first spoken utterance comprises the step of calculating a first voice feature vector from the spoken utterance, and wherein the step of calculating a second voice feature signature from the second spoken utterance comprises the step of calculating a second voice feature vector from the second spoken utterance.
9 . The method of claim 8 , wherein voice feature vectors are calculated by:
identifying a start of voice activity in audio;
performing automatic speech recognition on the audio to recognize words;
detecting the completion of the utterance by matching the recognized words to a word pattern; and
computing the voice feature vector as a vector of aggregate voice features in the audio between the start of voice activity and the completion of the utterance.
10 . The method of claim 8 , wherein determining that the second voice feature vector and the first voice feature vector have a difference greater than a threshold comprises:
computing a distance between points represented by the vectors in a multidimensional space; and
determining that the second voice feature and the first voice feature vector have a distance in the vector space greater than a threshold.
11 . The method of claim 6 , wherein modifying the second item is in response to the second spoken utterance being received within a period of time of receiving the first spoken utterance, the period of time being less than thirty seconds.
12 . The method of claim 6 , wherein the first item and the second item are members of a list.
13 . A computer-implemented method comprising:
calculating a first voice feature signature from a received first spoken utterance that specifies a first item of a specified type to order or modify;
storing the first voice feature signature in relation to the first item;
calculating a second voice feature signature from a received second spoken utterance to order or modify an item of the specified type; and
in response to determining that the second voice feature signature and the first voice feature signature have a difference greater than a threshold, ordering or modifying a second item of the specified type.
14 . The method of claim 13 , further comprising the step of outputting an indication of the status of the modified first item and the status of the modified second item.
15 . The method claim 13 , wherein said step of calculating a first voice feature signature from the first spoken utterance comprises the step of calculating a first voice feature vector from the spoken utterance, and wherein the step of calculating a second voice feature signature from the second spoken utterance comprises the step of calculating a second voice feature vector from the second spoken utterance.
16 . The method of claim 15 , wherein voice feature vectors are calculated by:
identifying a start of voice activity in audio;
performing automatic speech recognition on the audio to recognize words;
detecting the completion of the utterance by matching the recognized words to a word pattern; and
computing the voice feature vector as a vector of aggregate voice features in the audio between the start of voice activity and the completion of the utterance.
17 . The method of claim 15 , wherein determining that the second voice feature vector and the first voice feature vector have a difference greater than a threshold comprises:
computing a distance between points represented by the vectors in a multidimensional space; and
determining that the second voice feature and the first voice feature vector have a distance in the vector space greater than a threshold.
18 . The method of claim 13 , wherein modifying the second item is in response to the second spoken utterance being received within a period of time of receiving the first spoken utterance, the period of time being less than thirty seconds.
19 . The method of claim 13 wherein the first item and the second item are members of a list.