Voice-based menu personalization
A natural-language voice chatbot engages a consumer in a voice dialogue. The chatbot is customized for engaging the specific consumer based on features and characteristics of that specific consumer's speech and a lexicon associated with terms, words, and commands for item ordering. The consumer can perform voice queries for specific items and/or specific establishments for placing a pre-staged order with the chatbot. Once the consumer selects options with a specific establishment, a pre-staged order is provided to the corresponding establishment on behalf of the user. Location data for a consumer-operated device is monitored and when it is determined that the consumer will arrive at the establishment within a time period required by the establishment to prepare the pre-staged order, a message is sent to the establishment to begin preparing the pre-staged order.
1. A method, comprising:
engaging a consumer in a natural language voice dialogue to place an order at an establishment using voice characteristics specific to the consumer and a lexicon specific to ordering with the establishment;
translating speech of the consumer into text based on the voice characteristics that are specific to the consumer and the lexicon associated with ordering, wherein the translating utilizes a machine learning algorithm that receives as input the voice characteristics, an audio snippet of consumer speech, and the lexicon, and provides as output the text that corresponds to the speech;
customizing voice interaction using deep learning techniques by performing an initial voice training session to capture voice features and characteristics for the consumer;
wherein during the initial voice training session:
displaying text sentences on a display device;
receiving audio snippets of the speech from the consumer in response to prompts to the consumer to repeat the text sentences; and
training the machine learning algorithm to return voice features of the consumer, wherein corresponding features are retained in a voice profile specific to the consumer; and
training a non-user specific machine learning algorithm to utilize the voice profile to enable text translation for the consumer;
placing the order within an order system associated with the establishment using menu options obtained from the consumer during the engaging; and
sending a message to a fulfillment terminal of the establishment to begin order preparation when location data associated with a consumer device of the consumer indicates that the consumer is in route to the establishment to pick up the order and a calculated time in which the consumer is estimated to arrive at the establishment, wherein the calculated time corresponds with an order preparation time for the establishment to complete the order.
2. The method of claim 1 further comprising, sending a second message to the fulfillment terminal when the location data indicates the consumer has arrived at the establishment.
3. The method of claim 1 , wherein engaging further includes obtaining a voice profile for the consumer and identifying the voice characteristics from the voice profile.
4. The method of claim 3 , wherein engaging further includes obtaining the audio snippet from the voice profile.
5. The method of claim 4 , wherein engaging further includes obtaining the lexicon based on an establishment identifier associated with the establishment.
6. The method of claim 1 further comprising, updating the voice characteristics of the consumer based on the speech provided by the consumer during the engaging.
7. The method of claim 1 , wherein engaging further includes identifying the consumer based on a device identifier for a consumer device, wherein the speech of the consumer during the engaging is provided through a microphone of the consumer device.
8. The method of claim 7 , wherein engaging further includes obtaining the voice characteristics for the consumer from the consumer device.
9. The method of claim 1 , wherein engaging further includes communicating auto-generated speech at a start of the engaging to the consumer through a speaker of a consumer device, wherein the auto-generated speech communicates a list of available establishments.
10. The method of claim 9 , wherein engaging further includes identifying the establishment based on speech of the consumer responsive to the communicating of the auto-generated speech.