System and method for omnichannel text-based communication system utilizing speech recognition
A system and method for omnichannel voice and text-based advertising using voice recognition. The system comprises an application that allows a user who has viewed an advertisement on a non-interactive medium to speak one or more words dictated by the advertisement into the application in order to receive business incentives. A speech recognition engine recognizes the words spoken into the application and matches the words to the relevant advertisement and delivers a text-based incentive to the user. Furthermore, with the potential customer's phone number now available, an omnichannel text-based communicator may now send other advertisements, reminders (such as to use the incentive), and communications to the user of the application.
1. A system for real-time omnichannel interactions utilizing speech recognition, comprising:
a computing device comprising a memory, a processor, and a non-volatile data storage device;
a customer database residing on the non-volatile data storage device comprising customer telephone numbers;
an advertisement database residing on the non-volatile data storage device comprising advertisements, each advertisement comprising text from a non-interactive advertisement and additional details;
a communication application operating on a mobile computing device, the communication application comprising a unique tracking identifier associated with the mobile computing device on which the communication application is operating and being configured to:
record audio data comprising one or more words displayed on a non-interactive advertisement and spoken into a microphone of the mobile computing device;
transmit the audio data as a multimedia message via a cellular data network to an omnichannel text-based communicator along with the unique tracking identifier;
receive and display a first text message from a chatbot operating on the omnichannel text-based communicator, the text message comprising a query about the non-interactive advertisement; and
send a second text message to the omnichannel text-based communicator via the cellular data network, the second text message comprising a user freeform response to the query;
the omnichannel text-based communicator, comprising a first plurality of programming instructions stored in the memory and operating on the processor, wherein the first plurality of programming instructions, when operating on the processor, causes the computing device to:
receive the first text message comprising the audio data and the unique tracking identifier from the communication application via the cellular data network;
retrieve a telephone number associated with the communication application from the customer database;
transcribe each of the spoken words from the received audio data into a corresponding word in text format;
match the text-formatted words to one or more words associated with an advertisement contained in the advertisement database;
using a chatbot, generate a query about the non-interactive advertisement associated with the spoken words;
send the query to the mobile phone as a first text message to the telephone number via a cellular data network;
receive the first text message via the cellular data network;
retrieve additional details for the advertisement based on the queries and responses; and
send the additional details to the communication application via a non-cellular network;
wherein if the query is not responded to within a specific time period, a reminder message to respond to the query is sent to the communication application;
wherein the communication application is activated by voice commands;
wherein communications between the communication application and the omnichannel text-based communicator are stored in a database and processed using artificial intelligence; and
wherein the additional details comprise contact information for a business associated with the advertisement.
2. The system of claim 1 , wherein the communication application has access to other communication means on a mobile device selected from the group consisting of email, phone calls, text messaging and other text-based mobile communications.
3. A method for real-time omnichannel interactions utilizing speech recognition, comprising the steps of:
recording, using a communication application operating on a mobile computing device, audio data comprising one or more words displayed on a non-interactive advertisement and spoken into a microphone of the mobile computing device;
transmitting the audio data as a multimedia message via a cellular data network to an omnichannel text-based communicator along with the unique tracking identifier, the omnichannel text-based communicator operating on a computing device comprising a memory, a processor, and a non-volatile data storage device on which are stored a customer database comprising customer telephone numbers and an advertisement database comprising advertisements, each advertisement comprising text from a non-interactive advertisement and additional details;
receiving the audio data and the unique tracking identifier at the omnichannel text-based communicator via the cellular data network;
retrieving a telephone number associated with the communication application from the customer database;
transcribing, using the omnichannel text-based communicator, each of the spoken words from the received audio data into a corresponding word in text format;
matching, using the omnichannel text-based communicator, the text-formatted words to one or more words associated with an advertisement contained in the advertisement database;
using a chatbot, generating a query about the non-interactive advertisement associated with the spoken words;
sending the query from the omnichannel text-based communicator to the mobile phone as a first text message to the telephone number via a cellular data network;
receiving and displaying a first text message on a mobile device from a chatbot operating on the omnichannel text-based communicator, the text message comprising a query about the non-interactive advertisement;
sending a second text message to the omnichannel text-based communicator via the cellular data network, the second text message comprising a user freeform response to the query;
receiving the second text message at the omnichannel text-based communicator via the cellular data network;
retrieving, using the omnichannel text-based communicator, additional details for the advertisement based on the queries and responses; and
sending, using the omnichannel text-based communicator, the additional details to the communication application via a non-cellular network;
wherein if the query is not responded to within a specific time period, a reminder message to respond to the query is sent to the communication application;
wherein the communication application is activated by voice commands;
wherein communications between the communication application and the omnichannel text-based communicator are stored in a database and processed using artificial intelligence; and
wherein the additional details comprise contact information for a business associated with the advertisement.
4. The method of claim 3 , wherein the communication application has access to other communication means on a mobile device selected from the group consisting of email, phone calls, text messaging and other text-based mobile communications.