Automated intelligent personal representative
A virtual assistant application, system, and service that interacts with a caller over a telephone, cellular, or VoIP network as the called party's representative when the called party is unavailable, providing answers to queries and performing commands that were provisioned by the called party. The application includes a telephony interface, speech recognition and synthesis, a dialog manager, and knowledge domain. The application can also be configured to interact with a sender of SMS, MMS, or IM messages.
1. A method, comprising:
receiving a call at a device;
when the call is unanswerable, forwarding, by the device, the call to a personal representative device;
performing, by a communication programming interface:
directing a network interface to answer the call;
starting an instance of a dialog manager; and
directing the dialog manager to load an application and knowledge domain associated with the answered call;
forwarding, to a natural language processing module, a called party's knowledge domain associated with the answered call;
joining the call to a conference call by the personal representative device based on a conference attendee list if the call is not identified as an emergency call;
updating the knowledge domain to participate in the conference call;
transferring the call by the personal representative device to an emergency phone number provided by the called and stored in the called party's knowledge domain, wherein the transfer is performed if the call is identified as the emergency call; and
sending an email to a communication device known to the called and stored in the called party's knowledge domain as requested by a caller, wherein the personal representative device directs an email server to send the email to or from a called party's email account.
2. The method of claim 1 , wherein the call is unanswerable the personal representative device performs one of at least answer the call, screen the caller and transfer the call.
3. The method of claim 1 , wherein the call is unanswerable the personal representative device performs at least one of asking questions and answering questions.
4. The method of claim 1 , wherein the call is unanswerable the personal representative device performs at least one of making appointments and cancelling appointments.
5. The method of claim 1 , wherein the call is unanswerable the personal representative device answers an online chat request.
6. The method of claim 1 , wherein the call is unanswerable the personal representative device responds to an online chat request.
7. The method of claim 1 , wherein the call is unanswerable the personal representative device answers an SMS message.
8. The method of claim 1 , wherein the call is unanswerable the personal representative device responds to an SMS message.
9. The method of claim 1 , wherein the call is unanswerable the personal representative device participates in an online meeting.
10. The method of claim 1 , wherein the call is unanswerable the personal representative device participates in an online discussion.
11. The method of claim 1 , wherein the call is unanswerable the personal representative device responds to user commands.
12. The method of claim 1 , wherein the call is unanswerable the communication programming interface authenticates a user voice.
13. The method of claim 1 , wherein the call is unanswerable the communication programming interface accesses a user calendar.
14. The method of claim 1 , wherein the call is unanswerable the communication programming interface accesses contact information.
15. The method of claim 1 , wherein the call is unanswerable the communication programming interface presents caller history.
16. The method of claim 1 , wherein the call is unanswerable the communication programming interface presents usage statistics.
17. The method of claim 1 , further comprising:
forwarding, to the communication programming interface, a language model and grammars to be installed with an automatic speech recognition module;
outputting, from the natural language processing module, a list of intents having entities and confidence scores associated with the list of intents; and
providing a best match to the dialog manager based on a dialog context and on the knowledge domain.
18. A non-transitory computer readable medium comprising instructions that, when read by a processor, cause the processor to perform:
receiving a call at a device;
when the call is unanswerable, forwarding, by the device, the call to a personal representative device;
performing, by a communication programming interface:
directing a network interface to answer the call;
starting an instance of a dialog manager; and
directing the dialog manager to load an application and knowledge domain associated with the answered call;
forwarding, to a natural language processing module, a called party's knowledge domain associated with the answered call;
joining the call to a conference call by the personal representative device based on a conference attendee list if the call is not identified as an emergency call;
updating the knowledge domain to participate in the conference call;
transferring the call by the personal representative device to an emergency phone number provided by the called and stored in the called party's knowledge domain, if the call is identified as the emergency call; and
sending an email to a communication device known to the called and stored in the called party's knowledge domain as requested by a caller, wherein the personal representative device directs an email server to send the email to or from a called party's email account.
19. The non-transitory computer readable medium of claim 18 , further comprising:
forwarding, to the communication programming interface, a language model and grammars to be installed with an automatic speech recognition module;
outputting, from the natural language processing module, a list of intents having entities and confidence scores associated with the list of intents; and
providing a best match to the dialog manager based on a dialog context and on the knowledge domain.
20. A system, comprising:
a device configured to receive a call;
when the call is unanswerable, the device is configured to forward the call to a personal representative device;
a communication programming interface configured to:
direct a network interface to answer the call;
start an instance of a dialog manager; and
direct the dialog manager to load an application and knowledge domain associated with the answered call;
wherein a natural language processing model forwards a called party's knowledge domain associated with the answered call;
wherein the call to a conference call based on a conference attendee list is joined via the personal representative device if the call is not identified as an emergency call;
wherein the knowledge domain is updated to participate in the conference call;
wherein the call is transferred by the personal representative device to an emergency phone number provided by the called and stored in the called party's knowledge domain, if the call is identified as the emergency call; and
wherein an email is sent to a communication device known to the called and stored in the called party's knowledge domain as requested by a caller wherein the personal representative device directs an email server to send the email to or from a called party's email account.