Methods and systems for providing insights in real-time during a conversation
The disclosure describes systems, methods, and media for generating real-time insights in a voice over internet protocol (VoIP) conversation. According to the methods, an application server receives a transcript of one or more voice utterances of a participant in the VoIP conversation, and identifies a context of the VoIP conversation and a first state of the context based on the transcript. The application server further receives an intent of the participant from a conversation artificial intelligence (AI) engine based on the transcript provided to the conversation AI engine. The application server further formulates one or more queries based on the intent, the context, and the first state of the context to retrieve one or more insights from one or more backend databases, and transmits the one or more insights to a terminal of at least one participants of the VoIP conversation for display.
1. A computer-implemented method of generating real-time insights during a voice over internet protocol (VOIP) conversation, comprising:
receiving, at a backend application server, a transcript of one or more voice utterances of a participant in the VoIP conversation;
identifying, by the backend application server, a context of the VoIP conversation and a first state of the context based on the transcript;
receiving, by the backend application server, an intent of the participant from a conversation artificial intelligence (AI) engine, wherein the intent is identified by the conversation AI engine based on a sequence of words in the transcript;
determining, by the backend application server, one or more insights based on the context of the VoIP conversation, the first state of the context, and the intent of the participant;
transmitting, by the backend application server, the one or more insights to a terminal device of each of one or more participants of the VOIP conversation, wherein the one or more insights are displayed in real time in the terminal device of each of the one or more participants, and wherein each of the one or more participants is a participant with one or more predetermined attributes and at least one participant has one or more predetermined attributes that the one or more participants do not have.
2. The computer-implemented method of claim 1 , wherein the one or more insights are not displayed on a terminal device of at least one participant in the VoIP conversation.
3. The computer-implemented method of claim 1 , wherein the context of the VOIP conversation is a data object that defines one or more of the following properties: participants of the VoIP conversation, a time period that the VoIP conversation relates to, whether the participants include an external party, contact information of the external party, activities between the participants, whether a competitor is mentioned, or deal information among the participants.
4. The computer-implemented method of claim 3 , wherein one or more additional properties are added to the data object based on the one or more voice utterances.
5. The computer-implemented method of claim 4 , wherein the first state of the context is changed to a second state when each of the one or more additional properties is added to the data object or when a value of an existing property changes.
6. The computer-implemented method of claim 5 , wherein the context of the VOIP conversation, a unique identifier of the VOIP conversation, and the first state and the second state of the context of the VOIP conversation are stored in a cache in a cloud environment, wherein the cache further includes a state machine that keeps tracks of each state of the context during the VOIP conversation.
7. The computer-implemented method of claim 6 , wherein the intent generated by the conversation AI engine is further refined based on the state machine.
8. The computer-implemented method of claim 5 , wherein the backend application server formulates one or more queries to retrieve the one or more insights from one or more backend databases in a cloud environment.
9. The computer-implemented method of claim 8 , wherein the one or more backend databases include a task database and a conversation database, wherein the task database includes information related to a plurality of tasks, and wherein the conversation database includes a plurality of entries, each entry mapping an insight to a combination of a context, a state of the context, and the intent.
10. A data processing system, comprising:
a processor; and
a memory coupled to the processor to store instructions therein for generating real-time insights during a voice over internet protocol (VOIP) conversation, which when executed by the processor, cause the processor to perform operations, the operations comprising:
receiving a transcript of one or more voice utterances of a participant in the VoIP conversation;
identifying a context of the VOIP conversation and a first state of the context based on the transcript;
receiving an intent of the participant from a conversation artificial intelligence (AI) engine, wherein the intent is identified by the conversation AI engine based on a sequence of words in the transcript;
determining one or more insights based on the context of the VOIP conversation, the first state of the context, and the intent of the participant;
transmitting the one or more insights to a terminal device of each of one or more participants of the VOIP conversation, wherein the one or more insights are displayed in real time in the terminal device of each of the one or more participants, and wherein each of the one or more participants is a participant with one or more predetermined attributes and at least one participant has one or more predetermined attributes that the one or more participants do not have.
11. The data processing system of claim 10 , wherein the one or more insights are not displayed on a terminal device of at least one participant in the VoIP conversation.
12. The data processing system of claim 10 , wherein the context of the VoIP conversation is a data object that defines one or more of the following properties: participants of the VoIP conversation, a time period that the VOIP conversation relates to, whether the participants include an external party, contact information of the external party, activities between the participants, whether a competitor is mentioned, or deal information among the participants.
13. The data processing system of claim 12 , wherein one or more additional properties are added to the data object based on the one or more voice utterances.
14. The data processing system of claim 13 , wherein the first state of the context is changed to a second state when each of the one or more additional properties is added to the data object or when a value of an existing property changes.
15. The data processing system of claim 14 , wherein the context of the VoIP conversation, a unique identifier of the VoIP conversation, and the first state and the second state of the context of the VoIP conversation are stored in a cache in a cloud environment, wherein the cache further includes a state machine that keeps tracks of each state of the context during the VoIP conversation.
16. The data processing system of claim 15 , wherein the intent generated by the conversation AI engine is further refined based on the state machine.
17. The data processing system of claim 14 , wherein a backend application server formulates one or more queries to retrieve the one or more insights from one or more backend databases in a cloud environment.
18. A non-transitory computer-readable medium that stores instructions for generating real-time insights during a voice over internet protocol (VOIP) conversation, which instructions, when executed by a data processing system comprising at least one hardware processor, cause the data processing system to perform operation comprising:
receiving a transcript of one or more voice utterances of a participant in the VoIP conversation;
identifying a context of the VOIP conversation and a first state of the context based on the transcript;
receiving an intent of the participant from a conversation artificial intelligence (AI) engine, wherein the intent is identified by the conversation AI engine based on a sequence of words in the transcript;
determining one or more insights based on the context of the VOIP conversation, the first state of the context, and the intent of the participant;
transmitting the one or more insights to a terminal device of each of one or more participants of the VOIP conversation, wherein the one or more insights are displayed in real time in the terminal device of each of the one or more participants, and wherein each of the one or more participants is a participant with one or more predetermined attributes and at least one participant has one or more predetermined attributes that the one or more participants do not have.
19. The non-transitory computer-readable medium 18 , wherein the one or more insights are not displayed on a terminal device of at least one participant in the VoIP conversation.
20. The non-transitory computer-readable medium 18 , wherein the context of the VOIP conversation is a data object that defines one or more of the following properties: participants of the VOIP conversation, a time period that the VoIP conversation relates to, whether the participants include an external party, contact information of the external party, activities between the participants, whether a competitor is mentioned, or deal information among the participants.