Capturing output of language operator-based communication analysis
A method and system for automatically analyzing and/or summarizing communications using language operators, the method receiving a definition of a language operator, the definition comprising one or more phrases indicative of a match to a concept associated with a communication; surfacing, in a UI, one or more results of applying the language operator to the communication, the surfacing of each result of the one or more results using an interactive UI element linked to one or more communication phrases, the interactive UI element highlighting a match between the concept and the one or more communication phrases; and training a machine learned (ML) model to improve an accuracy of the result based on one or more inputs received via the UI.
1 . A computer-implemented method comprising:
receiving a definition of a language operator, the definition comprising one or more phrases indicative of a match to a concept associated with a communication;
surfacing, in a UI, one or more results of applying the language operator to the communication, the surfacing of each result of the one or more results using an interactive UI element linked to one or more communication phrases, the interactive UI element highlighting a match between the concept and the one or more communication phrases, the surfacing of the one or more results further comprising:
surfacing an identifier associated with the language operator, and
surfacing an indicator corresponding to a count of the one or more results of applying the language operator to the communication; and
training a machine learned (ML) model to improve an accuracy of the one or more results based on one or more inputs received via the UI, an input of the one of more inputs corresponding to a user indicating a confirmation or a rejection of a result of the one or more results, a quality of the input being assessed based on one or more user characteristics, the one or more user characteristics comprising at least one of a plurality of expertise levels associated with language operators.
2 . The method of claim 1 , wherein training the ML model to improve the accuracy of the one or more results comprises:
augmenting a training set for the ML model with a training example derived based on the input received via the UI, the ML model being enabled to implement the language operator, the training example including a context comprising the one or more communication phrases and a label being one of a positive label or a negative label, wherein:
the label is the positive label if the input corresponds to the user indicating the confirmation of the result of applying the language operator to the communication; and
the label is the negative label if the input corresponds to the user indicating the rejection of the result of applying the language operator to the communication; and
training the ML model using the augmented training set.
3 . The method of claim 1 , further comprising surfacing, in the UI, a plurality of language operators, wherein each language operator of the plurality of language operators is associated with an identifier, a set of results of applying the language operator to the communication, and an indicator associated with the set of results.
4 . The method of claim 3 , wherein the plurality of language operators comprise at least one of an extract operator, or a classify operator.
5 . The method of claim 3 , wherein the indicator associated with each language operator of the plurality of language operators is a number of elements in the set of results of applying the language operator to the communication.
6 . The method of claim 3 , further comprising surfacing a ranking of the plurality of language operators wherein a ranking position of each language operator of the plurality of language operators is determined based on the indicator associated with the language operator.
7 . A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, configure the system to:
receive a definition of a language operator, the definition comprising one or more phrases indicative of a match to a concept associated with a communication;
surface, in a UI, one or more results of applying the language operator to the communication, the surfacing of each result of the one or more results using an interactive UI element linked to one or more communication phrases, the interactive UI element highlighting a match between the concept and the one or more communication phrases, the surfacing of the one or more results further comprising:
surfacing an identifier associated with the language operator, and
surfacing an indicator corresponding to a count of the one or more results of applying the language operator to the communication; and
train a ML model to improve an accuracy of the one or more results based on one or more inputs received via the UI, an input of the one of more inputs corresponding to a user indicating a confirmation or a rejection of a result of the one or more results, a quality of the input being assessed based on one or more user characteristics, the one or more user characteristics comprising at least one of a plurality of expertise levels associated with language operators.
8 . The system of claim 7 , wherein training the ML model to improve the accuracy of the result comprises:
augmenting a training set for the ML model with a training example derived based on the input received via the UI, the ML model being enabled to implement the language operator, the training example comprising a context comprising the one or more communication phrases and a label being one of a positive label or a negative label, wherein:
the label is the positive label if the input corresponds to the user indicating the confirmation of the result of applying the language operator to the communication; and
the label is the negative label if the input corresponds to the user indicating the rejection of the result of applying the language operator to the communication; and
training the ML model using the augmented training set.
9 . The system of claim 7 , wherein the instructions further configure the system to surface, in the UI, a plurality of language operators, wherein each language operator of the plurality of language operators is associated with an identifier, a set of results of applying the language operator to the communication, and an indicator associated with the set of results.
10 . The system of claim 9 , wherein the indicator associated with each language operator of the plurality of language operators is a number of elements in the set of results of applying the language operator to the communication.
11 . The system of claim 9 , wherein the plurality of language operators comprises at least one of an extract operator or a classify operator.
12 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by at least one processor, cause the at least one processor to:
receive a definition of a language operator, the definition comprising one or more phrases indicative of a match to a concept associated with a communication;
surface, in a UI, one or more results of applying the language operator to the communication, the surfacing of each result of the one or more results using an interactive UI element linked to one or more communication phrases, the interactive UI element highlighting a match between the concept and the one or more communication phrases, the surfacing of the one or more results further comprising:
surfacing an identifier associated with the language operator, and
surfacing an indicator corresponding to a count of the one or more results of applying the language operator to the communication; and
train a ML model to improve an accuracy of the one or more results based on one or more inputs received via the UI, an input of the one of more inputs corresponding to a user indicating a confirmation or a rejection of a result of the one or more results, a quality of the input being assessed based on one or more user characteristics, the one or more user characteristics comprising at least one of a plurality of expertise levels associated with language operators.