Engagement analysis between groups of participants
In one embodiment, the system connects to a communication session with a number of participants; receives a transcript of a conversation between the participants; extracts utterances from the transcript; associates a subset of the utterances with a first group of speakers and the remaining subset of the utterances with a second group of speakers; calculates one or more statistical metrics for a number of engagement metrics based on the utterances of the first group of speakers and the utterances of the second group of speakers; assigns a weight to each of the engagement metrics; determines an engagement score for the communication session based on the assigned weights for the engagement metrics; and presents, to one or more users, the engagement score for the communication session.
1 . A method, comprising:
receiving a transcript between participants of a communication session, wherein a first portion of the transcript is associated with a first group of the participants and a second portion of the transcript is associated with a second group of the participants, wherein the first group of the participants is associated with a prespecified organization and the second group of the participants is associated with a different organization;
dynamically adjusting metric weights based on organizational groupings and a context of the communication session;
calculating engagement metrics for the communication session using the dynamically adjusted metric weights, wherein the engagement metrics are based on a ratio of time lag between data of the first group of the participants corresponding to the first portion of the transcript and data of the second group of the participants corresponding to the second portion of the transcript; and
determining an engagement score for the communication session based on the engagement metrics.
2 . The method of claim 1 , further comprising:
comparing the engagement metrics to a plurality of engagement metrics determined for a plurality of previous communication sessions, wherein determining the engagement score is further based on the comparison of the engagement metrics.
3 . The method of claim 2 , wherein the plurality of previous communication sessions are of a same meeting type as the communication session.
4 . The method of claim 1 , wherein one of the engagement metrics is representative of a number of speaker changes between the first group of participants and the second group of participants.
5 . The method of claim 4 , wherein the one of the engagement metrics for the number of speaker changes between the first group of participants and the second group of participants is normalized per minute during the communication session.
6 . The method of claim 1 , wherein one of the engagement metrics is representative of a ratio of the first group of participants speaking time to the second group of participants speaking time.
7 . The method of claim 6 , wherein the ratio of the first group of participants speaking time to the second group of participants speaking time is normalized for different meeting lengths.
8 . The method of claim 1 , wherein the ratio of time lag between data of the first group of participants and data of the second group of speakers is normalized based on the ratio of time lag between data of the second group of participants and data of the first group of participants.
9 . The method of claim 1 , further comprising:
presenting the engagement score.
10 . The method of claim 1 , wherein determining the engagement score comprises applying a cumulative distribution function to a weighted average of the engagement metrics.
11 . The method of claim 1 , wherein calculating the engagement metrics comprises calculating at least an average for the engagement metric and a standard deviation for the engagement metric.
12 . The method of claim 1 , further comprising:
receiving, based on the engagement score for the communication session, a label representative of whether the second group of participants was engaged during the communication session; and
adjusting one or more weights assigned to the engagement metrics based on the label.
13 . The method of claim 1 , further comprising:
receiving data from one or more additional communication sessions; and
adjusting one or more weights assigned to the engagement metrics based on the data from the one or more additional communication sessions.
14 . The method of claim 13 , wherein calculating the engagement metrics is based on analyzing parts of speech of one or more sentences in at least a portion of the transcript.
15 . An apparatus, comprising:
a memory; and
a processor configured to execute instructions stored in the memory to:
receive a transcript of a conversation between participants of a communication session, wherein a first portion of the transcript is associated with a first group of the participants and a second portion of the transcript is associated with a second group of the participants, wherein the first group of the participants is associated with a prespecified organization and the second group of the participants is associated with a different organization;
dynamically adjust metric weights based on organizational groupings and a context of the communication session;
calculate engagement metrics for the communication session using the dynamically adjusted metric weights, wherein the engagement metrics are based on a ratio of time lag between data of the first group of participants corresponding to the first portion of the transcript and data of the second group of participants corresponding to the second portion of the transcript; and
determine an engagement score for the communication session based on the engagement metrics.
16 . The apparatus of claim 15 , wherein the processor is configured to execute the instructions to:
compare the engagement metrics to a plurality of engagement metrics determined for a plurality of previous communication sessions, wherein determining the engagement score is further based on the comparison of the engagement metrics.
17 . The apparatus of claim 15 , wherein one of the engagement metrics is representative of a number of speaker changes between the first group of participants and the second group of participants.
18 . A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:
receiving a transcript between participants of a communication session, wherein a first portion of the transcript is associated with a first group of the participants and a second portion of the transcript is associated with a second group of the participants, wherein the first group of the participants is associated with a prespecified organization and the second group of the participants is associated with a different organization;
dynamically adjusting metric weights based on organizational groupings and a context of the communication session;
calculating engagement metrics for the communication session using the dynamically adjusted metric weights, wherein the engagement metrics are based on a ratio of time lag between data of the first group of participants corresponding to the first portion of the transcript and data of the second group of participants corresponding to the second portion of the transcript; and
determining an engagement score for the communication session based on the engagement metrics.
19 . The non-transitory computer readable medium of claim 18 , the operations comprising:
comparing the engagement metrics to a plurality of engagement metrics determined for a plurality of previous communication sessions, wherein determining the engagement score is further based on the comparison of the engagement metrics.
20 . The non-transitory computer readable medium of claim 18 , wherein one of the engagement metrics is representative of a number of speaker changes between the first group of participants and the second group of participants.