Systems and methods to generate an enriched meeting playback timeline

1 . A computer system comprising:

at least one processor; and

computer memory having computer-readable instructions embodied thereon, that, when executed by the at least one processor, perform operations comprising:

receiving user-meeting data associated with a meeting recording of a meeting;

determining at least one meeting data feature from the user-meeting data;

based at least in part on the at least one meeting data feature, automatically determining at least one event of interest of the meeting recording specific to a user by identifying topics or keywords associated with the at least one event of interest in contextual information of the user, the contextual information including email, calendar data, or browsing activity associated with the user;

determining an event time indicating a time in the meeting recording the at least one event of interest occurred; and

generating, for presentation via a graphical user interface (GUI), a personalized enriched meeting playback timeline that comprises multiple timelines that each correspond to an event of interest category, the multiple timelines including a timeline corresponding to a category of the at least one event of interest, wherein a graphical depiction representing the at least one event of interest is located on the timeline at a position corresponding to the event time and the graphical depiction is selectable to cause the GUI to toggle presentation of the meeting recording to the event time.

2 . The system of claim 1 , wherein the at least one meeting data feature comprises at least one of: a user annotation to the meeting recording; a user input into a chat field in an application associated with the meeting, the user input indicating an event of interest and comprising a word, phrase, letter, or symbol that is uttered by the user or entered into the chat field; meeting transcript content, an identity of a speaker in the meeting recording, a duration of the meeting recording; a duration of pauses in the meeting recording; a verbal command uttered during the meeting or while watching the meeting recording, or contextual metadata expressed as data features indicative of meeting invitees, meeting attendees, action items, or a type of meeting.

3 . The system of claim 1 , wherein the enriched meeting playback timeline is expandable to present a plurality of enriched meeting playback sub-timelines, each enriched meeting playback sub-timeline of the plurality of enriched meeting playback sub-timelines corresponding to a particular meeting feature of the at least one meeting features.

4 . The system of claim 1 , wherein the operations further comprise, in response to a selection of or a hovering selection over the graphical depiction representing the at least one event of interest, presenting a pop-up window proximate to the graphical depiction representing the at least one event of interest on the enriched meeting playback timeline, the pop-up window comprising a description of the at least one event of interest.

5 . The system of claim 1 :

wherein the enriched meeting playback timeline comprises a plurality of segments, each segment of the plurality of segments corresponding to a portion of the meeting recording during which a corresponding speaker was speaking or during which a corresponding topic was covered; and

wherein the enriched meeting playback timeline is expandable to present a plurality of enriched meeting playback sub-timelines, each enriched meeting playback sub-timeline of the plurality of enriched meeting playback sub-timelines corresponding to a different segment of the plurality of segments, wherein at least two segments of the plurality of segments are visually distinct from one another.

6 . The system of claim 1 , wherein determining the at least one event of interest comprises:

detecting an initial marking or wake-word provided by the user as user input and indicating an intent to designate an event of interest, wherein the event time corresponds to a time when the initial marking or wake-word is detected; and

determining the at least one event of interest by analyzing the time in the meeting preceding or following the user input to detect the event of interest.

7 . The system of claim 1 , wherein the operations further comprise:

generating an abbreviated meeting recording that includes, for each of the at least one event of interest of the meeting recording, a portion of the meeting recording occurring at a time of the event of interest; and

causing the abbreviated meeting recording to be provided thereby enabling the user to view only the portions of the meeting occurring at times of each of the at least one event of interest.

8 . The system of claim 1 , wherein the at least one event of interest comprises at least one of a mention of the user, a start of a session of a speaker, a keyword mention, or a question being asked by an attendee of the meeting; and

wherein the at least one event of interest is determined automatically by detecting the mention of the user, the start of the session of the speaker, the keyword mention, the question being asked, or a marking or word indicative of a type of event of interest.

9 . A computerized method, comprising:

receiving, from a computing device, a user request to access a meeting recording of a meeting;

receiving at least one user annotation to the meeting recording, each user annotation comprising a user input indicating a particular event of interest of the meeting recording, the input comprising a word, phrase, letter, or symbol;

determining an event of interest by analyzing a time in the meeting recording preceding or following when the at least one user annotation was received;

subsequent to receiving the user request and the at least one user annotation, presenting a graphical user interface (GUI) comprising a stream region and an enriched timeline region separate from the stream region, the enriched timeline region comprising multiple timelines that each correspond to an event of interest category, the multiple timelines including a timeline corresponding to a category of the at least one event of interest, wherein a first graphical depiction representing the event of interest is located on the timeline at a position corresponding to the event time;

receiving, via the GUI, a user selection of the first graphical depiction;

based on the user selection of the first graphical depiction, determining a time during which the determined event of interest occurred within the meeting recording; and

changing content on the stream region to correspond to the time during which the determined event of interest occurred based on the first user input and the determined time.

10 . The computerized method of claim 9 , comprising:

receiving, via the GUI, a user selection of a second graphical depiction that is positioned proximate to the enriched timeline region and that is selectable to present a plurality of enriched meeting playback sub-timelines associated with the timeline; and

changing content on the enriched timeline region to comprise the plurality of enriched meeting playback sub-timelines in response to receiving selection of the second indication, wherein each enriched meeting playback sub-timeline of the plurality of enriched meeting playback sub-timelines corresponds to a different speaker or a different topic.

11 . The computerized method of claim 10 , wherein at least one enriched meeting playback sub-timeline of the plurality of enriched meeting playback sub-timelines comprises a corresponding indication of an event of interest of a plurality of events of interest, wherein a meeting data feature is specific to the user and comprises at least one of: a user input into a chat field in an application associated with the meeting, meeting transcript content, an identity of a speaker in the meeting recording, a duration of the meeting recording, a duration of pauses in the meeting recording, a verbal command uttered during the meeting or while watching the meeting recording, or contextual metadata expressed as data features indicative of meeting invitees, meeting attendees, or a type of meeting.

12 . The computerized method of claim 11 , further comprising determining an event of interest of the plurality of events of interest based on a predictive model or a classification model, wherein the predictive model or the classification model determines the event of interest based on the at least one meeting data feature.

13 . Computer storage media having computer-executable instructions embodied thereon, that, when executed by at least one computer processor, cause computing operations to be performed, comprising:

receiving user-meeting data associated with a meeting;

determining, from the user-meeting data, at least one meeting data feature that is specific to a user;

based at least on the at least one meeting data feature, automatically determining at least one event of interest of the meeting specific to a user by identifying topics or keywords associated with the at least one event of interest in contextual information of the user, the contextual data comprising at least one of: a user activity pattern, user browsing activity, data from a user profile, previous recordings accessed by the user, a topic of interest to the user, or email or communication data received by the user;

determining an event time of the event of interest relative to a timing of the meeting; and

generating, for presentation via a graphical user interface (GUI), a personalized enriched meeting playback timeline that comprises multiple timelines that each correspond to an event of interest category, the multiple timelines including a timeline corresponding to a category of the at least one event of interest, wherein a graphical depiction representing the at least one event of interest is located on the timeline at a position corresponding to the event time and the graphical depiction is selectable to cause the GUI to navigate presentation of the meeting to a time corresponding to occurrence of the event of interest.

14 . The computer storage media of claim 13 , wherein determining the at least one event of interest comprises:

detecting an initial marking or wake-word, wherein the event time corresponds to a time when the initial marking or wake-word is detected;

entering a monitoring mode of operation based on the detection of the initial marking or wake-word; and

detecting a subsequent marking or word indicative of a category of event of interest during the monitoring mode of operation, wherein the indication corresponding to the at least one event of interest is generated based on the subsequent marking or word indicative of the category of event of interest.

15 . The computer storage media of claim 13 , wherein the enriched meeting playback timeline is expandable to present a plurality of enriched meeting playback sub-timelines that includes an indexed version of information included in the enriched meeting playback timeline, each enriched meeting playback sub-timeline, of the plurality of enriched meeting playback sub-timelines, indicating a category of event of interest that is different than the other enriched meeting playback sub-timelines.

16 . The computer storage media of claim 13 , wherein the enriched meeting playback timeline comprises a plurality of segments, each segment of the plurality of segments corresponding to a portion of the meeting during which a corresponding speaker was speaking or during which a corresponding topic was covered.

17 . The system of claim 1 , wherein determining the at least one event of interest comprises:

analyzing the contextual information to identify a topic of relevance to the user;

automatically identifying portions of the meeting recording that relate to the identified topic of relevance; and

determining the identified portions as events of interest specific to the user.

18 . The computerized method of claim 9 , wherein the event of interest is further determined based on the user input comprising the word, phrase, letter, or symbol.

19 . The computerized method of claim 9 , further comprising:

determining, based on the at least one user annotation, a type of event of interest indicated by the at least one user annotation;

analyzing the meeting recording to identify additional occurrences of the type of event of interest; and

wherein the timeline comprises a plurality of indications, each indication corresponding to an identified occurrence of the type of event of interest in the meeting recording.

20 . The computer storage media of claim 13 , the operations further comprising:

in response to a selection event or a hovering event of the graphical depiction representing the at least one event of interest, presenting a description of the at least one event of interest.

21 . The computer storage media of claim 13 , wherein the at least one event of interest is ranked based on the user-meeting data and a user profile of the user.