IP Library Granted Patent US 12,524,136
Granted Patent B2
US 12,524,136 · App. 17/694,349 · Granted Jan 13, 2026

Event transcript presentation

Inventors: Anirban Kundu (Redwood City, CA); Andrew Henderson Malcolm (Redwood City, CA); Amir Doron (Redwood City, CA)
Assignee: Bending Spoons S.p.A.
G06F3/04842G06Q10/063114G06Q10/103G06Q10/1093
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,524,136
App. No.
17/694,349
Granted
Jan 13, 2026
Kind
B2
Abstract

A computer system receives data that includes indications of a plurality of agenda items that correspond to the group event. During the group event, the system captures, by a media recording device, media data, converts the captured media data to a searchable version of the media data and searches the searchable version of the media data to determine a first time frame of the media data that corresponds to a first agenda item of the plurality of agenda items. The system displays, in a user interface that is accessible to at least one user associated with the group event, the representation of the media data. A first portion of the representation of the media data that corresponds to the first time frame is visually distinguished from at least a portion of the representation of the media data that does not correspond to the first time frame.

Claims (71)

1 . A method for displaying an audio waveform representation of media data that corresponds to a group event, the method comprising, at an electronic device:

obtaining media data captured during the group event, wherein at least a first agenda item and a distinct second agenda item are discussed during the group event;

enabling display of the audio waveform representation of the media data in a user interface on which a plurality of first portions and a second portion of the audio waveform representation are arranged along a time axis, the time axis including a plurality of segments, wherein the plurality of first portions discuss the first agenda item, and the second portion discusses the second agenda item, and the second portion is arranged between and separates two of the first portions on the time axis, wherein each of the first portions and the second portion of the audio waveform representation intersects a distinct segment of the time axis;

detecting a user input action at a location of any one of the first portions of the audio waveform representation arranged along and intersecting the time axis on the user interface; and

in response to detecting the user input action at the location of any one of the first portions of the audio waveform representation, concurrently:

visually emphasizing all of the plurality of first portions corresponding to the first agenda item of the audio waveform representation on the user interface;

displaying text describing the first agenda item in association with the plurality of the first portions of the audio waveform representation; and

displaying the second portion of the audio waveform representation without visual emphasis.

2 . The method of claim 1 , further comprising:

converting the captured media data to a searchable version of the media data; and

searching the searchable version of the media data to determine the plurality of first portions discussing the first agenda item and the second portion discussing the second agenda item.

3 . The method of claim 2 , wherein converting the captured media data to the searchable version of the media data includes performing speech-to-text processing and comparing text obtained from the speech-to-text processing with the text describing the first agenda item.

4 . The method of claim 1 , further comprising:

obtaining agenda data that includes indications of a plurality of agenda items that correspond to the group event, the plurality of agenda items including the first agenda item and the second agenda item, wherein the plurality of agenda items correspond to a sequence of meeting topics reviewed during the group event; and

automatically generating the plurality of agenda items including the first and second agenda items from the agenda data based on information stored by an organization data structure.

5 . The method of claim 1 , further comprising:

automatically generating a plurality of agenda items including the first and second agenda items based on information from a plurality of agendas;

determining, from the media data, a respective agenda of the plurality of agendas that includes the first agenda item;

wherein enabling display of the audio waveform representation of the media data includes enabling display of an indication of a source of the respective agenda of the plurality of agendas that includes the first agenda item, wherein the source is one or more of: a project within an organization, a calendar invitation, or a group event invitation.

6 . The method of claim 1 , further comprising:

obtaining indications of a plurality of group event attendees;

identifying a first attendee of the plurality of group event attendees, wherein the first agenda item is assigned to the first attendee and a task is assigned to the first attendee; and

determining that the first agenda item is associated with the task based on the first agenda item and the task being assigned to the first attendee.

7 . The method of claim 1 , wherein:

the audio waveform representation comprises a set of frames of video;

the plurality of first portions of the audio waveform representation of the media data includes a first subset of the set of frames of video;

the second portion of the audio waveform representation includes a second subset of the set of frames of video; and

the first subset of the set of frames of video is visually emphasized relative to the second subset of the set of frames of video.

8 . The method of claim 1 , wherein enabling display of the audio waveform representation of the media data in the user interface further includes:

displaying one or more markers to visually distinguish portions of the audio waveform representation that correspond to the first and second agenda items.

9 . The method of claim 1 , further comprising:

receiving indications of a plurality of group event attendees;

identifying a first attendee, of the plurality of group event attendees, that is associated with a project, wherein the first agenda item is assigned to the first attendee; and

determining that the first agenda item is associated to the project based on: (i) an association of the first attendee with the project and (ii) the first agenda item being assigned to the first attendee.

10 . The method of claim 1 , wherein the audio waveform representation includes an audio waveform, and each of the first and second portions includes a respective portion of the audio waveform.

11 . An electronic device, comprising:

one or more processors; and

memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for:

obtaining media data captured during a group event, wherein at least a first agenda item and a distinct second agenda item are discussed during the group event;

enabling display of an audio waveform representation of the media data in a user interface on which a plurality of first portions and a second portion of the audio waveform representation are arranged along a time axis, the time axis including a plurality of segments, wherein the plurality of first portions discuss the first agenda item, and the second portion discusses the second agenda item, and the second portion is arranged between and separates two of the first portions on the time axis, wherein each of the first portions and the second portion of the audio waveform representation intersects a distinct segment of the time axis;

detecting a user input action at a location of any one of the first portions of the audio waveform representation arranged along and intersecting the time axis on the user interface; and

in response to detecting the user input action at the location of any one of the first portions of the audio waveform representation, concurrently:

visually emphasizing all of the plurality of first portions corresponding to the first agenda item of the audio waveform representation on the user interface;

displaying text describing the first agenda item in association with the plurality of the first portions of the audio waveform representation; and

displaying the second portion of the audio waveform representation without visual emphasis.

12 . The electronic device of claim 11 , wherein information corresponding to a speaker at the group event is displayed at a location in the user interface that corresponds to a portion of the audio waveform representation associated with the speaker.

13 . The electronic device of claim 11 , wherein information identifying at least one person associated with the first agenda item is displayed at a location in the user interface that corresponds to the plurality of first portions of the audio waveform representation.

14 . The electronic device of claim 11 , wherein the media data includes data recorded at a plurality of personal devices of respective attendees of the group event, and the audio waveform representation of the media data is updated as the media data is captured.

15 . The method of claim 1 , further comprising:

obtaining an agenda including at least the first agenda item and the distinct second agenda item to be discussed during the group event; and

automatically identifying, in the media data, a first subset of media data corresponding to discussion of the first agenda item and a second subset of media data corresponding to discussion of the second agenda item;

wherein the plurality of first portions correspond to the first subset of media data, and the second portion corresponds to the second subset of media data.

16 . The electronic device of claim 11 , wherein the one or more programs further comprise instructions for:

converting the captured media data to a searchable version of the media data; and

searching the searchable version of the media data to determine the plurality of first portions discussing the first agenda item and the second portion discussing the second agenda item.

17 . A non-transitory computer-readable storage medium storing one or more programs for execution by one or more processors of an electronic device, the one or more programs comprising instructions for:

obtaining media data captured during a group event, wherein at least a first agenda item and a distinct second agenda item are discussed during the group event;

enabling display of an audio waveform representation of the media data in a user interface on which a plurality of first portions and a second portion of the audio waveform representation are arranged along a time axis, the time axis including a plurality of segments, wherein the plurality of first portions discuss the first agenda item, and the second portion discusses the second agenda item, and the second portion is arranged between and separates two of the first portions on the time axis, wherein each of the first portions and the second portion of the audio waveform representation intersects a distinct segment of the time axis;

detecting a user input action at a location of any one of the first portions of the audio waveform representation arranged along and intersecting the time axis on the user interface; and

in response to detecting the user input action at the location of any one of the first portions of the audio waveform representation, concurrently:

visually emphasizing all of the plurality of first portions corresponding to the first agenda item of the audio waveform representation on the user interface;

displaying text describing the first agenda item in association with the plurality of the first portions of the audio waveform representation; and

displaying the second portion of the audio waveform representation without visual emphasis.

18 . The non-transitory computer-readable storage medium of claim 17 , the one or more programs further comprising instructions for:

converting the captured media data to a searchable version of the media data; and

searching the searchable version of the media data to determine the plurality of first portions discussing the first agenda item and the second portion discussing the second agenda item.

19 . The non-transitory computer-readable storage medium of claim 17 , the one or more programs further comprising instructions for:

determining a time frame of the media data that corresponds to a key term associated with the group event, wherein displaying the audio waveform representation of the media data includes displaying a third portion of the audio waveform representation of the media data that corresponds to the time frame.

20 . The non-transitory computer-readable storage medium of claim 17 , the one or more programs further comprising instructions for:

automatically generating a plurality of agenda items including the first and second agenda items, wherein the plurality of agenda items correspond to a sequence of meeting topics reviewed during the group event; and

during the group event, displaying a prompt during the group event based on the captured media data and a plurality of agenda items, wherein the prompt includes any of an indication of a remaining time for the group event; and information indicating agenda items of the plurality of agenda items that have not yet been captured.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: EVERNOTE CORPORATION
To: BENDING SPOONS S.P.A.
Reel/Frame 066288/0195 →
Continuity (3)
Continuation 16162127 · Oct 16, 2018
Provisional Application 62739099 · Sep 28, 2018
Related Publication 20220198370A1 · Jun 23, 2022
References Cited (64)
US 5717869A · Moran et al. · 1998 [cited by applicant]
US 7212987B2 · Swanke et al. · 2007 [cited by applicant]
US 7298930B1 · Erol · 2007 [cited by examiner]
US 8332767B1 · Beil · 2012 [cited by examiner]
US 10817791B1 · Shoemaker et al. · 2020 [cited by applicant]
US 10909485B2 · Kundu et al. · 2021 [cited by applicant]
US 11144854B1 · Mouawad · 2021 [cited by applicant]
US 11308427B2 · Kundu et al. · 2022 [cited by applicant]
US 20030078826A1 · Swanke et al. · 2003 [cited by applicant]
US 20040095376A1 · Graham et al. · 2004 [cited by applicant]
US 20060106872A1 · Leban et al. · 2006 [cited by applicant]
US 20070168861A1 · Bell et al. · 2007 [cited by applicant]
US 20070233671A1 · Oztekin et al. · 2007 [cited by applicant]
US 20080162243A1 · Muller et al. · 2008 [cited by applicant]
US 20090306981A1 · Cromack · 2009 [cited by examiner]
US 20100107117A1 · Pearce · 2010 [cited by examiner]
US 20100125791A1 · Katis et al. · 2010 [cited by applicant]
US 20110072362A1 · Denner · 2011 [cited by examiner]
US 20110145823A1 · Rowe · 2011 [cited by applicant]
US 20120179465A1 · Cox · 2012 [cited by examiner]
US 20120321062A1 · Fitzsimmons et al. · 2012 [cited by applicant]
US 20120323575A1 · Gibbon · 2012 [cited by examiner]
US 20130246404A1 · Annau · 2013 [cited by applicant]
US 20140006518A1 · Sinkov · 2014 [cited by applicant]
US 20140164510A1 · Abuelsaad · 2014 [cited by examiner]
US 20140278408A1 · Park · 2014 [cited by examiner]
US 20140350930A1 · Cox et al. · 2014 [cited by applicant]
US 20150006218A1 · Klem et al. · 2015 [cited by applicant]
US 20150046370A1 · Libin et al. · 2015 [cited by applicant]
US 20150178861A1 · Gordon · 2015 [cited by applicant]
US 20160004390A1 · Laska · 2016 [cited by examiner]
US 20160092578A1 · Ganani et al. · 2016 [cited by applicant]
US 20160247542A1 · Tanaka · 2016 [cited by examiner]
US 20160277577A1 · Yentis · 2016 [cited by applicant]
US 20170053244A1 · Khalil et al. · 2017 [cited by applicant]
US 20170085691A1 · Kim · 2017 [cited by applicant]
US 20180006837A1 · Cartwright et al. · 2018 [cited by applicant]
US 20180039951A1 · Wynn · 2018 [cited by examiner]
US 20180095621A1 · Ryan · 2018 [cited by examiner]
US 20180101281A1 · Nelson · 2018 [cited by examiner]
US 20180101824A1 · Nelson et al. · 2018 [cited by applicant]
US 20180239822A1 · Reshef · 2018 [cited by examiner]
US 20180307383A1 · Faulkner · 2018 [cited by examiner]
US 20190273767A1 · Nelson · 2019 [cited by examiner]
US 20190286683A1 · Kittur et al. · 2019 [cited by applicant]
US 20200104379A1 · Wada et al. · 2020 [cited by applicant]
US 20200104783A1 · Kundu et al. · 2020 [cited by applicant]
US 20210158265A1 · Kundu et al. · 2021 [cited by applicant]
US 20220374817A1 · Kundu et al. · 2022 [cited by applicant]
WO WO2020068836 · 2020 [cited by applicant]
Kundu, Final Office Action, US App. No. 16/162,2086, May 25, 2022, 30 Pgs. [cited by applicant]
Kundu, Office Action, US App. No. 16/162,2086, Apr. 16, 2021, 28 Pgs. [cited by applicant]
Kundu, Notice of Allowance, U.S. Appl. No. 16/162,150, Sep. 25, 2020, 13 Pgs. [cited by applicant]
Kundu, Non-Final Office Action, U.S. Appl. No. 16/162,150, May 27, 2020, 14 Pgs. [cited by applicant]
Evernote Corporation, IPRP, PCTUS2019/052709, Mar. 23, 2021, 13 Pgs. [cited by applicant]
Evernote Corporation, ISR and WO, PCTUS2019/052709, Mar. 24, 2020, 19 Pgs. [cited by applicant]
Kundu, Final Office Action, U.S. Appl. No. 16/162,127, Aug. 4, 2020, 16 Pgs. [cited by applicant]
Kundu, Office Action, U.S. Appl. No. 16/162,127, Jul. 1, 2021, 22 Pgs. [cited by applicant]
Kundu, Notice of Allowance, U.S. Appl. No. 16/162,127, Jan. 5, 2022, 16 Pgs. [cited by applicant]
Kundu, Office Action, U.S. Appl. No. 17/164,673, Sep. 23, 2022, 17 Pgs. [cited by applicant]
Anirban Kundu et al., Final Office Action, U.S. Appl. No. 17/164,673, Mar. 13, 2023, 20 pgs. [cited by applicant]
Anirban Kundu et al., Non-Final Office Action, U.S. Appl. No. 17/164,673, Aug. 24, 2023, 9 pgs. [cited by applicant]
Anirban Kundu et al., Non-Final Office Action, U.S. Appl. No. 17/881,529, Aug. 17, 2023, 12 pgs. [cited by applicant]
Anirban Kundu et al., Notice of Allowance, U.S. Appl. No. 17/881,529, Dec. 5, 2023, 5 pgs. [cited by applicant]