IP Library › Granted Patent US 11,323,278
Granted Patent B1
US 11,323,278 · App. 17/089,836 · Granted May 3, 2022

Device, system, and method of generating and utilizing visual representations for audio meetings

Inventors: Shabtai Adlersberg (Ra'anana, IL); Menachem Honig (Metar, IL); Tatiana Adar (Belle Mead, NJ)
Assignee: AUDIOCODES LTD.
H04L12/1831H04L12/1818
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,323,278
App. No.
17/089,836
Granted
May 3, 2022
Kind
B1
Abstract

Devices, systems, and methods of generating and utilizing visual representations for audio meetings. A method includes: receiving an audio recording of a meeting having multiple participants; determining, for each meeting participant, time-slots in which that meeting participant spoke during the meeting; generating and displaying an audio playback progress bar which visually differentiates among time-slots of different meeting participants. Hovering or selection of a particular time-point on the audio progress bar, causes generation and display of a textual phrase that was uttered at that time-point by a meeting participant, together with an indication of the speaker; and optionally with several other preceding phrases and following phrases. Transcript portions are also color-coded or visually-coded, to efficiently distinguish among phrases of various meeting participants.

Claims (83)

1. A method comprising:

receiving an audio recording of a meeting having multiple participants;

determining, for each meeting participant, time-slots in which said meeting participant spoke during said meeting;

generating and displaying an interactive audio playback progress bar which visually differentiates among time-slots of different meeting participants;

receiving a user input which hovers upon or selects a particular time-point in said audio playback progress bar;

determining a phrase that was uttered by a meeting participant during said particular time-point;

determining preceding N phrases that were uttered by meeting participants immediately prior to said phrase, wherein N is a natural number;

determining M subsequent phrases that were uttered by meeting participants immediately after said phrase, wherein M is a natural number;

generating a textual paragraph that includes said N preceding phrases, said phrase, and said M subsequent phrases; and

displaying said textual paragraph in proximity to said particular time-point of said audio playback progress bar.

2. The method of claim 1 ,

wherein:

said audio playback progress bar comprises at least:

a first set of time-slot indications, colored in a first color, corresponding to time-slots in which a first particular meeting participant spoke; and

a second set of time-slot indications, colored in a second color, corresponding to time-slots in which a second particular meeting participant spoke.

3. The method of claim 1 ,

wherein:

said audio playback progress bar comprises at least:

a first set of time-slot indications, displayed with a first texture filling, corresponding to time-slots in which a first particular meeting participant spoke; and

a second set of time-slot indications, displayed with a second texture filling, corresponding to time-slots in which a second particular meeting participant spoke.

4. The method of claim 1 ,

wherein:

said audio playback progress bar comprises at least:

a first set of time-slot indications, displayed with a first visual characteristic, corresponding to time-slots in which a first particular meeting participant spoke; and

a second set of time-slot indications, displayed with a second, different visual characteristic, corresponding to time-slots in which a second particular meeting participant spoke.

5. The method of claim 1 , further comprising:

receiving a user selection of a single meeting participant;

updating a display of said audio playback progress bar, to visually indicate therein only time-slots corresponding to speech by said single particular meeting participant and not by other meeting participants.

6. The method of claim 1 , further comprising:

receiving a user selection of some, but not all, meeting participants;

updating a display of said audio playback progress bar, to visually indicate therein only time-slots corresponding to speech by said some meeting participants and not by other meeting participants.

7. The method of claim 1 , further comprising:

generating a textual transcript of said meeting, in which phrases that were uttered by a first meeting participant are colored in a first color, and phrases that were uttered by a second meeting participant are colored in a second, different, color.

8. The method of claim 1 , further comprising:

generating a textual transcript of said meeting, in which phrases that were uttered by a first meeting participant are displayed in a first font style, and phrases that were uttered by a second meeting participant are displayed in a second, different, font style.

9. The method of claim 1 , further comprising:

generating a textual transcript of said meeting, in which phrases that were uttered by a first meeting participant are emphasized via a first visual effect, and phrases that were uttered by a second meeting participant are emphasized via a second, different, visual effect.

10. The method of claim 1 , further comprising:

generating a textual transcript of said meeting;

receiving a user selection of a single meeting participant; and

in response to said user selection, generating and displaying only portions of said textual transcript of said meeting that correspond to phrases uttered by said single meeting participant;

and hiding portions of the textual transcript of said meeting that correspond to phrases uttered by other meeting participants.

11. The method of claim 1 , further comprising:

generating a textual transcript of said meeting;

receiving a user selection of some, but not all, meeting participants; and

in response to said user selection, generating and displaying only portions of said textual transcript of said meeting that correspond to phrases uttered by said some meeting participants, using a different color or visual effect for phrases uttered by each meeting participant; and hiding portions of the textual transcript of said meeting that correspond to phrases uttered by other meeting participants.

12. The method of claim 1 , further comprising:

receiving a user input which hovers upon or selects a particular time-point in said audio playback progress bar;

determining a phrase that was uttered by a meeting participant during said particular time-point; and

displaying a textual representation of said phrase in proximity to said particular time-point of said audio playback progress bar.

13. The method of claim 1 , further comprising:

receiving a user input which hovers upon or selects a particular time-point in said audio playback progress bar;

determining a phrase that was uttered by a meeting participant during said particular time-point; and

displaying a textual representation of said phrase in proximity to said particular time-point of said audio playback progress bar, accompanied by an indication of which meeting participant has uttered said phrase.

14. The method of claim 1 ,

wherein displaying said textual paragraph comprises:

displaying said textual paragraph by using different on-screen colors for phrases that were uttered, respectively, by different meeting participants.

15. The method of claim 1 , further comprising:

storing a representation of said audio playback progress bar, which visually differentiates among time-slots of different meeting participants, in a repository of audio recordings of meetings, as an accompanying data-item that is associated with a particular audio recording of a particular meeting.

16. The method of claim 1 ,

wherein the interactive audio playback progress bar enables visual differentiation among time-slots of different meeting participants, and further enables a user to selectively view time-slots of a particular user-selected participant, and further enables a user to selectively hear meeting audio segments that correspond only to time-slots of a particular user-selected participant.

17. A non-transitory storage medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

receiving an audio recording of a meeting having multiple participants;

determining, for each meeting participant, time-slots in which said meeting participant spoke during said meeting;

generating and displaying an interactive audio playback progress bar which visually differentiates among time-slots of different meeting participants;

receiving a user input which hovers upon or selects a particular time-point in said audio playback progress bar;

determining a phrase that was uttered by a meeting participant during said particular time-point;

determining preceding N phrases that were uttered by meeting participants immediately prior to said phrase, wherein N is a natural number;

determining M subsequent phrases that were uttered by meeting participants immediately after said phrase, wherein M is a natural number;

generating a textual paragraph that includes said N preceding phrases, said phrase, and said M subsequent phrases; and

displaying said textual paragraph in proximity to said particular time-point of said audio playback progress bar.

18. A system comprising:

one or more processors, operably associated with one or more memory units,

wherein the one or more processors are configured:

to receive an audio recording of a meeting having multiple participants;

to determine, for each meeting participant, time-slots in which said meeting participant spoke during said meeting;

to generate, and to cause a display unit to display, an interactive audio playback progress bar which visually differentiates among time-slots of different meeting participants;

to receive a user input which hovers upon or selects a particular time-point in said audio playback progress bar;

to determine a phrase that was uttered by a meeting participant during said particular time-point;

to determine preceding N phrases that were uttered by meeting participants immediately prior to said phrase, wherein N is a natural number;

to determine M subsequent phrases that were uttered by meeting participants immediately after said phrase, wherein M is a natural number;

to generate a textual paragraph that includes said N preceding phrases, said phrase, and said M subsequent phrases; and

to display said textual paragraph in proximity to said particular time-point of said audio playback progress bar.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2021
From: ADLERSBERG, SHABTAI; HONIG, MENACHEM; ADAR, TATIANA
To: AUDIOCODES LTD.
Reel/Frame 057749/0729 →
Cited By (1)
US 12,633,285