Systems and methods for processing and presenting conversations
System and method for processing and presenting a conversation. For example, a system includes a sensor configured to capture an audio-form conversation, and a processor configured to automatically transform the audio-form conversation into a transformed conversation. The transformed conversation includes a synchronized text, and the synchronized text is synchronized with the audio-form conversation. Additionally, the system includes a presenter configured to present the transformed conversation including the synchronized text and the audio-form conversation.
1. A system for processing and presenting a conversation, the system comprising:
a processor configured to:
receive a live audio-form conversation involving one or more speakers;
automatically transcribe the received live audio-form conversation into a live synchronized text, the live synchronized text being synchronized with the live audio-form conversation; and
after the live audio-form conversation has been transcribed into the live synchronized text,
automatically generate a plurality of segments of the live audio-form conversation, the plurality of segments of the live audio-form conversation including a first segment of the live audio-form conversation and a second segment of the live audio-form conversation; and
automatically generate a plurality of segments of the live synchronized text, the plurality of segments of the live synchronized text including a first segment of the live synchronized text and a second segment of the live synchronized text; and
a presenter configured to present the plurality of segments of the live synchronized text;
wherein the processor is further configured to:
after the live audio-form conversation has been transcribed into the live synchronized text,
identify an occurrence of a natural pause during the live audio-form conversation in which there is an absence of speech from the one or more speakers; and
in response to the identified occurrence of the natural pause,
automatically segment the live audio-form conversation into the first segment of the live audio-form conversation and the second segment of the live audio-form conversation; and
automatically segment the live synchronized text into the first segment of the live synchronized text and the second segment of the live synchronized text;
wherein the first segment of the live audio-form conversation and the second segment of the live audio-form conversation are next to each other and are spoken by a same speaker;
wherein the processor is further configured to:
automatically assign a first speaker label to the first segment of the live synchronized text; and
automatically assign a second speaker label to the second segment of the live synchronized text;
wherein the presenter is further configured to:
present the first speaker label together with the first segment of the live synchronized text; and
present the second speaker label together with the second segment of the live synchronized text;
wherein:
the first segment of the live synchronized text and the second segment of the live synchronized text are next to each other;
the first speaker label represents the same speaker;
the second speaker label represents the same speaker; and
the first speaker label and the second speaker label are the same.
2. The system of claim 1 , wherein the live audio-form conversation includes at least one selected from a group consisting of a human-to-human conversation in audio form, a meeting conversation, and a phone conversation.
3. The system of claim 1 , wherein the presenter is further configured to present the plurality of segments of the live synchronized text to be both navigable and searchable.
4. The system of claim 3 , wherein the presenter is further configured to present one or more matches of a searched text in a highlighted state, the one or more matches being one or more parts of the plurality of segments of the synchronized text.
5. The system of claim 4 , wherein the presenter is further configured to highlight the live audio-form conversation at one or more timestamps, the one or more timestamps corresponding to the one or more matches of the searched text respectively.
6. A computer-implemented method for processing and presenting a conversation, the method comprising:
receiving a live audio-form conversation involving one or more speakers;
automatically transcribing the received live audio-form conversation into a live synchronized text, the live synchronized text being synchronized with the live audio-form conversation;
after the live audio-form conversation has been transcribed into the live synchronized text,
automatically generating a plurality of segments of the live audio-form conversation, the plurality of segments of the live audio-form conversation including a first segment of the live audio-form conversation and a second segment of the live audio-form conversation; and
automatically generating a plurality of segments of the live synchronized text, the plurality of segments of the live synchronized text including a first segment of the live synchronized text and a second segment of the live synchronized text; and
presenting the plurality of segments of the live synchronized text;
wherein the automatically generating a plurality of segments of the live audio-form conversation and the automatically generating a plurality of segments of the live synchronized text include:
after the live audio-form conversation has been transcribed into the live synchronized text,
identifying an occurrence of a natural pause during the live audio-form conversation in which there is an absence of speech from the one or more speakers; and
in response to the identified occurrence of the natural pause,
automatically segmenting the live audio-form conversation into the first segment of the live audio-form conversation and the second segment of the live audio-form conversation; and
automatically segmenting the live synchronized text into the first segment of the live synchronized text and the second segment of the live synchronized text;
wherein the first segment of the live audio-form conversation and the second segment of the live audio-form conversation are next to each other and are spoken by a same speaker;
wherein the automatically generating a plurality of segments of the live audio-form conversation and automatically generating a plurality of segments of the live synchronized text further include:
automatically assigning a first speaker label to the first segment of the live synchronized text; and
automatically assigning a second speaker label to the second segment of the live synchronized text;
wherein the presenting the plurality of segments of the live synchronized text includes:
presenting the first speaker label together with the first segment of the live synchronized text; and
presenting the second speaker label together with the second segment of the live synchronized text;
wherein:
the first segment of the live synchronized text and the second segment of the live synchronized text are next to each other;
the first speaker label represents the same speaker;
the second speaker label represents the same speaker; and
the first speaker label and the second speaker label are the same.
7. The computer-implemented method of claim 6 , wherein the live audio-form conversation includes at least one selected from a group consisting of a human-to-human conversation in audio form, a meeting conversation, and a phone conversation.
8. The computer-implemented method of claim 6 , wherein the presenting the plurality of segments of the live synchronized text further includes presenting the plurality of segments of the live synchronized text to be both navigable and searchable.
9. The computer-implemented method of claim 8 , wherein the presenting the plurality of segments of the live synchronized text further includes presenting one or more matches of a searched text in a highlighted state, the one or more matches being one or more parts of the plurality of segments of the synchronized text.
10. The computer-implemented method of claim 9 , wherein the presenting the plurality of segments of the live synchronized text further includes highlighting the live audio-form conversation at one or more timestamps, the one or more timestamps corresponding to the one or more matches of the searched text respectively.
11. A non-transitory computer-readable medium with instructions stored thereon, that when executed by a processor, perform the processes comprising:
receiving a live audio-form conversation involving one or more speakers;
automatically transcribing the received live audio-form conversation into a live synchronized text, the live synchronized text being synchronized with the live audio-form conversation;
after the live audio-form conversation has been transcribed into the live synchronized text,
automatically generating a plurality of segments of the live audio-form conversation, the plurality of segments of the live audio-form conversation including a first segment of the live audio-form conversation and a second segment of the live audio- form conversation; and
automatically generating a plurality of segments of the live synchronized text, the plurality of segments of the live synchronized text including a first segment of the live synchronized text and a second segment of the live synchronized text; and
presenting the plurality of segments of the live synchronized text;
wherein the automatically generating a plurality of segments of the live audio-form conversation and the automatically generating a plurality of segments of the live synchronized text include:
after the live audio-form conversation has been transcribed into the live synchronized text,
identifying an occurrence of a natural pause during the live audio-form conversation in which there is an absence of speech from the one or more speakers; and
in response to the identified occurrence of the natural pause,
automatically segmenting the live audio-form conversation into the first segment of the live audio-form conversation and the second segment of the live audio-form conversation; and
automatically segmenting the live synchronized text into the first segment of the live synchronized text and the second segment of the live synchronized text;
wherein the first segment of the live audio-form conversation and the second segment of the live audio-form conversation are next to each other and are spoken by a same speaker;
wherein the automatically generating a plurality of segments of the live audio-form conversation and the automatically generating a plurality of segments of the live synchronized text further include:
automatically assigning a first speaker label to the first segment of the live synchronized text; and
automatically assigning a second speaker label to the second segment of the live synchronized text;
wherein the presenting the plurality of segments of the live synchronized text includes:
presenting the first speaker label together with the first segment of the live synchronized text; and
presenting the second speaker label together with the second segment of the live synchronized text;
wherein:
the first segment of the live synchronized text and the second segment of the live synchronized text are next to each other;
the first speaker label represents the same speaker;
the second speaker label represents the same speaker; and
the first speaker label and the second speaker label are the same.
12. The non-transitory computer-readable medium of claim 11 , wherein the presenting the plurality of segments of the live synchronized text further includes presenting one or more matches of a searched text in a highlighted state, the one or more matches being one or more parts of the plurality of segments of the synchronized text.
13. The non-transitory computer-readable medium of claim 12 , wherein the presenting the plurality of segments of the live synchronized text further includes highlighting the live audio-form conversation at one or more timestamps, the one or more timestamps corresponding to the one or more matches of the searched text respectively.