Speech recognition and summarization
The subject matter of this specification can be embodied in, among other things, a method that includes receiving two or more data sets each representing speech of a corresponding individual attending an internet-based social networking video conference session, decoding the received data sets to produce corresponding text for each individual attending the internet-based social networking video conference, and detecting characteristics of the session from a coalesced transcript produced from the decoded text of the attending individuals for providing context to the internet-based social networking video conference session.
1 . A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:
receiving one or more important words and/or phrases identified in a transcription of speech data from two or more users, the speech data captured by a first user device;
based on the identified one or more important words and/or phrases, generating a collection of context data; and
transmitting the collection of context data to the first user device.
2 . The method of claim 1 , wherein the transcription of the speech data is generated using a medical transcription engine.
3 . The method of claim 1 , wherein the operations further comprise generating a user interface component for the collection of context data.
4 . The method of claim 1 , wherein the operations further comprise identifying a topic of the transcription by analyzing the one or more important words and/or phrases in the transcription of the speech data.
5 . The method of claim 4 , wherein the operations further comprise obtaining a particular search result associated with the identified topic of the transcription.
6 . The method of claim 5 , wherein obtaining the particular search result comprises:
obtaining, from a search engine, one or more search results that are identified as a result of performing a query using one or more of the one or more important words and/or phrases in the transcription of the speech data as being potentially relevant to the identified topic of the transcription; and
selecting the particular search result from among the one or more search results identified as the result of performing the query.
7 . The method of claim 5 , wherein obtaining the particular search result comprises obtaining a particular phone number as a result of performing a query using one or more of the one or more important words and/or phrases in the transcription of the speech data as being potentially relevant to the identified topic of the transcription.
8 . The method of claim 5 , wherein obtaining the particular search result comprises obtaining a particular email address as a result of performing a query using one or more of the one or more important words and/or phrases in the transcription of the speech data as being potentially relevant to the identified topic of the transcription.
9 . The method of claim 5 , wherein generating the collection of context data comprises generating a hyperlink for the particular search result associated with the identified topic of the transcription.
10 . The method of claim 1 , wherein the operations further comprise processing the one or more important words and/or phrases to generate an event invitation.
11 . A system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
receiving one or more important words and/or phrases identified in a transcription of speech data from two or more users, the speech data captured by a first user device;
based on the identified one or more important words and/or phrases, generating a collection of context data; and
transmitting the collection of context data to the first user device.
12 . The system of claim 11 , wherein the transcription of the speech data is generated using a medical transcription engine.
13 . The system of claim 11 , wherein the operations further comprise generating a user interface component for the collection of context data.
14 . The system of claim 11 , wherein the operations further comprise identifying a topic of the transcription by analyzing the one or more important words and/or phrases in the transcription of the speech data.
15 . The system of claim 14 , wherein the operations further comprise obtaining a particular search result associated with the identified topic of the transcription.
16 . The system of claim 15 , wherein obtaining the particular search result comprises:
obtaining, from a search engine, one or more search results that are identified as a result of performing a query using one or more of the one or more important words and/or phrases in the transcription of the speech data as being potentially relevant to the identified topic of the transcription; and
selecting the particular search result from among the one or more search results identified as the result of performing the query.
17 . The system of claim 15 , wherein obtaining the particular search result comprises obtaining a particular phone number as a result of performing a query using one or more of the one or more important words and/or phrases in the transcription of the speech data as being potentially relevant to the identified topic of the transcription.
18 . The system of claim 15 , wherein obtaining the particular search result comprises obtaining a particular email address as a result of performing a query using one or more of the one or more important words and/or phrases in the transcription of the speech data as being potentially relevant to the identified topic of the transcription.
19 . The system of claim 15 , wherein generating the collection of context data comprises generating a hyperlink for the particular search result associated with the identified topic of the transcription.
20 . The system of claim 11 , wherein the operations further comprise processing the one or more important words and/or phrases to generate an event invitation.