Speech recognition and summarization
The subject matter of this specification can be embodied in, among other things, a method that includes receiving two or more data sets each representing speech of a corresponding individual attending an internet-based social networking video conference session, decoding the received data sets to produce corresponding text for each individual attending the internet-based social networking video conference, and detecting characteristics of the session from a coalesced transcript produced from the decoded text of the attending individuals for providing context to the internet-based social networking video conference session.
1. A method comprising:
during a video conference session between two or more participants each associated with a respective participant computing device:
from each participant computing device, receiving, at data processing hardware of a video conference system, video conference data representing speech of the participant associated with the corresponding participant computing device;
generating, by the data processing hardware, using an automated speech recognizer, a coalesced transcript of the video conference session by transcribing the speech represented by the video conference data received from each participant computing device into text in real-time;
annotating, by the data processing hardware, a particular phrase in the coalesced transcript by analyzing one or more terms in the text of the coalesced transcript;
processing, by the data processing hardware, the annotated particular phrase to generate an event invitation; and
transmitting, by the data processing hardware, the event invitation to each respective participant computing device associated with the two or more participants of the video conference session.
2. The method of claim 1 , wherein after transmitting the event invitation, each participant computing device is configured to use the received event invitation to populate a calendar application associated with the participant of the corresponding participant computing device.
3. The method of claim 1 , wherein the event invitation comprises at least one of a calendar date, a time, a location, or a guest list.
4. The method of claim 1 , wherein the video conference data further represents video data associated with the participant that is associated with corresponding participant computing device.
5. The method of claim 4 , wherein the video data is captured by a camera of the corresponding participant computing device during the video conference session.
6. The method of claim 1 , further comprising transmitting, by the data processing hardware, the coalesced to each respective participant computing device associated with the two or more participants of the video conference session.
7. The method of claim 6 , wherein after transmitting the coalesced transcript, each respective participant computing device is configured to display the text of the coalesced transcript on a video conference graphical user interface executing on the corresponding participant computing device.
8. The method of claim 1 , wherein each respective participant computing device executes a video conference graphical user interface, the video conference graphical user interface configured to display the coalesced transcript of the video conference session.
9. The method of claim 8 , wherein the video conference graphical user interface is further configured to display an image of each participant of the two or more participants.
10. The method of claim 1 , wherein generating the event invitation comprises generating a hyperlink for the event invitation.
11. A video conference system comprising:
data processing hardware; and
memory hardware in communication with the data processing hardware and storing instructions, that when executed by the data processing hardware, cause the data processing hardware to perform operations comprising:
during a video conference session between two or more participants each associated with a respective participant computing device:
from each participant computing device, receiving video conference data representing speech of the participant associated with the corresponding participant computing device;
generating, using an automated speech recognizer, a coalesced transcript of the video conference session by transcribing the speech represented by the video conference data received from each participant computing device into text in real-time;
annotating a particular phrase in the coalesced transcript by analyzing one or more terms in the text of the coalesced transcript;
processing the annotated particular phrase to generate an event invitation; and
transmitting the event invitation to each respective participant computing device associated with the two or more participants of the video conference session.
12. The video conference system of claim 11 , wherein after transmitting the event invitation, each participant computing device is configured to use the received event invitation to populate a calendar application associated with the participant of the corresponding participant computing device.
13. The video conference system of claim 11 , wherein the event invitation comprises at least one of a calendar date, a time, a location, or a guest list.
14. The video conference system of claim 11 , wherein the video conference data further represents video data associated with the participant that is associated with corresponding participant computing device.
15. The video conference system of claim 14 , wherein the video data is captured by a camera of the corresponding participant computing device during the video conference session.
16. The video conference system of claim 11 , wherein the operations further comprise transmitting the coalesced to each respective participant computing device associated with the two or more participants of the video conference session.
17. The video conference system of claim 16 , wherein after transmitting the coalesced transcript, each respective participant computing device is configured to display the text of the coalesced transcript on a video conference graphical user interface executing on the corresponding participant computing device.
18. The video conference system of claim 11 , wherein each respective participant computing device executes a video conference graphical user interface, the video conference graphical user interface configured to display the coalesced transcript of the video conference session.
19. The video conference system of claim 18 , wherein the video conference graphical user interface is further configured to display an image of each participant of the two or more participants.
20. The video conference system of claim 11 , wherein generating the event invitation comprises generating a hyperlink for the event invitation.