IP Library Granted Patent US 9,100,539
Granted Patent B2
US 9,100,539 · App. 13/742,449 · Granted Aug 4, 2015

Augmenting web conferences via text extracted from audio content

Inventor: Antonio Sanso (Allschwil, CH)
Assignee: Adobe Systems Incorporated
H04N7/15G06Q30/0269H04L12/1827G10L15/26G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,100,539
App. No.
13/742,449
Granted
Aug 4, 2015
Kind
B2
Abstract

Systems and methods for augmenting web conference sessions with multimedia content based on text extracted from audio content transmitted during the web conference. In one embodiment, a conference application or other application can receive audio content from at least one client participating in a web conference. The web conference can connect multiple clients for live sharing of audio and video. The conference application can also extract at least one text item from the audio content. The conference application can also generate augmented electronic content by combining electronic content received via the web conference with additional electronic content based on the at least one text item. The conference application can also provide the augmented electronic content via the web conference.

Claims (47)

1. A method comprising:

receiving, by a processing device configured to host a web conference, audio content from at least one client participating in the web conference;

extracting, by the processing device, at least one text item from the audio content, wherein the at least one text item comprises a transcription of the audio content;

determining an accuracy for information in the transcription based on a comparison to reference data;

generating additional electronic content describing the accuracy for the information in the transcription;

generating, by the processing device, augmented electronic content by combining electronic content received via the web conference with the additional electronic content; and

providing, by the processing device, the augmented electronic content via the web conference.

2. The method of claim 1 , wherein the audio content is received in real time during the web conference.

3. The method of claim 1 , wherein extracting the at least one text item comprises applying a speech recognition algorithm to the audio content.

4. The method of claim 1 , wherein the at least one text item further comprises at least one keyword, the method further comprising generating additional augmented electronic content including the electronic received via the web conference and electronic content corresponding to the at least one keyword.

5. The method of claim 1 , wherein the at least one text item further comprises at least one command, the method further comprising generating additional augmented electronic content including the electronic received via the web conference and electronic content retrieved in response to the at least one command.

6. The method of claim 1 , further comprising analyzing the transcription to generate additional data describing one or more qualitative criteria of the audio content, wherein the additional electronic content comprises the additional data describing the quality of the audio content.

7. The method of claim 1 , further comprising:

receiving, by the processing device, video content from the at least one client; and

extracting, by the processing device, at least one image from the video content;

wherein the augmented electronic content is generated by combining the electronic content received via the web conference with the additional electronic content based on the at least one text item extracted from the audio content and the at least one image extracted from the video content.

8. The method of claim 1 , wherein the additional electronic content comprises video content.

9. The method of claim 1 , wherein the additional electronic content comprises audio content.

10. The method of claim 1 , wherein the additional electronic content comprises text content.

11. A non-transitory computer-readable medium embodying program code executable by a processing device, the non-transitory computer-readable medium comprising:

program code for receiving audio content from at least one client participating in a web conference, the web conference connecting multiple clients for live sharing of audio and video;

program code for extracting at least one text item from the audio content, wherein the at least one text item comprises a transcription of the audio content;

program code for determining an accuracy for information in the transcription based on a comparison to reference data;

program code for generating additional electronic content describing the accuracy for the information in the transcription;

program code for generating augmented electronic content by combining electronic content received via the web conference with the additional electronic content; and

program code for providing the augmented electronic content via the web conference.

12. The non-transitory computer-readable medium of claim 11 , further comprising program code for receiving the audio content in real time during the web conference.

13. The non-transitory computer-readable medium of claim 11 , wherein the program code for extracting the at least one text item comprises program code for applying a speech recognition algorithm to the audio content.

14. The non-transitory computer-readable medium of claim 11 , wherein the at least one text item further comprises at least one keyword, the non-transitory computer-readable medium further comprising program code for generating additional augmented electronic content including the electronic received via the web conference and electronic content corresponding to the at least one keyword.

15. The non-transitory computer-readable medium of claim 11 , wherein the at least one text item further comprises at least one command, the non-transitory computer-readable medium further comprising program code for generating additional augmented electronic content including the electronic received via the web conference and electronic content retrieved in response to the at least one command.

16. The non-transitory computer-readable medium of claim 11 , further comprising program code for analyzing the transcription to generate additional data describing one or more qualitative criteria of the audio content, wherein the additional electronic content comprises the additional data describing the quality of the audio content.

17. The non-transitory computer-readable medium of claim 11 , further comprising:

program code for receiving video content from the at least one client; and

program code for extracting at least one image from the video content;

wherein the augmented electronic content is generated by combining the electronic content received via the web conference with the additional electronic content based on the at least one text item extracted from the audio content and the at least one image extracted from the video content.

18. A system comprising:

a processor configured to execute instructions stored in a non-transitory computer-readable medium providing a conference application;

wherein the conference application comprises one or more modules configured to perform operations comprising:

receiving audio content from at least one client participating in a web conference, the web conference connecting multiple clients for live sharing of audio and video;

extracting at least one text item from the audio content, wherein the at least one text item comprises a transcription of the audio content;

determining an accuracy for information in the transcription based on a comparison to reference data;

generating additional electronic content describing the accuracy for the information in the transcription;

generating augmented electronic content by combining electronic content received via the web conference with the additional electronic content; and

providing the augmented electronic content via the web conference.

19. The system of claim 18 , wherein the audio content is received in real time during the web conference.

20. The system of claim 18 , wherein extracting the at least one text item comprises applying a speech recognition algorithm to the audio content.

21. The system of claim 18 , wherein the at least one text item further comprises at least one keyword, the operations further comprising generating additional augmented electronic content including the electronic received via the web conference and electronic content corresponding to the at least one keyword.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2013
From: SANSO, ANTONIO
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 029636/0707 →
Continuity (1)
Related Publication 20140198174A1 · Jul 17, 2014