Granted Patent B2

US 9,472,238 · App. 14/634,939 · Granted Oct 18, 2016

Inventor: Eric Burns (Seattle, WA)

Assignee: Panopto, Inc.

G11B27/031G11B27/10H04N5/77H04N21/41407H04N21/47205H04N21/854H04N21/8547

Abstract

Claims (37)

1. A processor-implemented method of generating a multi-stream composite video, comprising:

linking a first mobile device with a second mobile device so that the first mobile device and the second mobile device are time synchronized;

capturing a video stream of an event using the first mobile device and first timing information derived from the first mobile device and associated with the video stream, the video stream captured without sharing the video stream with the second mobile device;

capturing objects displayed on the second mobile device during the event, user interactions with the displayed objects using the second mobile device, and second timing information derived from the second mobile device and associated with the display of objects and user interactions;

correlation the captured video stream, display objects, and user interactions based on the captured first and second timing information and the time synchronization of the first mobile device and the second mobile device; and

generating a composite video based on the correlated captured video stream, display objects, and user interactions.

2. The method of claim 1 , wherein the composite video includes a simultaneous display of the video stream, the displayed objects, and a representation of the captured user interactions.

3. The method of claim 2 , wherein the composite video includes a first frame that displays the video stream containing a person making a presentation and a second frame that displays the captured objects, corresponding to presentation materials, transformed based on the captured interactions.

4. The method of claim 3 , wherein the transforming of the objects includes a selection of a presentation image or a traversal of a series of presentation images.

5. The method of claim 1 , wherein the video stream is captured according to a first timeline, wherein the objects and user interactions with the objects are captured according to a second timeline, wherein the first timeline and the second timeline are aligned based on the time synchronization.

6. The method of claim 5 , wherein the composite video simultaneously displays a portion of the video stream and a display based on a portion of the captured objects and user interactions that corresponds with the portion of the video stream using the aligned first timeline and second timeline.

7. The method of claim 1 , wherein the objects displayed include an image, a series of images, a screen capture, web browser content, or a video.

8. The method of claim 1 , wherein the objects include slides of a presentation.

9. The method of claim 1 , wherein the captured interactions include annotations on a particular object of the objects displayed on the second mobile device.

10. The method of claim 9 , wherein the composite video includes a simultaneous display of the particular object displayed on the second mobile device and the annotations to the object indicated by the captured interactions.

11. The method of claim 1 , wherein the video stream includes video of a person delivering a presentation.

12. The method of claim 1 , further comprising:

capturing a second video stream using the second mobile device, wherein the second mobile device captures the second video stream from a different point of view than the first mobile device captures the video stream.

13. The method of claim 1 , wherein the first mobile device and the second mobile device are linked using applications operating on each of the first mobile device and the second mobile device.

14. The method of claim 13 , wherein the applications communicate with a server, wherein the first mobile device and the second mobile device are time synchronized based on one or more signals received from the server.

15. The method of claim 13 , wherein the first mobile device and the second mobile device are automatically linked by being brought within proximity of one another.

16. The method of claim 1 , further comprising:

transmitting the video stream to a server along with first timing data that is based on the time synchronization;

transmitting the captured displayed objects and user interactions to the server along with second timing data that is based on the time synchronization;

wherein the composite video is generated at the server using the first timing data and the second timing data.

17. A processor-implemented method of generating a multi-stream composite video, comprising:

receiving a video stream of an event captured using a first mobile device, the video stream having associated first timing information derived from the first mobile device, the video stream not being shared with a second mobile device;

receiving data associated with objects displayed on the second mobile device during the event, interactions of a user with the displayed objects captured using the second mobile device, and second timing information derived from the second mobile device and associated with the display of objects and user interaction, wherein the first mobile device and the second mobile device are linked so that the first mobile device and the second mobile device are time synchronized;

correlating the captured video stream, displayed objects, and user interactions based on the captured first and second timing information and the time synchronization of the first mobile device and the second mobile device; and

generating a composite video based on the correlated captured video stream, displayed objects, and user interactions.

18. A computer-implemented system for generating a multi-stream composite video, comprising:

one or more computer-readable mediums configured to store:

a video stream of an event captured using a first mobile device, the video stream having associated first timing information derived from the first mobile device, the video stream not being shared with a second mobile device; and

data associated with objects displayed on the second mobile device during the event, interactions of a user with the displayed objects captured using the second mobile device, and timing information derived from the second mobile device and associated with the display of objects and user interactions, wherein the first mobile device and the second mobile device are linked so that the first mobile device and the second mobile device are time synchronized; and

one or more data processors configured to perform operations that include:

correlation the captured video stream, displayed objects, and user interaction based on the first and second timing information and the time synchronization of the first mobile device and the second mobile device; and

generating a composite video based on the correlated captured video stream, displayed objects, and user interactions.

Assignments (8)

Continuity (2)