Granted Patent B1

US 9,888,211 · App. 15/369,005 · Granted Feb 6, 2018

Inventors: Jeffrey Casper Browne (San Francisco, CA); Mengqian Liu (Goleta, CA)

Assignee: GetGo, Inc.

H04N7/15G06K9/00718H04L65/403H04N5/265H04N5/2621H04L67/02

Abstract

Claims (121)

1. A method of conducting an online meeting, the method comprising:

electronically providing, by processing circuitry, live video of a first participant of the online meeting to a set of other participants of the online meeting, the live video displaying live physical movement of the first participant;

after electronically providing the live video of the first participant of the online meeting to the set of other participants of the online meeting, receiving, by the processing circuitry, a live video replacement command from the first participant;

in response to the live video replacement command, electronically providing, by the processing circuitry, recorded video of the first participant of the online meeting to the set of other participants of the online meeting in place of the live video, the recorded video displaying recorded physical movement of the first participant;

after electronically providing the recorded video of the first participant of the online meeting to the set of other participants of the online meeting, receiving, by the processing circuitry, a live video restore command from the first participant;

in response to the live video restore command, electronically providing, by the processing circuitry, new live video of the first participant of the online meeting to the set of other participants of the online meeting in place of the recorded video, the new live video displaying new live physical movement of the first participant;

while the live video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant;

while the recorded video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant; and

while the new live video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant;

wherein electronically providing the live video of the first participant to the set of other participants of the online meeting includes:

conveying a real time video feed of the first participant from a camera to the set of other participants of the online meeting;

wherein electronically providing the recorded video of the first participant to the set of other participants of the online meeting includes:

conveying a recorded video feed of the first participant from computerized memory to the set of other participants of the online meeting, the recorded video feed being different from the real time video feed; and

wherein electronically providing the new live video of the first participant to the set of other participants of the online meeting includes:

conveying a new real time video feed of the first participant from the camera to the set of other participants of the online meeting, the new real time video feed being different from the recorded video feed;

wherein the recorded video of the first participant includes artificially generated video having video portions which are stitched together in a random order; and

wherein electronically providing the recorded video of the first participant of the online meeting to the set of other participants further includes:

playing the artificially generated video to the set of other participants.

2. A method as in claim 1 further comprising:

while conveying the real time video feed of the first participant from the camera to the set of other participants of the online meeting, making a recording of at least a portion of the real time video feed of the first participant in the computerized memory.

3. A method as in claim 2 wherein the recording of the real time video feed includes a recorded series of frames; and

wherein conveying the recorded video feed of the first participant from computerized memory to the set of other participants includes playing at least some of the recorded series of frames to the set of other participants.

4. A method as in claim 3 wherein the recorded series of frames includes a video clip; and

wherein playing at least some of the recorded series of frames to the set of other participants includes:

playing the video clip to the set of other participants multiple times as a video loop.

5. A method as in claim 4 , further comprising:

performing a set of frame matching operations that matches frames among the recorded series of frames, the set of frame matching operations identifying a beginning frame of the video clip and an ending frame of the video clip, the beginning frame matching the ending frame within a predefined frame matching threshold.

6. A method as in claim 4 , further comprising:

in response to the live video replacement command and prior to conveying the recorded video feed of the first participant from computerized memory to the set of other participants of the online meeting, performing a set of frame matching operations that matches frames between (i) frames of the real time video feed of the first participant and (ii) the recorded series of frames, the set of frame matching operations identifying a transition from the real time video feed to the recorded video feed in response to matching a current frame of the real time video feed of the first participant and a particular frame of recorded series of frames within a predefined frame matching threshold.

7. A method as in claim 4 , further comprising:

in response to the live video restore command and prior to conveying the new real time video feed of the first participant from the camera to the set of other participants of the online meeting, performing a set of frame matching operations that matches frames between (i) the recorded series of frames and (ii) frames of the new real time video feed of the first participant, the set of frame matching operations identifying a transition from the recorded video feed to the new real time video feed in response to matching a particular frame of recorded series of frames and a current frame of the new real time video feed of the first participant within a predefined frame matching threshold.

8. A method of conducting an online meeting, the method comprising:

electronically providing, by processing circuitry, live video of a first participant of the online meeting to a set of other participants of the online meeting, the live video displaying live physical movement of the first participant;

after electronically providing the live video of the first participant of the online meeting to the set of other participants of the online meeting, receiving, by the processing circuitry, a live video replacement command from the first participant;

in response to the live video replacement command, electronically providing, by the processing circuitry, recorded video of the first participant of the online meeting to the set of other participants of the online meeting in place of the live video, the recorded video displaying recorded physical movement of the first participant;

after electronically providing the recorded video of the first participant of the online meeting to the set of other participants of the online meeting, receiving, by the processing circuitry, a live video restore command from the first participant;

in response to the live video restore command, electronically providing, by the processing circuitry, new live video of the first participant of the online meeting to the set of other participants of the online meeting in place of the recorded video, the new live video displaying new live physical movement of the first participant;

while the live video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant;

while the recorded video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant; and

while the new live video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant;

wherein electronically providing the live video of the first participant to the set of other participants of the online meeting includes:

conveying a real time video feed of the first participant from a camera to the set of other participants of the online meeting;

wherein electronically providing the recorded video of the first participant to the set of other participants of the online meeting includes:

conveying a recorded video feed of the first participant from computerized memory to the set of other participants of the online meeting, the recorded video feed being different from the real time video feed; and

wherein electronically providing the new live video of the first participant to the set of other participants of the online meeting includes:

conveying a new real time video feed of the first participant from the camera to the set of other participants of the online meeting, the new real time video feed being different from the recorded video feed;

wherein electronically providing the recorded video of the first participant to the set of other participants of the online meeting further includes:

while conveying the real time video feed of the first participant from the camera to the set of other participants of the online meeting, making a recording of at least a portion of the real time video feed of the first participant in the computerized memory;

wherein the recording of the real time video feed includes a recorded series of frames; and

wherein conveying the recorded video feed of the first participant from computerized memory to the set of other participants includes playing at least some of the recorded series of frames to the set of other participants; and

wherein the recorded series of frames includes artificially generated video having video portions which are stitched together in a random order; and

wherein playing at least some of the recorded series of frames to the set of other participants includes:

playing the artificially generated video to the set of other participants.

9. A method as in claim 8 , further comprising:

while conveying the real time video feed of the first participant from the camera to the set of other participants of the online meeting, rendering the real time video feed of the first participant on an electronic display to the first participant.

10. A method as in claim 9 , further comprising:

while conveying the real time video feed of the first participant from the camera to the set of other participants of the online meeting, further rendering a live video replacement command prompt on the electronic display to the first participant, the first participant actuating the live video replacement command prompt to provide the live video replacement command to the processing circuitry.

11. A method as in claim 10 , further comprising:

while conveying the recorded video feed of the first participant from the computerized memory to the set of other participants of the online meeting, rendering the recorded video feed of the first participant on the electronic display to the first participant.

12. A method as in claim 11 , further comprising:

while conveying the recorded video feed of the first participant from the computerized memory to the set of other participants of the online meeting, further rendering a live video restore command prompt on the electronic display to the first participant, the first participant actuating the live video restore command prompt to provide the live video restore command to the processing circuitry.

13. A method as in claim 10 , further comprising:

after the live video replacement command prompt is actuated and before the recorded video feed of the first participant is conveyed from the computerized memory to the set of other participants of the online meeting, displaying a warning notification on the electronic display to the first participant, the warning notification indicating that the real time video feed of the first participant is currently being conveyed from the camera to the set of other participants of the online meeting.

14. A method as in claim 10 , further comprising:

after the live video restore command prompt is actuated and before the new real time video feed of the first participant is conveyed from the computerized memory to the set of other participants of the online meeting, generating a visual effect between the recorded video feed and the new real time video feed to provide a controlled transition between the recorded video feed and the new real time video feed.

15. A method as in claim 1 , further comprising:

prior to providing the recorded video in place of the live video, (i) selecting a set of image portions from actual captured video containing period motion of the first participant, (ii) extracting the selected set of image portions from the actual captured video, and (iii) incorporating the selected set of image portions within a set of artificially generated frames and integrating the set of artificially generated frames into the recorded video.

16. A computer program product having a non-transitory computer readable medium that stores a set of instructions to conduct an online meeting; the set of instructions, when carried out by computerized circuitry, causing the computerized circuitry to perform a method of:

electronically providing live video of a first participant of the online meeting to a set of other participants of the online meeting, the live video displaying live physical movement of the first participant;

after electronically providing the live video of the first participant of the online meeting to the set of other participants of the online meeting, receiving a live video replacement command from the first participant; and

in response to the live video replacement command, electronically providing recorded video of the first participant of the online meeting to the set of other participants of the online meeting in place of the live video, the recorded video displaying recorded physical movement of the first participant;

after electronically providing the recorded video of the first participant of the online meeting to the set of other participants of the online meeting, receiving a live video restore command from the first participant;

in response to the live video restore command, electronically providing new live video of the first participant of the online meeting to the set of other participants of the online meeting in place of the recorded video, the new live video displaying new live physical movement of the first participant;

while the live video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant;

while the recorded video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant; and

while the new live video of the first participant is provided to the set of other participants, providing live video of the set of other participants to the first participant;

wherein electronically providing the live video of the first participant to the set of other participants of the online meeting includes:

conveying a real time video feed of the first participant from a camera to the set of other participants of the online meeting;

wherein electronically providing the recorded video of the first participant to the set of other participants of the online meeting includes:

conveying a recorded video feed of the first participant from computerized memory to the set of other participants of the online meeting, the recorded video feed being different from the real time video feed; and

wherein electronically providing the new live video of the first participant to the set of other participants of the online meeting includes:

conveying a new real time video feed of the first participant from the camera to the set of other participants of the online meeting, the new real time video feed being different from the recorded video feed;

wherein the recorded video of the first participant includes artificially generated video having video portions which are stitched together in a random order; and

wherein electronically providing the recorded video of the first participant of the online meeting to the set of other participants further includes:

playing the artificially generated video to the set of other participants.

17. An electronic apparatus, comprising:

an electronic display;

memory; and

control circuitry coupled to the electronic display and the memory, the memory storing instructions that, when carried out by the control circuitry, cause the control circuitry to:

electronically provide live video of a first participant of the online meeting to a set of other participants of the online meeting, the live video displaying live physical movement of the first participant;

after electronically providing the live video of the first participant of the online meeting to the set of other participants of the online meeting, receive a live video replacement command from the first participant; and

in response to the live video replacement command, electronically provide recorded video of the first participant of the online meeting to the set of other participants of the online meeting in place of the live video, the recorded video displaying recorded physical movement of the first participant;

after electronically providing the recorded video of the first participant of the online meeting to the set of other participants of the online meeting, receive a live video restore command from the first participant;

in response to the live video restore command, electronically provide new live video of the first participant of the online meeting to the set of other participants of the online meeting in place of the recorded video, the new live video displaying new live physical movement of the first participant;

while the live video of the first participant is provided to the set of other participants, provide live video of the set of other participants to the first participant;

while the recorded video of the first participant is provided to the set of other participants, provide live video of the set of other participants to the first participant; and

while the new live video of the first participant is provided to the set of other participants, provide live video of the set of other participants to the first participant;

wherein the control circuitry, when electronically providing the live video of the first participant to the set of other participants of the online meeting, is constructed and arranged to:

convey a real time video feed of the first participant from a camera to the set of other participants of the online meeting;

wherein the control circuitry, when electronically providing the recorded video of the first participant to the set of other participants of the online meeting, is constructed and arranged to:

convey a recorded video feed of the first participant from computerized memory to the set of other participants of the online meeting, the recorded video feed being different from the real time video feed; and

wherein the control circuitry, when electronically providing the new live video of the first participant to the set of other participants of the online meeting, is constructed and arranged to:

convey a new real time video feed of the first participant from the camera to the set of other participants of the online meeting, the new real time video feed being different from the recorded video feed;

wherein the recorded video of the first participant includes artificially generated video having video portions which are stitched together in a random order; and

wherein the control circuitry, when electronically providing the recorded video of the first participant of the online meeting to the set of other participants, is further constructed and arranged to:

play the artificially generated video to the set of other participants.

18. A method as in claim 1 , further comprising:

from image portions of actual captured video of the first participant, creating, as a series of artificially generated frames, a sequence of frames depicting eye movement and lip movement of the first participant.

19. A method as in claim 18 wherein creating the sequence of frames depicting eye movement and lip movement of the first participant includes:

joining together at least some of the image portions of the actual captured video of the first participant to dynamically generate a first frame of the sequence of frames, the first frame containing a first image of the first participant that never actually occurred, and

joining together at least some of the image portions of the actual captured video of the first participant to dynamically generate a second frame of the sequence of frames, the second frame containing a second image of the first participant that never actually occurred, the second image being different from the first image.

20. A computer program product as in claim 16 wherein the method further comprises:

from image portions of actual captured video of the first participant, creating, as a series of artificially generated frames, a sequence of frames depicting eye movement and lip movement of the first participant.

21. A computer program product as in claim 20 wherein creating the sequence of frames depicting eye movement and lip movement of the first participant includes:

joining together at least some of the image portions of the actual captured video of the first participant to dynamically generate a first frame of the sequence of frames, the first frame containing a first image of the first participant that never actually occurred, and

joining together at least some of the image portions of the actual captured video of the first participant to dynamically generate a second frame of the sequence of frames, the second frame containing a second image of the first participant that never actually occurred, the second image being different from the first image.

22. An electronic apparatus as in claim 17 wherein the control circuitry is further constructed and arranged to:

from image portions of actual captured video of the first participant, create, as a series of artificially generated frames, a sequence of frames depicting eye movement and lip movement of the first participant.

23. An electronic apparatus as in claim 22 wherein the control circuitry, when creating the sequence of frames depicting eye movement and lip movement of the first participant, is constructed and arranged to:

join together at least some of the image portions of the actual captured video of the first participant to dynamically generate a first frame of the sequence of frames, the first frame containing a first image of the first participant that never actually occurred, and

join together at least some of the image portions of the actual captured video of the first participant to dynamically generate a second frame of the sequence of frames, the second frame containing a second image of the first participant that never actually occurred, the second image being different from the first image.

Assignments (11)