IP Library Granted Patent US 11,281,423
Granted Patent B1
US 11,281,423 · App. 17/362,611 · Granted Mar 22, 2022

Video conference with shared whiteboard and recording

Inventor: Ethan Fieldman (Gainesville, FL)
Assignee: STUDY SOCIAL, INC.
G06F3/1454G06F9/452G06T11/203H04L12/1822H04L67/146H04N7/155G09B5/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,281,423
App. No.
17/362,611
Granted
Mar 22, 2022
Kind
B1
Abstract

One or more users log in to a video conference with a shared, online electronic whiteboard and draw upon a shared whiteboard. Each user has a video and audio stream that are sent to a recording server. Data describing each drawing action upon the shared whiteboard is sent to a database server and each action is then distributed to all users to update their whiteboards. Screenshots of the drawing actions are created by emulating a browser and inputting data describing each action from the database. Alternatively, screenshots are taken by each user computer (after each action or periodically) and sent to the recording server. Audiovisual manipulation software is used to create a whiteboard video from the screenshots are then combined with the audio and video streams to create a resulting video of the entire session. A video clip is created simply by sending begin and end timestamps during the session.

Claims (36)

1. A method of creating a video clip of an electronic whiteboard session, said method comprising:

beginning a whiteboard session and displaying a first electronic whiteboard on a first computing device of a first user;

when said whiteboard session begins, beginning on a recording computer a recording of drawing actions that appear on said first electronic whiteboard, said recording beginning without any intervention by said first user, wherein said recording of drawing actions is performed by

loading a plurality of data sets from a database into an emulated browser in sequence and rendering a corresponding drawing action from each of said data sets on an electronic whiteboard, each of said data sets not being an image, a screenshot or a video of a drawing action,

after each data set is loaded, said recording computer taking a screenshot of said electronic whiteboard and storing said screenshot, and

importing said stored screenshots into audiovisual software in sequence and exporting said recording based upon said stored screenshots;

after said recording begins, receiving a first input from said first user indicating a start of said video clip, and in response to said first input, sending a begin timestamp to said recording computer;

after receiving said first input, receiving a second input from said first user indicating an end of said video clip, and in response to said second input, sending an end timestamp to said recording computer; and

processing said recording of drawing actions based upon said begin and end timestamps to produce said video clip having a beginning at said begin timestamp and an end at said end timestamp.

2. A method as recited in claim 1 wherein sending said begin timestamp and said end timestamp does not include any command to start or stop said recording of drawing actions.

3. A method as recited in claim 1 wherein each of said first input and said second input is a single click upon a button of said first computing device.

4. A method as recited in claim 1 further comprising:

when said whiteboard session begins, beginning on said recording computer a recording of audio from a microphone of said first computing device; and

combining said recording of drawing actions with said recording of audio to produce a resulting recording and processing said resulting recording to produce said video clip.

5. A method as recited in claim 1 further comprising:

when said whiteboard session begins, beginning on said recording computer a recording of audio from a microphone of said first computing device and a recording of video from a camera of said first computing device; and

combining said recording of drawing actions with said recording of audio and said recording of video to produce a resulting recording and processing said resulting recording to produce said video clip.

6. A method as recited in claim 1 further comprising:

displaying a second electronic whiteboard of said whiteboard session on a second computing device of a second user who has joined said whiteboard session, wherein said recording of drawing actions include drawing actions that appear on said first and second electronic whiteboards.

7. A method as recited in claim 1 further comprising:

upon receiving said second input from said first user, prompting said first user for a recording name; and

storing said video clip under said recording name.

8. A method as recited in claim 1 further comprising:

producing a plurality of video clips from said recording of drawing actions, each of said video clips beginning at a first timestamp received in response to said first user inputting a start command, and each of said video clips ending at a second timestamp received in response to said first user inputting an end command, said video clips not overlapping with one another.

9. A method of creating a video clip of an electronic whiteboard session, said method comprising:

beginning a whiteboard session and displaying a first electronic whiteboard on a first computing device of a first user;

when said whiteboard session begins, beginning on a recording computer a recording of drawing actions that appear on said first electronic whiteboard, said recording beginning without any intervention by said first user, wherein said recording of drawing actions is performed by a browser of said first computing device taking a screenshot of said electronic whiteboard after an end of each of said drawing actions and storing said screenshot into a screenshot database, and importing said stored screenshots from said screenshot database into audiovisual software in sequence and exporting said recording based upon said stored screenshots;

after said recording begins, receiving a first input from said first user indicating a start of said video clip, and in response to said first input, sending a begin timestamp to said recording computer;

after receiving said first input, receiving a second input from said first user indicating an end of said video clip, and in response to said second input, sending an end timestamp to said recording computer; and

processing said recording of drawing actions based upon said begin and end timestamps to produce said video clip having a beginning at said begin timestamp and an end at said end timestamp.

10. A method of creating a video clip of an electronic whiteboard session, said method comprising:

beginning a whiteboard session and displaying a first electronic whiteboard on a first computing device of a first user;

when said whiteboard session begins, beginning on a recording computer a recording of drawing actions that appear on said first electronic whiteboard, said recording beginning without any intervention by said first user, wherein said recording of drawing actions is performed by a browser of said first computing device periodically taking a screenshot of said electronic whiteboard and storing said screenshot into a screenshot database and importing said stored screenshots from said screenshot database into audiovisual software in sequence and exporting said recording based upon said stored screenshots;

after said recording begins, receiving a first input from said first user indicating a start of said video clip, and in response to said first input, sending a begin timestamp to said recording computer;

after receiving said first input, receiving a second input from said first user indicating an end of said video clip, and in response to said second input, sending an end timestamp to said recording computer; and

processing said recording of drawing actions based upon said begin and end timestamps to produce said video clip having a beginning at said begin timestamp and an end at said end timestamp.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Aug 4, 2025
From: KENMORE LITTERA INVESTOR, LLC
To: LITTERA EDUCATION INC.
Reel/Frame 071926/0606 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2025
From: KENMORE INVESTOR, LLC
To: LITTERA EDUCATION INC.
Reel/Frame 071401/0065 →
SECURITY INTEREST Recorded Jun 12, 2025
From: LITTERA EDUCATION INC.
To: KENMORE LITTERA INVESTOR, LLC
Reel/Frame 071402/0094 →
SECURITY INTEREST Recorded Jan 5, 2024
From: LITTERA EDUCATION INC.
To: KENMORE INVESTOR, LLC
Reel/Frame 066031/0962 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 28, 2022
From: STUDY EDGE, INC.
To: LITTERA EDUCATION INC.
Reel/Frame 061247/0985 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: FIELDMAN, ETHAN
To: STUDYSOCIAL, INC.
Reel/Frame 060952/0781 →
MERGER Recorded Aug 31, 2022
From: SUNSHINE MERGER SUB, INC.; STUDYSOCIAL, INC.
To: STUDY EDGE, INC.
Reel/Frame 060957/0035 →
Continuity (2)
Continuation 16938687 · Jul 24, 2020
Division 16392383 · Apr 23, 2019
Cited By (3)
US 12,198,727 US 12,517,694 US 12,657,380