System and method for real-time whiteboard capture and processing
View Patent ↗A system that captures both whiteboard content and audio signals of a meeting using a video camera and records or transmits them in real-time. The Real-Time Whiteboard Capture captures pen strokes on whiteboards in real time using an off-the-shelf video camera. Unlike many existing tools, the RTWCS does not instrument the pens or the whiteboard. It analyzes the sequence of captured video images in real time, classifies the pixels into whiteboard background, pen strokes and foreground objects (e.g., people in front of the whiteboard), and extracts newly written pen strokes. This allows the RTWCS to transmit whiteboard contents using very low bandwidth to remote meeting participants. Combined with other teleconferencing tools such as voice conference and application sharing, the RTWCS becomes a powerful tool to share ideas during online meetings.
1. A system for transferring the content of data written on a whiteboard to at least one remote meeting participant, comprising:
a capture system that captures a sequence of images of content written on a whiteboard and audio signals corresponding to sounds that occur during a meeting;
an analysis server for analyzing the sequence of images and transmitting whiteboard content without foreground obstructions and associated audio to a remote meeting participant in real-time wherein the analysis server comprises modules for:
dividing each of said images into cells of cell images;
for each image,
determining if the cell images have changed from the last frame;
computing the background color of the cell images which represent the color of blank whiteboard;
updating a whiteboard background model by integrating the color of the blank whiteboard computed from the cell images;
classifying the cell images into foreground or whiteboard cells using the whiteboard color model;
extracting changed whiteboard content; and
outputting changed whiteboard content to at least one remote participant.
2. The system of claim 1 further comprising a module for enhancing the color of whiteboard content.
3. The system of claim 1 wherein each image frame is processed in Bayer color format.
4. The system of claim 3 wherein the sequence of images are captured in Bayer color format.
5. The system of claim 1 wherein the analysis server processes and outputs changed whiteboard content in real-time.