IP Library Granted Patent US 10,735,690
Granted Patent B2
US 10,735,690 · App. 16/404,457 · Granted Aug 4, 2020

System and methods for physical whiteboard collaboration in a video conference

Inventors: Ashish Nagpal (Bengaluru, IN); Alagu Periyannan (Palo Alto, CA); Navneet Kumar (Bengaluru, IN)
Assignee: Blue Jeans Network, Inc.
H04N7/147G06F3/048H04L12/1822H04L65/403H04L65/4015H04N7/152H04L65/1006H04L65/608
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,735,690
App. No.
16/404,457
Granted
Aug 4, 2020
Kind
B2
Abstract

A video conferencing may include a virtual whiteboard for displaying annotations and streaming of a physical whiteboard, indexing of physical whiteboard content, and compositing and projection of remote whiteboard content onto a local whiteboard.

Claims (28)

1. A method, comprising:

accepting, at a point of presence, from a plurality of participants to a video conference, a plurality of audio and video streams from a plurality of video-conference endpoints, each video-conference endpoint associated with at least one respective participant of the plurality of participants;

accepting, at the point of presence, a first physical-whiteboard stream generated based on a sequence of images of a first region designated as a writing area of a first physical whiteboard;

enabling, at the point of presence, a virtual whiteboard comprising the first physical-whiteboard stream;

providing a representation of the appearance of the virtual whiteboard as a virtual-whiteboard stream to the plurality of video conference endpoints;

providing a first projector stream based on remotely sourced visual data to a first projector endpoint associated with the first physical whiteboard; and

projecting the first projector stream on a second region of the first physical whiteboard for remotely sourced visual data, wherein the first region of the first physical whiteboard is separate from the second region of the first physical whiteboard to enable simultaneous viewing of local markings in the first region and projected markings in the second region.

2. A system, comprising:

a processor;

a storage device communicatively coupled to the processor; and

instructions stored on the storage device that, when executed by the processor, cause the processor to:

accept, at a point of presence, from a plurality of participants to a video conference, a plurality of audio and video streams from a plurality of video-conference endpoints, each video-conference endpoint associated with at least one respective participant of the plurality of participants;

accept, at the point of presence, a first physical-whiteboard stream generated based on a sequence of images of a first region designated as a writing area of the first physical whiteboard;

enable, at the point of presence, a virtual whiteboard comprising the first physical-whiteboard stream;

provide a representation of the appearance of the virtual whiteboard as a virtual-whiteboard stream to the plurality of video conference endpoints; and

provide a first projector stream based on remotely sourced visual data to a first projector endpoint associated with the first physical whiteboard, for projection on a second region of the first physical whiteboard for remotely sourced visual data, wherein the first region of the first physical whiteboard is separate from the second region of the first physical whiteboard to enable simultaneous viewing of local markings in the first region and projected markings in the second region.

3. The method of claim 1 , further comprising projecting a line to designate a border of the writing area of the first physical whiteboard onto the first physical whiteboard, the line separating the first region of the first physical whiteboard from the second region of the first physical whiteboard.

4. The method of claim 1 , wherein the first projector stream comprises at least one video stream from the plurality of audio and video streams from the plurality of video-conference endpoints.

5. The system of claim 2 , wherein the first projector stream comprises at least one video stream from the plurality of audio and video streams from the plurality of video-conference endpoints.

6. A method, comprising:

accepting, at a point of presence, from a plurality of participants to a video conference, a plurality of audio and video streams from a plurality of video-conference endpoints, each video-conference endpoint associated with at least one respective participant of the plurality of participants;

accepting, at the point of presence, a first physical-whiteboard stream generated based on a sequence of images of a first physical whiteboard;

enabling, at the point of presence, a virtual whiteboard comprising the first physical-whiteboard stream;

providing a representation of the appearance of the virtual whiteboard as a virtual-whiteboard stream to the plurality of video conference endpoints;

providing a first projector stream to a first projector endpoint associated with the first physical whiteboard, wherein the first projector stream represents remotely sourced visual data; and

projecting the first projector stream on the first physical whiteboard,

wherein the first physical-whiteboard stream excludes representations of remotely sourced visual content and is generated by performing a pixel-wise subtraction of the first projector stream from the sequence of images of the first physical whiteboard.

7. The system of claim 6 , wherein the first projector stream comprises at least one video stream from the plurality of audio and video streams from the plurality of video-conference endpoints.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Oct 2, 2020
From: SILICON VALLEY BANK
To: BLUE JEANS NETWORK, INC.
Reel/Frame 053958/0255 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2020
From: BLUE JEANS NETWORK, INC.
To: VERIZON PATENT AND LICENSING INC.
Reel/Frame 053726/0769 →
SECURITY INTEREST Recorded Jan 30, 2020
From: BLUE JEANS NETWORK, INC.
To: SILICON VALLEY BANK
Reel/Frame 051678/0121 →
SECURITY INTEREST: MEZZ. LOAN Recorded Jan 30, 2020
From: BLUE JEANS NETWORK, INC.
To: SILICON VALLEY BANK
Reel/Frame 051761/0865 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2019
From: PERIYANNAN, ALAGU
To: BLUE JEANS NETWORK, INC.
Reel/Frame 049384/0018 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2019
From: NAGPAL, ASHISH
To: BLUE JEANS NETWORK, INC.
Reel/Frame 049383/0993 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2019
From: KUMAR, NAVNEET
To: BLUE JEANS NETWORK, INC.
Reel/Frame 049384/0059 →
Priority Claims (1)
IN 201731026552 · Jul 26, 2017 · national
Continuity (2)
Continuation 15788629 · Oct 19, 2017
Related Publication 20190260964A1 · Aug 22, 2019
Cited By (3)
US 12,212,425 US 12,244,966 US 12,580,783