IP Library Granted Patent US 9,813,671
Granted Patent B2
US 9,813,671 · App. 12/012,630 · Granted Nov 7, 2017

Method and apparatus for enhanced video mixing

Inventors: Rami Caspi (Sunnyvale, CA); William J. Beyda (Cupertino, CA)
Assignee: Unify GmbH & Co. KG
H04N7/152H04L12/1827
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,813,671
App. No.
12/012,630
Granted
Nov 7, 2017
Kind
B2
Abstract

A telecommunications system including a network; a plurality of user devices coupled to the network; a multipoint control unit coupled to the network and configured to supervise multipoint conferencing among the plurality of user devices, the multipoint control unit including a presentation mixer, the presentation mixer configured to remove one or more backgrounds from a presentation and mix a live video feed into the presentation as a substitute background; and a screen for displaying a resulting mixed presentation such that a full area of the screen is used to display the mixed presentation. In some embodiments, the presentation mixer is further configured to adjust a level of transparency of the substitute background.

Claims (48)

1. A telecommunications system, comprising:

a presentation server;

a plurality of user devices associated with a plurality of conference participants and connected to the presentation server via a network; and

wherein the presentation server receives a presentation from a conference participant of the plurality of conference participants;

wherein the presentation server receives at least one video feed from the plurality of conference participants;

wherein the presentation server mixes the at least one received video feed with the received presentation to form a mixed video presentation; and

wherein the presentation server provides the mixed video presentation to the plurality of user devices of the plurality of conference participants via the network; and

a transparency level being adjustable by each of the conference participants independent of the other conference participants via the user device associated with the conference participant, adjustment of the transparency level adjusting how visible the at least one video feed portion of the mixed video presentation received from the presentation server is displayed to the conference participant via the user device associated with the conference participant during a conference.

2. The telecommunications system of claim 1 wherein each user device has a transparency level control that controls the transparency level, wherein the transparency level control has a control window having a first window that displays the mixed video presentation prior to an adjustment of the transparency level and a second window that displays the mixed video presentation following an adjustment of the transparency level.

3. The telecommunications system of claim 1 wherein information indicating an adjustment to the transparency level is to be effected for one of the conference participants is received by the presentation server such that the presentation server applies the adjustment to the transparency level to the at least one received video feed prior to mixing the at least one received video feed with the received presentation for effecting the adjustment of the transparency level for the conference participant that requested that adjustment of the transparency level.

4. The telecommunications system of claim 1 wherein the presentation server applies the adjusted transparency level to the at least one received video feed prior to mixing the at least one received video feed with the received presentation for effecting the adjustment of the transparency level for the conference participant that requested that adjustment of the transparency level.

5. The telecommunications system of claim 1 wherein the presentation comprises a slide presentation or a PowerPoint presentation.

6. A telecommunications system, comprising:

a presentation server;

a plurality of user devices associated with a plurality of conference participants and connected to the presentation server via a network, each one of the plurality of user devices having a transparency level control; and

wherein the presentation server receives a presentation from a conference participant of the plurality of conference participants;

wherein the presentation server determines if there is a background in the received presentation;

wherein if the background is present in the uploaded presentation, then the presentation server removes the background;

wherein the presentation server receives a video feed from a currently speaking participant of the plurality of conference participants and identifies the currently speaking participant in the received video feed;

wherein the presentation server mixes the received video feed with the received presentation to form a mixed video presentation;

wherein the presentation server provides the mixed video presentation to the plurality of user devices of the plurality of conference participants via the network; and

a transparency level being adjustable by each of the conference participants independent of the other conference participants via the user device associated with the conference participant, adjustment of the transparency level adjusting how visible an image of the currently speaking participant in the received video feed portion of the mixed video presentation received from the presentation server is displayed to the conference participant via the user device associated with the conference participant during a conference.

7. The telecommunications system of claim 6 wherein each user device has a transparency level control that controls the transparency level, wherein the transparency level control has a control window having a first window that displays the mixed video presentation prior to an adjustment of the transparency level and a second window that displays the mixed video presentation following an adjustment of the transparency level.

8. The telecommunications system of claim 6 wherein the presentation server applies the adjusted transparency level to the received video feed prior to mixing the received video feed with the received presentation.

9. The telecommunications system of claim 6 wherein the presentation comprises a slide presentation or a PowerPoint presentation.

10. A telecommunications method comprising:

a conference participant of a plurality of conference participants uploading a presentation to a presentation server;

receiving at least one video feed from the plurality of conference participants;

mixing the at least one received video feed with the uploaded presentation to form a mixed video presentation;

providing the mixed video presentation to a plurality of user devices associated with each of the plurality of conference participants, each user device displaying the mixed video presentation to the associated conference participant; and

providing each conference participant with a transparency level control that controls a transparency level of a portion of the mixed video presentation such that the transparency level is adjustable by each of the conference participants independent of the other conference participants during a conference, adjustment of the transparency level adjusting visibility of the at least one video feed included in the mixed video presentation received from the presentation server by the user device associated with the conference participant.

11. The telecommunications method of claim 10 wherein the uploaded presentation is a slide presentation.

12. The telecommunications method of claim 10 further comprising applying the adjusted transparency level to the at least one received video feed prior to mixing the at least one received video feed with the uploaded presentation and prior to the providing of the mixed video presentation to the user devices.

13. A telecommunications method, comprising:

at least one conference participant of a plurality of conference participants uploading a presentation to a presentation server;

determining if there is a background in the uploaded presentation:

removing the background upon a determination that if the background is present in the uploaded presentation;

receiving a video feed from a currently speaking participant of the plurality of conference participants;

mixing the received video feed with the uploaded presentation to form a mixed video presentation;

providing the mixed video presentation to a plurality of user devices associated with each of the plurality of conference participants, each user device displaying the mixed video presentation to the associated conference participant; and

controlling a level of transparency of an image of the currently speaking participant in the received video feed included in the mixed video presentation such that the transparency level is adjustable by each of the conference participants independent of the other conference participants during a conference, adjustment of the transparency level adjusting visibility of an image of the currently speaking participant in the mixed video presentation received from the presentation server via the user device associated with the conference participant.

14. The telecommunications method of claim 13 wherein the uploaded presentation is a slide presentation.

15. The telecommunications method of claim 13 further comprising applying the adjusted transparency level to the received video feed prior to mixing the received video feed with the uploaded presentation.

16. The telecommunications method of claim 13 wherein controlling a level of transparency comprises each conference participant controlling a transparency level control of the user device associated with that conference participant, the transparency level control having a control window, the control window having a first window that displays the mixed video presentation prior to an adjustment of the transparency level and a second window that displays the mixed video presentation following an adjustment of the transparency level.

17. The telecommunications system of claim 1 wherein the presentation server determines if there is a background in the received presentation and if the background is in the uploaded presentation, then the presentation server removes the background.

18. The telecommunications system of claim 1 wherein the user device comprises a graphical user interface.

19. The telecommunications method of claim 10 further comprising determining if there is a background in the uploaded presentation, and if the background is present in the uploaded presentation, then removing the background.

20. The telecommunications method of claim 10 wherein the transparency level control is provided such that a control window having a first window that displays the mixed video presentation prior to an adjustment of the transparency level and a second window that displays the mixed video presentation following an adjustment of the transparency level is displayed to the conference participant via the user device associated with that conference participant.

Assignments (12)
SECURITY INTEREST Recorded Feb 14, 2023
From: RINGCENTRAL, INC.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 062973/0194 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2022
From: RINGCENTRAL IP HOLDINGS, INC.
To: RINGCENTRAL, INC.
Reel/Frame 058856/0338 →
CONFIDENTIAL PATENT AGREEMENT Recorded Dec 21, 2020
From: UNIFY INC.
To: UNIFY GMBH & CO. KG
Reel/Frame 054836/0521 →
CONFIDENTIAL PATENT AGREEMENT Recorded Dec 21, 2020
From: UNIFY GMBH & CO. KG
To: UNIFY PATENTE GMBH & CO. KG
Reel/Frame 054822/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2020
From: RINGCENTRAL IP HOLDINGS, INC.
To: RINGCENTRAL, INC.
Reel/Frame 053351/0307 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2020
From: UNIFY SOFTWARE AND SOLUTIONS GMBH & CO. KG; UNIFY PATENTE GMBH & CO. KG
To: RINGCENTRAL IP HOLDINGS, INC.
Reel/Frame 053351/0292 →
RELEASE OF SECURITY INTEREST Recorded Feb 1, 2016
From: WELLS FARGO TRUST CORPORATION LIMITED
To: UNIFY INC.
Reel/Frame 037661/0781 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 20, 2016
From: WELLS FARGO TRUST CORPORATION LIMITED, AS SECURITY AGENT
To: UNIFY INC. (F/K/A SIEMENS ENTERPRISE COMMUNICATIONS, INC.)
Reel/Frame 037564/0703 →
CHANGE OF NAME Recorded Nov 11, 2015
From: SIEMENS ENTERPRISE COMMUNICATIONS, INC.
To: UNIFY, INC.
Reel/Frame 037090/0909 →
GRANT OF SECURITY INTEREST IN U.S. PATENTS Recorded Nov 10, 2010
From: SIEMENS ENTERPRISE COMMUNICATIONS, INC.
To: WELLS FARGO TRUST CORPORATION LIMITED, AS SECURITY AGENT
Reel/Frame 025339/0904 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2010
From: SIEMENS COMMUNICATIONS, INC.
To: SIEMENS ENTERPRISE COMMUNICATIONS, INC.
Reel/Frame 024294/0040 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2008
From: CASPI, RAMI; BEYDA, WILLIAM J.
To: SIEMENS COMMUNICATIONS, INC.
Reel/Frame 020535/0495 →
Continuity (1)
Related Publication 20090199078A1 · Aug 6, 2009