IP Library Granted Patent US 8,537,195
Granted Patent B2
US 8,537,195 · App. 13/024,101 · Granted Sep 17, 2013

Automatic video layouts for multi-stream multi-site telepresence conferencing system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,537,195
App. No.
13/024,101
Granted
Sep 17, 2013
Kind
B2
Abstract

A videoconference multipoint control unit (MCU) automatically generates display layouts for videoconference endpoints. Display layouts are generated based on attributes associated with video streams received from the endpoints and display configuration information of the endpoints. An endpoint can include one or more attributes in each outgoing stream. Attributes can be assigned based on video streams' role, content, camera source, etc. Display layouts can be regenerated if one or more attributes change. A mixer can generate video streams to be displayed at the endpoints based on the display layout.

Claims (28)

1. A method for generating display content for an endpoint communicating over a network with at least one other endpoint comprising:

generating a display layout automatically for the endpoint based on attributes associated with video streams received from the at least one other endpoint and display-configuration information of the endpoint, wherein display-configuration information includes at least a number of display devices at the endpoint, wherein generating the display layout comprises:

generating a plurality of cells, and

assigning video streams received from the at least one other endpoint to the plurality of cells, wherein one video stream is assigned to one cell; and

mixing received video streams based on the display layout to generate one or more video steams for the endpoint, wherein mixing further comprises combining video streams associated with the plurality of cells to form an outgoing video stream; and

wherein the display layout preserves a spatial relationship between at least two of the video streams received from the at least one other endpoint.

2. The method of claim 1 , wherein the display layout is a continuous presence layout.

3. The method of claim 1 , wherein at least one video stream has more than one attribute associated with it.

4. The method of claim 1 , further comprising dynamically regenerating the display layout in response to a change in any one of the attributes.

5. The method of claim 1 , wherein generating a display layout comprises identifying a first video stream received from a first of at least one other endpoint, the associated attribute of which indicates that the first video stream includes an image of a first current speaker.

6. The method of claim 1 , wherein generating the display layout further comprises assigning the first video stream to an outgoing video stream, and assigning an attribute to the outgoing video stream, the attribute indicating that the outgoing video stream includes an image of a current speaker.

7. The method of claim 3 , wherein generating the display layout further comprises identifying a second video stream received from a second of at least one other endpoint, the associated attribute of which indicates that the second video stream includes an image of a second current speaker, and assigning the second video stream to the outgoing stream.

8. The method of claim 1 , wherein at least two of the plurality of cells are spatially arranged in such a way that the arrangement preserves a spatial relationship between at least two of the associated video streams received from the at least one other endpoint.

9. A videoconferencing multipoint control unit (MCU) for managing videoconferencing between an endpoint and at least one other endpoint, comprising:

a layout manager configured to automatically generate a display layout for the endpoint based on attributes associated with video streams received from the at least one other endpoint and display-configuration information of the endpoint, the display-configuration information including at least a number of display devices at the endpoint, wherein the layout manager is configured to generate the display layout by generating a plurality of cells, and assigning video streams received from the at least one other endpoint to the plurality of cells, wherein one video stream is assigned to one cell; and

a mixer communicably coupled to the layout manager and configured to mix received video streams based on the display layout to generate one or more video steams for the endpoint, wherein the mixer is configured to combine the video streams associated with the plurality of cells to form an outgoing video stream; and

wherein the display layout preserves a spatial relationship between at least two of the video streams received from the at least one other endpoint.

10. The MCU of claim 9 , wherein the display layout is a continuous presence layout.

11. The MCU of claim 9 , wherein at least one video stream has more than one attribute associated with it.

12. The MCU of claim 9 , wherein the layout manager is configured to regenerate the display layout in response to a change in any of the attributes.

13. The MCU of claim 9 , further comprising:

a stream attribute module communicably coupled to the layout manager and configured to determine attributes associated with video streams,

wherein the stream attribute module identifies a first video stream received from a first of at least one other endpoint, the associated attribute of which indicates that the first video stream includes an image of a first current speaker.

14. The MCU of claim 13 , wherein the layout manager is configured to assign the first video stream to an outgoing video stream, and

wherein the stream attribute module is configured to assign an attribute to the outgoing video stream, the attribute indicating that the outgoing video stream includes an image of a current speaker.

15. The MCU of claim 14 , wherein the stream attribute module identifies a second video stream received from a second of at least one other endpoint, the associated attribute of which indicates that that the second video stream includes a second current speaker, and wherein the layout manager assigns the second video stream to the outgoing video stream.

16. The MCU of claim 9 , wherein the MCU is located at the endpoint.

17. The MCU of claim 9 , wherein the layout manager is configured to spatially arrange at least two of the plurality of cells in such a way that the arrangement preserves a spatial relationship between at least two of the associated video streams received from the at least one other endpoint.

Assignments (10)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 22, 2023
From: POLYCOM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 064056/0894 →
RELEASE OF PATENT SECURITY INTERESTS Recorded Aug 30, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: PLANTRONICS, INC.; POLYCOM, INC.
Reel/Frame 061356/0366 →
SECURITY AGREEMENT Recorded Jul 5, 2018
From: PLANTRONICS, INC.; POLYCOM, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 046491/0915 →
RELEASE OF SECURITY INTEREST Recorded Jul 3, 2018
From: MACQUARIE CAPITAL FUNDING LLC
To: POLYCOM, INC.
Reel/Frame 046472/0815 →
RELEASE OF SECURITY INTEREST Recorded Jul 3, 2018
From: MACQUARIE CAPITAL FUNDING LLC
To: POLYCOM, INC.
Reel/Frame 047247/0615 →
GRANT OF SECURITY INTEREST IN PATENTS - FIRST LIEN Recorded Sep 27, 2016
From: POLYCOM, INC.
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 040168/0094 →
RELEASE OF SECURITY INTEREST Recorded Sep 27, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: POLYCOM, INC.; VIVU, INC.
Reel/Frame 040166/0162 →
GRANT OF SECURITY INTEREST IN PATENTS - SECOND LIEN Recorded Sep 27, 2016
From: POLYCOM, INC.
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 040168/0459 →
SECURITY AGREEMENT Recorded Dec 9, 2013
From: POLYCOM, INC.; VIVU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 031785/0592 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 21, 2011
From: DUCKWORTH, MARK R.; PARIPALLY, GOPAL; SALEH, YOUSSEF; MACEDO, MARCIO
To: POLYCOM, INC.
Reel/Frame 026165/0814 →