IP Library Granted Patent US 9,088,692
Granted Patent B2
US 9,088,692 · App. 13/918,226 · Granted Jul 21, 2015

Managing the layout of multiple video streams displayed on a destination display screen during a videoconference

Inventors: James Carter (Cedar Park, TX); Arik Yaacob (Austin, TX); James F. Darrah (Austin, TX)
Assignee: Polycom, Inc.
H04N7/15H04L12/1827H04L65/4038H04N7/152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,088,692
App. No.
13/918,226
Filed
Jun 14, 2013
Granted
Jul 21, 2015
Kind
B2
Art Unit
2656
USPC
348/14.07
Abstract

A system includes a network interface for sending and receiving at least video data between two or more endpoints, where each endpoint includes a display screen. A camera may be located at more than one endpoint capturing video data. The system also includes a control unit for controlling spatial arrangement of one or more video data streams displayed on a display screen of one or more endpoints. The control unit determines a state and configuration of a videoconference and accesses a route description corresponding to the state and configuration of the videoconference. The route description includes a video data stream destination, one or more video data stream sources, and layout information determining the spatial arrangement of one or more video data streams displayed on the video data stream destination.

Claims (65)

1. A system comprising:

a network interface for sending and receiving at least video image data between two or more endpoints; and

a control unit for controlling spatial arrangement of one or more video image data streams sent or received via the network interface to be displayed on a display screen of one or more endpoints, the control unit operable to execute instructions to:

determine a state and configuration of an ongoing videoconference; and

access a route description corresponding to the state and configuration of the ongoing videoconference, the route description including a user created label describing a video image data stream destination, at least one user created label describing a video image data stream source for the video image data stream destination, and a user created label describing layout information determining the spatial arrangement of one or more video image data streams displayed on the video image data stream destination.

2. The system of claim 1 , wherein:

wherein more than one route description is accessed that corresponds to the state and configuration of the ongoing videoconference for displaying at least one video image data stream on the display screen of the one or more endpoints.

3. The system of claim 1 , further comprising:

a memory operatively coupled to the control unit and storing a plurality of route descriptions, wherein a route description is provided for each of a plurality of states and configurations of an ongoing videoconference and a video image data stream destination.

4. The system of claim 3 , wherein the control unit is operable to execute instructions to:

update at least one route description of the plurality of route descriptions when a change in at least one of the state and configuration of an ongoing videoconference is determined, a change in at least one of the state and configuration of an ongoing videoconference comprising at least one of: an endpoint joining the ongoing videoconference, an endpoint leaving the ongoing videoconference, an endpoint going into an active state, and an endpoint going into an idle state.

5. The system of claim 1 , wherein:

the control unit controls spatial arrangement of one or more video image data streams and at least one data stream; and

the layout information determines the spatial arrangement of one or more one video image data streams and at least one data stream displayed on the video image data stream destination.

6. A control unit comprising:

an interface for sending and receiving at least video data between two or more endpoints over a network; and

a control unit for controlling spatial arrangement of more than one video data stream displayed on a display screen of at least one endpoint, the control unit operable to execute instructions to:

determine a state and configuration of an ongoing videoconference; and

access at least one route description corresponding to the state and configuration of the ongoing videoconference, the route description comprising user created labels describing:

a video data stream destination;

at least one video data stream source corresponding to the video data stream destination; and

a layout description, the layout description label indicating the spatial arrangement of the at least one video data stream displayed on the destination.

7. The control unit of claim 6 , further comprising:

a memory storing a plurality of route descriptions, wherein a route description is provided for each of a plurality of states and configurations of an ongoing videoconference and a video image data stream destination.

8. The control unit of claim 7 , wherein the control unit is further operable to:

update at least one route description of the plurality of route descriptions when a change in at least one of the state and configuration of an ongoing videoconference is determined, a change in at least one of the state and configuration of an ongoing videoconference comprising at least one of: an endpoint joining the ongoing videoconference, an endpoint leaving the ongoing videoconference, an endpoint going into an active state, and an endpoint going into an idle state.

9. The control unit of claim 8 , wherein:

the video image data stream destination is dependent upon the video image data stream destination of a selected route description; and

the video image data stream source is dependent upon the video image data stream source of the selected route description.

10. The control unit of claim 6 , wherein the control unit is further operable to:

convert the video image data stream destination to a selected display screen of a selected endpoint; and

convert the more than one video image data stream source to more than one selected video image data stream from more than one selected remotely located endpoint.

11. The control unit of claim 10 , wherein:

the control unit converts the layout description to layout data, the layout data including at least height and width coordinates for each video data stream displayed on at least one display screen of the selected endpoint.

12. The control unit of claim 6 , wherein:

the control unit controls spatial arrangement of one or more video image data streams and at least one data stream; and

the layout description determines the spatial arrangement of one or more one video image data streams and at least one data stream displayed on the video image data stream destination.

13. A method comprising:

operating a programmed processor to determine at least one of state and configuration of an ongoing videoconference;

accessing one or more route descriptions stored in a memory operatively coupled to the programmed processor and corresponding to the determined state and configuration of the ongoing videoconference, a route description comprising at least one user created label describing a video data stream destination, one or more user created labels describing video data stream sources for the video data stream destination, and a user created label describing a spatial arrangement of one or more video data streams displayed on the destination; and

sending instructions to cause the display of one or more video data streams at the destination corresponding to the determined state and configuration of the ongoing videoconference.

14. The method of claim 13 , further comprising:

providing a plurality of route descriptions, wherein a route description is provided for each of a plurality of states and configurations of videoconferences and video data stream destinations.

15. The method of claim 14 , further comprising:

updating at least one route description of the plurality of route descriptions when a change in at least one of the state and configuration of an ongoing videoconference is determined, a change in at least one of the state and configuration of an ongoing videoconference comprising at least one of: an endpoint joining the ongoing videoconference, an endpoint leaving the ongoing videoconference, an endpoint going into an active state, and an endpoint going into an idle state.

16. The method of claim 13 , further comprising:

converting the video data stream destination to a selected display screen of a selected endpoint;

converting the one or more video data stream sources to more than one selected video image data stream from more than one selected remotely located endpoint; and

converting the spatial arrangement of one or more video data streams displayed on the destination to layout data, the layout data including at least height and width coordinates for each video data stream displayed on at least one display screen of the selected endpoint.

17. The method of claim 13 , further comprising:

displaying one or more video data streams and at least one data stream and on the destination corresponding to the determined state and configuration of the ongoing videoconference.

18. A method comprising:

monitoring at least one of state and configuration of an ongoing videoconference, the videoconference comprising a near endpoint and at least one remote endpoint;

sending instructions to cause the display of at least one video data stream on a destination display screen determined by a route description, the route description comprising a user created label describing a video data stream destination, at least one user created label describing a video data stream source, and a user created label describing a layout description;

detecting a change in state or configuration of the ongoing videoconference; and

updating at least one route description corresponding to a current state and configuration of the ongoing videoconference, updating at least one route description, said updating further comprising:

determining a video data stream destination corresponding to the current state and configuration of the ongoing videoconference;

determining at least one video data stream source corresponding to the current state and configuration of the ongoing videoconference; and

updating the layout description for video data stream destination, wherein at least one video data stream is displayed on the destination display screen determined by the layout description.

19. The method of claim 18 , further comprising:

converting the video data stream destination to a selected display screen of a selected endpoint; and

converting the at least one video data stream source to at least one selected video data stream from at least one selected remote endpoint; and

converting the layout description to layout data, the layout data including at least height and width coordinates for each video data stream displayed on the selected display screen of the selected endpoint.

20. The method of claim 19 , further comprising:

providing a route description for each of a plurality of states and configurations of the ongoing videoconference.

Assignments (9)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 22, 2023
From: POLYCOM, INC.
To: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Reel/Frame 064056/0947 →
RELEASE OF PATENT SECURITY INTERESTS Recorded Aug 30, 2022
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: PLANTRONICS, INC.; POLYCOM, INC.
Reel/Frame 061356/0366 →
SECURITY AGREEMENT Recorded Jul 5, 2018
From: PLANTRONICS, INC.; POLYCOM, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 046491/0915 →
RELEASE OF SECURITY INTEREST Recorded Jul 3, 2018
From: MACQUARIE CAPITAL FUNDING LLC
To: POLYCOM, INC.
Reel/Frame 046472/0815 →
RELEASE OF SECURITY INTEREST Recorded Jul 3, 2018
From: MACQUARIE CAPITAL FUNDING LLC
To: POLYCOM, INC.
Reel/Frame 047247/0615 →
GRANT OF SECURITY INTEREST IN PATENTS - FIRST LIEN Recorded Sep 27, 2016
From: POLYCOM, INC.
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 040168/0094 →
GRANT OF SECURITY INTEREST IN PATENTS - SECOND LIEN Recorded Sep 27, 2016
From: POLYCOM, INC.
To: MACQUARIE CAPITAL FUNDING LLC, AS COLLATERAL AGENT
Reel/Frame 040168/0459 →
SECURITY AGREEMENT Recorded Dec 9, 2013
From: POLYCOM, INC.; VIVU, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 031785/0592 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2013
From: CARTER, JAMES; YAACOB, ARIK; DARRAH, JAMES F.
To: POLYCOM, INC.
Reel/Frame 030616/0616 →
Continuity (2)
Provisional Application 61659866 · Jun 14, 2012
Related Publication 20130335506A1 · Dec 19, 2013