IP Library Granted Patent US 8,890,929
Granted Patent B2
US 8,890,929 · App. 13/275,433 · Granted Nov 18, 2014

Defining active zones in a traditional multi-party video conference and associating metadata with each zone

Inventors: Anand Paithankar (Pune, IN); Srinivasan Narayanan (Pune, IN)
Assignee: Avaya Inc.
H04N7/152
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,890,929
App. No.
13/275,433
Granted
Nov 18, 2014
Kind
B2
Abstract

A conference system provides metadata about the display of a multimedia stream to allow communication endpoints to control the format of a video conference. A multipoint control unit (MCU) can provide metadata that describes the display layout and other information about the multimedia stream. After setting up the conference, the MCU can generate a layout description in eXstensible Markup Language (XML) that can be sent to and understood by the communication endpoints. The communication endpoints can read and interpret the XML metadata to determine how the display layout is configured. If desired by the user, the communication endpoint can change the display layout or other multimedia stream function based on the received metadata.

Claims (45)

1. A non-transient computer program product including computer executable instructions stored onto a computer readable medium which, when executed by a processor of a computer, causes the computer to perform a method for changing a display of a video conference, the instructions comprising:

instructions to receive a single multimedia stream, wherein the single multimedia stream is associated with the video conference, and wherein the video conference has a first display format for display of the video conference;

instructions to receive metadata associated with the single multimedia stream;

instructions to determine a new configuration for a second display of the video conference, wherein the new configuration is to mute a selected participant in the single multimedia stream, wherein muting the selected participant in the single multimedia stream causes the selected participant's video to be collapsed into an icon or thumbnail;

instructions to configure the second display; and

instructions to provide the second display for the video conference in the single multimedia stream.

2. The computer program product as defined in claim 1 , wherein the metadata includes configuration information for the first display.

3. The computer program product as defined in claim 2 , wherein the configuration information includes a description of the first display format.

4. The computer program product as defined in claim 3 , wherein the description includes a master layout of a first conference display and participant metadata.

5. The computer program product as defined in claim 4 , wherein the participant metadata describes a zone within the conference display.

6. The computer program product as defined in claim 4 , wherein the master layout includes at least one of a conference identifier, a vector describing the size of the video conference display, a number of participants, and a property.

7. The computer program product as defined in claim 6 , wherein the property can include at least one of frames per second, sharpness, or contrast.

8. The computer program product as defined in claim 7 , wherein the property is the same for the zone and at least one other zone.

9. A method for changing a display of a video conference, comprising:

a multipoint control unit (MCU) receiving at least two uplinked multimedia streams from at least two communication endpoints;

the MCU creating a downlink multimedia stream from the at least two uplinked multimedia streams, wherein the downlink multimedia stream is associated with a video conference, and wherein the video conference has a first display format for display of the video conference;

the MCU generating metadata about the downlink multimedia stream;

the MCU sending the metadata associated with the downlink multimedia stream to the at least two communication endpoints;

the MCU sending the downlink multimedia stream to the at least two communication endpoints;

the MCU receiving, from a first communication endpoint of the at least two communication endpoints, a request to change the first display format to a second display format, wherein the request to change the first display format to the second display format is based on a request to mute a selected participant in the downlink multimedia stream, wherein muting the selected participant in the downlink multimedia stream causes the selected participant's video to be collapsed into an icon or thumbnail;

reconfiguring the downlink stream to provide second display format to the first communication endpoint;

the MCU generating second metadata about the reconfigured downlink multimedia stream;

the MCU sending the second metadata associated with the multimedia stream to the first communication endpoint; and

the MCU sending the reconfigured downlink multimedia stream to the first communication endpoint.

10. The method as defined in claim 9 , wherein the request is an (Extensible Markup Language) XML document.

11. The method as defined in claim 10 , wherein the XML document includes changes to the first display format.

12. The method as defined in claim 9 , wherein a second communication endpoint does not receive the reconfigured downlink multimedia stream.

13. The method as defined in claim 12 , wherein a third communication endpoint receives a third downlink multimedia stream having a third display format.

14. A communication system, comprising:

a first communication endpoint;

a multipoint control unit (MCU) in communication with the first communication endpoint, the first MCU comprising:

a memory;

a processor in communication with the memory, the processor operable to execute:

a conference engine operable to conduct a conference with the first communication endpoint;

a layout builder module operable to determine a first display format for the conference and receive, from the first communication endpoint, a request to change the first display format for the conference to a second display format for the conference, wherein the request to change the first display format for the conference to the second display format for the conference is based on a request to mute a selected participant in the conference, wherein muting the selected participant in the conference causes the selected participant's video to be collapsed into an icon or thumbnail;

an XML engine operable to create metadata associated with the first display format; and

a metadata interface operable to send the metadata to the first communication endpoint.

15. The communication system as defined in claim 14 , further comprising an uplink/downlink interface operable to send a downlink multimedia stream to the first communication endpoint, wherein the downlink multimedia stream includes multimedia data for the conference.

16. The communication system as defined in claim 15 , wherein the metadata describes the downlink multimedia stream.

17. The communication system as defined in claim 16 , wherein the first communication endpoint comprises:

an interface operable to receive at least one of the metadata or the downlink multimedia stream; and

an XML editor operable to interpret the metadata; and

a rendering engine operable to reconfigure the first display format, based on the metadata.

18. The communication system as defined in claim 17 , wherein the first communication endpoint further comprises a requester operable to send a XML request to the MCU to change the first display format for the first communication endpoint.

19. The computer program product as defined in claim 1 , further comprising instructions to modify a remote zone of a second selected participant in the single multimedia stream, wherein modifying the remote zone of the second selected participant in the single multimedia stream comprises adding at least one of: a menu to initiate a side bar conference, a history of past interactions of the video conference, a calendar related to the video conference, and an email related to the video conference.

Assignments (18)
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 029608/0256 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVAYA INC.
Reel/Frame 044891/0801 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 030083/0639 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVAYA INC.
Reel/Frame 045012/0666 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
SECURITY AGREEMENT Recorded Mar 13, 2013
From: AVAYA, INC.
To: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., THE
Reel/Frame 030083/0639 →
SECURITY AGREEMENT Recorded Jan 10, 2013
From: AVAYA, INC.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 029608/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 18, 2011
From: PAITHANKAR, ANAND; NARAYANAN, SRINIVASAN
To: AVAYA INC.
Reel/Frame 027076/0102 →
Continuity (1)
Related Publication 20130093835A1 · Apr 18, 2013