IP Library Granted Patent US 11,956,290
Granted Patent B2
US 11,956,290 · App. 14/638,960 · Granted Apr 9, 2024

Multi-media collaboration cursor/annotation control

Inventors: Ignacio Miranda Gonzalez (Madrid, ES); Bryan Solan (Galway, IE)
Assignee: Avaya Inc.
H04L65/4038G06F3/0481G06F3/167G06F40/169H04L65/1089H04L65/4015H04L65/403
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,956,290
App. No.
14/638,960
Granted
Apr 9, 2024
Kind
B2
Abstract

When a multimedia conference between multiple users at multiple locations is established, a first cursor controlled by a first user in a first location is provided. A first event associated with the multimedia conference is detected. In response to detecting the first event associated with the multimedia conference, control of cursors in the multimedia conference can be handled in various ways to enhance the multimedia conference. For example, control of the first cursor can be switched from the first user to a second user at a second location, a second cursor can be provided to the multimedia conference that is controlled by the second user, or control of the first cursor can be merged so that the first cursor can be controlled by both the first user and the second user. This allows for enhanced control of the cursor in the multimedia conference that more closely resembles an in-person conference.

Claims (55)

1. A method comprising:

providing, by a microprocessor, a first cursor in a multimedia conference, wherein the first cursor is shared by a plurality of users in the multimedia conference, wherein the multimedia conference comprises the plurality of users on a plurality of communication endpoints at a plurality of locations;

recording, by the microprocessor, annotations and cursor movements as part of the multimedia conference, wherein information regarding who is controlling the first cursor is also captured and made available during playback of the multimedia conference, and wherein a color of the annotations and cursor movements is changed based on a user associated with the annotations and cursor movements; and

detecting an event associated with a stress level or mood of a second user of the plurality of users speaking during the multimedia conference and in response to the detected event, determining whether the detected event results in switching control of the first cursor; and

when the detected event results in switching control of the first cursor, switch control of the first cursor to the second user;

when the detected event does not result in switching control of the first cursor, add a second cursor in the multimedia conference, wherein the second cursor is controlled by the second user.

2. The method of claim 1 , further comprising:

detecting a second event associated with the multimedia conference and in response to detecting the second event, further enabling at least one of:

switching control of the first cursor in the multimedia conference to a different user;

removing control of the first cursor in the multimedia conference from a user of the plurality of users; or

adding an additional cursor in the multimedia conference.

3. The method of claim 1 , further comprising associating a time period for a user speaking to control the first cursor in the multimedia conference after the user stops speaking.

4. The method of claim 1 further comprising:

recording the multimedia conference, wherein the recording the multimedia conference comprises recording control of the first cursor in the multimedia conference and individual users associated with controlling the first cursor in the multimedia conference.

5. The method of claim 1 , wherein an event associated with the multimedia conference further comprises detecting a group discussion period to switch control of the first cursor in the multimedia conference.

6. The method of claim 2 , wherein the second event is at least one of:

a user walking out of a conference room or office;

the user walking away from the multimedia conference;

the user not paying attention to the multimedia conference;

the user looking at or pointing to a specific area of a presented document;

one or more Dual Tone Multi-Frequency (DTMF) tones;

a stress level or mood of the user; and

presence of the user being off camera.

7. The method of claim 2 , wherein the second event is at least one of:

a controlling user walking out of a conference room or office; the controlling user walking away from the multimedia conference; and the controlling user not paying attention to the multimedia conference.

8. The method of claim 2 , wherein the second event is a stress level or mood of a controlling user.

9. The method of claim 2 , wherein the second event is a presence of a third user being off camera.

10. The method of claim 6 , wherein the second event is the user not paying attention to the multimedia conference.

11. The method of claim 6 , wherein the second event is a third user looking at or pointing to the specific area of the presented document.

12. The method of claim 6 , wherein the second event is the presence of the user being off camera.

13. The method of claim 6 , wherein the second event is the stress level or mood of the user.

14. A system comprising:

a memory, a microprocessor in communication with the memory, the microprocessor executes software modules, the software modules comprising:

a conferencing application that provides, a first cursor in a multimedia conference shared by a plurality of users in the multimedia conference, wherein the multimedia conference comprises the plurality of users on a plurality of communication endpoints at a plurality of locations;

the conferencing application records annotations and cursor movements as part of the multimedia conference, wherein information regarding who is controlling the first cursor is also captured and made available during playback of the multimedia conference, and wherein a color of the annotations and cursor movements is changed based on a user associated with the annotations and cursor movements; and

detecting an event associated with a stress level or mood of a second user of the plurality of users speaking during the multimedia conference and in response to the event, determining whether the detected event results in switching control of the first cursor and;

when the detected event results in switching control of the first cursor, switch control of the first cursor to the second user;

when the detected event does not result in switching control of the first cursor, add a second cursor in the multimedia conference, wherein the second cursor is controlled by the second user.

15. The system of claim 14 , wherein:

the conferencing application detects a second event associated with the multimedia conference and in response to detecting the event, does at least one of:

switches control of the first cursor in the multimedia conference to a different user;

removes control of the first cursor in the multimedia conference from a user; or

adds an additional cursor in the multimedia conference.

16. The system of claim 14 , wherein only displaying the first cursor in the multimedia conference on a first communication endpoint and on a second communication endpoint comprises:

a mixer that establishes a sidebar communication between the first communication endpoint and the second communication endpoint.

17. The system of claim 14 , wherein a user is speaking in the multimedia conference, and wherein a time period for the speaking user to control the first cursor in the multimedia conference after the speaking user stops speaking is determined.

18. The system of claim 15 , wherein the second event is at least one of:

a user walking out of a conference room or office;

the user walking away from the multimedia conference;

the user not paying attention to the multimedia conference;

the user looking at or pointing to a specific area of a presented document;

a stress level or mood of the user;

presence of the user being on camera;

one or more Dual Tone Multi-Frequency (DTMF) tones; and

presence of the user being off camera.

Assignments (16)
SECURITY INTEREST Recorded Sep 11, 2024
From: AVAYA LLC; AVAYA MANAGEMENT L.P.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 068554/0522 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT – SUPPLEMENT NO. 6 Recorded Aug 28, 2024
From: AVAYA MANAGEMENT L.P.; AVAYA LLC
To: WILMINGTON SAVINGS FUND SOCIETY, FSB, AS COLLATERAL AGENT
Reel/Frame 068798/0654 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 4, 2015
From: GONZALEZ, IGNACIO MIRANDA; SOLAN, BRYAN
To: AVAYA INC.
Reel/Frame 035088/0699 →
Continuity (1)
Related Publication 20160259522A1 · Sep 8, 2016