IP Library Granted Patent US 11,132,535
Granted Patent B2
US 11,132,535 · App. 16/715,139 · Granted Sep 28, 2021

Automatic video conference configuration to mitigate a disability

Inventor: Ofer Sova (Holon, IL)
Assignee: Avaya Inc.
G06K9/00355G06K9/00241G06K9/00315H04L12/1818H04L12/1822H04L12/1831
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,132,535
App. No.
16/715,139
Granted
Sep 28, 2021
Kind
B2
Abstract

Video conferences are a common occurrence in many business, academic, and other settings. Systems and methods provided herein enable a participant of a video conference, who has an impairment or disability, such as to hearing, speech, or vision, to have that impairment or disability mitigated by automatically detecting and implementing mitigating actions to the participants local device and/or the devices of the remote participants.

Claims (56)

1. A system, comprising:

at least one processor with a memory;

a user input-output device;

a network interface to enable the at least one processor to communicate via a network; and

wherein the user input-output device comprises a camera; and

wherein the at least one processor:

conducts a video conference as a node on a network and communicates via the network with a number of remote nodes associated with a number of remote participants;

receives an image from the user input-output device, the image comprising a local participant of the video conference;

determines that the image comprises indicia of a disability, wherein the disability impairs the local participant for at least one of speech, hearing, and vision;

in response to the determination that the image comprises indicia of the disability, altering an operational characteristic of the user input-output device to mitigate the disability for the video conference with respect to the at least one of speech, hearing, and vision utilized to participate in the video conference.

2. The system of claim 1 , further comprising:

a data storage comprising records, each record comprising a graphical attribute and an associated disability; and

wherein the at least one processor determines that the image comprises the indicia of the disability further comprising the at least one processor determining that the image comprises a captured attribute that matches the graphical attribute of at least one of the records.

3. The system of claim 2 , wherein:

the user input-output device further comprises a display visually presenting the video conference; and

wherein the at least one processor determines that the image comprises the indicia of the disability upon the at least one processor further determining that the graphical attribute comprises at least one of a head position or eye position of the local participant associated with the local participant directing their gaze to a location other than towards the display and wherein the disability comprises a vision disability.

4. The system of claim 2 , wherein:

the user input-output device further comprises a display visually presenting the video conference; and

wherein the at least one processor determines that the image comprises the indicia of the disability upon the at least one processor further determining that the graphical attribute comprises at least one of a head position or eye position of the local participant associated with the local participant wearing dark glasses and wherein the disability comprises a vision disability.

5. The system of claim 2 , wherein the at least one processor determines that the image comprises the indicia of the disability upon the at least one processor further determining that the graphical attribute comprises hand gestures while the local participant is speaking and wherein the disability comprises a hearing disability.

6. The system of claim 2 , wherein the at least one processor determines that the image comprises the indicia of the disability upon the at least one processor further determining that the graphical attribute comprises asymmetric facial movement and wherein the disability comprises a speech disability.

7. The system of claim 2 , wherein:

the user input-output device further comprises a microphone receiving speech from the local participant; and

the at least one processor determines that the image comprises the indicia of the disability upon the at least one processor further determining that facial gestures while providing speech to the microphone occur at a pace slower than a previously determined threshold pace and wherein the disability comprises a speech disability.

8. The system of claim 1 , wherein the at least one processor alters the operational characteristic of the user input-output device to mitigate the disability for the video conference, further comprising, presenting an image of a first active speaker, of the number of remote participants, on the user input-output device with additional magnification of a mouth region of the first active speaker to facilitate lip reading by the local participant.

9. The system of claim 1 , wherein the at least one processor alters the operational characteristic of the user input-output device to mitigate the disability for the video conference, further comprising, continuously presenting an image of a first active speaker and a second active speaker, of the number of remote participants, when engaged in a back-and-forth dialog therebetween, with additional magnification of a mouth region of each of the first active speaker and the second active speaker to facilitate lip reading of each of the first active speaker and the second active speaker by the local participant.

10. The system of claim 1 , wherein the at least one processor alters the operational characteristic of the user input-output device to mitigate the disability for the video conference, further comprising, generating text from speech received by the number of remote participants and presenting the generated text on the user input-output device.

11. The system of claim 1 , further comprising:

the user input-output device further comprises a microphone receiving speech from the local participant; and

a data storage comprising records of sound cues associated with speech previously provided by the local participant and associated text; and

wherein the at least one processor alters the operational characteristic of the user input-output device to mitigate the disability for the video conference, further comprising, the microphone receiving a sound cue from the local participant and the at least one processor accessing a record of the sound cues and accessing the associated text and providing the associated text to each of the number of remote participants.

12. The system of claim 1 , wherein the number of remote participants is zero and wherein the at least one processor receives the image from the user input-output device and determines the image comprises indicia of the disability prior to any of the number of remote participants joining the video conference.

13. The system of claim 1 , wherein the user input-output devices comprises a plurality of user input-output devices.

14. A method, comprising:

conducting a video conference over a network comprising a local node, utilized by a local participant, and a number of remote nodes associated with a number of remote participants;

receiving an image of the local participant of the video conference;

determining that the image comprises indicia of a disability, wherein the disability impairs the local participant for at least one of speech, hearing, and vision; and

in response the determination that the image comprises indicia of the disability, altering an operational characteristic of a user input-output device to mitigate the disability for the video conference with respect to the at least one of speech, hearing, and vision utilized to participate in the video conference.

15. The method of claim 14 , wherein:

accessing a record, of a number of records, from a data storage device, each record comprising a graphical attribute and an associated disability; and

wherein the step of determining that the image comprises the indicia of the disability comprising determining that the image comprises a captured attribute that matches the graphical attribute of the records.

16. The method of claim 15 , further comprising:

presenting the video conference on a display associated with the local participant; and

determining that the image comprises the indicia of the disability further comprising determining that the graphical attribute comprises at least one of a head position or eye position of the local participant associated with the local participant directing their gaze to a location other than towards a visual display device and wherein the disability comprises a vision disability; and

presenting an image of a first active speaker, of the number of remote participants, on the display with additional magnification of a mouth region of the first active speaker to facilitate lip reading by the local participant.

17. The method of claim 15 , wherein determining that the image comprises the indicia of the disability further comprises determining that the graphical attribute comprises hand gestures while the local participant is speaking and wherein the disability comprises a hearing disability.

18. The method of claim 17 , further comprising presenting an image of a first active speaker, of the number of remote participants, on an input-output device with additional magnification of a mouth region of the first active speaker to facilitate lip reading by the local participant.

19. The method of claim 14 , further comprising:

receiving speech from the local participant; and

accessing a record, of a number of records, from a data storage device, each record comprising speech previously provided by the local participant and associated text; and

upon determining the speech comprises a sound cue from the local participant, accessing the text from the record and providing the associated text to each of the number of remote participants.

20. A system comprising:

means to conduct a video conference as a node on a network and communicate via the network with a number of remote nodes associated with a number of remote participants;

means to receive an image of a local participant of the video conference;

means to determine that the image comprises indicia of a disability, wherein the disability impairs the local participant for at least one of speech, hearing, or vision;

means to, in response to the determination that the image comprises indicia of the disability, alter an operational characteristic of a user input-output device to mitigate the disability for the video conference with respect to the at least one of speech, hearing, or vision utilized to participate in the video conference.

Assignments (11)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2019
From: SOVA, OFER
To: AVAYA INC.
Reel/Frame 051291/0329 →
Continuity (1)
Related Publication 20210182544A1 · Jun 17, 2021