IP Library Granted Patent US 12,493,445
Granted Patent B2
US 12,493,445 · App. 18/112,184 · Granted Dec 9, 2025

Listening assistance by virtual conference applications for hybrid events

Inventors: Samuel Kokajko (Round Rock, TX); Jonathan Kokotajlo (Brooklyn, NY)
Assignee: Zoom Communications, Inc.
G06F3/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,493,445
App. No.
18/112,184
Granted
Dec 9, 2025
Kind
B2
Abstract

Example methods and systems provide listening assistance via a virtual conference application for hybrid events. A client device joins a virtual session of an on-site event via the virtual conference application provided by a virtual conference provider. The virtual conference application receives a first audio signal of the virtual session and a second audio signal directly from the audio source at the on-site event. The virtual conference application determines the second audio signal has a latency in reference to the first audio signal satisfying a threshold value. The virtual conference application delays the first audio signal to create a delayed first audio signal to substantially align in time with the second audio signal at the client device. The client device then transmits the delayed first audio signal to an assistive listening device.

Claims (66)

1 . A method comprising:

receiving, by a client device, a first audio signal of a virtual session from a virtual conference provider, wherein the first audio signal originates from an audio source at an on-site event corresponding to the virtual session;

receiving, by the client device, a second audio signal via an audio input device of the client device, the second audio signal received directly from the audio source at the on-site event;

determining, by the client device, whether a latency of the second audio signal in reference to the first audio signal satisfies a threshold value;

in response to determining that the latency satisfies the threshold value, delaying the first audio signal to create a delayed first audio signal to substantially align with the second audio signal in time at the client device; and

transmitting the delayed first audio signal to an assistive listening device.

2 . The method of claim 1 , wherein determining whether the latency of the second audio signal in reference to the first audio signal satisfies the threshold value comprises:

detecting a particular audio signature from the first audio signal at a first time point;

detecting the particular audio signature in the second audio signal at a second time point;

determining the latency by comparing the second time point to the first time point; and

comparing the latency to the threshold value.

3 . The method of claim 1 , wherein the virtual conference provider is configured to generate the first audio signal in a low latency mode, wherein the first audio signal has a first latency in the low latency mode in reference to the audio source, wherein determining whether the latency of the second audio signal in reference to the first audio signal satisfies the threshold value comprises:

determining a distance between a location of the client device and a location of the audio source;

converting the distance into a second latency for the second audio signal in reference to the audio source;

determining the latency of the second audio signal in reference to the first audio signal based on the second latency of the second audio signal in reference to the audio source and the first latency of the first audio signal in reference to the audio source; and

comparing the latency of the second audio signal in reference to the first audio signal to the threshold value.

4 . The method of claim 1 , further comprising:

in response to determining that the latency of the second audio signal in reference to the first audio signal does not satisfy the threshold value, transmitting the first audio signal to the assistive listening device.

5 . The method of claim 1 , further comprising delaying the first audio signal by using a delay buffer on the first audio signal.

6 . The method of claim 1 , further comprising transmitting the delayed first audio signal to the assistive listening device via Bluetooth, wherein the assistive listening device is paired with the client device via Bluetooth.

7 . The method of claim 1 , further comprising transmitting the delayed first audio signal to the assistive listening device via Bluetooth Low Energy (BLE), wherein the assistive listening device is paired with the client device via BLE.

8 . The method of claim 1 , further comprising transmitting the delayed first audio signal to the assistive listening device via ultra-wideband (UWB), wherein the assistive listening device is paired with the client device via UWB.

9 . The method of claim 1 , wherein the assistive listening device is connected to the client device by a wire.

10 . The method of claim 1 , further comprising adjusting, by the client device, a strength level of the delayed first audio signal.

11 . The method of claim 1 , further comprising transmitting location information about the client device to the virtual conference provider, wherein the virtual conference provider is configured to:

determine whether the latency of the second audio signal in reference to the first audio signal satisfies the threshold value based on the location information,

delay the first audio signal to create a delayed first audio signal to substantially align with the second audio signal in time at the client device, and

transmit the delayed first audio signal to the client device.

12 . A system comprising:

a communications interface;

a non-transitory computer-readable medium; and

one or more processors communicatively coupled to the communications interface and the non-transitory computer-readable medium, the one or more processors configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to:

receive a first audio signal of a virtual session from a virtual conference provider, wherein the first audio signal originates from an audio source at an on-site event corresponding to the virtual session;

receive a second audio signal via an audio input device of a client device, the second audio signal received directly from the audio source at the on-site event;

determine whether a latency of the second audio signal in reference to the first audio signal satisfies a threshold value;

in response to determining that the latency of the second audio signal in reference to the first audio signal satisfies the threshold value, delay the first audio signal to create a delayed first audio signal to substantially align with the second audio signal in time at the client device; and

transmit the delayed first audio signal to an assistive listening device.

13 . The system of claim 12 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

detect a particular audio signature from the first audio signal at a first time point;

detect the particular audio signature in the second audio signal at a second time point;

determine the latency by comparing the second time point to the first time point; and

compare the latency to the threshold value.

14 . The system of claim 12 , wherein the virtual conference provider is configured to generate the first audio signal in a low latency mode, wherein the first audio signal has a first latency in the low latency mode in reference to the audio source, wherein determining whether the latency of the second audio signal in reference to the first audio signal satisfies the threshold value comprises:

determining a distance between a location of the client device and a location of the audio source;

converting the distance into a second latency for the second audio signal in reference to the audio source;

determining the latency of the second audio signal in reference to the first audio signal based on the second latency of the second audio signal in reference to the audio source and the first latency of the first audio signal in reference to the audio source; and

comparing the latency of the second audio signal in reference to the first audio signal to the threshold value.

15 . The system of claim 12 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

in response to determining that the latency of the second audio signal in reference to the first audio signal does not satisfy the threshold value, transmit the first audio signal to the assistive listening device.

16 . The system of claim 12 , wherein the one or more processors are configured to execute further processor-executable instructions stored in the non-transitory computer-readable medium to:

use a delay buffer on the first audio signal to create the delayed first audio signal to substantially align with the second audio signal in time at the client device.

17 . A non-transitory computer-readable medium comprising code that is executable by a processor for causing the processor to:

receive a first audio signal of a virtual session from a virtual conference provider, wherein the first audio signal originates from an audio source at an on-site event corresponding to the virtual session;

receive a second audio signal via an audio input device of a client device, the second audio signal received directly from the audio source at the on-site event;

determine whether a latency of the second audio signal in reference to the first audio signal satisfy a threshold value;

in response to determining that the latency of the second audio signal in reference to the first audio signal satisfies the threshold value, delay the first audio signal to create a delayed first audio signal to substantially align with the second audio signal in time at the client device; and

transmit the delayed first audio signal to an assistive listening device.

18 . The non-transitory computer-readable medium of claim 17 , further comprising processor-executable instructions configured to cause one or more processors to:

detect a particular audio signature from the first audio signal at a first time point;

detect the particular audio signature in the second audio signal at a second time point;

determine the latency by comparing the second time point to the first time point; and

compare the latency to the threshold value.

19 . The non-transitory computer-readable medium of claim 17 , further comprising processor-executable instructions configured to cause one or more processors to:

transmit the delayed first audio signal to the assistive listening device via wireless communication comprising Bluetooth, Bluetooth Low Energy, or ultra-wideband, wherein the assistive listening device is paired with the client device via the wireless communication.

20 . The non-transitory computer-readable medium of claim 17 , further comprising processor-executable instructions configured to cause one or more processors to:

adjust a strength level of the delayed first audio signal.

Assignments (3)
CHANGE OF NAME Recorded Nov 6, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 073507/0330 →
CHANGE OF NAME Recorded Nov 6, 2025
From: ZOOM VIDEO COMMUNICATIONS, INC.
To: ZOOM COMMUNICATIONS, INC.
Reel/Frame 073506/0058 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2023
From: KOKAJKO, SAMUEL; KOKOTAJLO, JONATHAN
To: ZOOM VIDEO COMMUNICATIONS, INC.
Reel/Frame 062764/0450 →
Continuity (1)
Related Publication 20240281197A1 · Aug 22, 2024
References Cited (6)
US 10650840B1 · Solbach · 2020 [cited by examiner]
US 20130106976A1 · Chu · 2013 [cited by examiner]
US 20170041357A1 · Wang · 2017 [cited by examiner]
US 20200396540A1 · Ehlert · 2020 [cited by examiner]
US 20210058517A1 · Serbajlo · 2021 [cited by examiner]
EP 3627860A1 · 2020 [cited by examiner]