IP Library Granted Patent US 12,470,617
Granted Patent B2
US 12,470,617 · App. 17/864,720 · Granted Nov 11, 2025

Dynamic latency estimation for audio streams

Inventors: Vikram Singh (San Francisco, CA); Charles Edward Luckhardt, IV (San Francisco, CA)
Assignee: Mixhalo Corp.
H04L65/80H04B17/309H04L65/60H04W24/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,470,617
App. No.
17/864,720
Granted
Nov 11, 2025
Kind
B2
Abstract

Systems and methods for packet dynamic latency estimation for audio streams may include, for example, capturing a first audio signal using a microphone of a computing device; receiving a second audio signal at the computing device via wireless communications from an access point; determining a set of estimates of a delay of the first audio signal relative to the second audio signal based on a cross-correlation at respective analysis steps within the first audio signal and the second audio signal; determining an average delay and a confidence interval for the set of estimates of the delay; comparing the confidence interval to a threshold duration; and, responsive to the confidence interval being less than the threshold duration, playing, using a speaker controlled by the computing device, an audio signal received from the access point with an added delay determined based on the average delay.

Claims (43)

1 . A system comprising:

a microphone;

a speaker;

a network interface;

a memory; and

a processor, wherein the memory includes instructions executable by the processor to cause the system to:

capture a first audio signal using the microphone;

receive, using the network interface, a second audio signal via wireless communications from an access point;

determine a set of estimates of a delay of the first audio signal relative to the second audio signal based on a cross-correlation at respective analysis steps within the first audio signal and the second audio signal, including:

receiving, using the network interface, a delay parameter via the wireless communications from the access point and selecting, based on the delay parameter, a range of phase shifts to search using cross-correlation to determine the set of estimates of the delay; or

determine an average delay and a confidence interval for the set of estimates of the delay;

compare the confidence interval to a threshold duration; and

responsive to the confidence interval being less than the threshold duration, play, using the speaker, an audio signal received from the access point with an added delay determined based on the average delay.

2 . The system of claim 1 , in which the confidence interval is a 90% confidence interval and the threshold duration is 20 milliseconds.

3 . The system of claim 1 , in which the respective analysis steps have overlapping analysis windows.

4 . The system of claim 3 , in which the respective analysis steps have analysis windows that overlap by half with adjacent analysis steps.

5 . A method comprising:

capturing a first audio signal using a microphone of a computing device;

receiving a second audio signal at the computing device via wireless communications from an access point;

determining a set of estimates of a delay of the first audio signal relative to the second audio signal based on a cross-correlation at respective analysis steps within the first audio signal and the second audio signal, including:

receiving, using the network interface, a delay parameter via the wireless communications from the access point and selecting, based on the delay parameter, a range of phase shifts to search using cross-correlation to determine the set of estimates of the delay;

determining an average delay and a confidence interval for the set of estimates of the delay;

comparing the confidence interval to a threshold duration; and

responsive to the confidence interval being less than the threshold duration, playing, using a speaker controlled by the computing device, an audio signal received from the access point with an added delay determined based on the average delay.

6 . The method of claim 5 , in which the confidence interval is a 90% confidence interval and the threshold duration is 20 milliseconds.

7 . The method of claim 5 , in which the respective analysis steps have overlapping analysis windows.

8 . The method of claim 7 , in which the respective analysis steps have analysis windows that overlap by half with adjacent analysis steps.

9 . A non-transitory computer-readable storage medium provided that includes executable instructions that, when executed by a processor, facilitate performance of operations, including:

capturing a first audio signal using a microphone of a computing device;

receiving a second audio signal at the computing device via wireless communications from an access point;

determining a set of estimates of a delay of the first audio signal relative to the second audio signal based on a cross-correlation at respective analysis steps within the first audio signal and the second audio signal, including:

receiving, using the network interface, a delay parameter via the wireless communications from the access point and selecting, based on the delay parameter, a range of phase shifts to search using cross-correlation to determine the set of estimates of the delay;

determining an average delay and a confidence interval for the set of estimates of the delay;

comparing the confidence interval to a threshold duration; and

responsive to the confidence interval being less than the threshold duration, playing, using a speaker controlled by the computing device, an audio signal received from the access point with an added delay determined based on the average delay.

10 . The non-transitory computer-readable storage medium of claim 9 , in which the confidence interval is a 90% confidence interval and the threshold duration is 20 milliseconds.

11 . The non-transitory computer-readable storage medium of claim 9 , in which the respective analysis steps have overlapping analysis windows.

12 . The system of claim 1 , wherein the delay parameter is a maximum delay parameter or a minimum delay parameter.

13 . The system of claim 1 , wherein the delay parameter is based upon a distance estimate for the access point that is determined using a timestamp received from the access point.

14 . The method of claim 5 , wherein the delay parameter is a maximum delay parameter or a minimum delay parameter.

15 . The method of claim 5 , wherein the delay parameter is based upon a distance estimate for the access point that is determined using a timestamp received from the access point.

16 . The non-transitory computer-readable storage medium of claim 9 , wherein the delay parameter is a maximum delay parameter or a minimum delay parameter.

17 . The non-transitory computer-readable storage medium of claim 9 , wherein the delay parameter is based upon a distance estimate for the access point that is determined using a timestamp received from the access point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 14, 2022
From: SINGH, VIKRAM; LUCKHARDT, CHARLES EDWARD, IV
To: MIXHALO CORP.
Reel/Frame 060505/0597 →
Continuity (2)
Provisional Application 63222950 · Jul 16, 2021
Related Publication 20230020399A1 · Jan 19, 2023
References Cited (24)
US 8938078B2 · Meyer · 2015 [cited by third party]
US 10481859B2 · Tull et al. · 2019 [cited by applicant]
US 11132172B1 · Naik et al. · 2021 [cited by examiner]
US 20070253561A1 · Williams et al. · 2007 [cited by examiner]
US 20120087507A1 · Meyer · 2012 [cited by examiner]
US 20130094683A1 · Hansen · 2013 [cited by examiner]
US 20140003611A1 · Mohammad et al. · 2014 [cited by examiner]
US 20170019743A1 · Tull · 2017 [cited by applicant]
US 20180233136A1 · Torok et al. · 2018 [cited by examiner]
US 20180329670A1 · Einziger · 2018 [cited by third party]
US 20190179597A1 · Tull · 2019 [cited by examiner]
US 20190327524A1 · Milavsky et al. · 2019 [cited by examiner]
US 20200302948A1 · Gossard · 2020 [cited by third party]
US 20200357426A1 · Trella · 2020 [cited by examiner]
US 20210058517A1 · Serbajlo et al. · 2021 [cited by examiner]
US 20210092514A1 · Agarwala et al. · 2021 [cited by examiner]
US 20210132895A1 · Cengarle et al. · 2021 [cited by examiner]
US 20210312920A1 · Stahl · 2021 [cited by examiner]
WO WO9404010 · 1994 [cited by applicant]
WO WO0028740 · 2000 [cited by examiner]
WO WO2019002179A1 · 2019 [cited by examiner]
Atti et al. (CN 107408395 A), Conference Audio Management (see title) (Year: 2017). [cited by examiner]
Contreras et al. (CN 102257750 A) Using the Secondary RF Link Sound Suppression (see title) (Year: 2011). [cited by examiner]
Tuchet, et al., Latency and Reliability Analysis of a 5G-Enabled Internet of Musical Things System, IEEE Internet of Things Journal, Jan. 2024, vol. 11, No. 1. [cited by applicant]