IP Library Granted Patent US 12,143,798
Granted Patent B2
US 12,143,798 · App. 17/669,534 · Granted Nov 12, 2024

Multi-channel speech compression system and method

Inventors: Dushyant Sharma (Mountain House, CA); Patrick A. Naylor (Reading, GB); Uwe Helmut Jost (Groton, MA)
Assignee: Microsoft Technology Licensing, LLC
H04S7/30G06T7/70G10L15/063G10L15/22G10L19/008G10L19/167G10L21/0208H04R1/406H04R3/005H04R5/027H04S3/008G10L2019/0001G10L2019/0002G10L2021/02166H04R2201/401H04S2400/01H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,143,798
App. No.
17/669,534
Granted
Nov 12, 2024
Kind
B2
Abstract

A method, computer program product, and computing system for generating a plurality of acoustic relative transfer functions associated with a plurality of audio acquisition devices of an audio recording system deployed in an acoustic environment. At least a pair of the plurality of acoustic relative transfer functions from time frames may be compared. A change in the acoustic environment may be detected based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames.

Claims (29)

1. A computer-implemented method, executed on a computing device, comprising:

generating a plurality of acoustic relative transfer functions associated with a plurality of audio acquisition devices of an audio recording system deployed in an acoustic environment, wherein generating the plurality of acoustic relative transfer functions includes generating a plurality of residual signals associated with the plurality of audio acquisition devices based upon, at least in part, the acoustic relative transfer functions for each audio acquisition device of the plurality of audio acquisition devices;

comparing the plurality of acoustic relative transfer functions from at least a pair of time frames; and

detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames from the plurality of acoustic relative transfer functions, wherein detecting the change in the acoustic environment includes:

comparing the plurality of residual signals from at least a pair of time frames; and

detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of residual signals from at least the pair of time frames.

2. The computer-implemented method of claim 1 , wherein the plurality of audio acquisition devices of the audio recording system are positioned within a fixed geometry relative to each other.

3. The computer-implemented method of claim 1 , wherein detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames includes determining at least a threshold change in the acoustic relative transfer functions between the at least a pair of time frames.

4. The computer-implemented method of claim 1 , further comprising:

training a machine learning model to output a change classification based upon, at least in part, the plurality of acoustic relative transfer functions from at least the pair of time frames.

5. The computer-implemented method of claim 4 , wherein detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames includes detecting the change in the acoustic environment using the trained machine learning model.

6. A computer program product comprising a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

generating a plurality of acoustic relative transfer functions associated with a plurality of audio acquisition devices of an audio recording system deployed in an acoustic environment, wherein generating the plurality of acoustic relative transfer functions includes generating a plurality of residual signals associated with the plurality of audio acquisition devices based upon, at least in part, the acoustic relative transfer functions for each audio acquisition device of the plurality of audio acquisition devices;

comparing the plurality of acoustic relative transfer functions from at least a pair of time frames; and

detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames from the plurality of acoustic relative transfer functions, wherein detecting the change in the acoustic environment includes:

comparing the plurality of residual signals from at least a pair of time frames; and

detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of residual signals from at least the pair of time frames.

7. The computer program product of claim 6 , wherein the plurality of audio acquisition devices of the audio recording system are positioned within a fixed geometry relative to each other.

8. The computer program product of claim 6 , wherein detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames includes determining at least a threshold change in the acoustic relative transfer functions between the at least a pair of time frames.

9. The computer program product of claim 6 , wherein the operations further comprise: training a machine learning model to output a change classification based upon, at least in part, the plurality of acoustic relative transfer functions from at least the pair of time frames.

10. The computer program product of claim 9 , wherein detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames includes detecting the change in the acoustic environment using the trained machine learning model.

11. A computing system comprising:

a memory; and

a processor configured to generate a plurality of acoustic relative transfer functions associated with a plurality of audio acquisition devices of an audio recording system deployed in an acoustic environment, wherein generating the plurality of acoustic relative transfer functions includes generating a plurality of residual signals associated with the plurality of audio acquisition devices based upon, at least in part, the acoustic relative transfer functions for each audio acquisition device of the plurality of audio acquisition devices, wherein the processor is further configured to compare the plurality of acoustic relative transfer functions from at least a pair of time frames, and wherein the processor is further configured to detect a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames from the plurality of acoustic relative transfer functions, wherein detecting the change in the acoustic environment includes: comparing the plurality of residual signals from at least a pair of time frames, and detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of residual signals from at least the pair of time frames.

12. The computing system of claim 11 , wherein the plurality of audio acquisition devices of the audio recording system are positioned within a fixed geometry relative to each other.

13. The computing system of claim 11 , wherein detecting a change in the acoustic environment based upon, at least in part, the comparison of at least the pair of time frames from the plurality of acoustic relative transfer functions includes determining at least a threshold change in the acoustic relative transfer functions between the at least a pair of time frames.

14. The computing system of claim 11 , wherein the processor is further configured to:

train a machine learning model to output a change classification based upon, at least in part, the plurality of acoustic relative transfer functions from at least the pair of time frames.

15. The computing system of claim 14 , wherein detecting a change in the acoustic environment based upon, at least in part, the comparison of the plurality of acoustic relative transfer functions from at least the pair of time frames includes detecting the change in the acoustic environment using the trained machine learning model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065578/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2022
From: SHARMA, DUSHYANT; NAYLOR, PATRICK A.; JOST, UWE HELMUT
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 059224/0298 →
Continuity (3)
Provisional Application 63148427 · Feb 11, 2021
Provisional Application 63183848 · May 4, 2021
Related Publication 20220256303A1 · Aug 11, 2022