IP Library Granted Patent US 11,997,469
Granted Patent B2
US 11,997,469 · App. 17/669,592 · Granted May 28, 2024

Multi-channel speech compression system and method

Inventors: Dushyant Sharma (Mountain House, CA); Patrick A. Naylor (Reading, GB); Uwe Helmut Jost (Groton, MA)
Assignee: Microsoft Technology Licensing, LLC
H04S7/30G06T7/70G10L15/063G10L15/22G10L19/008G10L19/167G10L21/0208H04R1/406H04R3/005H04R5/027H04S3/008G10L2019/0001G10L2019/0002G10L2021/02166H04R2201/401H04S2400/01H04S2400/15
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,997,469
App. No.
17/669,592
Granted
May 28, 2024
Kind
B2
Abstract

A method, computer program product, and computing system for encoding audio encounter information of a reference audio acquisition device of a plurality of audio acquisition devices of an audio recording system, thus defining encoded reference audio encounter information. Location information may be estimated, via a machine vision system, for an acoustic source within an acoustic environment. One or more acoustic relative transfer functions may be selected from a plurality of acoustic relative transfer functions for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information. The encoded reference audio encounter information and a representation of the selected one or more acoustic relative transfer function may be transmitted.

Claims (31)

1. A computer-implemented method, executed on a computing device, comprising:

encoding audio encounter information of a reference audio acquisition device of a plurality of audio acquisition devices of an audio recording system, thus defining encoded reference audio encounter information;

estimating, via a machine vision system, location information for an acoustic source within an acoustic environment;

generating a plurality of acoustic relative transfer functions between the reference audio acquisition device and the plurality of audio acquisition devices of the audio recording system which includes generating an acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system and associating each acoustic relative transfer function with a unique identifier for being uniquely identifiable from the plurality of acoustic relative transfer functions of the acoustic relative transfer function codebook based upon, at least in part, the location information and speakers within the acoustic environment,

wherein the acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system includes a data structure configured to store mapping characteristics of one or more acoustic relative transfer functions from speech signals obtained by the reference audio acquisition device to speech signals of another audio acquisition device of the plurality of audio acquisition devices;

selecting the one or more acoustic relative transfer functions corresponding to the encoded reference audio information from the acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information; and

transmitting the encoded reference audio encounter information and a representation of the selected one or more acoustic relative transfer functions.

2. The computer-implemented method of claim 1 , wherein the plurality of audio acquisition devices of the audio recording system are positioned within a fixed geometry relative to each other.

3. The computer-implemented method of claim 1 , further comprising:

mapping the location information for the acoustic source within the acoustic environment to the plurality of acoustic relative transfer functions.

4. The computer-implemented method of claim 3 , wherein selecting one or more acoustic relative transfer functions from a plurality of acoustic relative transfer functions for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information includes selecting one or more acoustic relative transfer functions from a plurality of acoustic relative transfer functions for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information and the mapping of the location information to the plurality of acoustic relative transfer functions.

5. The computer-implemented method of claim 1 , wherein generating a plurality of acoustic relative transfer functions between the reference audio acquisition device and the plurality of audio acquisition devices of the audio recording system includes generating a plurality of residual signals associated with the selected one or more acoustic relative transfer functions.

6. A non-transitory computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

encoding audio encounter information of a reference audio acquisition device of a plurality of audio acquisition devices of an audio recording system, thus defining encoded reference audio encounter information;

estimating, via a machine vision system, location information for an acoustic source within an acoustic environment;

generating a plurality of acoustic relative transfer functions between the reference audio acquisition device and the plurality of audio acquisition devices of the audio recording system which includes generating an acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system and associating each acoustic relative transfer function with a unique identifier for being uniquely identifiable from the plurality of acoustic relative transfer functions of the acoustic relative transfer function codebook based upon, at least in part, the location information and speakers within the acoustic environment,

wherein the acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system includes a data structure configured to store mapping characteristics of one or more acoustic relative transfer functions from speech signals obtained by the reference audio acquisition device to speech signals of another audio acquisition device of the plurality of audio acquisition devices;

selecting the one or more acoustic relative transfer functions corresponding to the encoded reference audio information from the acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information; and

transmitting the encoded reference audio encounter information and a representation of the selected one or more acoustic relative transfer functions.

7. The computer program product of claim 6 , wherein the plurality of audio acquisition devices of the audio recording system are positioned within a fixed geometry relative to each other.

8. The computer program product of claim 6 , wherein the operations further comprise:

mapping the location information for the acoustic source within the acoustic environment to the plurality of acoustic relative transfer functions.

9. The computer program product of claim 8 , wherein selecting one or more acoustic relative transfer functions from a plurality of acoustic relative transfer functions for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information includes selecting one or more acoustic relative transfer functions from a plurality of acoustic relative transfer functions for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information and the mapping of the location information to the plurality of acoustic relative transfer functions.

10. The computer program product of claim 6 , wherein generating a plurality of acoustic relative transfer functions between the reference audio acquisition device and the plurality of audio acquisition devices of the audio recording system includes generating a plurality of residual signals associated with the selected one or more acoustic relative transfer functions.

11. A computing system comprising:

a memory; and

a processor configured to encode audio encounter information of a reference audio acquisition device of a plurality of audio acquisition devices of an audio recording system, thus defining encoded reference audio encounter information, wherein the processor is further configured to estimate, via a machine vision system, location information for an acoustic source within an acoustic environment, wherein the processor is further configured to generate a plurality of acoustic relative transfer functions between the reference audio acquisition device and the plurality of audio acquisition devices of the audio recording system which includes generating an acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system and associating each acoustic relative transfer function with a unique identifier for being uniquely identifiable from the plurality of acoustic relative transfer functions of the acoustic relative transfer function codebook based upon, at least in part, the location information and speakers within the acoustic environment, wherein the acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system includes a data structure configured to store mapping characteristics of one or more acoustic relative transfer functions from speech signals obtained by the reference audio acquisition device to speech signals of another audio acquisition device of the plurality of audio acquisition devices, wherein the processor is further configured to select the one or more acoustic relative transfer functions corresponding to the encoded reference audio information from the acoustic relative transfer function codebook for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information, and wherein the processor is further configured to transmit the encoded reference audio encounter information and the selected one or more acoustic relative transfer functions corresponding to the encoded reference audio information.

12. The computing system of claim 11 , wherein the plurality of audio acquisition devices of the audio recording system are positioned within a fixed geometry relative to each other.

13. The computing system of claim 11 , wherein the processor is further configured to:

map the location information for the acoustic source within the acoustic environment to the plurality of acoustic relative transfer functions.

14. The computing system of claim 13 , wherein selecting one or more acoustic relative transfer functions from a plurality of acoustic relative transfer functions for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information includes selecting one or more acoustic relative transfer functions from a plurality of acoustic relative transfer functions for the plurality of audio acquisition devices of the audio recording system based upon, at least in part, the location information and the mapping of the location information to the plurality of acoustic relative transfer functions.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065578/0676 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2022
From: SHARMA, DUSHYANT; NAYLOR, PATRICK A.; JOST, UWE HELMUT
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 059225/0402 →