IP Library Granted Patent US 11,676,598
Granted Patent B2
US 11,676,598 · App. 17/314,660 · Granted Jun 13, 2023

System and method for data augmentation for multi-microphone signal processing

Inventors: Dushyant Sharma (Woburn, MA); Patrick A. Naylor (Reading, GB); Rong Gong (Vienna, AT); Stanislav Kruchinin (Vienna, AT); Ljubomir Milanovic (Vienna, AT)
Assignee: Nuance Communications, Inc.
G10L15/22G06F16/65G06F16/686G06N20/00G10L15/20G10L15/32G10L17/06G10L21/028G10L25/78G10L25/84G16H15/00H04R1/406H04R3/005H04R3/04H04R5/04H04R29/005H04S7/307G10L15/26G10L21/0216G10L21/0272G10L2021/02166G16H10/60G16H40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,676,598
App. No.
17/314,660
Granted
Jun 13, 2023
Kind
B2
Abstract

A method, computer program product, and computing system for receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals. One or more microphone frequency responses associated with at least one microphone may be received. One or more microphone frequency response-based augmentations may be performed on the plurality of signals based upon, at least in part, the one or more microphone frequency responses, thus defining one or more microphone frequency response-based augmented signals.

Claims (30)

1. A computer-implemented method, executed on a computing device, comprising:

receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals;

receiving one or more microphone frequency responses associated with at least one microphone;

performing one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses, thus defining one or more microphone frequency response-based augmented signals; and

training one or more models representative of a microphone frequency response based upon, at least in part, the one or more microphone frequency response-based augmentations on the plurality of signals.

2. The computer-implemented method of claim 1 , wherein receiving the one or more frequency responses associated with the at least one microphone includes simulating the one or more models representative of the microphone frequency response.

3. The computer-implemented method of claim 1 , wherein receiving the one or more frequency responses associated with the at least one microphone includes measuring a frequency response from the at least one microphone.

4. The computer-implemented method of claim 1 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes augmenting one or more of a magnitude component and a phase component of the plurality of signals based upon, at least in part, the one or more microphone frequency responses.

5. The computer-implemented method of claim 1 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes filtering the plurality of signals with the one or more microphone frequency responses.

6. The computer-implemented method of claim 1 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes filtering the plurality of signals with a randomly selected microphone frequency response from the one or more microphone frequency responses.

7. The computer-implemented method of claim 1 , wherein the plurality of microphones define a microphone array.

8. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

receiving a speech signal from each microphone of a plurality of microphones, thus defining a plurality of signals;

receiving one or more microphone frequency responses associated with at least one microphone;

performing one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses, thus defining one or more microphone frequency response-based augmented signals; and

training one or more models representative of a microphone frequency response based upon, at least in part, the one or more microphone frequency response-based augmentations on the plurality of signals.

9. The computer program product of claim 8 , wherein receiving the one or more frequency responses associated with the at least one microphone includes simulating the one or more models representative of the microphone frequency response.

10. The computer program product of claim 8 , wherein receiving the one or more frequency responses associated with the at least one microphone includes measuring a frequency response from the at least one microphone.

11. The computer program product of claim 8 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes augmenting one or more of a magnitude component and a phase component of the plurality of signals based upon, at least in part, the one or more microphone frequency responses.

12. The computer program product of claim 8 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes filtering the plurality of signals with the one or more microphone frequency responses.

13. The computer program product of claim 8 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes filtering the plurality of signals with a randomly selected microphone frequency response from the one or more microphone frequency responses.

14. The computer program product of claim 8 , wherein the plurality of microphones define a microphone array.

15. A computing system comprising:

a memory; and

a processor configured to receive a speech signal from each microphone of a plurality of microphones, thus defining a plurality of signals, wherein the processor is further configured to receive one or more microphone frequency responses associated with at least one microphone, wherein the processor is further configured to perform one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses, thus defining one or more microphone frequency response-based augmented signals, wherein the processor is further configured to train one or more models representative of a microphone frequency response based upon, at least in part, the one or more microphone frequency response-based augmentations on the plurality of signals.

16. The computing system of claim 15 , wherein receiving the one or more frequency responses associated with the at least one microphone includes simulating the one or more models representative of the microphone frequency response.

17. The computing system of claim 15 , wherein receiving the one or more frequency responses associated with the at least one microphone includes measuring a frequency response from the at least one microphone.

18. The computing system of claim 15 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes augmenting one or more of a magnitude component and a phase component of the plurality of signals based upon, at least in part, the one or more microphone frequency responses.

19. The computing system of claim 15 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes filtering the plurality of signals with the one or more microphone frequency responses.

20. The computing system of claim 15 , wherein performing the one or more microphone frequency response-based augmentations on the plurality of signals based upon, at least in part, the one or more microphone frequency responses includes filtering the plurality of signals with a randomly selected microphone frequency response from the one or more microphone frequency responses.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065530/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2021
From: SHARMA, DUSHYANT; NAYLOR, PATRICK A.; GONG, RONG; KRUCHININ, STANISLAV; MILANOVIC, LJUBOMIR
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 056173/0001 →