IP Library Granted Patent US 11,631,410
Granted Patent B2
US 11,631,410 · App. 17/314,527 · Granted Apr 18, 2023

System and method for data augmentation for multi-microphone signal processing

Inventors: Dushyant Sharma (Woburn, MA); Patrick A. Naylor (Reading, GB); Rong Gong (Vienna, AT); Stanislav Kruchinin (Vienna, AT); Ljubomir Milanovic (Vienna, AT)
Assignee: Nuance Communications, Inc.
G10L15/22G06F16/65G06F16/686G06N20/00G10L15/20G10L15/32G10L17/06G10L21/028G10L25/78G10L25/84G16H15/00H04R1/406H04R3/005H04R3/04H04R5/04H04R29/005H04S7/307G10L15/26G10L21/0216G10L21/0272G10L2021/02166G16H10/60G16H40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,631,410
App. No.
17/314,527
Granted
Apr 18, 2023
Kind
B2
Abstract

A method, computer program product, and computing system for receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals. One or more inter-microphone gain-based augmentations may be performed on the plurality of signals, thus defining one or more inter-microphone gain-augmented signals.

Claims (27)

1. A computer-implemented method, executed on a computing device, comprising:

receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals; and

performing one or more inter-microphone gain-based augmentations on the plurality of signals, thus defining one or more inter-microphone gain-augmented signals, wherein performing the one or more inter-microphone gain-based augmentations on the plurality of signals includes applying a gain level from a plurality of gain levels to the signal from each microphone, and wherein the plurality of gain levels is based upon a maximum and minimum gain introduced by each microphone relative to the plurality of microphones.

2. The computer-implemented method of claim 1 , wherein applying the gain level from the plurality of gain levels to the signal from each microphone includes applying a gain level, from a predefined range of gain levels, to the signal from each microphone.

3. The computer-implemented method of claim 2 , wherein applying the gain level from the plurality of gain levels to the signal from each microphone includes applying a random gain level, from the predefined range of gain levels, to the signal from each microphone.

4. The computer-implemented method of claim 1 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes converting the one or more signals to the frequency domain.

5. The computer-implemented method of claim 4 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes applying a plurality of gain levels to a plurality of frequency bands of the one or more signals converted to the frequency domain.

6. The computer-implemented method of claim 1 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes one or more of:

amplifying at least a portion of the one or more signals; and

attenuating at least a portion of the one or more signals.

7. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals; and

performing one or more inter-microphone gain-based augmentations on the plurality of signals, thus defining one or more inter-microphone gain-augmented signals, wherein performing the one or more inter-microphone gain-based augmentations on the plurality of signals includes applying a gain level from a plurality of gain levels to the signal from each microphone, and wherein the plurality of gain levels is based upon a maximum and minimum gain introduced by each microphone relative to the plurality of microphones.

8. The computer program product of claim 7 , wherein applying the plurality of gain levels to the signal of each microphone includes applying a plurality of gain levels from a predefined range of gain levels to the signal from each microphone.

9. The computer program product of claim 8 , wherein applying the plurality of gain levels to the signal of each microphone includes applying a random gain level from the predefined range of gain levels to the signal from each microphone.

10. The computer program product of claim 7 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes converting the one or more signals to the frequency domain.

11. The computer program product of claim 10 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes applying a plurality of gain levels to a plurality of frequency bands of the one or more signals converted to the frequency domain.

12. The computer program product of claim 7 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes one or more of:

amplifying at least a portion of the one or more signals; and

attenuating at least a portion of the one or more signals.

13. A computing system comprising:

a memory; and

a processor configured to receive a signal from each microphone of a plurality of microphones, thus defining a plurality of signals, and wherein the processor is further configured to perform one or more inter-microphone gain-based augmentations on the plurality of signals, thus defining one or more inter-microphone gain-augmented signals, wherein performing the one or more inter-microphone gain-based augmentations on the plurality of signals includes applying a gain level from a plurality of gain levels to the signal from each microphone, and wherein the plurality of gain levels is based upon a maximum and minimum gain introduced by each microphone relative to the plurality of microphones.

14. The computing system of claim 13 , wherein applying the plurality of gain levels to the signal of each microphone includes applying a plurality of gain levels from a predefined range of gain levels to the signal from each microphone.

15. The computing system of claim 14 , wherein applying the plurality of gain levels to the signal of each microphone includes applying a random gain level from the predefined range of gain levels to the signal from each microphone.

16. The computing system of claim 13 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes converting the one or more signals to the frequency domain.

17. The computing system of claim 16 , wherein performing the one or more inter-microphone gain-based augmentations on the one or more signals includes applying a plurality of gain levels to a plurality of frequency bands of the one or more signals converted to the frequency domain.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065530/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2021
From: SHARMA, DUSHYANT; NAYLOR, PATRICK A.; GONG, RONG; KRUCHININ, STANISLAV; MILANOVIC, LJUBOMIR
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 056171/0765 →