IP Library Granted Patent US 11,670,298
Granted Patent B2
US 11,670,298 · App. 17/314,718 · Granted Jun 6, 2023

System and method for data augmentation for multi-microphone signal processing

Inventors: Dushyant Sharma (Woburn, MA); Patrick A. Naylor (Reading, GB); Rong Gong (Vienna, AT); Stanislav Kruchinin (Vienna, AT); Ljubomir Milanovic (Vienna, AT)
Assignee: Nuance Communications, Inc.
G10L15/22G06F16/65G06F16/686G06N20/00G10L15/20G10L15/32G10L17/06G10L21/028G10L25/78G10L25/84G16H15/00H04R1/406H04R3/005H04R3/04H04R5/04H04R29/005H04S7/307G10L15/26G10L21/0216G10L21/0272G10L2021/02166G16H10/60G16H40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,670,298
App. No.
17/314,718
Granted
Jun 6, 2023
Kind
B2
Abstract

A method, computer program product, and computing system for receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals. Harmonic distortion associated with at least one microphone may be determined. One or more harmonic distortion-based augmentations may be performed on the plurality of signals based upon, at least in part, the harmonic distortion associated with the at least one microphone, thus defining one or more harmonic distortion-based augmented signals.

Claims (31)

1. A computer-implemented method, executed on a computing device, comprising:

receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals;

determining a total harmonic distortion associated with at least one microphone; and

performing one or more harmonic distortion-based augmentations on the plurality of signals based upon, at least in part, the total harmonic distortion associated with the at least one microphone, thus defining one or more harmonic distortion-based augmented signals.

2. The computer-implemented method of claim 1 , wherein determining the total harmonic distortion associated with the at least one microphone includes receiving a harmonic distortion parameter associated with the at least one microphone.

3. The computer-implemented method of claim 2 , wherein the harmonic distortion parameter indicates an order of harmonics associated with the at least one microphone.

4. The computer-implemented method of claim 2 , wherein performing the one or more harmonic distortion-based augmentations on the plurality of signals based upon, at least in part, the harmonic distortion parameter includes generating a harmonic distortion-based augmented signal based upon, at least in part, the harmonic distortion parameter and a table of harmonic distortion coefficients.

5. The computer-implemented method of claim 4 , wherein determining the total harmonic distortion associated with the at least one microphone includes measuring the total harmonic distortion from the at least one microphone.

6. The computer-implemented method of claim 5 , further comprising:

generating the table of harmonic distortion coefficients based upon, at least in part, the total harmonic distortion measured from the at least one microphone.

7. The computer-implemented method of claim 1 , wherein the plurality of microphones define a microphone array.

8. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

receiving a signal from each microphone of a plurality of microphones, thus defining a plurality of signals;

determining a total harmonic distortion associated with at least one microphone; and

performing one or more harmonic distortion-based augmentations on the plurality of signals based upon, at least in part, the total harmonic distortion associated with the at least one microphone, thus defining one or more harmonic distortion-based augmented signals.

9. The computer program product of claim 8 , wherein determining the total harmonic distortion associated with the at least one microphone includes receiving a harmonic distortion parameter associated with the at least one microphone.

10. The computer program product of claim 9 , wherein the harmonic distortion parameter indicates an order of harmonics associated with the at least one microphone.

11. The computer program product of claim 9 , wherein performing the one or more harmonic distortion-based augmentations on the plurality of signals based upon, at least in part, the harmonic distortion parameter includes generating a harmonic distortion-based augmented signal based upon, at least in part, the harmonic distortion parameter and a table of harmonic distortion coefficients.

12. The computer program product of claim 11 , wherein determining the total harmonic distortion associated with the at least one microphone includes measuring the total harmonic distortion from the at least one microphone.

13. The computer program product of claim 12 , wherein the operations further comprise:

generating the table of harmonic distortion coefficients based upon, at least in part, the total harmonic distortion measured from the at least one microphone.

14. The computer program product of claim 8 , wherein the plurality of microphones define a microphone array.

15. A computing system comprising:

a memory; and

a processor configured to receive a signal from each microphone of a plurality of microphones, thus defining a plurality of signals, wherein the processor is further configured to determine a total harmonic distortion associated with at least one microphone, and wherein the processor is further configured to perform one or more harmonic distortion-based augmentations on the plurality of signals based upon, at least in part, the total harmonic distortion associated with the at least one microphone, thus defining one or more harmonic distortion-based augmented signals.

16. The computing system of claim 15 , wherein determining the total harmonic distortion associated with the at least one microphone includes receiving a harmonic distortion parameter associated with the at least one microphone.

17. The computing system of claim 16 , wherein the harmonic distortion parameter indicates an order of harmonics associated with the at least one microphone.

18. The computing system of claim 16 , wherein performing the one or more harmonic distortion-based augmentations on the plurality of signals based upon, at least in part, the harmonic distortion parameter includes generating a harmonic distortion-based augmented signal based upon, at least in part, the harmonic distortion parameter and a table of harmonic distortion coefficients.

19. The computing system of claim 18 , wherein determining the total harmonic distortion associated with the at least one microphone includes measuring the total harmonic distortion from the at least one microphone.

20. The computing system of claim 15 , wherein the processor is further configured to:

generate the table of harmonic distortion coefficients based upon, at least in part, the plurality of harmonic distortions measured from the at least one microphone.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: NUANCE COMMUNICATIONS, INC.
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065530/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2021
From: SHARMA, DUSHYANT; NAYLOR, PATRICK A.; GONG, RONG; KRUCHININ, STANISLAV; MILANOVIC, LJUBOMIR
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 056173/0675 →