IP Library Granted Patent US 9,886,967
Granted Patent B2
US 9,886,967 · App. 14/824,623 · Granted Feb 6, 2018

Systems and methods for speech extraction

Inventors: Srikanth Vishnubhotla (Minnetonka, MN); Carol Espy-Wilson (Atlanta, GA)
Assignee: University of Maryland, College Park
G10L21/0308G10L19/008G10L19/09G10L21/0272G10L2025/786G10L2025/906
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,886,967
App. No.
14/824,623
Granted
Feb 6, 2018
Kind
B2
Abstract

In some embodiments, a processor-readable medium stores code representing instructions to cause a processor to receive an input signal having a first component and a second component. An estimate of the first component of the input signal is calculated based on an estimate of a pitch of the first component of the input signal. An estimate of the input signal is calculated based on the estimate of the first component of the input signal and an estimate of the second component of the input signal. The estimate of the first component of the input signal is modified based on a scaling function to produce a reconstructed first component of the input signal. The scaling function is a function of at least one of the input signal, the estimate of the first component of the input signal, the estimate of the second component of the input signal, or a residual signal.

Claims (33)

1. A non-transitory processor-readable medium storing code representing instructions to cause a processor to perform a process of reconstructing a voiced speech signal, the code comprising code to:

receive an input signal simultaneously having a first component associated with a first source and a second component associated with a second source different from the first source, the first component being a voiced speech signal, the second component being noise;

sample the input signal at a specified frame rate for a plurality of frames, each frame from the plurality of frames being associated with a plurality of frequency channels;

calculate an estimate of the first component of the input signal based on an estimate of a pitch of the first component of the input signal at each frequency channel from the plurality of frequency channels for each frame from the plurality of frames;

calculate an estimate of the input signal based on each estimate of the first component of the input signal and an estimate of the second component of the input signal; and

modify each estimate of the first component of the input signal at each frequency channel from the plurality of frequency channels for each frame from the plurality of frames based on a scaling function that is adaptive based on that frequency channel to produce a reconstructed first component of the input signal, the reconstructed first component of the input signal being produced after each modified estimate of the first component of the input signal is combined across each frequency channel from the plurality of frequency channels for each frame from the plurality of frames, the scaling function being a function of at least one of the input signal, the estimate of the first component of the input signal, the estimate of the second component of the input signal, or a residual signal derived from the input signal and the estimate of the input signal.

2. The non-transitory processor-readable medium of claim 1 , further comprising code to:

calculate the estimate of the second component of the input signal based on an estimate of a pitch of the second component of the input signal.

3. The non-transitory processor-readable medium of claim 1 , wherein the scaling function is a first scaling function, the processor-readable medium further comprising code to:

modify the estimate of the second component of the input signal based on a second scaling function to produce a reconstructed second component of the input signal, the second scaling function being different from the first scaling function and being a function of at least one of the input signal, the estimate of the first component of the input signal, the estimate of the second component of the input signal or the residual signal.

4. The non-transitory processor-readable medium of claim 1 , further comprising code to:

assign the first source to the first component of the input signal based on at least one characteristic of the reconstructed first component of the input signal.

5. The non-transitory processor-readable medium of claim 1 , wherein the scaling function is configured to operate as one of a non-linear function, a linear function or a threshold-based switch.

6. The non-transitory processor-readable medium of claim 1 , wherein the residual signal corresponds to the estimate of the input signal subtracted from the input signal.

7. The non-transitory processor-readable medium of claim 1 , wherein the processor is a digital signal processor of a device of a user, the code being downloaded to the processor-readable medium.

8. The non-transitory processor-readable medium of claim 1 , wherein the scaling function is a function of a power of the estimate of the first component of the input signal, a power of the estimate of the second component of the input signal, a power of the input signal and a power of the residual signal.

9. The non-transitory processor-readable medium of claim 1 , wherein the scaling function is adaptive for the estimate of the first component of the input signal based on the estimate of the pitch of the first component of the input signal.

10. A system of reconstructing a voiced speech signal, comprising:

at least one computer memory configured to store an analysis module and a synthesis module,

the analysis module configured to receive an input signal simultaneously having a first component associated with a first source and a second component associated with a second source different from the first source, the first component being a voiced speech signal, the second component being noise, the analysis module configured to calculate a first signal estimate associated with the first component of the input signal, the analysis module configured to calculate a second signal estimate associated with at least one of the first component of the input signal or the second component of the input signal, the analysis module configured to calculate a third signal estimate derived from the first signal estimate and the second signal estimate; and

the synthesis module configured to modify the first signal estimate based on a scaling function to produce a reconstructed first component of the input signal and to modify the second signal estimate based on the scaling function, the scaling function being a function derived from at least one of a power of the input signal, a power of the first signal estimate, a power of the second signal estimate, or a power of a residual signal calculated based on the input signal and the third signal estimate.

11. The system of claim 10 , wherein the at least one computer memory is configured to store a cluster module configured to assign the first source to the first component of the input signal based on at least one characteristic of the reconstructed first component of the input signal.

12. The system of claim 10 , wherein the analysis module is configured to estimate a pitch of the first component of the input signal to produce an estimated pitch of the first component of the input signal, the analysis module is configured to calculate the first signal estimate based on the estimated pitch of the first component of the input signal.

13. The system of claim 10 , wherein the synthesis module is configured to calculate the residual noise by subtracting the third signal estimate from the input signal.

14. The system of claim 10 , wherein the scaling function is adaptive based on a frequency channel of the first component of the input signal or a pitch estimate of the first component of the input signal.

15. The system of claim 10 , wherein the first component is substantially periodic.

16. The system of claim 10 , wherein the analysis module is configured to calculate the second signal estimate based on the power of the first signal estimate and the power of the input signal.

17. A non-transitory processor-readable medium storing code representing instructions to cause a processor to perform a process of reconstructing a voiced speech signal, the code comprising code to:

receive a first signal estimate associated with a component of an input signal for a frequency channel from a plurality of frequency channels, the input signal simultaneously having a first component associated with a first source and a second component associated with a second source different from the first source, the first component being a voiced speech signal, the second component being noise;

receive a second signal estimate associated with the input signal for the frequency channel from the plurality of frequency channels, the second signal estimate being derived from the first signal estimate;

calculate a scaling function based on at least one of the frequency channel from the plurality of frequency channels, a power of the first signal estimate, or a power of a residual signal derived from the second signal estimate and the input signal;

modify the first signal estimate for the frequency channel from the plurality of frequency channels based on the scaling function to produce a modified first signal estimate for the frequency channel from the plurality of frequency channels; and

combine the modified first signal estimate for the frequency channel from the plurality of frequency channels with a modified first signal estimate for each remaining frequency channel from the plurality of frequency channels to reconstruct the component of the input signal to produce a reconstructed component of the input signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2015
From: ESPY-WILSON, CAROL; VISHNUBHOTLA, SRIKANTH
To: UNIVERSITY OF MARYLAND, COLLEGE PARK
Reel/Frame 036426/0647 →
Continuity (3)
Continuation 13018064 · Jan 31, 2011
Provisional Application 61299776 · Jan 29, 2010
Related Publication 20160203829A1 · Jul 14, 2016