Reconstruction of a smooth speech signal from a stuttered speech signal
Described herein are methods, systems, apparatuses and products for reconstruction of a smooth speech signal from a stuttered speech signal. One aspect provides for accessing a stored speech signal having stuttering; identifying at least one stuttered region in the stored speech signal; modifying the at least one stuttered region in the stored speech signal; and responsive to modifying the at least one stuttered region, reconstructing a smooth speech signal corresponding to the stored speech signal. Other embodiments are disclosed.
1. A method comprising:
accessing a stored speech signal having stuttering;
identifying at least one stuttered region in the stored speech signal;
modifying the at least one stuttered region in the stored speech signal, the modifying including at least one of:
a) retaining one of a plurality of repeated syllables in the stuttered region in the stored speech signal,
b) shortening a steady state of elongated phones in the stuttered region in the stored speech signal, and
c) reducing at least one silence/breath region in the stuttered region in the stored speech signal and
responsive to modifying the at least one stuttered region, reconstructing a smooth speech signal corresponding to the stored speech signal.
2. The method of claim 1 , further comprising comparing the stored speech signal with the smooth speech signal to detect at least one speaker-specific stutter pattern.
3. The method of claim 2 , further comprising providing feedback related to the at least one speaker-specific stutter pattern as a speaker-specific profile.
4. The method of claim 3 , further comprising: automatically detecting the at least one stuttered region; and automatically labeling the at least one stuttered region with at least one stutter type.
5. The method of claim 4 , wherein reconstructing a smooth speech signal corresponding to the stored speech signal further comprises applying remedial signal processing based on at least one of location of the at least one stuttered region and a stutter type.
6. The method of claim 4 , wherein the at least one stutter type is at least one of syllable repetition, phone elongation and silence/breath.
7. The method of claim 6 , further comprising detecting syllable repetition via: aligning syllables; and comparing aligned syllables to detect repeated syllables.
8. The method of claim 7 , wherein aligning syllables comprises: detecting relative energy minima in the stored speech signal; computing a ratio of energy minima and adjacent maxima in the stored speech signal; and detecting silence between two consecutive energy minima in the stored speech signal.
9. The method of claim 7 , wherein comparing aligned syllables further comprises comparing at least two adjacent syllables using frame level features based on distance computation metrics.
10. The method of claim 7 , wherein comparing aligned syllables further comprises comparing at least two adjacent syllables using syllable level features capturing dynamic variations over syllable duration in at least one of periodicity, frequency content, and energy.
11. The method of claim 6 , further comprising detecting phone elongation via detecting at least one of fricatives exceeding a predetermined threshold, voice-bars exceeding a predetermined threshold, and vocalic sounds exceeding a predetermined threshold; wherein elongated phones include phones with or without a formant structure.