IP Library Granted Patent US 12711983
Granted Patent B2
US 12711983 · App. 18/766,553 · Granted Aug 18, 2026

Method of detecting speech and speech detector for low signal-to-noise ratios

Inventors: Rob Anton Jurjen De Vries (Eindhoven, NL); Tobias Piechowiak (Hedehusene, DK)
Assignee: GN Hearing A/S
G10L25/78G10L21/0232G10L25/93H04R3/04G10L2025/937
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12711983
App. No.
18/766,553
Granted
Aug 18, 2026
Kind
B2
Abstract

The present disclosure relates in a first aspect to a method of detecting speech of incoming sound at a portable communication device. A microphone signal is divided into a plurality of separate frequency band signals from which respective power envelope signals are derived. Onsets of voiced speech of a first frequency band signal are determined based on a first stationary noise power signal and a first clean power signal and onsets of unvoiced speech in a second frequency band signal are determined based on a second stationary noise power signal and second clean power signal.

Claims (85)

1 . A method performed by a communication device, the method comprising:

generating a microphone signal by the communication device based on sound;

dividing the microphone signal into a plurality of frequency band signals comprising a first frequency band signal in a first frequency band, and a second frequency band signal in a second frequency band;

determining a first stationary noise power signal associated with the first frequency band;

determining a first clean power signal associated with the first frequency band;

determining a second stationary noise power signal associated with the second frequency band;

determining a second clean power signal associated with the second frequency band;

determining an onset of voiced speech based on the first stationary noise power signal and the first clean power signal;

determining an onset of unvoiced speech based on the second stationary noise power signal and the second clean power signal; and

obtaining a speech flag or marker;

adjusting a signal processing parameter based on the speech flag or the marker; and

providing an acoustic signal reception by a user, wherein the acoustic signal is generated by the communication device based on the signal processing parameter.

2 . The method of claim 1 , further comprising:

determining a first power envelope signal associated with the first frequency band; and

determining a second power envelope signal associated with the second frequency band.

3 . The method of claim 2 , wherein the first stationary noise power signal is based on the first power envelope signal, and wherein the second stationary noise power signal is based on the second power envelope signal.

4 . The method of claim 3 , further comprising:

determining a first non-stationary noise power signal based on the first power envelope signal; and

determining a second non-stationary noise power signal based on the second power envelope signal.

5 . The method of claim 4 , wherein the first clean power signal is determined based on the first stationary noise power signal and the first non-stationary noise power signal; and

the second clean power signal is determined based on the second stationary noise power signal and the second non-stationary noise power signal.

6 . The method of claim 2 , wherein the first power envelope signal is determined by performing non-linear averaging of the first frequency band signal; and/or

wherein the second power envelope signal is determined by performing non-linear averaging of the second frequency band signal.

7 . The method of claim 2 , wherein the first power envelope signal is determined by lowpass filtering the first frequency band signal using a first attack time and a first release time; and/or

wherein the second power envelope signal is determined by lowpass filtering the second frequency band signal using a second attack time and a second release time.

8 . The method of claim 7 , wherein the first attack time is between 0 and 10 ms, and the first release time is between 20 ms and 100 ms; and/or

wherein the second attack time is between 0 and 10 ms, and the second release time is between 20 ms and 100 ms.

9 . The method of claim 2 , further comprising tracking the first power envelope signal using:

a first envelope attack time when the first power envelope signal is larger than a threshold; and

a first envelope release time when the first power envelope signal is smaller than or equal to the threshold.

10 . The method of claim 9 , wherein the first envelope attack time exceeds 500 ms and the first envelope release time is less than 50 ms.

11 . The method of claim 2 , further comprising:

tracking a difference between the first power envelope signal and the first stationary noise power signal using an attack time when the difference is larger than the first non-stationary noise power signal, and using a release time when the difference is smaller than or equal to the first non-stationary noise power signal.

12 . The method of claim 2 , further comprising limiting a maximum increase of the first non-stationary noise power signal to be smaller than, or equal to, a maximum of zero and an increase of a difference between the first power envelope signal and the first stationary noise power signal.

13 . The method of claim 1 , wherein the onset of voiced speech is determined based on a first crest value representative of a relative power or energy between the first clean power signal and the first stationary noise power signal; and/or

wherein the onset of unvoiced speech is determined based on a second crest value representative of a relative power or energy between the second clean power signal and second stationary noise power signal.

14 . The method of claim 13 , further comprising determining a first fast onset probability, fastOnsetProb_1, associated with the first frequency band signal by comparing the first crest value with a minimum threshold value and a maximum threshold value; and/or

determining a second fast onset probability, fastOnsetProb_2, associated with the second frequency band signal by comparing the second crest value with the minimum threshold value and the maximum threshold value.

15 . The method of claim 14 , wherein the comparing the first crest value with the minimum threshold value and the maximum threshold value is in accordance with: fastOnsetProb_1=min(1, max(0, (crest−crestThldMin)/(crestThldMax−crestThldMin))); and/or

wherein the comparing the second crest value with the minimum threshold value and the maximum threshold value is in accordance with: fastOnsetProb_2=min(1, max(0, (crest−crestThldMin)/(crestThldMax−crestThldMin))); and

wherein crestThldMax is a crest maximum threshold, crestThldMin is a crest minimum threshold, and crest is the first crest value or the second crest value.

16 . The method of claim 15 , wherein a value of crestThldMin is between 1.5 and 3.5, and a value of crestThldMax is between 1.8 and 4.

17 . The method of claim 14 , further comprising:

detecting an occurrence of a fast onset associated with the first frequency band;

determining a duration of the fast onset; and

comparing the duration of the fast onset to a first duration threshold.

18 . The method of claim 17 , further comprising:

if the duration of the fast onset associated with the first frequency band exceeds the first duration threshold, categorizing the fast onset as a speech onset, and increasing a value of a speech probability estimate; and

if the duration of the fast onset in the first frequency band signal does not exceed the first duration threshold, categorizing the fast onset as an impulse, and maintaining or decreasing the value of the speech probability estimate.

19 . The method of claim 17 , further comprising, if the fast onset associated with the first frequency band is categorized as the speech onset:

determining whether power of the first clean power signal following the fast onset satisfies a criterion;

if the power of the first clean power signal following the fast onset satisfies the criterion, increasing a value of a speech probability estimate; and

if the power of the first clean power signal following the fast onset does not satisfy the criterion, maintaining or decreasing the value of the speech probability estimate.

20 . The method of claim 1 , further comprising determining whether there are multiple fast onsets concurrently in the first and second frequency band signals, or not; and

if there are multiple fast onsets concurrently in the first and second frequency band signals, maintaining or decreasing a value of a speech probability estimate.

21 . The method of claim 20 , further comprising:

if there are no multiple fast onsets concurrently in the first and second frequency band signals, increasing the value of the speech probability estimate.

22 . The method of claim 1 , further comprising:

determining a first point in time for an occurrence of a fast onset that is associated with the first frequency band;

determining a second point in time for an occurrence of a fast onset that is associated with the second frequency band;

determining a time difference between the first and second points in time;

comparing the time difference to a time threshold; and

increasing a value of a speech probability estimate if the time difference is less than the time threshold, or maintaining or decreasing the value of the speech probability estimate if the time difference is not less than the time threshold.

23 . The method of claim 1 , further comprising:

determining a first envelope difference based on the first stationary noise power signal and the first non-stationary noise power signal; and

setting the first non-stationary noise power signal to zero when the first envelope difference is negative.

24 . The method of claim 1 , further comprising:

comparing a speech probability estimate to a predetermined speech criterion; and

determining that there is speech in the sound if the predetermined speech criterion is satisfied.

25 . The method of claim 1 further comprising determining a value of a speech probability estimate based on the determined onset of voiced speech and the determined onset of unvoiced speech.

26 . The method of claim 1 further comprising adjusting a value of a speech probability estimate based on the determined onset of voiced speech and the determined onset of unvoiced speech.

27 . The method of claim 1 , wherein the act of determining the onset of voiced speech is performed by an onset detector based on the first stationary noise power signal and the first clean power signal.

28 . The method of claim 1 , wherein the communication device comprises a hearing device.

29 . A speech detector configured to obtain a plurality of separate frequency band signals based on a microphone signal, the frequency band signals comprising a first frequency band signal in a first frequency band, and a second frequency band signal in a second frequency band, the speech detector comprising:

a processing unit configured to:

determine a first stationary noise power signal associated with the first frequency band;

determine a first clean power signal associated with the first frequency band;

determine a second stationary noise power signal associated with the second frequency band;

determine a second clean power signal associated with the second frequency band;

determine an onset of voiced speech that is associated with the first frequency band based on the first stationary noise power signal and the first clean power signal; and

determine an onset of unvoiced speech that is associated with the second frequency band based on the second stationary noise power signal and the second clean power signal;

wherein the speech detector is configured to provide a speech flag or marker for a communication device, wherein the communication device is configured to adjust a signal processing parameter based on the speech flag or the marker, and to provide an acoustic signal for transmission into an ear canal of a user, wherein the communication device is configured to generate the acoustic signal based on the signal processing parameter.

30 . The speech detector of claim 29 , wherein the processing unit of the speech detector comprises an onset detector configured to determine the onset of voiced speech based on the first stationary noise power signal and the first clean power signal.

31 . A portable device comprising the speech detector of claim 29 , wherein the portable device is the communication device.

32 . The portable device of claim 31 , wherein the portable device comprises a hearing device, the hearing device comprising the speech detector.