Subband domain acoustic echo canceller based acoustic state estimator
Some implementations involve receiving, from a first subband domain acoustic echo canceller (AEC) of a first audio device in an audio environment, first adaptive filter management data from each of a plurality of first adaptive filter management modules, each first adaptive filter management module corresponding to a subband of the first subband domain AEC, each first adaptive filter management module being configured to control a first plurality of adaptive filters. The first plurality of adaptive filters may include at least a first adaptive filter type and a second adaptive filter type. Some implementations involve extracting, from the first adaptive filter management data, a first plurality of extracted features corresponding to a plurality of subbands of the first subband domain AEC and estimating a current local acoustic state based, at least in part, on the first plurality of extracted features.
1. An audio processing method, comprising:
receiving, from a first subband domain acoustic echo canceller (AEC) of a first audio device in an audio environment, first adaptive filter management data from each of a plurality of first adaptive filter management modules, each first adaptive filter management module of the plurality of first adaptive filter management modules corresponding to a subband of the first subband domain AEC, each first adaptive filter management module being configured to control a first plurality of adaptive filters, the first plurality of adaptive filters including at least a first adaptive filter type and a second adaptive filter type, wherein each adaptive filter of the first plurality of adaptive filters is used to produce an echo-canceled signal for the respective subband;
extracting, a first plurality of extracted features from the first adaptive filter management data, the first plurality of extracted features corresponding to a plurality of subbands of the first subband domain AEC; and
estimating, a current local acoustic state in a vicinity of the first audio device based, at least in part, on the first plurality of extracted features,
wherein the first plurality of extracted features includes one or more features from a list of features consisting of:
a probability of the echo-canceled signal produced via the first adaptive filter type having lowest power in the plurality of subbands;
a probability of the echo-canceled signal produced via the second adaptive filter type having lowest power in the plurality of subbands;
a probability of an input microphone power being lower than the power of the echo-canceled signal produced via any one of the first plurality of adaptive filters.
2. The method of claim 1 , further comprising controlling one or more types of audio processing based, at least in part, on the current local acoustic state.
3. The method of claim 2 , wherein controlling one or more types of audio processing involves controlling audio processing for audio data to be reproduced in the audio environment.
4. The method of claim 2 , wherein controlling one or more types of audio processing involves controlling automatic speech recognition processing, controlling noise compensation processing, controlling the first subband domain AEC, or combinations thereof.
5. The method of claim 1 , wherein the current local acoustic state includes at least one of a doubletalk state in which both speech and reproduced audio data are present in the vicinity of the first audio device or an echo path change in the vicinity of the first audio device.
6. The method of claim 1 , wherein the current local acoustic state includes one or more of a change of a location of the first audio device, a change one or more settings of the first audio device, a change of a configuration of an audio system that includes the first audio device, a level of playback audio, or a level of background noise.
7. The method of claim 1 , wherein the first plurality of extracted features includes one or more of a rate at which first filter coefficients of the first adaptive filter type are copied into adaptive filters of the second adaptive filter type or a rate at which second filter coefficients of the second adaptive filter type are copied into adaptive filters of the first adaptive filter type.
8. The method of claim 1 , wherein the first plurality of adaptive filters includes at least first through M th adaptive filter types, M being an integer of 3 or more and wherein the first plurality of extracted features includes one or more features from a list of features consisting of:
a probability of the echo-canceled signal produced via an M th adaptive filter type having lowest power;
a probability of the echo-canceled signal produced via any one of second through (M−1) th adaptive filter types having lowest power;
a probability of an input microphone power being lower than the power of an echo-canceled signal produced via any one of the first through M th adaptive filter types; and a rate at which filter coefficients of any one of the first through M th adaptive filter types are copied into adaptive filters of any other one of the first through M th adaptive filter types.
9. The method of claim 1 , further comprising:
receiving, from second through N th subband domain AECs of second through N th audio devices in the audio environment, second through N th adaptive filter management data from each of second through N th pluralities of adaptive filter management modules, each of the second through N th pluralities of adaptive filter management modules corresponding to one of the second through N th audio devices, N being an integer greater than 2;
extracting second through N th pluralities of extracted features from the second through N th adaptive filter management data;
estimating a current global acoustic state in the audio environment based, at least in part, on the first plurality of extracted features and the second through N th pluralities of extracted features; and
controlling one or more types of audio processing based, at least in part, on the current global acoustic state.
10. The method of claim 1 , wherein the first adaptive filter type is a linear adaptive filter type and the second adaptive filter type is a non-linear adaptive filter type.
11. The method of claim 1 , wherein the first adaptive filter type and the second adaptive filter type are updated by different adaptive filtering algorithms.
12. The method of claim 1 , wherein the first adaptive filter management data does not include individual filter coefficient values.
13. The method of claim 1 , wherein the first adaptive filter management data does not include an output of the first subband domain AEC, wherein the output of the first subband domain AEC is a full-band echo-cancelled signal generated from subband domain echo-canceled signals output by the plurality of first adaptive filter management modules.
14. An apparatus comprising an interface system and a control system wherein the apparatus is configured to perform the method of claim 1 .
15. One or more non-transitory media comprising a memory device having software stored thereon, the software including instructions used by a processor for controlling one or more devices to perform the method of claim 1 .