Acoustic signal enhancement device, acoustic signal enhancement method, and program
There is provided an acoustic signal enhancement device that receives, as an input, a recording sound obtained by frequency division and updates parameters, the device including: assuming that a switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial states where a recording sound temporally changes, a beamformer unit that performs beamformer processing based on a weighted spatial covariance matrix which is updated and updates an auxiliary estimation value of a target sound; a switch unit that updates the switch weight and power of a target sound based on the updated auxiliary estimation value and outputs an estimation value of the target sound; and a weighted spatial covariance estimation unit that updates the weighted spatial covariance matrix based on the updated switch weight and the power.
1 . An acoustic signal enhancement device that receives, as an input, a recording sound obtained by frequency division and updates parameters, the acoustic signal enhancement device comprising:
processing circuitry configured to:
assuming that a switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial states where a recording sound temporally changes,
perform beamformer processing based on a weighted spatial covariance matrix which is updated and update an auxiliary estimation value of a target sound;
update the switch weight and power of a target sound based on the updated auxiliary estimation value and output an estimation value of the target sound; and
update the weighted spatial covariance matrix based on the updated switch weight and the power.
2 . An acoustic signal enhancement device that receives, as an input, a recording sound obtained by frequency division and updates parameters, the acoustic signal enhancement device comprising:
processing circuitry configured to:
assuming that a first switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial states where a recording sound temporally changes, and
assuming that a second switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial-temporal states where a recording sound temporally changes,
perform reverberation suppression processing on the recording sound based on a weighted spatial-temporal covariance matrix which is updated and update an auxiliary reverberation-suppressed sound of a target sound;
update the second switch weight based on the auxiliary reverberation-suppressed sound, updated power of the target sound, and an updated beamformer coefficient;
update an estimation value of the target sound, the beamformer coefficient, the power of the target sound, and the first switch weight of the target sound based on at least one of the auxiliary reverberation-suppressed sounds; and
update the weighted spatial-temporal covariance matrix based on the first switch weight, the second switch weight, and the power.
3 . The acoustic signal enhancement device according to claim 2 ,
wherein processing circuitry configured to:
perform beamformer processing based on a weighted spatial covariance matrix which is updated and update an auxiliary estimation value of the target sound;
update the first switch weight and power of the target sound based on the updated auxiliary estimation value and output the estimation value of the target sound; and
update the weighted spatial covariance matrix based on the updated first switch weight and the power.
4 . An acoustic signal enhancement device that receives, as inputs, recording sounds from a plurality of microphones, the acoustic signal enhancement device comprising:
processing circuitry configured to,
assuming that a first switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial states where a recording sound temporally changes, and
assuming that a second switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial-temporal states where a recording sound temporally changes,
update a weighted spatial covariance matrix for estimating a coefficient for obtaining a target sound of a beamformer based on the first and second switch weights, power of each sound source, and an auxiliary reverberation-suppressed sound of each sound source;
update the coefficient of the beamformer which estimates a separation sound of a separation matrix based on the weighted spatial covariance matrix and update an auxiliary estimation value of each sound source based on the updated coefficient of the beamformer and the auxiliary reverberation-suppressed sound; and
update estimation values of all the sound sources based on the first and second switch weights, update power of each sound source based on the estimation values of all the sound sources, and update the first switch weight based on the power of each sound source.
5 . The acoustic signal enhancement device according to claim 4 , further comprising:
processing circuitry configured to:
update a weighted spatial-temporal covariance matrix for estimating a filter coefficient of reverberation suppression processing based on the first and second switch weights and the power of each sound source; and
update the filter coefficient of reverberation suppression processing based on the coefficient of the beamformer and the weighted spatial-temporal covariance matrix and update the auxiliary reverberation-suppressed sound,
wherein processing circuitry configured to
update the second switch weight in addition to the first switch weight based on the power of each sound source.
6 . An acoustic signal enhancement method executed by an acoustic signal enhancement device that receives, as an input, a recording sound obtained by frequency division and updates parameters, the acoustic signal enhancement method comprising:
assuming that a switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial states where a recording sound temporally changes,
a beamformer step of performing beamformer processing based on a weighted spatial covariance matrix which is updated and updating an auxiliary estimation value of a target sound;
a switch step of updating the switch weight and power of a target sound based on the updated auxiliary estimation value and outputting an estimation value of the target sound; and
a weighted spatial covariance estimation step of updating the weighted spatial covariance matrix based on the updated switch weight and the power.
7 . An acoustic signal enhancement method executed by an acoustic signal enhancement device that receives, as an input, a recording sound obtained by frequency division and updates parameters, the acoustic signal enhancement method comprising:
assuming that a first switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial states where a recording sound temporally changes, and
assuming that a second switch weight is a weight indicating a ratio of a classification to which a recording sound at each timing belongs in classifications of spatial-temporal states where a recording sound temporally changes,
a reverberation suppression step of performing reverberation suppression processing on the recording sound, performing beamformer processing based on a weighted spatial-temporal covariance matrix which is updated, and updating an auxiliary reverberation-suppressed sound of a target sound;
a switch step of updating the second switch weight based on the auxiliary reverberation-suppressed sound, updated power of the target sound, and an updated beamformer coefficient;
a switching beamformer step of updating an estimation value of the target sound, the beamformer coefficient, the power of the target sound, and the first switch weight of the target sound based on at least one of the auxiliary reverberation-suppressed sounds; and
a weighted spatial-temporal covariance estimation step of updating the weighted spatial-temporal covariance matrix based on the first switch weight, the second switch weight, and the power.
8 . A program causing a computer to function as the acoustic signal enhancement device according to claim 1 .
9 . A program causing a computer to function as the acoustic signal enhancement device according to claim 2 .
10 . A program causing a computer to function as the acoustic signal enhancement device according to claim 3 .
11 . A program causing a computer to function as the acoustic signal enhancement device according to claim 4 .
12 . A program causing a computer to function as the acoustic signal enhancement device according to claim 5 .