Sound separation device and sound separation method
View Patent ↗A sound separation device includes: a signal obtainment unit which obtains a plurality of acoustic signals including a first acoustic signal and a second acoustic signal; a differential signal generation unit which generates a differential signal that is a signal representing a difference in a time domain between the first acoustic signal and the second acoustic signal; an acoustic signal generation unit which generates, using at least one acoustic signal among the acoustic signals, a third acoustic signal; and an extraction unit which generates a frequency signal by subtracting, from a signal obtained by transforming the third acoustic signal into a frequency domain, a signal obtained by transforming the differential signal into a frequency domain, and generates a separated acoustic signal by transforming the generated frequency signal into a time domain.
1. A sound separation device comprising:
a processor and a memory device, the processor including a signal obtainment unit, a differential signal generation unit, an acoustic signal generation unit and an extraction unit;
the signal obtainment unit obtains a plurality of acoustic signals including a first acoustic signal and a second acoustic signal, the first acoustic signal representing a sound outputted from a first position, and the second acoustic signal representing a sound outputted from a second position;
the differential signal generation unit generates a differential signal which is a signal representing a difference in a time domain between the first acoustic signal and the second acoustic signal;
the acoustic signal generation unit generates, using at least one acoustic signal among the acoustic signals, a third acoustic signal including a component of a sound which is localized in a position between the first position and the second position by the sound outputted from the first position and the sound outputted from the second position; and
the extraction unit generates a third frequency signal by subtracting, from a first frequency signal obtained by transforming the third acoustic signal into a frequency domain, a second frequency signal obtained by transforming the differential signal into a frequency domain, and generates a separated acoustic signal by transforming the generated third frequency signal into a time domain, the separated acoustic signal being an acoustic signal representing a sound localized in the position between the first position and the second position, the separated acoustic signal being output by the sound separation device.
2. The sound separation device according to claim 1 , wherein when a distance from the position to the first position is shorter than a distance from the position to the second position, the acoustic signal generation unit utilizes the first acoustic signal as the third acoustic signal.
3. The sound separation device according to claim 1 , wherein when a distance from the position to the second position is shorter than a distance from the position to the first position, the acoustic signal generation unit utilizes the second acoustic signal as the third acoustic signal.
4. The sound separation device according to claim 1 , wherein the acoustic signal generation unit determines a first coefficient and a second coefficient, and generate the third acoustic signal by adding a signal obtained by multiplying the first acoustic signal by the first coefficient and a signal obtained by multiplying the second acoustic signal by the second coefficient, the first coefficient being a value which increases with a decrease in a distance from the position to the first position, and the second coefficient being a value which increases with a decrease in a distance from the position to the second position.
5. The sound separation device according to claim 1 , wherein the differential signal generation unit generates the difference signal which is a difference in a time domain between a signal obtained by multiplying the first acoustic signal by a first weighting coefficient and a signal obtained by multiplying the second acoustic signal by a second weighting coefficient, and determine the first weighting coefficient and the second weighting coefficient so that a value obtained by dividing the second weighting coefficient by the first weighting coefficient increases with a decrease in a distance from the first position to the position.
6. The sound separation device according to claim 5 , wherein a localization range of a sound outputted using the separated acoustic signal increases with a decrease in absolute values of the first weighting coefficient and the second weighting coefficient determined by the differential signal generation unit, and
a localization range of a sound outputted using the separated acoustic signal decreases with an increase in absolute values of the first weighting coefficient and the second weighting coefficient determined by the differential signal generation unit.
7. The sound separation device according to claim 1 , wherein the extraction unit generates the third frequency signal by using a subtracted value which is obtained for each frequency by subtracting a magnitude of the second frequency signal from a magnitude of the first frequency signal, and
the subtracted value is replaced with a predetermined positive value when the subtracted value is a negative value.
8. The sound separation device according to claim 1 , further comprising a sound modification unit generates a modification acoustic signal using at least one acoustic signal among the acoustic signals, and add the modification acoustic signal to the separated acoustic signal, the modification acoustic signal being for modifying the separated acoustic signal according to the position.
9. The sound separation device according to claim 8 , wherein the sound modification unit determines a third coefficient and a fourth coefficient, and generate the modification acoustic signal by adding a signal obtained by multiplying the first acoustic signal by the third coefficient and a signal obtained by multiplying the second acoustic signal by the fourth coefficient, the third coefficient being a value which increases with a decrease in a distance from the position to the first position, and the fourth coefficient being a value which increases with a decrease in a distance from the position to the second position.
10. The sound separation device according to claim 1 , wherein the first acoustic signal and the second acoustic signal form a stereo signal.
11. A sound separation method comprising:
obtaining a plurality of acoustic signals including a first acoustic signal and a second acoustic signal, the first acoustic signal representing a sound outputted from a first position, and the second acoustic signal representing a sound outputted from a second position;
generating a differential signal which is a signal representing a difference in a time domain between the first acoustic signal and the second acoustic signal;
generating, using at least one acoustic signal among the acoustic signals, a third acoustic signal including a component of a sound which is localized in a position between the first position and the second position by the sound outputted from the first position and the sound outputted from the second position; and
generating a third frequency signal by subtracting, from a first frequency signal obtained by transforming the third acoustic signal into a frequency domain, a second frequency signal obtained by transforming the differential signal into a frequency domain, and generating a separated acoustic signal by transforming the generated third frequency signal into a time domain, the separated acoustic signal being an acoustic signal representing a sound localized in the position between the first position and the second position, the separated acoustic signal being output.