Sound source separation apparatus and method
The present technology relates to a sound source separation apparatus and a method which make it possible to separate a sound source at lower calculation cost. A communication unit receives a spatial frequency spectrum of a sound collection signal which is obtained by a microphone array collecting a plane wave of sound from a sound source, and a spatial frequency mask generating unit generates a spatial frequency mask for masking a component of a predetermined region in a spatial frequency domain on the basis of the spatial frequency spectrum. A sound source separating unit extracts a component of a desired sound source from the spatial frequency spectrum as an estimated sound source spectrum on the basis of the spatial frequency mask. The present technology can be applied to a spatial frequency sound source separator.
1. A sound source separation apparatus, comprising:
a central processing unit (CPU) configured to:
obtain a multichannel sound signal via a microphone array;
generate a spatial frequency spectrum based on the multichannel sound signal;
generate a spatial frequency mask to mask a component of a specific region in a spatial frequency domain, wherein the spatial frequency mask is generated based on:
a direction of arrival of the multichannel sound signal from a specific sound source, and
the spatial frequency spectrum; and
extract, as an estimated sound source spectrum, a component of the specific sound source based on a multiplication of the spatial frequency spectrum with the spatial frequency mask.
2. The sound source separation apparatus according to claim 1 , wherein the CPU is further configured to generate the spatial frequency mask through blind sound source separation.
3. The sound source separation apparatus according to claim 2 , wherein the CPU is further configured to generate the spatial frequency mask through the blind sound source separation by utilization of non-negative matrix factorization.
4. The sound source separation apparatus according to claim 1 , wherein the CPU is further configured to generate the spatial frequency mask through sound source separation based on information associated with the specific sound source.
5. The sound source separation apparatus according to claim 4 , wherein the information associated with the specific sound source indicates the direction of arrival.
6. The sound source separation apparatus according to claim 5 , wherein the CPU is further configured to generate the spatial frequency mask based on an adaptive beam former.
7. The sound source separation apparatus according to claim 1 , wherein the CPU is further configured to:
generate a drive signal in the spatial frequency domain based on the estimated sound source spectrum;
reproduce the multichannel sound signal based on the drive signal;
calculate a time-frequency spectrum based on spatial frequency synthesis on the drive signal;
generate a speaker drive signal based on time frequency synthesis on the time-frequency spectrum; and
reproduce, via a speaker array, the multichannel sound signal based on the speaker drive signal.
8. A sound source separation method, comprising:
obtaining a multichannel sound signal via a microphone array;
generating a spatial frequency spectrum based on the multichannel sound signal;
generating a spatial frequency mask for masking a component of a specific region in a spatial frequency domain, wherein the spatial frequency mask is generated based on:
a direction of arrival of the multichannel sound signal from a specific sound source, and
the spatial frequency spectrum; and
extracting, as an estimated sound source spectrum, a component of the specific sound source based on a multiplication of the spatial frequency spectrum with the spatial frequency mask.
9. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:
obtaining a multichannel sound signal via a microphone array;
generating a spatial frequency spectrum based on the multichannel sound signal;
generating a spatial frequency mask for masking a component of a specific region in a spatial frequency domain, wherein the spatial frequency mask is generated based on:
a direction of arrival of the multichannel sound signal from a specific sound source, and
the spatial frequency spectrum; and
extracting, as an estimated sound source spectrum, a component of the specific sound source based on a multiplication of the spatial frequency spectrum with the spatial frequency mask.