Sound processing apparatus and sound processing system
The present technology relates to a sound processing apparatus and a sound processing system for enabling more stable localization of a sound image. A virtual speaker is assumed to exist on the lower side among the sides of a tetragon having its corners formed with four speakers surrounding a target sound image position on a spherical plane. Three-dimensional VBAP is performed with respect to the virtual speaker and the two speakers located at the upper right and the upper left, to calculate gains of the two speakers at the upper right and the upper left and the virtual speaker, the gains being to be used for fixing a sound image at the target sound image position. Further, two-dimensional VBAP is performed with respect to the lower right and lower left speakers, to calculate gains of the lower right and lower left speakers, the gains being to be used for fixing a sound image at the position of the virtual speaker. The values obtained by multiplying these gains by the gain of the virtual speaker are set as the gains of the lower right and lower left speakers for fixing a sound image at the target sound image position. The present technology can be applied to sound processing apparatuses.
1. A method executed by at least one processing circuit of a sound processing apparatus, the method comprising:
acquiring an audio object signal and metadata of the audio object signal, wherein the metadata is position data of an audio object associated with the audio object signal;
determining, based on the position data, a plurality of sound outputting units, wherein the plurality of sound outputting units form a polygon surrounding the sound image localization position;
determining, from the selected sound outputting units, a plurality of combinations of sound outputting units, wherein each combination contains at least two sound outputting units;
determining output gain coefficients for the plurality of sound outputting units at least in part by calculating gain coefficients for the plurality of sound outputting units based on a positional relationship between the plurality of sound outputting units with respect to each combination of the plurality of combinations of sound outputting units, wherein:
calculating the gain coefficients comprises calculating the gain coefficients for the plurality of sound outputting units based on a positional relationship among the plurality of sound outputting units and the sound image localization position; and
outputting the output gain coefficients for the plurality of sound outputting units.
2. The method of claim 1 , wherein a number of the plurality of sound outputting units is equal to or larger than four.
3. The method of claim 1 , wherein calculating the gain coefficients comprises calculating the gain coefficients for the plurality of sound outputting units based on position information of the plurality of sound outputting units.
4. The method of claim 3 , wherein the position information of the plurality of sound outputting units is represented in a coordinate system.
5. The method of claim 4 , wherein the coordinate system includes at least a vertical and horizontal direction.
6. The method of claim 4 , wherein the coordinate system is a Cartesian coordinate system.
7. The method of claim 4 , wherein the coordinate system is an Orthogonal or a Rectangular system.
8. The method of claim 1 , wherein one or more of the gain coefficients for one or more sound outputting units that are not processing targets are set to zero.
9. The method of claim 1 , wherein determining the output gain coefficients comprises determining the output gain coefficients based on the gain coefficients calculated for the plurality of sound outputting units.
10. The method of claim 9 , wherein determining the output gain coefficients comprises determining the output gain coefficients by multiplying the gain coefficients calculated for the plurality of sound outputting units.
11. The method of claim 1 , wherein at least one of the plurality of sound outputting units is common among the plurality of combinations of two or three of the plurality of sound outputting units.
12. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processing circuit of a sound processing apparatus, causes the at least one processing circuit to perform a method comprising:
acquiring an audio object signal and metadata of the audio object signal, wherein the metadata is position data of an audio object associated with the audio object signal;
determining, based on the position data, a plurality of sound outputting units, wherein the plurality of sound outputting units form a polygon surrounding a sound image localization position;
determining, from the selected sound outputting units, a plurality of combinations of sound outputting units, wherein each combination contains at least two sound outputting units;
determining output gain coefficients for the plurality of sound outputting units at least in part by calculating gain coefficients for the plurality of sound outputting units based on a positional relationship between the plurality of sound outputting units with respect to each combination of the plurality of combinations of sound outputting units, wherein:
calculating the gain coefficients comprises calculating the gain coefficients for the plurality of sound outputting units based on a positional relationship among the plurality of sound outputting units and the sound image localization position; and
outputting the output gain coefficients for the plurality of sound outputting units.
13. The non-transitory computer-readable storage medium of claim 12 , wherein a number of the plurality of sound outputting units is equal to or larger than four.
14. The non-transitory computer-readable storage medium of claim 12 , wherein calculating the gain coefficients comprises calculating the gain coefficients for the plurality of sound outputting units based on position information of the plurality of sound outputting units.
15. The non-transitory computer-readable storage medium of claim 14 , wherein the position information of the plurality of sound outputting units is represented in a coordinate system.
16. The non-transitory computer-readable storage medium of claim 12 , wherein one or more of the gain coefficients for one or more sound outputting units that are not processing targets are set to zero.
17. The non-transitory computer-readable storage medium of claim 12 , wherein determining the output gain coefficients comprises determining the output gain coefficients based on the gain coefficients calculated for the plurality of sound outputting units.
18. The non-transitory computer-readable storage medium of claim 12 , wherein at least one of the plurality of sound outputting units is common among the plurality of combinations of two or three of the plurality of sound outputting units.
19. A sound processing apparatus comprising:
at least one processing circuit configured to:
acquire an audio object signal and metadata of the audio object signal, wherein the metadata is position data of an audio object associated with the audio object signal;
determining, based on the position data, a plurality of sound outputting units, wherein the plurality of sound outputting units form a polygon surrounding a sound image localization position;
determine, from the selected outputting units, a plurality of combinations of sound outputting units, wherein each combination contains at least two sound outputting units;
determine output gain coefficients for the plurality of sound outputting units at least in part by calculating gain coefficients for the plurality of sound outputting units based on a positional relationship between the plurality of sound outputting units with respect to each combination of the plurality of combinations of sound outputting units, wherein:
calculating the gain coefficients comprises calculating the gain coefficients for the plurality of sound outputting units based on a positional relationship among the plurality of sound outputting units and the sound image localization position; and
output the output gain coefficients for the plurality of sound outputting units.
20. The sound processing apparatus of claim 19 , wherein a number of the plurality of sound outputting units is equal to or larger than four.