Device and method for processing audio signal
The present invention relates to an apparatus and a method for processing an audio signal, and more particularly, to an apparatus and a method for efficiently rendering a higher order ambisonics signal. To this end, provided are an audio signal processing apparatus, including: a pre-processor configured to separate an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal and extract position vector information corresponding to the first component from the input audio signal; a first rendering unit configured to perform an object-based first rendering on the first component using the position vector information; and a second rendering unit configured to perform a channel-based second rendering on the second component and an audio signal processing method using the same.
1. An audio signal processing apparatus, the apparatus comprising:
a pre-processor configured to separate an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal and extract position vector information corresponding to the first component from the input audio signal, wherein the input audio signal comprises higher order ambisonics (HOA) coefficients, and wherein the position vector information is obtained by decomposing the HOA coefficients into a first matrix representing a plurality of audio signals and a second matrix representing position vector information of each of the plurality of audio signals;
a first rendering unit configured to perform an object-based first rendering on the first component using position vector information of the second matrix corresponding to the first component; and
a second rendering unit configured to perform a channel-based second rendering on the second component,
wherein the first component is extracted from audio signals having a level equal to or higher than a threshold value among the plurality of audio signals represented by the first matrix.
2. The apparatus of claim 1 , wherein the pre-processor performs a matrix decomposition of the HOA coefficients using singular value decomposition (SVD).
3. The apparatus of claim 1 ,
wherein the first rendering is an object-based binaural rendering, and
wherein the first rendering unit performs the first rendering using a head related transfer function (HRTF) based on the position vector information corresponding to the first component.
4. The apparatus of claim 1 ,
wherein the second rendering is a channel-based binaural rendering, and
wherein the second rendering unit maps the second component to at least one virtual channel and performs the second rendering using an HRTF based on the mapped virtual channel.
5. The apparatus of claim 1 , wherein the first rendering unit performs the first rendering by referring to spatial information of at least one object obtained from a video signal corresponding to the input audio signal.
6. The apparatus of claim 5 , wherein the first rendering unit modifies at least one parameter related to the first component based on the spatial information obtained from the video signal, and performs an object-based rendering on the first component using the modified parameter.
7. An audio signal processing method, the method comprising:
separating an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal, wherein the input audio signal comprises higher order ambisonics (HOA) coefficients;
extracting position vector information corresponding to the first component from the input audio signal, wherein the position vector information is obtained by decomposing the HOA coefficients into a first matrix representing a plurality of audio signals and a second matrix representing position vector information of each of the plurality of audio signals;
performing an object-based first rendering on the first component using position vector information of the second matrix corresponding to the first component; and
performing a channel-based second rendering on the second component,
wherein the first component is extracted from audio signals having a level equal to or higher than a threshold value among the plurality of audio signals represented by the first matrix.
8. The method of claim 7 , further comprising
performing a matrix decomposition of the HOA coefficients using singular value decomposition (SVD).
9. The method of claim 7 ,
wherein the first rendering is an object-based binaural rendering, and
wherein the first rendering is performed using a head related transfer function (HRTF) based on the position vector information corresponding to the first component.
10. The method of claim 7 ,
wherein the second rendering is a channel-based binaural rendering, and
wherein the second rendering is performed by mapping the second component to at least one virtual channel and using an HRTF based on the mapped virtual channel.
11. The method of claim 7 , wherein the first rendering is performed by referring to spatial information of at least one object obtained from a video signal corresponding to the input audio signal.
12. The method of claim 11 , wherein performing the first rendering further comprises:
modifying at least one parameter related to the first component based on the spatial information obtained from the video signal; and
performing an object-based rendering on the first component using the modified parameter.
13. An audio signal processing apparatus, the apparatus comprising:
a pre-processor configured to separate an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal and extract position vector information corresponding to the first component from the input audio signal, wherein the input audio signal comprises higher order ambisonics (HOA) coefficients, and wherein the position vector information is obtained by decomposing the HOA coefficients into a first matrix representing a plurality of audio signals and a second matrix representing position vector information of each of the plurality of audio signals;
a first rendering unit configured to perform an object-based first rendering on the first component using position vector information of the second matrix corresponding to the first component; and
a second rendering unit configured to perform a channel-based second rendering on the second component,
wherein the first component is extracted from coefficients of a predetermined low order among the HOA coefficients.
14. The apparatus of claim 13 , wherein the pre-processor performs a matrix decomposition of the HOA coefficients using singular value decomposition (SVD).
15. The apparatus of claim 13 ,
wherein the first rendering is an object-based binaural rendering, and
wherein the first rendering unit performs the first rendering using a head related transfer function (HRTF) based on the position vector information corresponding to the first component.
16. The apparatus of claim 13 ,
wherein the second rendering is a channel-based binaural rendering, and
wherein the second rendering unit maps the second component to at least one virtual channel and performs the second rendering using an HRTF based on the mapped virtual channel.
17. The apparatus of claim 13 , wherein the first rendering unit performs the first rendering by referring to spatial information of at least one object obtained from a video signal corresponding to the input audio signal.
18. The apparatus of claim 17 , wherein the first rendering unit modifies at least one parameter related to the first component based on the spatial information obtained from the video signal, and performs an object-based rendering on the first component using the modified parameter.
19. An audio signal processing method, the method comprising:
separating an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal, wherein the input audio signal comprises higher order ambisonics (HOA) coefficients;
extracting position vector information corresponding to the first component from the input audio signal, wherein the position vector information is obtained by decomposing the HOA coefficients into a first matrix representing a plurality of audio signals and a second matrix representing position vector information of each of the plurality of audio signals;
performing an object-based first rendering on the first component using position vector information of the second matrix corresponding to the first component; and
performing a channel-based second rendering on the second component,
wherein the first component is extracted from coefficients of a predetermined low order among the HOA coefficients.
20. The method of claim 19 , further comprising performing a matrix decomposition of the HOA coefficients using singular value decomposition (SVD).
21. The method of claim 19 ,
wherein the first rendering is an object-based binaural rendering, and
wherein the first rendering is performed using a head related transfer function (HRTF) based on the position vector information corresponding to the first component.
22. The method of claim 19 ,
wherein the second rendering is a channel-based binaural rendering, and
wherein the second rendering is performed by mapping the second component to at least one virtual channel and using an HRTF based on the mapped virtual channel.
23. The method of claim 19 , wherein the first rendering is performed by referring to spatial information of at least one object obtained from a video signal corresponding to the input audio signal.
24. The method of claim 23 , wherein performing the first rendering further comprises:
modifying at least one parameter related to the first component based on the spatial information obtained from the video signal; and
performing an object-based rendering on the first component using the modified parameter.