Method for describing the composition of audio signals
View Patent ↗Method for describing the composition of audio signals, which are encoded as separate audio objects. The arrangement and the processing of the audio objects in a sound scene is described by nodes arranged hierarchically in a scene description. A node specified only for spatialization on a 2D screen using a 2D vector describes a 3D position of an audio object using said 2D vector and a 1D value describing the depth of said audio object. In a further embodiment a mapping of the coordinates is performed, which enables the movement of a graphical object in the screen plane to be mapped to a movement of an audio object in the depth perpendicular to said screen plane.
1. A method using an audio processing apparatus for spatialization of a sound object, the sound object having associated a first parameter, 2D location information and depth information, wherein the first parameter defines whether or not the sound object is to be spatialized, the 2D location information comprises second and third parameters that define the 2D location of the sound object in terms of height and width respectively on a 2D plane, and the depth information comprises a fourth parameter, the method comprising steps of
using an audio processing apparatus to determine from the first parameter that the sound object is to be spatialized;
transforming the 2D location information and the depth information of the sound object to a 3D coordinate system, wherein said second parameter defining the height of the 2D location is mapped to audio depth information perpendicular to said 2D plane, said third parameter defining the width of the 2D location is mapped to the width information in the 3D coordinate system, and said fourth parameter is mapped to the height in the 3D coordinate system; and
spatializing the sound according to the resulting 3D location information.
2. Method according to claim 1 , wherein the spatialization is performed according to a scene description containing a parametric description of sound sources corresponding to the audio signals, wherein the parametric description has a hierarchical graph structure with nodes, wherein a first node comprises said 2D location information and a second node comprises at least said defining depth information, the second node being hierarchically arranged above said first node.
3. Method according to claim 2 , wherein the second node comprises further data defining said step of transforming.
4. Method according to claim 2 , wherein the first node further comprises an intensity parameter for adjusting the loudness of a sound, and a source parameter.
5. Method according to claim 2 , wherein a soundtrack is composed from a plurality of sound objects, and wherein each of the sound objects is decoded separately.
6. Method according to claim 1 , wherein said 2D plane in which the sound object is located corresponds to the screen plane of a video related to the sound object.
7. Method according to claim 6 , wherein said transforming enables mapping of a vertical movement of a graphical object in the screen plane to a movement of a corresponding audio object in the depth, perpendicular to said screen plane.
8. Method according to claim 1 , wherein the mapping is performed according to a 2×3 matrix or corresponding rotation.