Binaural rendering for headphones using metadata processing
Embodiments are described for a method of rendering audio for playback through headphones comprising receiving digital audio content, receiving binaural rendering metadata generated by an authoring tool processing the received digital audio content, receiving playback metadata generated by a playback device, and combining the binaural rendering metadata and playback metadata to optimize playback of the digital audio content through the headphones.
1. A method, performed by an audio signal processing device, for generating a binaural rendering of digital audio content for playback through headphones, the method comprising:
receiving an encoded signal comprising the digital audio content and rendering metadata, wherein the digital audio content comprises a plurality of audio object signals;
receiving playback control metadata comprising local setup information;
decoding the encoded signal to obtain the plurality of audio object signals; and
generating the binaural rendering of the digital audio content in response to the plurality of audio object signals, the rendering metadata, and the playback control metadata;
wherein the rendering metadata indicates, for each audio object signal, position, gain, and whether to apply head tracking information to the audio object signal;
wherein the local setup information comprises listener specific characteristics including head orientation information;
wherein, when the rendering metadata indicates, for an audio object signal, not to apply head tracking information to the audio object signal, generating the binaural rendering comprises, for the audio object signal, ignoring the head orientation information; and
wherein, when the rendering metadata indicates, for an audio object signal, to apply head tracking information to the audio object signal, generating the binaural rendering comprises, for the audio object signal, applying the head orientation information to the audio object signal.
2. An audio signal processing device for generating a binaural rendering of digital audio content for playback through headphones, the audio signal processing device comprising one or more processors to:
receive an encoded signal comprising the digital audio content and rendering metadata, wherein the digital audio content comprises a plurality of audio object signals;
receive playback control metadata comprising local setup information;
decode the encoded signal to obtain the plurality of audio object signals; and
generate the binaural rendering of the digital audio content in response to the plurality of audio object signals, the rendering metadata, and the playback control metadata;
wherein the rendering metadata indicates, for each audio object signal, position, gain, and whether to apply head tracking information to the audio object signal;
wherein the local setup information comprises listener specific characteristics including head orientation information;
wherein, when the rendering metadata indicates, for an audio object signal, not to apply head tracking information to the audio object signal, generating the binaural rendering comprises, for the audio object signal, ignoring the head orientation information; and
wherein, when the rendering metadata indicates, for an audio object signal, to apply head tracking information to the audio object signal, generating the binaural rendering comprises, for the audio object signal, applying the head orientation information to the audio object signal.
3. A non-transitory computer readable storage medium comprising a sequence of instructions, which, when executed by an audio signal processing device, cause the audio signal processing device to perform a method for generating a binaural rendering of digital audio content for playback through headphones, the method comprising:
receiving an encoded signal comprising the digital audio content and rendering metadata, wherein the digital audio content comprises a plurality of audio object signals;
receiving playback control metadata comprising local setup information;
decoding the encoded signal to obtain the plurality of audio object signals; and
generating the binaural rendering of the digital audio content in response to the plurality of audio object signals, the rendering metadata, and the playback control metadata;
wherein the rendering metadata indicates, for each audio object signal, position, gain, and whether to apply head tracking information to the audio object signal;
wherein the local setup information comprises listener specific characteristics including head orientation information;
wherein, when the rendering metadata indicates, for an audio object signal, not to apply head tracking information to the audio object signal, generating the binaural rendering comprises, for the audio object signal, ignoring the head orientation information; and
wherein, when the rendering metadata indicates, for an audio object signal, to apply head tracking information to the audio object signal, generating the binaural rendering comprises, for the audio object signal, applying the head orientation information to the audio object signal.