Methods, apparatus and systems for generation, transportation and processing of immediate playout frames (IPFs)
Described herein is an audio decoder for decoding a bitstream of encoded audio data, wherein the bitstream of encoded audio data represents a sequence of audio sample values and comprises a plurality of frames, wherein each frame comprises associated encoded audio sample values, the audio decoder comprising: a determiner configured to determine whether a frame of the bitstream of encoded audio data is an immediate playout frame comprising encoded audio sample values associated with a current frame and additional information; and an initializer configured to initialize the decoder if the determiner determines that the frame is an immediate playout frame, wherein initializing the decoder comprises decoding the encoded audio sample values comprised by the additional information before decoding the encoded audio sample values associated with the current frame. Described are further a method for decoding said bitstream of encoded audio data as well as an audio encoder, a system of audio encoders and a method for generating said bitstream of encoded audio data with immediate playout frames. Described are moreover also an apparatus for generating immediate playout frames in a bitstream of encoded audio data or for removing immediate playout frames from a bitstream of encoded audio data and respective non-transitory digital storage media.
1. An audio decoder for decoding a bitstream of encoded audio data, wherein the bitstream of encoded audio data represents a sequence of audio sample values and comprises a plurality of frames, wherein each frame comprises associated encoded audio sample values, the audio decoder comprising:
a determiner configured to determine whether a frame of the bitstream of encoded audio data is an immediate playout frame comprising encoded audio sample values associated with a current frame and additional information, wherein the additional information comprises information on the codec configuration used for encoding the audio sample values associated with the current frame, wherein the bitstream of encoded audio data is an MPEG-4 Audio bitstream, wherein the additional information is transported via an MPEG-4 Audio bitstream extension mechanism that is an extension payload element of a new extension payload element type EXT_AUDIO_PRE_ROLL, wherein the extension payload element is located at a first position in the MPEG-4 Audio bitstream, and wherein the extension_payload element is contained inside a fill element (ID_FIL),
wherein the additional information further comprises encoded audio sample values of a number of frames preceding the immediate playout frame, wherein the encoded audio sample values of the preceding frames are encoded using the same codec configuration as the current frame,
wherein the number of preceding frames, corresponding to pre-roll frames, corresponds to the number of frames needed by the decoder to build up the full signal so as to be in a position to output valid audio sample values associated with the current frame whenever an immediate playout frame is decoded; and
an initializer configured to initialize the decoder if the determiner determines that the frame is an immediate playout frame,
wherein initializing the decoder comprises decoding the encoded audio sample values comprised by the additional information before decoding the encoded audio sample values associated with the current frame,
wherein the initializer is configured to switch the audio decoder from a current codec configuration to a different codec configuration if the determiner determines that the frame is an immediate playout frame and if the audio sample values of the current frame have been encoded using the different codec configuration, and
wherein the decoder is configured to decode the current frame using the current codec configuration and to discard the additional information if the determiner determines that the frame is an immediate playout frame and if the audio sample values of the current frame have been encoded using the current codec configuration.
2. A method for decoding a bitstream of encoded audio data, wherein the bitstream of encoded audio data represents a sequence of audio sample values and comprises a plurality of frames, wherein each frame comprises associated encoded audio sample values, comprising:
determining whether a frame of the bitstream of encoded audio data is an immediate playout frame comprising encoded audio sample values associated with a current frame and additional information, wherein the additional information comprises information on the codec configuration used for encoding the audio sample values associated with the current frame, wherein the bitstream of encoded audio data is an MPEG-4 Audio bitstream, wherein the additional information is transported via an MPEG-4 Audio bitstream extension mechanism that is an extension payload element of a new extension payload element type EXT_AUDIO_PRE_ROLL, wherein the extension_payload element is located at a first position in the MPEG-4 Audio bitstream, and wherein the extension payload element is contained inside a fill element (ID_FIL),
wherein the additional information further comprises encoded audio sample values of a number of frames preceding the immediate playout frame,
wherein the encoded audio sample values of the preceding frames are encoded using the same codec configuration as the immediate playout frame,
wherein the number of preceding frames, corresponding to pre-roll frames, corresponds to the number of frames needed by a decoder to build up the full signal so as to be in a position to output valid audio sample values associated with the current frame whenever an immediate playout frame is decoded;
initializing the decoder if it is determined that the frame is an immediate playout frame, wherein the initializing comprises decoding the encoded audio sample values comprised by the additional information before decoding the encoded audio sample values associated with the current frame;
switching the audio decoder from a current codec configuration to a different codec configuration if it is determined that the frame is an immediate playout frame and if the audio sample values of the immediate playout frame have been encoded using the different codec configuration; and
decoding the immediate playout frame using the current codec configuration and discarding the additional information if it is determined that the frame is an immediate playout frame and if the audio sample values of the immediate playout frame have been encoded using the current codec configuration.
3. A non-transitory computer program product storing a computer program, the computer program when executed by a device including a processor and a memory performs the method of claim 2 .