Processor for generating a prediction spectrum based on long-term prediction and/or harmonic post-filtering
A processor for processing an (encoded) audio signal, the processor comprising: an LTP buffer configured to receive samples derived from a frame of the encoded audio signal; an interval splitter configured to divide a time interval associated with a subsequent frame of the encoded audio signal into sub-intervals depending on the encoded pitch parameter; calculation means configured to derive sub-interval parameters from the encoded pitch parameter dependent on a position of the sub-intervals within the time interval associated with the subsequent frame of the encoded audio signal; a predictor configured for generating a prediction signal from the LTP buffer dependent on the sub-interval parameters; and a frequency domain transformer configured for generating a prediction spectrum (X P ) based on the prediction signal.
1 . A processor for processing an encoded audio signal, the encoded audio signal comprising at least an encoded pitch parameter, the processor comprising:
an LTP buffer configured to receive samples derived from a frame of the encoded audio signal;
an interval splitter configured to divide a time interval associated with a subsequent frame of the encoded audio signal into sub-intervals depending on the encoded pitch parameter;
a calculation unit configured to derive sub-interval parameters from the encoded pitch parameter dependent on a position of the sub-intervals within the time interval associated with the subsequent frame of the encoded audio signal;
a predictor configured for generating a prediction signal from the LTP buffer dependent on the sub-interval parameters; and
a frequency domain transformer configured for generating a prediction spectrum based on the prediction signal.
2 . The processor according to claim 1 , wherein there are more sub-intervals than temporarily distinct encoded pitch parameters; and/or
wherein there are more distinct sub-interval parameters than temporarily distinct encoded pitch parameters; and/or
wherein there are more than one temporarily distinct encoded pitch parameters in the frame.
3 . The processor according to claim 1 , further comprising a combiner configured to combine at least a portion of a derivation of the prediction spectrum with an error spectrum to generate a combined spectrum; and/or
wherein a derivation of the prediction spectrum is derived from the prediction spectrum by perceptually flattening the prediction spectrum.
4 . The processor according to claim 3 , further comprising a unit for putting all samples from a block of aliased time domain audio signal being not different from the audio signal into the LTP buffer; or
further comprising a unit for putting samples from the block of aliased time domain audio signal not different from a time domain audio signal into the LTP buffer, wherein the samples are used for producing the subsequent frame of audio signal; or
further comprising a unit for putting samples from the block of aliased time domain audio signal not different from a current frame into the LTP buffer, wherein the samples are used for producing the subsequent frame of time domain audio signal, wherein a selection of a portion of the current frame or of the samples selected from the block of aliased time domain audio signal is adapted by the unit for putting samples.
5 . The processor according to claim 1 , wherein the processor further comprises an inverse frequency domain transformer; and/or
wherein the processor further comprises an inverse frequency domain transformer configured for generating a block of aliased time domain audio signal from a derivation of an error spectrum, where the prediction spectrum is obtained from the frame of the encoded audio signal and/or where an error spectrum is obtained from the subsequent frame of the encoded audio signal subsequent to the frame and the derivation of the error spectrum is derived from the error spectrum; or
wherein the processor further comprises the inverse frequency domain transformer configured for generating the block of aliased time domain audio signal from the derivation of the error spectrum, where the prediction spectrum is obtained from the frame of the encoded audio signal and/or where the error spectrum is obtained from the subsequent frame of the encoded audio signal subsequent to the frame and the derivation of the error spectrum is derived from the error spectrum; and a unit for generating a frame of time domain audio signal using at least two blocks of the aliased time domain audio signal, where at least some portions of the aliased time domain audio signal are different from the time domain audio signal and the received samples, respectively.
6 . The processor according to claim 4 , further comprising an entity configured for zero filling based on a signal received from a band-wise parametric decoder and a combined spectrum to obtain the derivation of the error spectrum where the combined spectrum is obtained based on at least a portion of a derivation of the prediction spectrum and the error spectrum; and an entity configured for spectral shaping a spectral envelope of a signal modified by an entity configured for temporal shaping and taking into account a coded information for the spectral shaping to obtain the derivation of the error spectrum and the entity configured for temporal shaping the signal taking into account the coded information for temporal shaping to obtain the derivation of the error spectrum.
7 . The processor according to claim 1 , further comprising a combiner configured to combine at least a portion of the prediction spectrum X P with an error spectrum XD to generate a combined spectrum X DT ; and/or
further comprising a combiner configured to combine at least a portion of the prediction spectrum X P or at least a portion of a derivation of a prediction spectrum X PS with an error spectrum X D , wherein the portion is determined based on the encoded pitch parameter; and/or
further comprising a combiner configured to combine at least a portion of the prediction spectrum X P or at least a portion of a derivation of the prediction spectrum X PS with an error spectrum X D , wherein if the LTP buffer is active, then first └(n LTP +0.5)iF0┘ coefficients of the prediction spectrum or the derivation of the prediction spectrum, except a zeroth coefficient, are added to the error spectrum to produce a combined spectrum X DT ; and/or wherein the zeroth and the coefficients above └(n LTP +0.5)iF0┘ are copied from the error spectrum to the combined spectrum), wherein “└ ┘” indicates a use of a floor function;
where n LTP is a parameter from the encoded audio signal and/or where n LTP is a number of predictable harmonics; and
where iF0 is derived from the encoded pitch parameter.
8 . The processor according to claim 1 , wherein in each sub-interval the predicted signal is constructed using the LAP buffer and/or using a decoded audio signal out of the LTP buffer and a filter whose parameters are derived from the encoded pitch parameter and the sub-interval position within the time interval associated with the subsequent frame of the encoded audio signal.
9 . The processor according to claim 1 , wherein the calculation unit are configured to derive sub-interval parameters from the encoded pitch parameter, wherein the sub-interval parameters comprise at least a sub-interval pitch parameter, as follows:
obtaining a sub-interval pitch lag associated with a center of the sub-interval from a pitch contour, wherein the pitch contour comprises multiple values, comprising:
setting the sub-interval pitch lag to the pitch contour value at the position of the sub-interval center,
determining a sub-interval end,
comparing the sub-interval pitch lag to the sub-interval end producing a comparison result, and/or
adapting the sub-interval pitch lag for the pitch contour value at position derived from the sub-interval pitch lag depending on the comparison result
and
further comprising the calculation unit configured to derive a pitch contour from the encoded pitch parameter; where the pitch contour is obtained from the encoded pitch parameters using an interpolation; or
further comprising the calculation unit configured to derive a pitch contour from the encoded pitch parameter; where the pitch contour is obtained from the encoded pitch parameters using an interpolation.
10 . The processor according to claim 1 , further comprising a unit for smoothing the prediction signal across and/or at borders of at least two sub-intervals of a plurality of sub-intervals and/or
further comprising a unit for smoothing the prediction signal across and/or at borders of at least two sub-intervals of the plurality of sub-intervals, wherein at least the at least two sub-intervals are overlapping.
11 . The processor according to claim 1 , further comprising a unit for modifying the predicted spectrum, or a derivative of the predicted spectrum, dependent on a parameter derived from the encoded pitch parameter in order to generate a modified predicted spectrum; and/or
further comprising a unit for modifying the predicted spectrum, or a derivative of the predicted spectrum, wherein the unit for modifying are configured to adapt magnitudes of MDCT coefficients at least n Fsafeguard away from harmonics in X P or in X PS by setting to zero or multiplying with a positive factor smaller than 1 magnitudes of the MDCT coefficients; or further comprising a unit for modifying the predicted spectrum, or a derivative of the predicted spectrum, wherein the unit for modifying are configured to reduce magnitudes of the predicted spectrum, or magnitudes of the derivative of the predicted spectrum, between harmonics.
12 . The processor according to claim 1 , further comprising a unit for deriving a modified pitch parameter from the encoded pitch parameter dependent on a content of the LTP buffer; or
wherein the predicted spectrum is generated dependent on a modified pitch parameter.
13 . A processing unit comprising a processor claim 1 , and the processor comprising:
a splitter configured for splitting a time interval associated with a frame of the audio signal into a plurality of sub-intervals, each comprising a respective length, the respective length of the plurality of sub-intervals being dependent on a pitch lag value;
a harmonic post-filter configured for filtering the plurality of sub-intervals, wherein the harmonic post-filter is based on a transfer function comprising a numerator and a denominator, where the numerator comprises a harmonicity value, and wherein the denominator comprises a sub-interval pitch lag value and the harmonicity value and/or a gain value;
wherein the associated harmonicity value and/or the sub-interval pitch lag value and/or the gain value is different in at least two different sub-intervals of the plurality of sub-intervals;
wherein the sub-interval pitch lag value, the harmonicity value and/or the gain value are obtained based on the audio signal in each sub-interval of the plurality of sub-intervals.
14 . A processor for processing an audio signal, the processor comprising:
a splitter configured for splitting a time interval associated with a frame of the audio signal into a plurality of sub-intervals, each comprising a respective length, the respective length of the plurality of sub-intervals being dependent on a pitch lag value;
a harmonic post-filter configured for filtering the plurality of sub-intervals, wherein the harmonic post-filter is based on a transfer function comprising a numerator and a denominator, where the numerator comprises a harmonicity value, and wherein the denominator comprises a sub-interval pitch lag value and the harmonicity value and/or a gain value;
wherein the associated harmonicity value and/or the sub-interval pitch lag value and/or the gain value is different in at least two different sub-intervals of the plurality of sub-intervals;
wherein the sub-interval pitch lag value, the harmonicity value and/or the gain value are obtained based on the audio signal in each sub-interval of the plurality of sub-intervals.
15 . The processor according to claim 14 , wherein at least two subintervals or the plurality of sub-intervals are overlapping.
16 . The processor according to claim 14 , wherein the harmonicity value is proportional to a desired intensity of the harmonic post-filter and/or independent of amplitude changes in the audio signal; and/or
wherein the gain value is dependent on the amplitude changes in the audio signal).
17 . The processor according to according to claim 14 , wherein the harmonic post-filter changes from a sub-interval to a subsequent sub-interval; and/or
wherein the harmonicity value and/or the gain value and/or the sub-interval pitch lag value in the subsequent sub-interval are derived using an output of the harmonic post-filter in the sub-interval.
18 . The processor according to claim 14 , wherein the harmonic post-filter is different in at least two different sub-intervals of the plurality of sub-intervals; or
wherein the harmonic post-filter is different in at least two different sub-intervals of the plurality of sub-intervals or wherein the associated harmonicity value and/or the sub-interval pitch lag value and/or the gain value is different in at least two different sub-intervals of the plurality of sub-intervals, the in at least two different sub-intervals of the plurality of sub-intervals belonging to a same frame.
19 . The processor according to claim 14 , further comprising a unit for smoothing an output of the harmonic post-filter in the plurality of sub-intervals across and/or at sub-interval borders.
20 . The processor according to claim 14 , wherein there are at least two sub-intervals within the frame.
21 . The processor according to claim 14 , wherein the respective length is dependent on an average pitch; and/or
wherein an average pitch is obtained from an encoded pitch parameter; and/or
wherein the encoded pitch parameter comprises higher time resolution than a codec framing and/or wherein the encoded pitch parameter comprises lower time resolution then a pitch contour.
22 . The processor according to claim 14 , further comprising a domain converter configured for converting on a frame basis a first domain representation of the audio signal into a second domain representation of the audio signal; or
further comprising a domain converter configured for converting on a frame basis a frequency domain representation of the audio signal into a time domain representation of the audio signal.
23 . The processor claim 14 , wherein the harmonicity value and/or the gain value and/or the sub-interval pitch lag value for each sub-interval is derived dependent on a position of the respective sub-interval within the time interval associated with the frame.
24 . A decoder for decoding an encoded audio signal which comprises a processor claim 1 and/or a processor comprising:
a splitter configured for splitting a time interval associated with a frame of the audio signal into a plurality of sub-intervals, each comprising a respective length, the respective length of the plurality of sub-intervals being dependent on a pitch lag value;
a harmonic post-filter configured for filtering the plurality of sub-intervals, wherein the harmonic post-filter is based on a transfer function comprising a numerator and a denominator, where the numerator comprises a harmonicity value, and wherein the denominator comprises a sub-interval pitch lag value and the harmonicity value and/or a gain value;
wherein the associated harmonicity value and/or the sub-interval pitch lag value and/or the gain value is different in at least two different sub-intervals of the plurality of sub-intervals; wherein the sub-interval pitch lag value, the harmonicity value and/or the gain value are obtained based on the audio signal in each sub-interval of the plurality of sub-intervals.
25 . The decoder claim 24 , further comprising a frequency domain decoder or a decoder based on an inverse MDCT.
26 . An encoder for encoding an audio signal, comprising the processor claim 1 .
27 . A method for processing an encoded audio signal, the encoded audio signal comprising at least an encoded pitch parameter, the method comprising following steps:
receiving samples derived from a frame of the encoded audio signal using an LTP buffer;
dividing a time interval associated with a subsequent frame of the encoded audio signal subsequent to the frame into sub-intervals depending on the encoded pitch parameter;
deriving sub-interval parameters from the encoded pitch parameter dependent on a position of the sub-intervals within the time interval associated with the subsequent frame of the encoded audio signal;
generating a prediction signal from the LTP buffer dependent on the sub-interval parameters; and
generating a prediction spectrum based on the prediction signal.
28 . A method for processing an audio signal, the method comprising following steps:
splitting a time interval associated with a frame of the audio signal into a plurality of sub-intervals, each comprising a respective length, the respective lengths of at least two of the plurality of sub-intervals being dependent on a pitch lag value; and
filtering the plurality of sub-intervals using a harmonic post-filter, wherein the harmonic post-filter is based on a transfer function comprising a numerator and a denominator, where the numerator comprises a harmonicity value, and wherein the denominator comprises a sub-interval pitch lag value and the harmonicity value and/or a gain value,
wherein the associated harmonicity value and/or the sub-interval pitch lag value and/or the gain value is different in at least two different sub-intervals of the plurality of sub-intervals, and
wherein the sub-interval pitch lag value, the harmonicity value and/or the gain value are obtained based on the audio signal in each sub-interval of the plurality of sub-intervals.
29 . A non-transitory digital storage medium having a computer program stored thereon to perform a method for processing an encoded audio signal, the encoded audio signal comprising at least an encoded pitch parameter and the method comprising following steps:
receiving samples derived from a frame of the encoded audio signal using an LTP buffer;
dividing a time interval associated with a subsequent frame of the encoded audio signal subsequent to the frame into sub-intervals depending on the encoded pitch parameter;
deriving sub-interval parameters from the encoded pitch parameter dependent on a position of the sub-intervals within the time interval associated with the subsequent frame of the encoded audio signal;
generating a prediction signal from the LTP buffer dependent on the sub-interval parameters; and
generating a prediction spectrum based on the prediction signal, when said computer program is run by a computer.
30 . A non-transitory digital storage medium having a computer program stored thereon to perform a method for processing an audio signal, the method comprising following steps:
splitting a time interval associated with a frame of the audio signal into a plurality of sub-intervals, each comprising a respective length, the respective lengths of at least two of the plurality of sub-intervals being dependent on a pitch lag value; and
filtering the plurality of sub-intervals using a harmonic post-filter, wherein the harmonic post-filter is based on a transfer function comprising a numerator and a denominator, where the numerator comprises a harmonicity value, and wherein the denominator comprises a sub-interval pitch lag value and the harmonicity value and/or a gain value,
wherein the associated harmonicity value and/or the sub-interval pitch lag value and/or the gain value is different in at least two different sub-intervals of the plurality of sub-intervals, and wherein the sub-interval pitch lag value, the harmonicity value and/or the gain value are obtained based on the audio signal in each sub-interval of the plurality of sub-intervals, when said computer program is run by a computer.