Granted Patent B2

US 12,315,519 · App. 18/386,020 · Granted May 27, 2025

Inventors: Sebastian Näslund (Solna, SE); Volodya Grancharov (Solna, SE); Jonas Svedberg (Luleå, SE)

Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)

G10L19/005G10L19/025

Abstract

Claims (69)

1. A frame loss concealment method performed by an audio decoder, the method comprising:

receiving a first frame comprising B bands of n transform coefficients, where B>1 and n>1;

receiving a second frame comprising B bands of n transform coefficients;

for the first band of the first frame, storing a first counter value (C [1] (1));

for the first band of the second frame, storing a second counter value (C [2] (1))

setting a value of a state variable (denoted ΔC [2] (1)) equal to C [2] (1)+C [1] (1);

using ΔC [2] (1) in a process for producing a constructed frame corresponding to a lost frame wherein

the constructed frame comprises an ordered set of B vectors of n transform coefficients, and

the process for producing the constructed frame comprises, for each one of the n transform coefficients of the first vector of the constructed frame, determining a sign for the transform coefficient based on ΔC [2] (1) and a threshold value (T).

2. The method of claim 1 , wherein signs of copied transform coefficients are randomized if any of two previous frames contains transient.

3. The method of claim 1 , further comprising assigning a value to T based on a number of consecutive frames immediately preceding the lost frame that do not contain transient.

4. The method of claim 3 , wherein assigning a value to T based on a number of consecutive frames immediately preceding the lost frame that do not contain transient comprises:

assigning a first value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is two; and

assigning a second value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is three.

5. The method of claim 4 , wherein when the band comprises 4 coefficients, the first value is 3 and the second value is 6.

6. A computer program product comprising a non-transitory computer readable medium storing a computer program for frame loss concealment, the computer program comprising computer readable code which when run on a processor causes the processor to perform the method of claim 1 .

7. An apparatus for frame loss concealment, comprising:

a memory; and

a processor coupled to the memory, wherein the apparatus is configured to perform a method comprising:

receiving a first frame comprising B bands of n transform coefficients, where B>1 and n>1;

receiving a second frame comprising B bands of n transform coefficients;

for the first band of the first frame, storing a first counter value (C [1] (1));

for the first band of the second frame, storing a second counter value (C [2] (1)) setting a value of a state variable (denoted ΔC [2] (1)) equal to C [2] (1)+C [1] (1);

using ΔC [2] (1) in a process for producing a constructed frame corresponding to a lost frame, wherein

the constructed frame comprises an ordered set of B vectors of n transform coefficients, and

the process for producing the constructed frame comprises, for each one of the n transform coefficients of the first vector of the constructed frame, determining a sign for the transform coefficient based on ΔC [2] (1) and a threshold value (T).

8. The apparatus of claim 7 , wherein the apparatus is configured to randomize signs of copied transform coefficients if any of two previous frames contains transient.

9. The apparatus of claim 7 , wherein the apparatus is configured to assign a value to T based on a number of consecutive frames immediately preceding the lost frame that do not contain transient.

10. The apparatus of claim 9 , wherein the apparatus is configured such that:

the apparatus assigns a first value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is two; and

the apparatus assigns a second value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is three.

11. The apparatus of claim 10 , wherein the first value is 3 and the second value is 6.

12. An audio decoder comprising the apparatus of claim 7 .

13. A mobile communication device comprising the apparatus of claim 7 .

14. An apparatus for frame loss concealment, comprising:

a receiver for receiving a first audio frame, the first audio frame comprising a plurality of bands, each of the plurality of bands of the first audio frame comprising a plurality of transform coefficients;

a memory; and

a processor coupled to the memory, wherein the apparatus is configured to:

determine that a next audio frame immediately following the first audio frame is lost; and

after determining that the next audio frame is lost, produce a reconstructed frame using the first audio frame, wherein

the reconstructed audio frame comprises a plurality of bands, wherein each one of the plurality of bands of the reconstructed audio frame corresponds to one of the plurality of bands of the first audio frame and wherein each band of the reconstructed audio frame comprises a plurality of transform coefficients,

for each transform coefficient included in the reconstructed audio frame, the absolute value of the transform coefficient is identical to the absolute value of a corresponding transform coefficient included in the first audio frame, and

for a first band of the reconstructed audio frame, the sign of each transform coefficient included in the first band of the reconstructed audio frame is determined based on a sign switch value that indicates a number of transform coefficient sign switches accumulated over two consecutive audio frames, the two consecutive audio frames including the first audio frame and a second audio frame that immediately precedes the first audio frame.

15. An apparatus for frame loss concealment, comprising:

a receiver for receiving a first audio frame, the first audio frame comprising a plurality of bands comprising a first band and a second band, each of the plurality of bands of the first audio frame comprising a plurality of transform coefficients;

a memory; and

a processor coupled to the memory, wherein the apparatus is configured to:

determine that a next audio frame immediately following the first audio frame is lost; and

as a result of determining that the next audio frame is lost, construct a replacement audio frame, wherein

the replacement audio frame comprises a plurality of bands comprising a first band and a second band,

the first band of the replacement audio frame corresponds to the first band of the first audio frame,

the second band of the replacement audio frame corresponds to the second band of the first audio frame,

the first band of the replacement audio frame comprises a plurality of transform coefficients, each of which corresponds to one of the transform coefficients included in the first band of the first audio frame,

for each transform coefficient included in the first band of the replacement audio frame, the absolute value of the transform coefficient is identical to the absolute value of its corresponding transform coefficient included in the first band of the first audio frame,

for each transform coefficient included in the first band of the replacement audio frame, the sign of the transform coefficient is determined based on a first sign switch value that indicates a first accumulated number of transform coefficient sign switches accumulated over two consecutive audio frames, the two consecutive audio frames including the first audio frame and a second audio frame that immediately precedes the first audio frame,

the second band of the replacement audio frame comprises a plurality of transform coefficients, each of which corresponds to one of the transform coefficients included in the second band of the first audio frame,

for each transform coefficient included in the second band of the replacement audio frame, the absolute value of the transform coefficient is identical to the absolute value of its corresponding transform coefficient included in the second band of the first audio frame, and

for each transform coefficient included in the second band of the replacement audio frame, the sign of the transform coefficient is determined based on a second sign switch value that indicates a second accumulated number of transform coefficient sign switches accumulated over the two consecutive audio frames.

16. The apparatus of claim 15 , wherein the apparatus is further configured to calculate the first sign switch value, wherein calculating the first sign switch value comprises calculating S n (1)+S n-1 (1), wherein S n (1) is a state value associated with the first band of the first audio frame and S n-1 (1) is a state value associated with a first band of an audio frame that preceded the first audio frame.

17. The apparatus of claim 15 , wherein the apparatus is further configured to calculate the first sign switch value, wherein calculating the first sign switch value comprises:

determining whether x n (1)*x n-1 (1)<0; and

calculating (S n (1)=S n (1)+1) as a result of determining that x n (1)*x n-1 (1)<0, wherein

the first band of the first audio frame comprises a first transform coefficient,

x n (1) is the value of the first transform coefficient of the first band of the first audio frame,

x n-1 (1) is the value of a first transform coefficient included in a first band of an audio frame that preceded the first audio frame,

S n (1) is the first sign switch value.

18. The apparatus of claim 15 , wherein

the first sign switch value is associated with the first band of the first audio frame and indicates a first number of transform coefficient sign switches, and

the second sign switch value is associated with the second band of the first audio frame and indicates a second number of transform coefficient sign switches.

Continuity (7)

References Cited (36)