IP Library › Granted Patent US 11,227,613
Granted Patent B2
US 11,227,613 · App. 16/747,269 · Granted Jan 18, 2022

Frame error concealment

Inventors: Sebastian Näslund (Solna, SE); Volodya Grancharov (Solna, SE); Jonas Svedberg (Luleå, SE)
Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
G10L19/005G10L19/025
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,227,613
App. No.
16/747,269
Granted
Jan 18, 2022
Kind
B2
Abstract

A frame error concealment method based on frames including transform coefficient vectors including the following steps: It tracks sign changes between corresponding transform coefficients of predetermined sub-vectors of consecutive good stationary frames. It accumulates the number of sign changes in corresponding sub-vectors of a predetermined number of consecutive good stationary frames. It reconstructs an erroneous frame with the latest good stationary frame, but with reversed signs of transform coefficients in sub-vectors having an accumulated number of sign changes that exceeds a predetermined threshold.

Claims (66)

1. A frame loss concealment method performed by an audio decoder, the method comprising:

determining a number of sign changes between corresponding transform coefficients of bands, each comprising a plurality of coefficients, of consecutive frames that do not contain transient;

accumulating the number of sign changes in corresponding bands of consecutive frames; and

reconstructing a lost frame by copying the transform coefficients from a previous frame, but with reversed signs of transform coefficients in bands having an accumulated number of sign changes that meets or exceeds a threshold (T), wherein

the step of determining the number of sign changes between corresponding transform coefficients of bands of consecutive frames that do not contain transient comprises storing a first value (C [m] (1)) indicating a first number of sign changes between transform coefficients of a first band of a first frame and corresponding transform coefficients of a first band of a second frame that immediately precedes the first frame, and

the accumulating comprises storing a second value (ΔC [m] (1)) for the first band, and further wherein

ΔC [m] (1)=C [m] (1), and

C [m] (1) is the number of sign changes between transform coefficients of the first band of the second frame and corresponding transform coefficients of a first band of a third frame that immediately precedes the second frame.

2. The method of claim 1 , wherein signs of copied transform coefficients are randomized if any of two previous frames contains transient.

3. The method of claim 1 , further comprising assigning a value to T based on a number of consecutive frames immediately preceding the lost frame that do not contain transient.

4. The method of claim 3 , wherein assigning a value to T based on a number of consecutive frames immediately preceding the lost frame that do not contain transient comprises:

assigning a first value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is two; and

assigning a second value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is three.

5. The method of claim 4 , wherein when the band comprises 4 coefficients, the first value is 3 and the second value is 6.

6. A computer program product comprising a non-transitory computer readable medium storing a computer program for frame loss concealment, the computer program comprising computer readable code which when run on a processor causes the processor to perform the method of claim 1 .

7. An apparatus for frame loss concealment, comprising:

a memory; and

a processor coupled to the memory, wherein the apparatus is configured to:

determine a number of sign changes between corresponding transform coefficients of bands, each comprising a plurality of coefficients, of consecutive frames that do not contain transient;

accumulate the number of sign changes in corresponding bands of consecutive frames; and

reconstruct a lost frame by copying the transform coefficients from a previous frame, but with reversed signs of transform coefficients in bands having an accumulated number of sign changes that meets or exceeds a threshold (T), wherein

the apparatus is configured to determine a number of sign changes between corresponding transform coefficients of bands of consecutive frames that do not contain transient by performing a process that comprises storing a first value (C [m] (1)) indicating a first number of sign changes between transform coefficients of a first band of a first frame and corresponding transform coefficients of a first band of a second frame that immediately precedes the first frame, and

the apparatus is configured to accumulate the number of sign changes in corresponding bands of consecutive frames by performing a process that comprises storing a second value (ΔC [m] (1)) for the first band, and further wherein

ΔC [m] (1)=C [m] (1), and

C [m] (1) is the number of sign changes between transform coefficients of the first band of the second frame and corresponding transform coefficients of a first band of a third frame that immediately precedes the second frame.

8. The apparatus of claim 7 , wherein the apparatus is configured to randomize signs of copied transform coefficients if any of two previous frames contains transient.

9. The apparatus of claim 7 , wherein the apparatus is configured to assign a value to T based on a number of consecutive frames immediately preceding the lost frame that do not contain transient.

10. The apparatus of claim 9 , wherein the apparatus is configured such that:

the apparatus assigns a first value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is two; and

the apparatus assigns a second value to T if the number of consecutive frames immediately preceding the lost frame that do not contain transient is three.

11. The apparatus of claim 10 , wherein the first value is 3 and the second value is 6.

12. An audio decoder comprising the apparatus of claim 7 .

13. A mobile communication device comprising the apparatus of claim 7 .

14. An apparatus for frame loss concealment, comprising:

a receiver for receiving a first audio frame, the first audio frame comprising a plurality of bands, each of the plurality of bands of the first audio frame comprising a plurality of transform coefficients;

a memory; and

a processor coupled to the memory, wherein the apparatus is configured to:

determine that a next audio frame immediately following the first audio frame is lost; and

as a result of determining that the next audio frame is lost, reconstruct the lost audio frame such that:

the reconstructed lost audio frame comprises a plurality of bands, wherein each one of the plurality of bands of the reconstructed lost audio frame corresponds to one of the plurality of bands of the first audio frame and wherein each band of the reconstructed lost audio frame comprises a plurality of transform coefficients,

for each transform coefficient included in the reconstructed lost audio frame, the absolute value of the transform coefficient is identical to the absolute value of a corresponding transform coefficient included in the first audio frame, and

for each band of the reconstructed lost audio frame, the sign of each transform coefficient included in the band is determined based on a sign switch value that is associated with the band of the first audio frame to which the band of the reconstructed lost audio frame corresponds and that indicates a number of transform coefficient sign switches.

15. An apparatus for frame loss concealment, comprising:

a receiver for receiving a first audio frame, the first audio frame comprising a plurality of bands comprising a first band and a second band, each of the plurality of bands of the first audio frame comprising a plurality of transform coefficients;

a memory; and

a processor coupled to the memory, wherein the apparatus is configured to:

determine that a next audio frame immediately following the first audio frame is lost; and

as a result of determining that the next audio frame is lost, construct a replacement audio frame such that:

the replacement audio frame comprises a plurality of bands comprising a first band and a second band, wherein the first band of the replacement audio frame corresponds to the first band of the first audio frame and the second band of the replacement audio frame corresponds to the second band of the first audio frame,

the first band of the replacement audio frame comprises a plurality of transform coefficients, each of which corresponds to one of the transform coefficients included in the first band of the first audio frame,

for each transform coefficient included in the first band of the replacement audio frame, the absolute value of the transform coefficient is identical to the absolute value of its corresponding transform coefficient included in the first band of the first audio frame,

for each transform coefficient included in the first band of the replacement audio frame, the sign of the transform coefficient is determined based on a first sign switch value,

the second band of the replacement audio frame comprises a plurality of transform coefficients, each of which corresponds to one of the transform coefficients included in the second band of the first audio frame,

for each transform coefficient included in the second band of the replacement audio frame, the absolute value of the transform coefficient is identical to the absolute value of its corresponding transform coefficient included in the second band of the first audio frame, and

for each transform coefficient included in the second band of the replacement audio frame, the sign of the transform coefficient is determined based on a second sign switch value.

16. The apparatus of claim 15 , wherein the apparatus is further configured to calculate the first sign switch value, wherein calculating the first sign switch value comprises calculating S n (1)+S n−1 (1), wherein S n (1) is a state value associated with the first band of the first audio frame and S n−1 (1) is a state value associated with a first band of an audio frame that preceded the first audio frame.

17. The apparatus of claim 15 , wherein the apparatus is further configured to calculate the first sign switch value, wherein calculating the first sign switch value comprises:

determining whether x n (1)* X n−1 (1)<0; and

calculating (S n (1)=S n (1)+(1) as a result of determining that x n (1)*x n−1 (1)<0, wherein

the first band of the first audio frame comprises a first transform coefficient,

x n (1) is the value of the first transform coefficient of the first band of the first audio frame,

x n−1 (1) is the value of a first transform coefficient included in a first band of an audio frame that preceded the first audio frame,

S n (1) is the first sign switch value.

18. The apparatus of claim 15 , wherein

the first sign switch value is associated with the first band of the first audio frame and indicates a first number of transform coefficient sign switches, and

the second sign switch value is associated with the second band of the first audio frame and indicates a second number of transform coefficient sign switches.

Continuity (5)
Continuation 15989618 · May 25, 2018
Continuation 15271930 · Sep 21, 2016
Continuation 14767499
Provisional Application 61764254 · Feb 13, 2013
Related Publication 20200152208A1 · May 14, 2020
Cited By (1)
US 12,315,519