IP Library › Granted Patent US 8,301,440
Granted Patent B2
US 8,301,440 · App. 12/431,155 · Granted Oct 30, 2012

Bit error concealment for audio coding systems

Assignee: Broadcom Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,301,440
App. No.
12/431,155
Granted
Oct 30, 2012
Kind
B2
Abstract

A bit error concealment (BEC) system and method is described herein that detects and conceals the presence of click-like artifacts in an audio signal caused by bit errors introduced during transmission of the audio signal within an audio communications system. A particular embodiment of the present invention utilizes a low-complexity design that introduces no added delay and that is particularly well-suited for applications such as Bluetooth® wireless audio devices which have low cost and low power dissipation requirements.

Claims (95)

1. A method for performing bit error concealment in an audio receiver, comprising:

decoding a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

analyzing at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the analyzing including:

determining if a maximum absolute sample value in a segment of a prediction residual that is associated with the decoded audio frame exceeds an average signal level of the prediction residual for the decoded audio frame multiplied by an adaptive threshold; and

responsive to detecting that the decoded audio frame includes the distortion, performing operations on the decoded audio signal to conceal the distortion.

2. The method of claim 1 , wherein the step of decoding the portion of the encoded bit stream is performed by one of:

a Continuously Variable Slope Delta Modulation (CVSD) decoder;

a pulse code modulation (PCM) decoder;

a G.711 decoder; or

a sub-band codec (SBC) decoder.

3. The method of claim 1 further comprising:

obtaining the prediction residual by performing short term prediction and long term prediction.

4. The method of claim 1 , further comprising:

determining the average signal level of the prediction residual for the decoded audio frame by computing an average magnitude of the prediction residual for the decoded audio frame.

5. The method of claim 1 , further comprising:

determining the average signal level of the prediction residual for the decoded audio frame by computing an energy level of the prediction residual for the decoded audio frame.

6. A method for performing bit error concealment in an audio receiver, comprising:

decoding a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

analyzing at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the analyzing including:

analyzing a pitch history of the decoded audio signal;

assigning the pitch history to one of a plurality of pitch track categories based on the analysis; and

modifying a sensitivity level for detecting whether the decoded audio frame includes the distortion based on the pitch track category assigned to the pitch history; and responsive to detecting that the decoded audio frame includes the distortion, performing operations on the decoded audio signal to conceal the distortion.

7. A method for performing bit error concealment in an audio receiver, comprising:

decoding a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

analyzing at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the analyzing including:

computing a plurality of pitch predictor taps associated with the decoded audio frame; and

modifying a sensitivity level for detecting whether the decoded audio frame includes the distortion based on a difference between a sum of the plurality of pitch predictor taps associated with the decoded audio frame and a sum of a plurality of pitch predictor taps associated with a previously-decoded audio frame; and

responsive to detecting that the decoded audio frame includes the distortion, performing operations on the decoded audio signal to conceal the distortion.

8. A method for performing bit error concealment in an audio receiver, comprising:

decoding a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

analyzing at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the analyzing including:

calculating a voicing strength measure associated with the decoded audio frame; and

modifying a sensitivity level for detecting whether the decoded audio frame includes the distortion based on the voicing strength measure; and

responsive to detecting that the decoded audio frame includes the distortion, performing operations on the decoded audio signal to conceal the distortion.

9. The method of claim 1 , wherein performing operations on the decoded audio signal to conceal the distortion comprises replacing the decoded audio frame with a synthesized audio frame generated in accordance with a packet loss concealment algorithm.

10. The method of claim 9 , further comprising:

performing a state memory update of an audio decoder based on re-encoding of the synthesized audio frame responsive to at least detecting that the decoded audio frame includes the distortion.

11. The method of claim 10 , further comprising performing the state memory update of the audio decoder based on re-encoding of the synthesized audio frame responsive to detecting that the decoded audio frame includes the distortion and determining that the decoded audio signal represents background noise.

12. A method for performing bit error concealment in an audio receiver, comprising:

decoding a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

analyzing at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream;

responsive to detecting that the decoded audio frame includes the distortion, performing operations on the decoded audio signal to conceal the distortion;

analyzing non-speech segments of the decoded audio signal to estimate a rate at which audible distortions are detected; and

adapting a biasing factor based on the estimated rate, wherein the biasing factor is used to determine a sensitivity level for detecting whether the decoded audio frame includes the distortion.

13. The method of claim 12 , wherein analyzing non-speech segments of the decoded audio signal to estimate a rate at which audible distortions are detected includes:

limiting the estimated rate to a function of a received packet loss rate.

14. A method for performing bit error concealment in an audio receiver, comprising:

decoding a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

analyzing at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream;

responsive to detecting that the decoded audio frame includes the distortion, performing operations on the decoded audio signal to conceal the distortion;

analyzing non-speech segments of the decoded audio signal to estimate a rate at which audible distortions are detected;

determining whether the estimated rate is below a predefined threshold; and

responsive to determining that the estimated rate is below the predefined threshold, disabling at least a component configured to perform the analysis of the decoded audio signal to detect whether the decoded audio frame includes the distortion.

15. A system, comprising:

an audio decoder configured to decode a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

a bit error detection module configured to analyze at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the bit error detection module being configured to perform the analysis by determining if a maximum absolute sample value in a segment of a prediction residual that is associated with the decoded audio frame exceeds an average signal level of the prediction residual for the decoded audio frame multiplied by an adaptive threshold; and

a concealment module configured to perform operations on the decoded audio signal to conceal the distortion responsive to detection of the distortion within the decoded audio frame.

16. The system of claim 15 , wherein the audio decoder comprises one of:

a Continuously Variable Slope Delta Modulation (CVSD) decoder;

a pulse code modulation (PCM) decoder;

a G.711 decoder; or

a sub-band codec (SBC) decoder.

17. The system of claim 15 , wherein the bit error detection module is configured to determine the average signal level of the prediction residual for the decoded audio frame by computing an average magnitude of the prediction residual for the decoded audio frame.

18. The system of claim 15 , wherein the bit error detection module is configured to determine the average signal level of the prediction residual for the decoded audio frame by computing an energy level of the prediction residual for the decoded audio frame.

19. A system, comprising:

an audio decoder configured to decode a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

a bit error detection module configured to analyze at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the bit error detection module being configured to perform the analysis by analyzing a pitch history of the decoded audio signal, assigning the pitch history to one of a plurality of pitch track categories based on the analysis, and modifying a sensitivity level for detecting whether the decoded audio frame includes the distortion based on the pitch track category assigned to the pitch history; and

a concealment module configured to perform operations on the decoded audio signal to conceal the distortion responsive to detection of the distortion within the decoded audio frame.

20. A system, comprising:

an audio decoder configured to decode a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

a bit error detection module configured to analyze at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the bit error detection module being configured to perform the analysis by computing a plurality of pitch predictor taps associated with the decoded audio frame and modifying a sensitivity level for detecting whether the decoded audio frame includes the distortion based on a difference between a sum of the plurality of pitch predictor taps associated with the decoded audio frame and a sum of a plurality of pitch predictor taps associated with a previously-decoded audio frame; and

a concealment module configured to perform operations on the decoded audio signal to conceal the distortion responsive to detection of the distortion within the decoded audio frame.

21. A system, comprising:

an audio decoder configured to decode a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

a bit error detection module configured to analyze at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the bit error detection module being configured to perform the analysis by calculating a voicing strength measure associated with the decoded audio frame and modifying a sensitivity level for detecting whether the decoded audio frame includes the distortion based on the voicing strength measure; and

a concealment module configured to perform operations on the decoded audio signal to conceal the distortion responsive to detection of the distortion within the decoded audio frame.

22. The system of claim 15 , wherein the concealment module is configured to perform operations on the decoded audio signal to conceal the distortion by replacing the decoded audio frame with a synthesized audio frame generated in accordance with a packet loss concealment algorithm.

23. The system of claim 22 , further comprising:

a re-encoding module configured to perform a state memory update of the audio decoder based on re-encoding of the synthesized audio frame responsive to at least detection of the distortion within the decoded audio frame.

24. The system of claim 23 , wherein the re-encoding module is configured to perform the state memory update of the audio decoder based on re-encoding of the synthesized audio frame responsive to at least detection of the distortion within the decoded audio frame and to determining that the decoded audio signal represents background noise.

25. A system, comprising:

an audio decoder configured to decode a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

a bit error detection module configured to analyze at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream;

a concealment module configured to perform operations on the decoded audio signal to conceal the distortion responsive to detection of the distortion within the decoded audio frame; and

a threshold biasing module configured to analyze non-speech segments of the decoded audio signal to estimate a rate at which audible distortions are detected and to adapt a biasing factor based on the estimated rate, wherein the biasing factor is used by the bit error detection module to determine a sensitivity level for detecting whether the decoded audio frame includes the distortion.

26. The system of claim 25 , wherein the threshold biasing module is configured to estimate the rate at which audible distortions are detected by limiting the estimated rate to a function of a received packet loss rate.

27. A system, comprising:

an audio decoder configured to decode a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

a bit error detection module configured to analyze at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream;

a concealment module configured to perform operations on the decoded audio signal to conceal the distortion responsive to detection of the distortion within the decoded audio frame; and

a threshold biasing module configured to analyze non-speech segments of the decoded audio signal to estimate a rate at which audible distortions are detected, to determine whether the estimated rate is below a predefined threshold and to disable at least the bit error detection module responsive to determining that the estimated rate is below the predefined threshold.

28. A computer program product comprising a computer-readable medium having computer program logic recorded thereon for enabling a processing unit to perform bit error concealment, the computer program logic comprising:

first means for enabling the processing unit to decode a portion of an encoded bit stream to generate a decoded audio frame, wherein the decoded audio frame comprises a portion of a decoded audio signal;

second means for enabling the processing unit to analyze at least the decoded audio signal to detect whether the decoded audio frame includes a distortion that will be audible during playback thereof, the distortion being due to bit errors in the encoded bit stream, the analyzing including determining if a maximum absolute sample value in a segment of a prediction residual that is associated with the decoded audio frame exceeds an average signal level of the prediction residual for the decoded audio frame multiplied by an adaptive threshold; and

third means for enabling the processing unit to perform operations on the decoded audio signal to conceal the distortion responsive to detection of the distortion within the decoded audio frame.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF MERGER TO 09/05/2018 PREVIOUSLY RECORDED AT REEL: 047230 FRAME: 0133. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047630/0456 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047230/0133 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: BROADCOM CORPORATION
Reel/Frame 041712/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2017
From: BROADCOM CORPORATION
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041706/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: BROADCOM CORPORATION
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037806/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2009
From: ZOPF, ROBERT W.; KUMAR, VIVEK; CHEN, JUIN-HWEY
To: BROADCOM CORPORATION
Reel/Frame 022604/0991 →
Continuity (2)
Provisional Application 61051981 · May 9, 2008
Related Publication 20090281797A1 · Nov 12, 2009