IP Library Granted Patent US 10,714,106
Granted Patent B2
US 10,714,106 · App. 15/910,954 · Granted Jul 14, 2020

Jitter buffer control, audio decoder, method and computer program

Inventors: Stefan Reuschl (Nuremberg, DE); Stefan Doehla (Erlangen, DE); Jérémie Lecomte (Fuerth, DE); Manuel Jander (Erlangen, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
G10L19/022G10L19/012G10L19/04H04J3/0632G10L21/04H04J3/0664
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,714,106
App. No.
15/910,954
Granted
Jul 14, 2020
Kind
B2
Abstract

A jitter buffer control for controlling a provision of a decoded audio content on the basis of an input audio content is configured to select a frame-based time scaling or a sample-based time scaling in a signal-adaptive manner. An audio decoder uses such a jitter buffer control.

Claims (44)

1. A jitter buffer control for controlling a provision of a decoded audio content on the basis of an input audio content,

wherein the jitter buffer control is configured to select a frame-based time scaling or a sample-based time scaling in a signal-adaptive manner, such that a decision whether a frame-based time scaling or a sample-based time scaling is used is adapted to the characteristics of the audio signal, and

wherein the jitter buffer control is implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

2. The jitter buffer control according to claim 1 , wherein audio frames are dropped or inserted to control a depth of a jitter buffer when the frame-based time scaling is used, and wherein a time-shifted overlap-and-add of audio signal portions is performed when the sample-based time-scaling is used.

3. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to switch between a frame-based time scaling, a sample-based time scaling and a deactivation of a time scaling in a signal-adaptive manner.

4. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to select the frame-based time scaling or the sample-based time scaling in order to control a depth of a jitter buffer.

5. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to select a comfort noise insertion or a comfort noise deletion if a previous frame was inactive.

6. The jitter buffer control according to claim 5 , wherein a comfort noise insertion results in an insertion of a comfort noise frame into a jitter buffer, and wherein a comfort noise deletion results in a removal of a comfort noise frame from the jitter buffer.

7. The jitter buffer control according to claim 5 , wherein a respective frame is considered inactive when the respective frame carries a signaling information indicating a generation of comfort noise.

8. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to select a time-shifted overlap-and-add of audio signal portions if a previous frame was active.

9. The jitter buffer control according to claim 8 , wherein the time-shifted overlap-and-add of audio signal portions is adapted to allow for an adjustment of a time shift between blocks of audio samples acquired on the basis of subsequent frames of the input audio content with a resolution which is smaller than a length of the blocks of audio samples, or which is smaller than a quarter of the length of the blocks of audio samples, or which is smaller than or equal to two audio samples.

10. The jitter buffer control according to claim 8 , wherein the jitter buffer control is configured to determine whether a block of audio samples represents an active but silent audio signal portion, and wherein the jitter buffer control is configured to select an overlap-and-add mode, in which a time shift between the block of audio samples representing a silent audio signal portion and a previous or subsequent block of audio samples is set to a predetermined maximum value, for a block of audio samples representing a silent audio signal portion.

11. The jitter buffer control according to claim 8 , wherein the jitter buffer control is configured to determine whether a block of audio samples represents an active and non-silent audio signal portion, and to select an overlap-and-add mode, in which the time shift between blocks of audio samples determined on the basis of subsequent frames of the input audio content is determined in a signal adaptive manner.

12. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to select an insertion of a concealed frame in response to a determination that a time stretching is necessitated and that a jitter buffer is empty.

13. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to select the frame-based time scaling or the sample-based time scaling in dependence on whether a discontinuous transmission in conjunction with comfort noise generation is currently used or was used for a previous frame.

14. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to select a frame-based time scaling if a comfort noise generation is currently used or was used for a previous frame and to select a sample-based time scaling if a comfort noise generation is not currently used or was not used for a previous frame.

15. The jitter buffer control according to claim 1 ,

wherein the jitter buffer control is configured to select a frame-based comfort noise insertion or a frame-based comfort noise deletion for a time scaling if a discontinuous transmission in conjunction with comfort noise generation is currently used or was used for a previous frame,

wherein the jitter buffer control is configured to select an overlap-add-operation using a predetermined time shift for a time scaling if a current audio signal portion is active but comprises a signal energy which is smaller than or equal to an energy threshold value, and if a jitter buffer is not empty, or if a previous audio signal portion was active but comprises a signal energy which is smaller than or equal to the energy threshold value, and if the jitter buffer is not empty;

wherein the jitter buffer control is configured to select an overlap-add-operation using a signal-adaptive time shift for a time scaling if a current audio signal portion is active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty, or if a previous audio signal portion was active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty; and

wherein the jitter buffer control is configured to select an insertion of a concealed frame for a time scaling if a current audio signal portion is active and if the jitter buffer is empty, or if a previous audio signal portion was active and if the jitter buffer is empty.

16. The jitter buffer control according to claim 1 , wherein the jitter buffer control is configured to select an overlap-add-operation using a signal-adaptive time shift and a quality control mechanism for a time scaling if a current audio signal portion is active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty, or if a previous audio signal portion was active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty.

17. A method for controlling a provision of a decoded audio content on the basis of an input audio content,

wherein the method comprises selecting a frame-based time scaling or a sample-based time scaling in a signal-adaptive manner, such that a decision whether a frame-based time scaling or a sample-based time scaling is used is adapted to the characteristics of the audio signal.

18. A non-transitory computer-readable medium comprising a computer program for performing the method according to claim 17 when the computer program is running on a computer.

19. A jitter buffer control for controlling a provision of a decoded audio content on the basis of an input audio content,

wherein the jitter buffer control is configured to select a frame-based time scaling or a sample-based time scaling in a signal-adaptive manner;

wherein audio frames are dropped or inserted to control a depth of a jitter buffer when the frame-based time scaling is used, and wherein a time-shifted overlap-and-add of audio signal portions is performed when the sample-based time-scaling is used;

wherein the jitter buffer control is configured to select a frame-based comfort noise insertion or a frame-based comfort noise deletion for a time scaling if a discontinuous transmission in conjunction with comfort noise generation is currently used or was used for a previous frame,

wherein the jitter buffer control is configured to select an overlap-add-operation using a predetermined time shift for a time scaling if a current audio signal portion is active but comprises a signal energy which is smaller than or equal to an energy threshold value, and if a jitter buffer is not empty, or if a previous audio signal portion was active but comprises a signal energy which is smaller than or equal to the energy threshold value, and if the jitter buffer is not empty;

wherein the jitter buffer control is configured to select an overlap-add-operation using a signal-adaptive time shift for a time scaling if a current audio signal portion is active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty, or if a previous audio signal portion was active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty;

wherein the jitter buffer control is configured to select an insertion of a concealed frame for a time scaling if a current audio signal portion is active and if the jitter buffer is empty, or if a previous audio signal portion was active and if the jitter buffer is empty; and

wherein the jitter buffer control is implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

20. A jitter buffer control for controlling a provision of a decoded audio content on the basis of an input audio content,

wherein the jitter buffer control is configured to select a frame-based time scaling or a sample-based time scaling in a signal-adaptive manner;

wherein audio frames are dropped or inserted to control a depth of a jitter buffer when the frame-based time scaling is used, and wherein a time-shifted overlap-and-add of audio signal portions is performed when the sample-based time-scaling is used;

wherein the jitter buffer control is configured to select an overlap-add-operation using a signal-adaptive time shift and a quality control mechanism for a time scaling if a current audio signal portion is active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty, or if a previous audio signal portion was active and comprises a signal energy which is larger than or equal to the energy threshold value and if the jitter buffer is not empty; and

wherein the jitter buffer control is implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

21. A jitter buffer control for controlling a provision of a decoded audio content on the basis of an input audio content,

wherein the jitter buffer control is configured to select a frame-based time scaling or a sample-based time scaling in a signal-adaptive manner, such that a decision whether a frame-based time scaling or a sample-based time scaling is used is adapted to the characteristics of the audio signal;

wherein audio frames are dropped or inserted to control a depth of a jitter buffer when the frame-based time scaling is used, and wherein a time-shifted overlap-and-add of audio signal portions is performed when the sample-based time-scaling is used;

wherein the jitter buffer control is configured to select a comfort noise insertion or a comfort noise deletion if a previous frame was inactive;

wherein the jitter buffer control is configured to select a time-shifted overlap-and-add of audio signal portions if a previous frame was active;

wherein the jitter buffer control is implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2018
From: REUSCHL, STEFAN; DOEHLA, STEFAN; LECOMTE, JÉRÉMIE; JANDER, MANUEL
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 046343/0104 →
Priority Claims (2)
EP 13173159 · Jun 21, 2013 · regional
EP 14167061 · May 5, 2014 · regional
Continuity (3)
Continuation 14973729 · Dec 18, 2015
Continuation PCTEP2014062789 · Jun 18, 2014
Related Publication 20180190302A1 · Jul 5, 2018