IP Library › Granted Patent US 10,204,640
Granted Patent B2
US 10,204,640 · App. 14/977,507 · Granted Feb 12, 2019

Time scaler, audio decoder, method and a computer program using a quality control

Inventors: Stefan Reuschl (Nuremberg, DE); Stefan Doehla (Erlangen, DE); Jeremie Lecomte (Fuerth, DE); Manuel Jander (Erlangen, DE); Nikolaus Faerber (Erlangen, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
G10L21/04G10L19/022G10L25/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,204,640
App. No.
14/977,507
Granted
Feb 12, 2019
Kind
B2
Abstract

A time scaler for providing a time scaled version of an input audio signal is configured to compute or estimate a quality of a time scaled version of the input audio signal obtainable by a time scaling of the input audio signal. The time scaler is configured to perform the time scaling of the input audio signal in dependence on the computation or estimation of the quality of the time scaled version of the input audio signal obtainable by the time scaling. An audio decoder has such a time scaler.

Claims (36)

1. A time scaler for providing a time scaled version of an input audio signal,

wherein the time scaler comprises a quality determinator block configured to compute or estimate a quality of a time scaled version of the input audio signal acquirable by a time scaling of the input audio signal, and

wherein the time scaler comprises a time scaling performer block configured to perform the time scaling of the input audio signal in dependence on the computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling;

wherein the time scaler is configured to compare a quality value, which is based on a computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling, with a variable threshold value, to decide whether a time scaling should be performed or not;

wherein the time scaler is configured to increase the variable threshold value depending on previous time scaling operations, to thereby increase a quality requirement, in response to the fact that a time scaling has been applied to one or more previous blocks of samples, such that it is ensured that subsequent blocks of samples are only time scaled if a comparatively high quality level, higher than a normal quality level, can be reached,

wherein the time scaler is implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

2. An audio decoder for providing a decoded audio content on the basis of an input audio content, the audio decoder comprising:

a jitter buffer configured to buffer a plurality of audio frames representing blocks of audio samples;

a decoder core configured to provide blocks of audio samples on the basis of audio frames received from the jitter buffer;

a sample-based time scaler according to claim 1 , wherein the sample-based time scaler is configured to provide time-scaled blocks of audio samples on the basis of blocks of audio samples provided by the decoder core.

3. A method for providing a time scaled version of an input audio signal,

wherein the method comprises computing or estimating a quality of a time scaled version of the input audio signal acquirable by a time scaling of the input audio signal, and

wherein the method comprises performing the time scaling of the input audio signal in dependence on the computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling;

wherein the method comprises comparing a quality value, which is based on a computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling, with a variable threshold value, to decide whether a time scaling should be performed or not;

wherein the method comprises increasing the variable threshold value depending on previous time scaling operations, to thereby increase a quality requirement, in response to the fact that a time scaling has been applied to one or more previous blocks of samples such that it is ensured that subsequent blocks of samples are only time scaled if a comparatively high quality level, higher than a normal quality level, can be reached.

4. A non-transitory digital storage medium for performing the method according to claim 3 when the computer program is running on a computer.

5. A time scaler for providing a time scaled version of an input audio signal,

wherein the time scaler is configured to compute or estimate a quality of a time scaled version of the input audio signal acquirable by a time scaling of the input audio signal, and

wherein the time scaler comprises a quality determinator block configured to perform the time scaling of the input audio signal in dependence on the computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling;

wherein the time scaler comprises a time scaling performer block configured to time-shift a second block of samples with respect to a first block of samples, and to overlap-and-add the first block of samples and the time-shifted second block of samples, to thereby acquire the time-scaled version of the input audio signal, if the computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling indicates a quality which is larger than or equal to a quality threshold value; and

wherein the time scaler is configured to determine a time shift of the second block of samples with respect to the first block of samples in dependence on a determination of a level of similarity, evaluated using a first similarity measure, between the first block of samples, or a portion of the first block of samples, and the second block of samples, or a portion of the second block of samples; and

wherein the time scaler is configured to compute or estimate a quality of the time scaled version of the input audio signal acquirable by a time scaling of the input audio signal on the basis of an information about the level of similarity, evaluated using a second similarity measure, between the first block of samples, or a portion of the first block of samples, and the second block of samples, time-shifted by the determined time shift, or a portion of the second block of samples, time-shifted by the determined time shift;

wherein the first similarity measure is a cross correlation or a normalized cross correlation, or an average magnitude difference function or a sum of squared errors, and

wherein the second similarity measure is a combination of a cross correlations or of normalized cross correlations for a plurality of different time shifts; or

wherein the second similarity measure is a combination of cross correlations for at least four different time shifts,

wherein the time scaler is implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

6. A method for providing a time scaled version of an input audio signal,

wherein the method comprises computing or estimating a quality of a time scaled version of the input audio signal acquirable by a time scaling of the input audio signal, and

wherein the method comprises performing the time scaling of the input audio signal in dependence on the computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling;

wherein the method comprises time-shifting a second block of samples with respect to a first block of samples, and to overlap-and-add the first block of samples and the time-shifted second block of samples, to thereby acquire the time-scaled version of the input audio signal, if the computation or estimation of the quality of the time scaled version of the input audio signal acquirable by the time scaling indicates a quality which is larger than or equal to a quality threshold value; and

wherein the method comprises determining a time shift of the second block of samples with respect to the first block of samples in dependence on a determination of a level of similarity, evaluated using a first similarity measure, between the first block of samples, or a portion of the first block of samples, and the second block of samples, or a portion of the second block of samples; and

wherein the method comprises computing or estimating a quality of the time scaled version of the input audio signal acquirable by a time scaling of the input audio signal on the basis of an information about the level of similarity, evaluated using a second similarity measure, between the first block of samples, or a portion of the first block of samples, and the second block of samples, time-shifted by the determined time shift, or a portion of the second block of samples, time-shifted by the determined time shift;

wherein the first similarity measure is a cross correlation or a normalized cross correlation, or an average magnitude difference function or a sum of squared errors, and

wherein the second similarity measure is a combination of a cross correlations or of normalized cross correlations for a plurality of different time shifts; or

wherein the second similarity measure is a combination of cross correlations for at least four different time shifts.

7. A non-transitory digital storage medium for performing the method according to claim 6 when the computer program is running on a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2016
From: REUSCHL, STEFAN; DOEHLA, STEFAN; LECOMTE, JEREMIE; JANDER, MANUEL; FAERBER, NIKOLAUS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 037872/0358 →
Priority Claims (2)
EP 13173159 · Jun 21, 2013 · regional
EP 14167055 · May 5, 2014 · regional
Continuity (2)
Continuation PCTEP2014062833 · Jun 18, 2014
Related Publication 20160171990A1 · Jun 16, 2016