IP Library Granted Patent US 9,570,085
Granted Patent B2
US 9,570,085 · App. 14/682,015 · Granted Feb 14, 2017

Apparatus and method for efficient synthesis of sinusoids and sweeps by employing spectral patterns

Inventors: Sascha Disch (Fuerth, DE); Benjamin Schubert (Nuremberg, DE); Ralf Geiger (Erlangen, DE); Bernd Edler (Fuerth, DE); Martin Dietz (Nuremberg, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
G10L19/02G10L19/032G10L19/0212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,570,085
App. No.
14/682,015
Granted
Feb 14, 2017
Kind
B2
Abstract

An apparatus for generating an audio output signal based on an encoded audio signal spectrum is provided. The apparatus has a processing unit for processing the encoded audio signal spectrum to obtain a decoded audio signal spectrum having a plurality of spectral coefficients, wherein each of the spectral coefficients has a spectral location within the encoded audio signal spectrum and a spectral value. Moreover, the apparatus has a pseudo coefficients determiner for determining one or more pseudo coefficients. Furthermore, the apparatus has a replacement unit for replacing at least one or more pseudo coefficients by a determined spectral pattern to obtain a modified audio signal spectrum, wherein each of at least two pattern coefficients has a spectral value. Moreover, the apparatus has a spectrum-time-conversion unit for converting the modified audio signal spectrum to a time-domain.

Claims (87)

1. An apparatus for generating an audio output signal based on an encoded audio signal spectrum, wherein the apparatus comprises:

a processing unit for processing the encoded audio signal spectrum to acquire a decoded audio signal spectrum comprising a plurality of spectral coefficients, wherein each of the spectral coefficients comprises a spectral location within the encoded audio signal spectrum and a spectral value, wherein the spectral coefficients are sequentially ordered according to their spectral location within the encoded audio signal spectrum so that the spectral coefficients form a sequence of spectral coefficients,

a pseudo coefficients determiner for determining one or more pseudo coefficients of the decoded audio signal spectrum, wherein each of the pseudo coefficients is one of the spectral coefficients,

a replacement unit for replacing at least one or more pseudo coefficients by a determined spectral pattern to acquire a modified audio signal spectrum, wherein the determined spectral pattern comprises at least two pattern coefficients, wherein each of the at least two pattern coefficients comprises a spectral value, and

a spectrum-time-conversion unit for converting the modified audio signal spectrum to a time-domain to acquire the audio output signal.

2. The apparatus according to claim 1 ,

wherein the apparatus furthermore comprises a storage unit comprising a database or a memory having stored within the database or within the memory a plurality of stored spectral patterns, wherein each of the stored spectral patterns comprises a spectral property,

wherein the replacement unit is configured to request one of the stored spectral patterns from the storage unit as a requested spectral pattern,

wherein the storage unit is configured to provide the requested spectral pattern, and

wherein the replacement unit is configured to replace the at least one or more pseudo coefficients by the determined spectral pattern based on the requested spectral pattern.

3. The apparatus according to claim 2 , wherein the replacement unit is configured to request said one of the stored spectral patterns from the storage unit depending on a first derived spectral location derived from at least one of the one or more pseudo coefficients determined by the pseudo coefficients determiner.

4. The apparatus according to claim 3 ,

wherein the one or more pseudo coefficients are signed values, each comprising a sign component, and

wherein the replacement unit is configured to determine the first derived spectral location based on the spectral location of one pseudo coefficient of the one or more pseudo coefficients and based on the sign component of said pseudo coefficient, so that the first derived spectral location is equal to the spectral location of said pseudo coefficient when the sign component comprises a first sign value, and so that the first derived spectral location is equal to a modified location, the modified location resulting from shifting the spectral location of said pseudo coefficient by a predefined value when the sign component comprises a different second value.

5. The apparatus according to claim 3 ,

wherein the plurality of stored spectral patterns being stored within the database or the memory of the storage unit are either stationary tone patterns or frequency sweep patterns,

wherein the pseudo coefficients determiner is configured to determine two or more temporally consecutive pseudo coefficients of the decoded audio signal spectrum,

wherein the replacement unit is configured to assign a first pseudo coefficient and a second pseudo coefficient of the two or more temporally consecutive pseudo coefficients to a track depending on whether an absolute difference between the first derived spectral location derived from the first pseudo coefficient and a second derived spectral location derived from the second pseudo coefficient is smaller than a threshold value, and

wherein the replacement unit is configured to request one of the stationary tone patterns from the storage unit when the first derived spectral location derived from the first pseudo coefficient of the track is equal to the second derived spectral location derived from the second pseudo coefficient of the track, and wherein the replacement unit is configured to request one of the frequency sweep patterns from the storage unit when the first derived spectral location derived from the first pseudo coefficient of the track is different from the second derived spectral location derived from the second pseudo coefficient of the track.

6. The apparatus according to claim 5 ,

wherein the replacement unit is configured to request a first frequency sweep pattern of the frequency sweep patterns from the storage unit when a frequency difference between the second derived spectral location derived from the second pseudo coefficient of the track and the first derived spectral location derived from the first pseudo coefficient of the track is equal to half of a predefined value,

wherein the replacement unit is configured to request a second frequency sweep pattern, being different from the first frequency sweep pattern, of the frequency sweep patterns from the storage unit when the frequency difference between the second derived spectral location derived from the second pseudo coefficient of the track and the first derived spectral location derived from the first pseudo coefficient of the track is equal to the predefined value, and

wherein the replacement unit is configured to request a third frequency sweep pattern, being different from the first sweep pattern and the second frequency sweep pattern, of the frequency sweep patterns from the storage unit when the frequency difference between the second derived spectral location derived from the second pseudo coefficient of the track and the first derived spectral location derived from the first pseudo coefficient of the track is equal to one and a half times the predefined value.

7. The apparatus according to claim 2 , wherein the replacement unit comprises a pattern adaptation unit being configured to modify the requested spectral pattern provided by the storage unit to acquire the determined spectral pattern.

8. The apparatus according to claim 7 , wherein the pattern adaptation unit is configured to modify the requested spectral pattern provided by the storage unit by rescaling the spectral values of the pattern coefficients of the requested spectral pattern depending on the spectral value of one of the one or more pseudo coefficients.

9. The apparatus according to claim 7 , wherein the pattern adaptation unit is configured to modify the requested spectral pattern provided by the storage unit depending on a start phase so that the spectral value of each of the pattern coefficients of the requested spectral pattern is modified in a first way, when the start phase comprises a first start phase value, and so that the spectral value of each of the pattern coefficients of the requested spectral pattern is modified in a different second way, when the start phase comprises a different second start phase value.

10. The apparatus according to claim 7 ,

wherein the spectral value of each of the pattern coefficients of the requested spectral pattern is a complex coefficient comprising a real part and an imaginary part, and

wherein the pattern adaptation unit is configured to modify the requested spectral pattern by modifying the real part and the imaginary part of each of the pattern coefficients of the requested spectral pattern provided by the storage unit by applying a complex rotation factor e j·φ , wherein φ is an angle value.

11. The apparatus according to claim 7 ,

wherein the spectral value of each of the pattern coefficients of the requested spectral pattern is a complex coefficient comprising a real part and an imaginary part, and

wherein the pattern adaptation unit is configured to modify the requested spectral pattern provided by the storage unit by negating the real and the imaginary part of the spectral value of each of the pattern coefficients of the requested spectral pattern, or by swapping the real part or a negated real part and the imaginary part or a negated imaginary part of the spectral value of each of the pattern coefficients of the requested spectral pattern.

12. The apparatus according to claim 7 , wherein the pattern adaptation unit is configured to modify the requested spectral pattern provided by the storage unit by realizing a temporal mirroring of the pattern by computing the complex conjugate of the pattern and applying a complex phase term.

13. The apparatus according to claim 7 ,

wherein the decoded audio signal spectrum is represented in an MDCT domain,

wherein the pattern adaptation unit is configured to modify the requested spectral pattern provided by the storage unit by modifying the spectral values of the pattern coefficients of the requested spectral pattern to acquire a modified spectral pattern, wherein the spectral values are represented in an Oddly-Stacked Discrete Fourier Transform domain,

wherein the pattern adaptation unit is configured to transform the spectral values of the pattern coefficients of the modified spectral pattern from the Oddly-Stacked Discrete Fourier Transform domain to the MDCT domain to acquire the determined spectral pattern, and

wherein the replacement unit is configured to replace the at least one or more pseudo coefficients by the determined spectral pattern being represented in the MDCT domain to acquire the modified audio signal spectrum being represented in the MDCT domain.

14. An apparatus for generating a plurality of spectral patterns, comprising:

a signal generator for generating a plurality of signals in a first domain,

a signal transformation unit for transforming each signal of the plurality of signals from the first domain to a second domain to acquire a plurality of spectral patterns, each pattern of the plurality of transformed spectral patterns comprising a plurality of coefficients,

a postprocessing unit for truncating the transformed spectral patterns by removing one or more of the coefficients of the transformed spectral patterns to acquire a plurality of processed patterns, and

a storage unit comprising a database or a memory, wherein the storage unit is configured to store each processed pattern of the plurality of processed patterns in the database or the memory,

wherein the signal generator is configured to generate each signal of the plurality of signals based on the formulae

x ( t )=cos(2πφ( t ))

and

φ( t )=φ(0)+∫ 0 t 2π f (τ) dτ,

wherein t and τ indicate time,

wherein φ(t) is an instantaneous phase at t, and

wherein f(τ) is an instantaneous frequency at τ,

wherein each signal of the plurality of signals comprises a start frequency, being an instantaneous frequency of said signal at a first point-in-time, and a target frequency, being an instantaneous frequency of said signal at a different second point-in-time,

wherein the signal generator is configured to generate a first signal of the plurality of signals so that the target frequency of the first signal is equal to the start frequency, and

wherein the signal generator is configured to generate a different second signal of the plurality of signals so that the target frequency of the first signal is different from the start frequency.

15. The apparatus according to claim 14 ,

wherein the signal transformation unit is configured to transform each signal of the plurality of signals from the first domain, being a time domain, to a second domain, being a spectral domain,

wherein the signal transformation unit is configured to generate a first one of a plurality of time blocks for transforming said signal,

wherein each time block of the plurality of time blocks comprises a plurality of weighted samples, wherein each of said weighted samples is a signal sample of said signal being weighted by a weight of a plurality of weights, wherein the plurality of weights are assigned to said time block, and wherein each weight of the plurality of weights is assigned to a point-in-time,

wherein the start frequency of each signal of the plurality of signals is an instantaneous frequency of said signal at the first point-in-time, where a first one of the weights of the first one of the time blocks is assigned to the first point-in-time, where a second one of the weights of a different second one of the time blocks is assigned to the first point-in-time, wherein the first one of the time blocks and the second one of the time blocks overlap, and wherein the first one of the weights is equal to the second one of the weights, and

wherein the target frequency of each signal of the plurality of signals is an instantaneous frequency of said signal at the second point-in-time, where a third one of the weights of the first one of the time blocks is assigned to the second point-in-time, where a fourth one of the weights of a different third one of the time blocks, is assigned to the second point-in-time, wherein the first one of the time blocks and the third one of the time blocks overlap, and wherein the third one of the weights is equal to the fourth one of the weights.

16. The apparatus according to claim 14 ,

wherein each signal of the plurality of signals comprises a start phase, being a phase of said signal at a first point-in-time,

wherein the signal generator is configured to generate the plurality of signals such that the start phase of a first one of the plurality signals is equal to the start phase of a different second one of the plurality of the signals.

17. The apparatus according to claim 14 , wherein the postprocessing unit is furthermore configured to conduct a rotation by an arbitrary phase angle on the spectral coefficients of each of the transformed spectral patterns to acquire a plurality of arbitrarily rotated spectral patterns.

18. The apparatus according to claim 14 , wherein the postprocessing unit is furthermore configured to conduct a rotation by π/4 on the spectral coefficients of each of the transformed spectral patterns to acquire a plurality of rotated spectral patterns.

19. The apparatus according to claim 14 , wherein the signal generator is configured to generate the first signal, the second signal and one or more further signals as the plurality of signals, so that each difference of the target frequency and the start frequency of each of the further signals is an integer multiple of a difference of the target frequency and the start frequency of the second signal.

20. A method for generating an audio output signal based on an encoded audio signal spectrum, wherein the method comprises:

processing the encoded audio signal spectrum to acquire a decoded audio signal spectrum comprising a plurality of spectral coefficients, wherein each of the spectral coefficients comprises a spectral location within the encoded audio signal spectrum and a spectral value, wherein the spectral coefficients are sequentially ordered according to their spectral location within the encoded audio signal spectrum so that the spectral coefficients form a sequence of spectral coefficients,

determining one or more pseudo coefficients of the decoded audio signal spectrum, wherein each of the pseudo coefficients is one of the spectral coefficients,

replacing at least one or more pseudo coefficients by a determined spectral pattern to acquire a modified audio signal spectrum, wherein the determined spectral pattern comprises at least two pattern coefficients, wherein each of the at least two pattern coefficients comprises a spectral value, and

converting the modified audio signal spectrum to a time-domain to acquire the audio output signal.

21. A method for generating a plurality of spectral patterns, comprising:

generating a plurality of signals in a first domain,

transforming each signal of the plurality of signals from the first domain to a second domain to acquire a plurality of spectral patterns, each pattern of the plurality of transformed spectral patterns comprising a plurality of coefficients,

truncating the transformed spectral patterns by removing one or more of the coefficients of the transformed spectral patterns to acquire a plurality of processed patterns, and

storing each processed pattern of the plurality of processed patterns in a database or a memory,

wherein generating each signal of the plurality of signals is conducted based on the formulae

x ( t )=cos(2πφ( t ))

and

φ( t )=φ(0)+∫ 0 t 2π f (τ) dτ,

wherein t and τ indicate time,

wherein φ(t) is an instantaneous phase at t, and

wherein f(τ) is an instantaneous frequency at τ,

wherein each signal of the plurality of signals comprises a start frequency, being an instantaneous frequency of said signal at a first point-in-time, and a target frequency, being an instantaneous frequency of said signal at a different second point-in-time,

wherein generating the plurality of signals is conducted by generating a first signal of the plurality of signals so that the target frequency of the first signal is equal to the start frequency, and

wherein generating the plurality of signals is conducted by generating a different second signal of the plurality of signals so that the target frequency of the first signal is different from the start frequency.

22. A non-transitory computer readable medium having stored thereon a computer program for implementing the method of claim 20 when being executed on a computer or signal processor.

23. A non-transitory computer readable medium having stored thereon a computer program for implementing the method of claim 21 when being executed on a computer or signal processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2015
From: DISCH, SASCHA; SCHUBERT, BENJAMIN; GEIGER, RALF; EDLER, BERND; DIETZ, MARTIN
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 036241/0739 →
Priority Claims (1)
EP 12199266 · Dec 21, 2012 · regional
Continuity (3)
Continuation PCTEP2013069592 · Sep 20, 2013
Provisional Application 61712013 · Oct 10, 2012
Related Publication 20150213808A1 · Jul 30, 2015