IP Library › Granted Patent US 9,997,162
Granted Patent B2
US 9,997,162 · App. 14/659,911 · Granted Jun 12, 2018

Apparatus and method for generating a bandwidth extended signal from a bandwidth limited audio signal

Inventors: Frederik Nagel (Nernberg, DE); Stephan Wilde (Nuernberg, DE)
Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
G10L19/00G10L19/008G10L19/025G10L21/038G10L19/0208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,997,162
App. No.
14/659,911
Granted
Jun 12, 2018
Kind
B2
Abstract

An apparatus for generating a bandwidth extended signal from a bandwidth limited audio signal, the bandwidth limited audio signal The patch generator is configured to perform a harmonic patching algorithm to obtain the patched signal. The signal manipulator is configured for manipulating a signal before patching or the patched signal. The timely preceding bandwidth limited time block timely precedes the current bandwidth limited time block in the plurality of consecutive bandwidth limited time blocks of the bandwidth limited audio signal. The combiner is configured for combining the bandwidth limited audio signal having the core frequency band and the manipulated patched signal having the upper frequency band to obtain the bandwidth extended signal.

Claims (65)

1. An apparatus for generating a bandwidth extended signal from a bandwidth limited audio signal, the bandwidth limited audio signal comprising a plurality of consecutive bandwidth limited time blocks, each bandwidth limited time block comprising at least one associated spectral band replication parameter comprising a core frequency band and the bandwidth extended signal comprising a plurality of consecutive bandwidth extended time blocks, the apparatus comprising:

a patch generator for generating a patched signal comprising an upper frequency band using a bandwidth limited time block of the bandwidth limited audio signal;

wherein the patch generator is configured to perform a harmonic patching algorithm to acquire the patched signal;

wherein the patch generator is configured to perform the harmonic patching algorithm for a current bandwidth extended time block of the plurality of consecutive bandwidth extended time blocks using a timely preceding bandwidth limited time block of the plurality of consecutive bandwidth limited time blocks of the bandwidth limited audio signal;

a signal manipulator for manipulating a signal before patching or the patched signal generated using the timely preceding bandwidth limited time block using a spectral band replication parameter associated with a current bandwidth limited time block to acquire a manipulated patched signal comprising the upper frequency band;

wherein the timely preceding bandwidth limited time block timely precedes the current bandwidth limited time block in the plurality of consecutive bandwidth limited time blocks of the bandwidth limited audio signal; and

a combiner for combining the bandwidth limited audio signal comprising the core frequency band and the manipulated patched signal comprising the upper frequency band to acquire the bandwidth extended signal,

wherein at least one of the patch generator and the signal manipulator and the combiner is implemented using a hardware apparatus, a computer or a combination of a hardware apparatus and a computer.

2. The apparatus in accordance with claim 1 ,

wherein the patch generator is configured for performing the harmonic patching algorithm using an overlap add processing between at least two bandwidth limited time blocks.

3. The apparatus in accordance with claim 1 ,

wherein the patch generator is configured for applying the harmonic patching algorithm to the timely preceding bandwidth limited time block using a bandwidth extension factor of two;

wherein the patch generator is configured for generating from the core frequency band of the timely preceding bandwidth limited time block a first target frequency band of the current bandwidth extended time block; and

wherein the patch generator is configured for applying a copy-up patching algorithm for copying up the first target frequency band of the current bandwidth extended time block generated from the core frequency band of the timely preceding bandwidth limited time block to a second target frequency band of the current bandwidth extended time block.

4. The apparatus in accordance with claim 1 ,

wherein the patch generator is configured for applying the harmonic patching algorithm to the timely preceding bandwidth limited time block using a bandwidth extension factor of two;

wherein the patch generator is configured for generating from the core frequency band of the timely preceding bandwidth limited time block a first target frequency band of the current bandwidth extended time block;

wherein the patch generator is configured for applying the harmonic patching algorithm to the timely preceding bandwidth limited time block using a bandwidth extension factor of three; and

wherein the patch generator is configured for generating from the core frequency band of the timely preceding bandwidth limited time block a second target frequency band of the current bandwidth extended time block.

5. The apparatus in accordance with claim 1 ,

wherein the patch generator is configured for continuously applying the harmonic patching algorithm to each bandwidth limited time block of the bandwidth limited audio signal.

6. The apparatus in accordance with claim 1 , further comprising:

a provider for providing a patching algorithm information;

wherein the patch generator is configured for performing a copy-up patching algorithm for a timely preceding bandwidth extended time block using the timely preceding bandwidth limited time block or a timely succeeding bandwidth limited time block for a timely succeeding bandwidth extended time block, the timely succeeding bandwidth limited time block timely succeeding the current bandwidth limited time block;

wherein the patch generator is configured for using the patched signal for the current bandwidth extended time block generated from the harmonic patching algorithm in response to the patching algorithm information.

7. The apparatus in accordance with claim 6 ,

wherein the provider is configured for providing the patching algorithm information using a side information encoded within the bandwidth limited audio signal.

8. The apparatus in accordance with claim 6 , wherein the provider is configured for providing the patching algorithm information in dependence on a signal analysis of the bandwidth limited audio signal.

9. The apparatus in accordance with claim 7 ,

wherein the provider is configured for determining a transient flag for each bandwidth limited time block of the bandwidth limited audio signal;

wherein the patch generator is configured for using the patched signal for the current bandwidth extended time block generated from the harmonic patching algorithm when a stationarity of the bandwidth limited audio signal is indicated by the transient flag; and

wherein the patch generator is configured for using the patched signal generated from the copy-up patching algorithm when a non-stationarity of the bandwidth limited audio signal is indicated by the transient flag.

10. The apparatus in accordance with claim 1 ,

wherein the patch generator is configured for performing the harmonic patching algorithm comprising a first time delay between the timely preceding bandwidth limited time block and the current bandwidth extended time block;

wherein the patch generator is configured for performing a copy-up patching algorithm using the current bandwidth limited time block, the copy-up patching algorithm comprising a second time delay;

wherein the first time delay of the harmonic patching algorithm is larger than the second time delay of the copy-up patching algorithm.

11. The apparatus in accordance with claim 10 ,

wherein the patch generator comprises a phase vocoder for performing the harmonic patching algorithm comprising the first time delay; and

wherein the phase vocoder is configured for using an overlap add processing between at least two bandwidth limited time blocks.

12. The apparatus in accordance with claim 1 , further comprising:

a transient detector for detecting a transient event in the bandwidth limited audio signal;

wherein the patch generator is configured for performing a copy-up patching algorithm when the transient event is detected in the bandwidth limited audio signal; and

wherein the patch generator is configured for not performing the harmonic patching algorithm using an overlap add processing between at least two bandwidth limited time blocks when the transient event is detected in the bandwidth limited audio signal.

13. The apparatus in accordance with claim 1 ,

wherein the patch generator is configured for performing a copy-up patching algorithm; and

wherein the patch generator is configured for performing a phase continuation between the current bandwidth extended time block generated from the harmonic patching algorithm and a timely preceding bandwidth extended time block or a timely succeeding bandwidth extended time block generated from the copy-up patching algorithm, the timely preceding bandwidth extended time block timely preceding the current bandwidth extended time block and the timely succeeding bandwidth extended time block timely succeeding the current bandwidth extended time block.

14. The apparatus in accordance with claim 1 ,

wherein the patch generator is configured for performing a copy-up patching algorithm;

wherein the patch generator is configured for performing a cross-fade operation between the current bandwidth extended time block generated from the harmonic patching algorithm and a timely preceding bandwidth extended time block or a timely succeeding bandwidth extended time block generated from the copy-up patching algorithm, the timely preceding bandwidth extended time block timely preceding the current bandwidth extended time block and the timely succeeding bandwidth extended time block timely succeeding the current bandwidth extended time block, and

wherein the current bandwidth extended time block and the timely preceding bandwidth extended time block or the timely succeeding bandwidth extended time block at least partially overlap in a transition region of same.

15. A method for generating a bandwidth extended signal from a bandwidth limited audio signal, the bandwidth limited audio signal comprising a plurality of consecutive bandwidth limited time blocks, each bandwidth limited time block comprising at least one associated spectral band replication parameter comprising a core frequency band and the bandwidth extended signal comprising a plurality of consecutive bandwidth extended time blocks, the method comprising;

generating a patched signal comprising an upper frequency band using a bandwidth limited time block of the bandwidth limited audio signal;

performing a harmonic patching algorithm to acquire the patched signal;

performing the harmonic patching algorithm for a current bandwidth extended time block of the plurality of consecutive bandwidth extended time blocks using a timely preceding bandwidth limited time block of the plurality of consecutive bandwidth limited time blocks of the bandwidth limited audio signal;

manipulating a signal before patching or the patched signal generated using the timely preceding bandwidth limited time block using a spectral band replication parameter associated with a current bandwidth limited time block to acquire a manipulated patched signal comprising the upper frequency band;

wherein the timely preceding bandwidth limited time block timely precedes the current bandwidth limited time block in the plurality of consecutive bandwidth limited time blocks of the bandwidth limited audio signal; and

combining the bandwidth limited audio signal comprising the core frequency band and the manipulated patched signal comprising the upper frequency band to acquire the bandwidth extended signal,

wherein the method is performed using a hardware apparatus, a computer or a combination of a hardware apparatus and a computer.

16. A non-transitory computer-readable medium comprising a computer program comprising a program code for performing a method for generating a bandwidth extended signal from a bandwidth limited audio signal, when the computer program is executed on a computer, wherein the bandwidth limited audio signal comprises a plurality of consecutive bandwidth limited time blocks, each bandwidth limited time block comprising at least one associated spectral band replication parameter comprising a core frequency band and the bandwidth extended signal comprising a plurality of consecutive bandwidth extended time blocks, wherein the method comprises:

generating a patched signal comprising an upper frequency band using a bandwidth limited time block of the bandwidth limited audio signal;

performing a harmonic patching algorithm to acquire the patched signal;

performing the harmonic patching algorithm for a current bandwidth extended time block of the plurality of consecutive bandwidth extended time blocks using a timely preceding bandwidth limited time block of the plurality of consecutive bandwidth limited time blocks of the bandwidth limited audio signal;

manipulating a signal before patching or the patched signal generated using the timely preceding bandwidth limited time block using a spectral band replication parameter associated with a current bandwidth limited time block to acquire a manipulated patched signal comprising the upper frequency band;

herein the timely preceding bandwidth limited time block timely precedes the current bandwidth limited time block in the plurality of consecutive bandwidth limited time blocks of the bandwidth limited audio signal; and

combining the bandwidth limited audio signal comprising the core frequency band and the manipulated patched signal comprising the upper frequency band to acquire the bandwidth extended signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2015
From: NAGEL, FREDERIK; WILDE, STEPHAN
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 036160/0183 →
Priority Claims (1)
EP 12184706 · Sep 17, 2012 · regional
Continuity (2)
Continuation PCTEP2013068808 · Sep 11, 2013
Related Publication 20150187360A1 · Jul 2, 2015