IP Library Granted Patent US 10,636,436
Granted Patent B2
US 10,636,436 · App. 16/047,661 · Granted Apr 28, 2020

Method and device for spectral expansion for an audio signal

Inventors: John Usher (Beer, GB); Dan Ellis (New York, NY)
Assignee: Staton Techiya, LLC
G10L21/038
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,636,436
App. No.
16/047,661
Granted
Apr 28, 2020
Kind
B2
Abstract

A method and device for automatically increasing the spectral bandwidth of an audio signal including generating a “mapping” (or “prediction”) matrix based on the analysis of a reference wideband signal and a reference narrowband signal, the mapping matrix being a transformation matrix to predict high frequency energy from a low frequency energy envelope, generating an energy envelope analysis of an input narrowband audio signal, generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and the envelope analysis, high-pass filtering the resynthesized noise signal, and summing the high-pass filtered resynthesized noise signal with the original an input narrowband audio signal. Other embodiments are disclosed.

Claims (28)

1. A system, comprising:

a processor that performs operations comprising:

generating a mapping matrix based on an analysis of a reference wideband signal and a reference narrowband signal, wherein the mapping matrix is generated without using a linear predictive coefficient (LPC) method, wherein the mapping matrix is generated based on using a dB domain for performing a linear prediction;

generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and an energy envelope analysis of an input narrowband audio signal; and generating an output audio signal by summing a high-pass filtered version of the resynthesized noise signal with the input narrowband audio signal.

2. The system of claim 1 , wherein the operations further comprise generating an audible output using the output audio signal.

3. The system of claim 1 , wherein the operations further comprise performing the energy envelope analysis on the input narrowband audio signal.

4. The system of claim 1 , wherein the operations further comprise conducting high-pass filtering on the resynthesized noise signal to generate the high-pass filtered version of the resynthesized noise signal.

5. The system of claim 1 , wherein the operations further comprise obtaining the input narrowband audio signal from a microphone.

6. The system of claim 1 , wherein the operations further comprise generating the reference wideband signal and the reference narrowband signal from a simultaneous recording of a phonetically balanced sentence made with an ambient microphone located in an earphone and an ear canal microphone located in the earphone.

7. The system of claim 1 , wherein the operations further comprise directing the output audio signal to a speaker as output.

8. The system of claim 1 , wherein the operations further comprise generating the mapping matrix from a least squares fit analysis of the reference wideband signal and the reference narrowband signal.

9. The system of claim 1 , wherein the operations further comprise generating the mapping matrix by utilizing a linear regression model.

10. The system of claim 1 , wherein the mapping matrix comprises a transformation matrix to predict high frequency energy from a lower frequency energy envelope.

11. A method, comprising:

generating, by utilizing a processor, a mapping matrix based on an analysis of a reference wideband signal and a reference narrowband signal, wherein the mapping matrix is generated without using a linear predictive coefficient (LPC) method, wherein the mapping matrix is generated based on using a dB domain for performing a linear prediction;

generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and an energy envelope analysis of an input narrowband audio signal; and generating an output audio signal by summing a high-pass filtered version of the resynthesized noise signal with the input narrowband audio signal.

12. The method of claim 11 , further comprising transmitting the output audio signal to a device.

13. The method of claim 11 , further comprising generating the reference wideband signal and the reference narrowband signal from a recording of a phonetically balanced sentence.

14. The method of claim 11 , further comprising conducting high-pass filtering on the resynthesized noise signal to generate the high-pass filtered version of the resynthesized noise signal.

15. The method of claim 11 , further comprising generating an audible output using the output audio signal.

16. The method of claim 11 , further comprising expanding a spectral bandwidth of a speech signal based on the generating of the mapping matrix, the generating of the resynthesized noise signal, and the generating of the output audio signal.

17. The method of claim 11 , further comprising conducting the energy envelope analysis on the input narrowband audio signal.

18. The method of claim 11 , further comprising generating the mapping matrix by utilizing a linear regression model.

19. A non-transitory computer readable medium containing instructions, the execution of the instructions by a processor of a computer system causing the processor to perform operations comprising:

generating a mapping matrix based on an analysis of a reference wideband signal and a reference narrowband signal, wherein the mapping matrix is generated based on using a dB domain for performing a linear prediction;

generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and an energy envelope analysis of an input narrowband audio signal; and

generating an output audio signal by summing a high-pass filtered version of the resynthesized noise signal with the input narrowband audio signal.

20. The non-transitory computer-readable medium of claim 19 , wherein the operations further comprise conducting high-pass filtering on the resynthesized noise signal to generate the high-pass filtered version of the resynthesized noise signal.

Assignments (6)
MERGER Recorded May 9, 2026
From: ST CASE1TECH, LLC; ST CASESTECH, LLC; ST FAMTECH, LLC; ST R&DTECH, LLC; ST TIPTECH, LLC; ST SEALTECH, LLC; ST BIOTECH, LLC; ST EARTECH, LLC; ST DETECTTECH, LLC; ST VRTECH, LLC; ST AWARETECH, LLC; CASES2TECH, LLC
To: ST PORTFOLIO HOLDINGS, LLC
Reel/Frame 075533/0472 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2024
From: STATON TECHIYA, LLC
To: ST PORTFOLIO HOLDINGS, LLC
Reel/Frame 067806/0722 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2024
From: ST PORTFOLIO HOLDINGS, LLC
To: ST R&DTECH, LLC
Reel/Frame 067806/0751 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2018
From: USHER, JOHN; ELLIS, DAN
To: PERSONICS HOLDINGS, LLC
Reel/Frame 046486/0159 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2018
From: PERSONICS HOLDINGS, INC.; PERSONICS HOLDINGS, LLC
To: DM STATON FAMILY LIMITED PARTNERSHIP
Reel/Frame 046486/0193 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 27, 2018
From: DM STATON FAMILY LIMITED PARTNERSHIP
To: STATON TECHIYA, LLC
Reel/Frame 046486/0241 →