IP Library Granted Patent US 12,236,971
Granted Patent B2
US 12,236,971 · App. 18/096,655 · Granted Feb 25, 2025

Method and device for spectral expansion of an audio signal

Inventors: John Usher (Beer, GB); Dan Ellis (New York City, NY)
Assignee: ST R&DTech LLC
G10L21/0388H04R3/00H04R1/028H04R1/1083H04R5/033H04R2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,971
App. No.
18/096,655
Granted
Feb 25, 2025
Kind
B2
Abstract

A method and device for automatically increasing the spectral bandwidth of an audio signal including generating a “mapping” (or “prediction”) matrix based on the analysis of a reference wideband signal and a reference narrowband signal, the mapping matrix being a transformation matrix to predict high frequency energy from a low frequency energy envelope, generating an energy envelope analysis of an input narrowband audio signal, generating a resynthesized noise signal by processing a random noise signal with the mapping matrix and the envelope analysis, high-pass filtering the resynthesized noise signal, and summing the high-pass filtered resynthesized noise signal with the input narrowband audio signal. Other embodiments are disclosed.

Claims (45)

1. A method comprising:

receiving a command to initiate communication in a noisy environment;

retrieving a wideband reference signal and narrowband reference signal from memory, wherein the narrowband reference signal was generated from an ear canal microphone in a first earpiece, and the wideband reference signal was generated from an ambient sound microphone in the first earpiece, wherein the first earpiece is wirelessly connected to a first communication device;

receiving an ear canal signal from an ear canal microphone in the first earpiece;

generating a modified ear canal signal by spectrally expanding the ear canal signal using the wideband reference signal and the narrowband reference signal; and

sending the modified ear canal signal to a second communication device.

2. The method comprising:

receiving a command to initiate communication in a noisy environment:

retrieving a wideband reference signal and narrowband reference signal from memory, wherein the narrowband reference signal was generated from an ear canal microphone in a first earpiece, and the wideband reference signal was generated from an ambient sound microphone in the first earpiece, wherein the first earpiece is wirelessly connected to a first communication device;

receiving an ear canal signal from an ear canal microphone in the first earpiece;

generating a modified ear canal signal by spectrally expanding the ear canal signal using the wideband reference signal and the narrowband reference signal;

receiving an ambient sound signal from an ambient sound microphone in the first earpiece;

generating a background noise signal from the ambient sound signal;

generating the command to initiate communication with a second communication device when a pressure level of the background noise signal is above a value; and

sending the modified ear canal signal to the second communication device.

3. The method according to claim 2 , wherein the pressure level is an averaged pressure level across frequencies from 50 Hz to 10 kHz.

4. The method according to claim 2 , wherein the wideband reference signal was generated when the pressure level is below the value.

5. The method according to claim 4 , wherein the narrowband reference signal was generated when the pressure level is below the value.

6. The method according to claim 1 , wherein spectrally expanding the ear canal signal is performed by applying a mapping matrix, wherein the mapping matrix is generated using the wideband reference signal and the narrowband reference signal.

7. The method according to claim 6 , wherein the mapping matrix is a transformation matrix to predict high frequency energy from a low frequency energy envelope.

8. The method according to claim 7 further comprising:

generating the low frequency energy envelope from the ear canal signal prior to generating a modified ear canal signal.

9. The method according to claim 1 , wherein the ear canal signal was received from a remote communication device.

10. The method according to claim 1 , wherein the command is initiated from a user interface.

11. A method comprising:

receiving a command to initiate communication in a noisy environment, wherein a first communication device which is connected wirelessly to a first earpiece, generates the command;

receiving from a second communication device, a wideband reference signal and narrowband reference signal, wherein the narrowband reference signal was generated from an ear canal microphone in a second earpiece wirelessly connected to the second communication system, and the wideband reference signal was generated from an ambient sound microphone in the second earpiece;

receiving an ear canal signal from the second communication system;

generating a modified ear canal signal by spectrally expanding the ear canal signal using the wideband reference signal and the narrowband reference signal; and

sending the modified ear canal signal to a speaker of the first earpiece worn by a user.

12. The method according to claim 11 , wherein spectrally expanding the ear canal signal is performed by applying a mapping matrix, wherein the mapping matrix is generated using the wideband reference signal and the narrowband reference signal.

13. The method according to claim 12 , wherein the mapping matrix is a transformation matrix to predict high frequency energy from a low frequency energy envelope.

14. The method according to claim 13 further comprising:

generating the low frequency energy envelope from the ear canal signal prior to generating a modified ear canal signal.

15. The method according to claim 11 , wherein the command is initiated from a user interface.

16. A method comprising:

receiving a command to initiate communication in a noisy environment, wherein a first communication device which is connected wirelessly to a first earpiece, generates the command;

receiving from a second communication device, a wideband reference signal and narrowband reference signal, wherein the narrowband reference signal was generated from an ear canal microphone in a second earpiece wirelessly connected to the second communication system, and the wideband reference signal was generated from an ambient sound microphone in the second earpiece;

receiving an ear canal signal from the second communication system;

generating a modified ear canal signal by spectrally expanding the ear canal signal using the wideband reference signal and the narrowband reference signal;

receiving an ambient sound signal from an ambient sound microphone in an earpiece worn by the user;

generating a background noise signal from the ambient sound signal;

generating the command to initiate communication when a pressure level of the background noise signal is above a value; and

sending the modified ear canal signal to a speaker of the first earpiece worn by a user.

17. The method according to claim 16 , wherein the pressure level is an averaged pressure level across frequencies from 50 Hz to 10 kHz.

Assignments (7)
MERGER Recorded May 9, 2026
From: ST CASE1TECH, LLC; ST CASESTECH, LLC; ST FAMTECH, LLC; ST R&DTECH, LLC; ST TIPTECH, LLC; ST SEALTECH, LLC; ST BIOTECH, LLC; ST EARTECH, LLC; ST DETECTTECH, LLC; ST VRTECH, LLC; ST AWARETECH, LLC; CASES2TECH, LLC
To: ST PORTFOLIO HOLDINGS, LLC
Reel/Frame 075533/0472 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2024
From: STATON TECHIYA, LLC
To: ST PORTFOLIO HOLDINGS, LLC
Reel/Frame 067806/0722 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2024
From: ST PORTFOLIO HOLDINGS, LLC
To: ST R&DTECH, LLC
Reel/Frame 067806/0751 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2023
From: USHER, JOHN; ELLIS, DAN
To: PERSONICS HOLDINGS, INC.
Reel/Frame 062557/0330 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2023
From: DM STATON FAMILY LIMITED PARTNERSHIP
To: STATON TECHIYA, LLC
Reel/Frame 062557/0508 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2023
From: PERSONICS HOLDINGS, INC.
To: PERSONICS HOLDINGS, LLC
Reel/Frame 062557/0388 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2023
From: PERSONICS HOLDINGS, INC.; PERSONICS HOLDINGS, LLC
To: DM STATON FAMILY LIMITED PARTNERSHIP
Reel/Frame 062557/0481 →