IP Library Granted Patent US 11,665,495
Granted Patent B2
US 11,665,495 · App. 17/480,100 · Granted May 30, 2023

Methods, systems, apparatuses, and devices for facilitating enhanced perception of ambiance soundstage and imaging in headphones and comprehensive linearization of in-ear monitors

Inventor: Nicolas John Gault (St Augustine, FL)
H04S1/005H04R3/04H04R29/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,665,495
App. No.
17/480,100
Granted
May 30, 2023
Kind
B2
Abstract

A method and system for facilitating enhanced perception of ambiance soundstage and imaging as well as frequency and phase response linearization in audio devices is provided. The method includes receiving measurement data from an omnidirectional microphone and linearizing the data, both in the amplitude and time domains, using digital signal processing. The method also includes a crossfeed algorithm designed to emulate sound propagation from speakers.

Claims (84)

1. A method for facilitating enhanced perception of ambiance, soundstage, and imaging in audio devices, the method comprising:

receiving, using a communication device, a right channel measurement data of a right audio device driver associated with a right channel of an audio device and a left channel measurement data of a left audio device driver associated with a left channel of the audio device from a microphone, wherein the audio device comprises a headphone;

duplicating, using a processing device, the right channel measurement data and the left channel measurement data;

generating, using the processing device, a duplicate right channel measurement data for the right channel measurement data and a duplicate left channel measurement data for the left channel measurement data based on the duplicating;

applying, using the processing device, an inversion function to the duplicate right channel measurement data and the duplicate left channel measurement data based on the generating of the duplicate right channel measurement data and the duplicate left channel measurement data;

generating, using the processing device, a duplicate right inverted impulse data for the duplicate right channel measurement data and a duplicate left inverted impulse data for the duplicate left channel measurement data based on the applying;

convolving, using the processing device, the right channel measurement data with the duplicate right inverted impulse data and the left channel measurement data with the duplicate left inverted impulse data based on the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data;

generating, using the processing device, a right impulse data for the right audio device driver and a left impulse data for the left audio device driver based on the convolving;

analyzing, using the processing device, the right impulse data and the left impulse data based on the generating of the right impulse data and the left impulse data;

generating, using the processing device, a corrective signal data for at least one of the right audio device driver and the left audio device driver for linearizing the audio device in amplitude and time domains based on the analyzing, wherein at least one of the right audio device driver and the left audio device driver is operated based on the corrective signal data; and

storing, using a storage device, the corrective signal data.

2. The method of claim 1 , wherein the applying comprises applying a phase reversion function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the duplicate right inverted impulse data comprises a duplicate right phase reversed impulse data and the duplicate left inverted impulse data comprises a duplicate left phase reversed impulse data, wherein the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data comprises generating the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data based on the applying of the phase reversion function, wherein the convolving comprises convolving the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data based on the generating of the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data, wherein the right impulse data comprises a right amplitude impulse data and the left impulse data comprises a left amplitude impulse data, wherein the generating of the right impulse data and the left impulse data comprises generating the right amplitude impulse data and the left amplitude impulse data based on the convolving of the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data.

3. The method of claim 2 , wherein the right amplitude impulse data and the left amplitude impulse data comprises at least one information associated with an amplitude domain, wherein the analyzing of the right impulse data and the left impulse data comprises applying an amplitude difference function to the right amplitude impulse data and the left amplitude impulse data, wherein the right amplitude impulse data is subtracted from the left amplitude impulse data based on the applying of the amplitude difference function, wherein the corrective signal data comprises a frequency matching impulse data, wherein the generating of the corrective signal data comprises generating the frequency matching impulse data based on the applying of the amplitude difference function.

4. The method of claim 1 , wherein the applying comprises applying an inverse amplitude function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the duplicate right inverted impulse data comprises a duplicate right amplitude inverted impulse data and the duplicate left inverted impulse data comprises a duplicate left amplitude inverted impulse data, wherein the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data comprises generating the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data based on the applying of the inverse amplitude function, wherein the convolving comprises convolving the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data based on the generating of the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data, wherein the right impulse data comprises a right phase impulse data and the left impulse data comprises a left phase impulse data, wherein the generating of the right impulse data and the left impulse data comprises generating the right phase impulse data and the left phase impulse data based on the convolving of the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data.

5. The method of claim 4 , wherein the right phase impulse data and the left phase impulse data comprises at least one information associated with a phase domain, wherein the analyzing of the right impulse data and the left impulse data comprises applying a phase reversion function to the right phase impulse data and the left phase impulse data, wherein the corrective signal data comprises a phase matching impulse data, wherein the generating of the corrective signal data comprises generating of the phase matching impulse data based on the applying of the phase reversion function.

6. The method of claim 1 , wherein the applying comprises:

applying a phase reversion function to the duplicate right channel measurement data and the duplicate left channel measurement data; and

applying an inverse amplitude function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the duplicate right inverted impulse data comprises a duplicate right phase reversed impulse data and a duplicate right amplitude inverted impulse data and the duplicate left inverted impulse data comprises a duplicate left phase reversed impulse data and a duplicate left amplitude inverted impulse data, wherein the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data comprises:

generating the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data based on the applying of the phase reversion function to the duplicate right channel measurement data and the duplicate left channel measurement data; and

generating the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data based on the applying of the inverse amplitude function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the convolving comprises:

convolving the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data based on the generating of the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data; and

convolving the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data based on the generating of the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data, wherein the right impulse data comprises a right amplitude impulse data and a right phase impulse data, wherein the left impulse data comprises a left amplitude impulse data and a left phase impulse data, wherein the generating of the right impulse data and the left impulse data comprises:

generating the right amplitude impulse data and the left amplitude impulse data based on the convolving of the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data; and

generating the right phase impulse data and the left phase impulse data based on the convolving of the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data.

7. The method of claim 6 , wherein the right amplitude impulse data and the left amplitude impulse data comprises at least one information associated with an amplitude domain, wherein the right phase impulse data and the left phase impulse data comprises at least one information associated with a phase domain, wherein the analyzing of the right impulse data and the left impulse data comprises:

applying an amplitude difference function to the right amplitude impulse data and the left amplitude impulse data, wherein the right amplitude impulse data is subtracted from the left amplitude impulse data based on the applying of the amplitude difference function;

applying a phase reversion function to the right phase impulse data and the left phase impulse data, wherein the corrective signal data comprises a frequency matching impulse data and a phase matching impulse data, wherein the generating of the corrective signal data comprises:

generating the frequency matching impulse data based on the applying of the amplitude difference function; and

generating of the phase matching impulse data based on the applying of the phase reversion function, wherein the storing of the corrective signal data comprises storing the frequency matching impulse data and the phase matching impulse data.

8. The method of claim 7 , wherein the frequency matching impulse data comprises a right channel frequency matching impulse data for the right audio device driver and a left channel frequency matching impulse data for the left audio device driver, wherein the phase matching impulse data comprises a right channel phase matching impulse data for the right audio device driver and a left channel phase matching impulse data for the left audio device driver, wherein the method further comprises:

convolving, using the processing device, the right channel frequency matching impulse data and the right channel phase matching impulse data;

generating, using the processing device, a right mono impulse data based on the convolving of the right channel frequency matching impulse data and the right channel phase matching impulse data;

convolving, using the processing device, the left channel frequency matching impulse data and the left channel phase matching impulse data;

generating, using the processing device, a left mono impulse data based on the convolving of the left channel frequency matching impulse data and the left channel phase matching impulse data;

generating, using the processing device, a stereo impulse data for the linearizing of the audio device in frequency, amplitude, and time domains based on the left mono impulse data and the right mono impulse data, wherein the audio device is operated based on the stereo impulse data; and

storing, using the storage device, the stereo impulse data.

9. The method of claim 1 further comprising:

receiving, using the communication device, a left channel audio signal data associated with the left channel and a right channel audio signal data associated with the right channel from an audio signal source device;

analyzing, using the processing device, the left channel audio signal data and the right channel audio signal data, wherein the analyzing comprises delaying a left channel audio signal associated with the left channel audio signal data and a right channel audio signal associated with the right channel audio signal data by a time delay;

generating, using the processing device, a delayed left channel audio signal data and a delayed right channel audio signal data based on the analyzing of the left channel audio signal data and the right channel audio signal data;

generating, using the processing device, a combined left channel audio signal data for the left channel by combining a delayed right channel audio signal associated with the delayed right channel audio signal data with the left channel audio signal and a combined right channel audio signal data for the right channel by combining a delayed left channel audio signal associated with the delayed left channel audio data with the right channel audio signal, wherein the corrective signal data comprises an output left channel audio signal data and an output right channel audio signal data, wherein the generating of the corrective signal data comprises generating the output left channel audio signal data for the left channel and the output right channel audio signal data by attenuating a combined left channel audio signal associated with the combined left channel audio signal data and a combined right channel audio signal associated with the combined right channel audio signal data using a 24 dB/Octave low pass linear phase finite impulse response (FIR) filter; and

transmitting, using the communication device, the output left channel audio signal data to the left audio device driver and the output right channel audio signal data to the right audio device driver, wherein the left audio device driver is operated based on the output left channel audio signal data and the right audio device driver is operated based on the left audio device driver.

10. A system for facilitating enhanced perception of ambiance, soundstage, and imaging in audio devices, the system comprising:

a communication device configured for receiving a right channel measurement data of a right audio device driver associated with a right channel of an audio device and a left channel measurement data of a left audio device driver associated with a left channel of the audio device from a microphone, wherein the audio device comprises a headphone;

a processing device communicatively coupled with the communication device, wherein the processing device is configured for:

duplicating the right channel measurement data and the left channel measurement data;

generating a duplicate right channel measurement data for the right channel measurement data and a duplicate left channel measurement data for the left channel measurement data based on the duplicating;

applying an inversion function to the duplicate right channel measurement data and the duplicate left channel measurement data based on the generating of the duplicate right channel measurement data and the duplicate left channel measurement data;

generating a duplicate right inverted impulse data for the duplicate right channel measurement data and a duplicate left inverted impulse data for the duplicate left channel measurement data based on the applying;

convolving the right channel measurement data with the duplicate right inverted impulse data and the left channel measurement data with the duplicate left inverted impulse data based on the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data;

generating a right impulse data for the right audio device driver and a left impulse data for the left audio device driver based on the convolving;

analyzing the right impulse data and the left impulse data based on the generating of the right impulse data and the left impulse data; and

generating a corrective signal data for at least one of the right audio device driver and the left audio device driver for linearizing the audio device in amplitude and time domains based on the analyzing, wherein at least one of the right audio device driver and the left audio device driver is operated based on the corrective signal data; and

a storage device communicatively coupled with the processing device, wherein the storage device is configured for storing the corrective signal data.

11. The system of claim 10 , wherein the applying comprises applying a phase reversion function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the duplicate right inverted impulse data comprises a duplicate right phase reversed impulse data and the duplicate left inverted impulse data comprises a duplicate left phase reversed impulse data, wherein the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data comprises generating the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data based on the applying of the phase reversion function, wherein the convolving comprises convolving the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data based on the generating of the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data, wherein the right impulse data comprises a right amplitude impulse data and the left impulse data comprises a left amplitude impulse data, wherein the generating of the right impulse data and the left impulse data comprises generating the right amplitude impulse data and the left amplitude impulse data based on the convolving of the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data.

12. The system of claim 11 , wherein the right amplitude impulse data and the left amplitude impulse data comprises at least one information associated with an amplitude domain, wherein the analyzing of the right impulse data and the left impulse data comprises applying an amplitude difference function to the right amplitude impulse data and the left amplitude impulse data, wherein the right amplitude impulse data is subtracted from the left amplitude impulse data based on the applying of the amplitude difference function, wherein the corrective signal data comprises a frequency matching impulse data, wherein the generating of the corrective signal data comprises generating the frequency matching impulse data based on the applying of the amplitude difference function.

13. The system of claim 10 , wherein the applying comprises applying an inverse amplitude function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the duplicate right inverted impulse data comprises a duplicate right amplitude inverted impulse data and the duplicate left inverted impulse data comprises a duplicate left amplitude inverted impulse data, wherein the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data comprises generating the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data based on the applying of the inverse amplitude function, wherein the convolving comprises convolving the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data based on the generating of the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data, wherein the right impulse data comprises a right phase impulse data and the left impulse data comprises a left phase impulse data, wherein the generating of the right impulse data and the left impulse data comprises generating the right phase impulse data and the left phase impulse data based on the convolving of the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data.

14. The system of claim 13 , wherein the right phase impulse data and the left phase impulse data comprises at least one information associated with a phase domain, wherein the analyzing of the right impulse data and the left impulse data comprises applying a phase reversion function to the right phase impulse data and the left phase impulse data, wherein the corrective signal data comprises a phase matching impulse data, wherein the generating of the corrective signal data comprises generating of the phase matching impulse data based on the applying of the phase reversion function.

15. The system of claim 10 , wherein the applying comprises:

applying a phase reversion function to the duplicate right channel measurement data and the duplicate left channel measurement data; and

applying an inverse amplitude function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the duplicate right inverted impulse data comprises a duplicate right phase reversed impulse data and a duplicate right amplitude inverted impulse data and the duplicate left inverted impulse data comprises a duplicate left phase reversed impulse data and a duplicate left amplitude inverted impulse data, wherein the generating of the duplicate right inverted impulse data and the duplicate left inverted impulse data comprises:

generating the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data based on the applying of the phase reversion function to the duplicate right channel measurement data and the duplicate left channel measurement data; and

generating the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data based on the applying of the inverse amplitude function to the duplicate right channel measurement data and the duplicate left channel measurement data, wherein the convolving comprises:

convolving the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data based on the generating of the duplicate right phase reversed impulse data and the duplicate left phase reversed impulse data; and

convolving the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data based on the generating of the duplicate right amplitude inverted impulse data and the duplicate left amplitude inverted impulse data, wherein the right impulse data comprises a right amplitude impulse data and a right phase impulse data, wherein the left impulse data comprises a left amplitude impulse data and a left phase impulse data, wherein the generating of the right impulse data and the left impulse data comprises:

generating the right amplitude impulse data and the left amplitude impulse data based on the convolving of the right channel measurement data with the duplicate right phase reversed impulse data and the left channel measurement data with the duplicate left phase reversed impulse data; and

generating the right phase impulse data and the left phase impulse data based on the convolving of the right channel measurement data with the duplicate right amplitude inverted impulse data and the left channel measurement data with the duplicate left amplitude inverted impulse data.

16. The system of claim 15 , wherein the right amplitude impulse data and the left amplitude impulse data comprises at least one information associated with an amplitude domain, wherein the right phase impulse data and the left phase impulse data comprises at least one information associated with a phase domain, wherein the analyzing of the right impulse data and the left impulse data comprises:

applying an amplitude difference function to the right amplitude impulse data and the left amplitude impulse data, wherein the right amplitude impulse data is subtracted from the left amplitude impulse data based on the applying of the amplitude difference function;

applying a phase reversion function to the right phase impulse data and the left phase impulse data, wherein the corrective signal data comprises a frequency matching impulse data and a phase matching impulse data, wherein the generating of the corrective signal data comprises:

generating the frequency matching impulse data based on the applying of the amplitude difference function; and

generating of the phase matching impulse data based on the applying of the phase reversion function, wherein the storing of the corrective signal data comprises storing the frequency matching impulse data and the phase matching impulse data.

17. The system of claim 16 , wherein the frequency matching impulse data comprises a right channel frequency matching impulse data for the right audio device driver and a left channel frequency matching impulse data for the left audio device driver, wherein the phase matching impulse data comprises a right channel phase matching impulse data for the right audio device driver and a left channel phase matching impulse data for the left audio device driver, wherein the processing device is further configured for:

convolving the right channel frequency matching impulse data and the right channel phase matching impulse data;

generating a right mono impulse data based on the convolving of the right channel frequency matching impulse data and the right channel phase matching impulse data;

convolving the left channel frequency matching impulse data and the left channel phase matching impulse data;

generating a left mono impulse data based on the convolving of the left channel frequency matching impulse data and the left channel phase matching impulse data; and

generating a stereo impulse data for the linearizing of the audio device in frequency, amplitude, and time domains based on the left mono impulse data and the right mono impulse data, wherein the audio device is operated based on the stereo impulse data, wherein the storage device is further configured for storing the stereo impulse data.

18. The system of claim 10 , wherein the communication device is further configured for:

receiving a left channel audio signal data associated with the left channel and a right channel audio signal data associated with the right channel from an audio signal source device; and

transmitting an output left channel audio signal data to the left audio device driver and an output right channel audio signal data to the right audio device driver, wherein the left audio device driver is operated based on the output left channel audio signal data and the right audio device driver is operated based on the left audio device driver, wherein the processing device is further configured for:

analyzing the left channel audio signal data and the right channel audio signal data, wherein the analyzing comprises delaying a left channel audio signal associated with the left channel audio signal data and a right channel audio signal associated with the right channel audio signal data by a time delay;

generating a delayed left channel audio signal data and a delayed right channel audio signal data based on the analyzing of the left channel audio signal data and the right channel audio signal data; and

generating a combined left channel audio signal data for the left channel by combining a delayed right channel audio signal associated with the delayed right channel audio signal data with the left channel audio signal and a combined right channel audio signal data for the right channel by combining a delayed left channel audio signal associated with the delayed left channel audio data with the right channel audio signal, wherein the corrective signal data comprises the output left channel audio signal data and the output right channel audio signal data, wherein the generating of the corrective signal data comprises generating the output left channel audio signal data for the left channel and the output right channel audio signal data by attenuating a combined left channel audio signal associated with the combined left channel audio signal data and a combined right channel audio signal associated with the combined right channel audio signal data using a 24 dB/Octave low pass linear phase finite impulse response (FIR) filter.

Continuity (2)
Provisional Application 63080593 · Sep 18, 2020
Related Publication 20220095065A1 · Mar 24, 2022