IP Library Granted Patent US 12707223
Granted Patent B2
US 12707223 · App. 18/509,173 · Granted Aug 11, 2026

Systems and methods for a personalized audio system

Inventors: Joy Lyons (Lake Forest Park, WA); Sean Olive (Oak Park, CA); Christian Garcia (Winnetka, CA); Todd Welti (Thousand Oaks, CA); Alfredo Fernandez Franco (Sherman Oaks, CA)
Assignee: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
H04S7/303H04R1/025H04S7/301H04R2400/11H04S2400/07H04S2400/11H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12707223
App. No.
18/509,173
Granted
Aug 11, 2026
Kind
B2
Abstract

Systems and methods are provided for personalized three-dimensional audio. In one embodiment, a sound calibration system comprises a headrest having a first speaker, a second speaker, and one or more sensors, the headrest configured to engage a head of a user, and a controller with computer readable instructions stored on non-transitory memory. The instructions, when executed, cause the controller to create customized spatial audio by utilizing a head-related impulse response (HRIR) that is modified based on an input audio signal, the location of the audio source and receiver, and the head position of the user. The resulting audio output is generated by applying the HRIR and interaural crosstalk cancellation filters to frequencies above a threshold frequency.

Claims (65)

1 . A sound calibration system, comprising:

a headrest having a first speaker, a second speaker, and one or more sensors, the headrest configured to engage a head of a user; and

a controller with computer readable instructions stored on non-transitory memory that when executed cause the controller to:

generate personalized spatial audio using a head related impulse response (HRIR), the HRIR modified based on an input audio signal, an audio signal source location, a receiver location, and a head position of the user relative thereto; and

produce audio output based on the HRIR and further based on interaural crosstalk cancellation filters filtering the input audio signal, wherein the HRIR and the interaural crosstalk cancellation filters are applied to frequencies greater than a first threshold frequency;

wherein the HRIR is an impulse response of a head related transfer function (HRTF); and

wherein the HRIR is interpolated to a desired location based on an array of time aligned HRIR corresponding to multiple locations around the user and a frame of reference stored in a location engine;

the computer readable instructions further causing the controller to:

divide the input audio signal into a high frequency band and a low frequency band based on the first threshold frequency;

apply delay and equalizing to the low frequency band;

convolve the high frequency band with the HRIR to produce an HRIR convolved high frequency output;

divide the HRIR convolved high frequency output into a left output and a right output;

apply an arrival time delay to each of the left output and the right output separately;

apply a pre-equalizing to each of the left output and the right output separately;

recombine each of the left output and the right output with the low frequency band;

apply a post-equalizing to each of the left output and the right output separately; and

apply a near-field correction to each of the left output and the right output separately based on a near-field model using a low shelf filter and a high shelf filter, prior to filtering by the interaural crosstalk cancellation filters.

2 . The sound calibration system of claim 1 , wherein the head of the user is free to move relative to the first speaker and the second speaker.

3 . The sound calibration system of claim 1 , wherein the interaural crosstalk cancellation filters comprise one or more of pseudo-inverse, regularized inverse, frequency-dependent regularization, and LMS filters with an arbitrary penalty function.

4 . The sound calibration system of claim 1 , wherein HRIR is determined based one or more of anatomical features of the user, interaural time difference, interaural level difference, a spectral model comprising fine-scale frequency response features, relative location of transducers to pinnae, and range correction of near-field differences.

5 . The sound calibration system of claim 1 , wherein the frame of reference is updated based on the audio signal source location and the head position of the user relative thereto.

6 . The sound calibration system of claim 1 , wherein the low shelf filter and the high shelf filter have settings depending on an azimuth, elevation, and distance of a virtual audio signal source to the user.

7 . The sound calibration system of claim 1 , wherein the arrival time delay is determined based on a look-up table comprising interaural time difference measurements for the user, wherein inputs to the look-up table comprise the audio signal source location and the head position of the user.

8 . The sound calibration system of claim 1 , wherein the arrival time delay is determined based on a continuous spherical head model, wherein inputs to the continuous spherical head model include the audio signal source location and the head position of the user.

9 . A method of calibrating sound for a listener, the method comprising:

receiving an input audio signal, an audio signal source location, a receiver location, and a head position of a user;

determining an HRIR for the user based on an array of time aligned HRIR corresponding to locations around the user, the audio signal source location, the receiver location, and the head position;

dividing the input audio signal into a high frequency band and a low frequency band;

applying delay and equalizing to the low frequency band to produce a filtered low frequency output;

convolving the high frequency band with the HRIR to produce an HRIR convolved high frequency output;

dividing the HRIR convolved high frequency output into a left output and a right output;

applying an arrival time delay to each of the left output and the right output separately;

applying a pre-equalizing to each of the left output and the right output separately;

recombining each of the left output and the right output with the filtered low frequency output;

applying a post-equalizing to each of the left output and the right output separately;

applying a near-field correction to each of the left output and the right output separately based on a near-field model using a using a low shelf filter and a high shelf filter;

filtering the HRIR convolved high frequency output with interaural crosstalk cancellation filters to produce a crosstalk filtered high frequency output;

combining the filtered low frequency output and the crosstalk filtered high frequency output into combined filtered signals; and

producing an audio output based on the combined filtered signals;

wherein the HRIR is an impulse response of a head related transfer function (HRTF).

10 . The method of claim 9 , wherein the interaural crosstalk cancellation filters comprise one or more of pseudo-inverse, regularized inverse, frequency-dependent regularization, and LMS filters with an arbitrary penalty function.

11 . The method of claim 9 , wherein the arrival time delay is determined based on one of a look-up table comprising interaural time difference measurements for the user and a continuous spherical head model, wherein inputs to the look-up table and the continuous spherical head model comprise the audio signal source location and the head position.

12 . A system comprising:

a headrest having a left speaker and a right speaker, the headrest configured to engage a head of a user;

a sensor tracking a head position of the user;

an audio signal source;

an array of time aligned head related impulse responses (HRIR) corresponding to locations around the user; and

a controller in electronic communication with the sensor and the audio signal source with computer readable instructions stored on non-transitory memory that when executed cause the controller to:

receive an input audio signal, an audio signal source location, a receiver location, and the head position;

determine HRIR for the user based on the array of time aligned HRIR corresponding to locations around the user, the audio signal source location, the receiver location, and the head position;

divide the input audio signal into a high frequency band and a low frequency band;

apply delay and equalizing to the low frequency band to produce a filtered low frequency output;

convolve the high frequency band with the HRIR to produce an HRIR convolved high frequency output;

divide the HRIR convolved high frequency output into a left output and a right output;

apply an arrival time delay to each of the left output and the right output separately;

recombine each of the left output and the right output with the filtered low frequency output;

apply a post-equalizing to each of the left output and the right output separately;

apply a near-field correction to each of the left output and the right output separately based on a near-field model using a low shelf filter and a high shelf filter;

filter the HRIR convolved high frequency output with interaural crosstalk cancellation filters to produce a crosstalk filtered high frequency output;

combine the filtered low frequency output and the crosstalk filtered high frequency output into combined filtered signals; and

produce an audio output based on the combined filtered signals;

wherein the HRIR is an impulse response of a head related transfer function (HRTF).

13 . The system of claim 12 , further comprising interpolating the HRIR to a desired location based on the array of time aligned HRIR corresponding to locations around the user and a frame of reference stored in a location engine, wherein the frame of reference is updated based on the audio signal source location and the head position of the user relative thereto.

14 . The system of claim 12 , wherein the HRIR is determined based one or more of anatomical features of the user, interaural time difference, interaural level difference, a spectral model comprising fine-scale frequency response features, relative location of transducers to pinnae, and range correction of near-field differences.

15 . The system of claim 12 , wherein the interaural crosstalk cancellation filters comprise one or more of pseudo-inverse, regularized inverse, frequency-dependent regularization, and LMS filters with an arbitrary penalty function.