IP Library › Granted Patent US 11,595,754
Granted Patent B1
US 11,595,754 · App. 16/852,203 · Granted Feb 28, 2023

Personalized headphone EQ based on headphone properties and user geometry

Inventors: Martin E. Johnson (Los Gatos, CA); Darius A. Satongar (Santa Clara, CA); Antti J. Vanne (Los Gatos, CA); Tomi A. Huttunen (Kuopio, FI)
Assignee: APPLE INC.
H04R1/2873G06F30/10G06F30/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,595,754
App. No.
16/852,203
Granted
Feb 28, 2023
Kind
B1
Abstract

Audio processing for a headworn device can include obtaining ear geometry of a user. A frequency response or transfer function can be determined, based on the ear geometry of the user and a model of the headworn device, where the frequency response or transfer function characterizes an effect of a path between a speaker of the headworn device and an ear canal entrance of the user on sound. An equalization filter profile can be generated based on the based on the frequency response or transfer function. The equalization filter profile can be applied to an audio signal, and the audio signal can be used to drive the speaker of the headworn device.

Claims (39)

1. A method of processing audio for a headworn device comprising:

obtaining ear geometry of a user;

determining a frequency response characterizing an effect of a path between a speaker of the headworn device and an ear canal entrance of the user on sound, based on the ear geometry of the user and a model of the headworn device;

generating an equalization filter profile based on the frequency response; and

applying the equalization filter profile to a spatialized audio signal, wherein the spatialized audio signal is used to drive the speaker of the headworn device and the equalization filter profile removes the effect of the path between the speaker of the headworn device and the ear canal entrance of the user.

2. The method of claim 1 , wherein the ear geometry of the user is generated by capturing an image of a user ear with a depth scanner, camera, magnetic resonance imaging (MRI), or combinations thereof.

3. The method of claim 1 , wherein the ear geometry of the user includes pinna geometry, and the equalization filter profile spectrally shapes the audio signal to add or remove pinna cues.

4. The method of claim 1 , wherein the headworn device is an extra-aural headphone set, over-ear headphone set, on-ear headphone set, in-ear headphone set.

5. The method of claim 1 , wherein the model of the headworn device includes a computer aided design (CAD) model of the headworn device.

6. The method of claim 5 , wherein the model of the headworn device includes one or more of the following parameters of the speaker of the headworn device: a location, a sound direction, a geometry, a sound pressure level (SPL) range, a distortion, or a frequency response characteristic.

7. The method of claim 1 , wherein determining the frequency response includes combining the ear geometry of the user and the model of the headworn device into a composite model and performing a numerical simulation on the composite model.

8. The method of claim 7 , wherein the numerical simulation is performed with a) a finite element method, b) a boundary element method, or c) a multi-physics simulation, including characterization of the speaker of the headworn device.

9. The method of claim 1 , wherein determining the frequency response includes estimating a fit of the headworn device on the user based on the ear geometry of the user and the model of the headworn device.

10. The method of claim 1 , wherein the headworn device is an over-ear, on-ear, or extra-aural headphone set, and the equalization filter profile is based on an inverse of the frequency response, to compensate for the effect of the path between the speaker of the headworn device and the ear canal entrance of the user on sound when applied to the audio signal.

11. The method of claim 10 , wherein the audio signal contains spatialized audio that includes pinna cues, and the equalization filter profile compensates for those pinna cues.

12. The method of claim 1 , wherein the headworn device is an in-ear headphone set and the equalization filter profile, when applied to the audio signal, adds the effect of the path between the speaker of the headworn device and the ear canal entrance of the user.

13. A system for processing audio for a headworn device comprising:

a processor; and

non-transitory memory having stored therein a plurality of instructions, that when executed by the processor, perform the following:

generating ear geometry of a user;

determining a frequency response characterizing an effect of a path between a speaker of the headworn device and an ear canal entrance of the user on sound, based on the ear geometry of the user and a model of the headworn device;

generating an equalization filter profile based on the frequency response; and

applying the equalization filter profile to a spatialized audio signal, wherein the audio signal is used to drive the speaker of the headworn device and the equalization filter profile removes the effect of the path between the speaker of the headworn device and the ear canal entrance of the user.

14. The system of claim 13 , wherein generating the ear geometry of the user includes capturing an image of a user ear with a depth scanner, camera, magnetic resonance imaging (MRI), or combinations thereof.

15. The system of claim 13 , wherein the ear geometry of the user includes pinna geometry, and the equalization filter profile spectrally shapes the audio signal to add or remove pinna cues.

16. The system of claim 13 , wherein the model of the headworn device includes a computer aided design (CAD) model of the headworn device.

17. The system of claim 13 , wherein determining the frequency response includes combining the ear geometry of the user and the model of the headworn device into a composite model and performing a numerical simulation on the composite model.

18. The system of claim 13 , wherein

the headworn device is an over-ear, on-ear, or extra-aural headphone set,

the audio signal the audio signal contains spatialized audio that includes pinna cues, and

the equalization filter profile is based on an inverse of the frequency response, to compensate for the effect of the path between the speaker of the headworn device and the ear canal entrance of the user on sound, including the pinna cues, when applied to the audio signal.

19. The system of claim 18 , wherein the headworn device is an in-ear headphone set and the equalization filter profile, when applied to the audio signal, adds the effect of the path between the speaker of the headworn device and the ear canal entrance of the user, including pinna cues.

20. An article of manufacture, comprising:

a processor; and

non-transitory memory having stored therein a plurality of instructions, that when executed by the processor, perform the following:

obtaining ear geometry of a user;

determining a transfer function characterizing an effect of a path between a speaker of the headworn device and an ear canal entrance of the user on sound, based on the ear geometry of the user and a model of the headworn device;

generating an equalization filter profile based on the transfer function; and

applying the equalization filter profile to en-a spatialized audio signal, wherein the spatialized audio signal is used to drive the speaker of the headworn device and the equalization filter profile removes the effect of the path between the speaker of the headworn device and the ear canal entrance of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2020
From: JOHNSON, MARTIN E.; SATONGAR, DARIUS A.; VANNE, ANTTI J.; HUTTUNEN, TOMI A.
To: APPLE INC.
Reel/Frame 052433/0430 →
Continuity (1)
Provisional Application 62854900 · May 30, 2019
Cited By (1)
US 12,732,769