IP Library › Granted Patent US 11,190,896
Granted Patent B1
US 11,190,896 · App. 16/560,418 · Granted Nov 30, 2021

System and method of determining head-related transfer function parameter based on in-situ binaural recordings

Inventors: Darius A. Satongar (Santa Clara, CA); Martin E. Johnson (Los Gatos, CA); Peter Victor Jupin (Copenhagen, DK); Jonathan D. Sheaffer (Santa Clara, CA)
Assignee: APPLE INC.
H04S7/304H04R1/406H04R3/005H04R5/027H04R5/033H04R5/04H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,190,896
App. No.
16/560,418
Granted
Nov 30, 2021
Kind
B1
Abstract

An audio system and a method of using the audio system to determine an interaural head-related transfer function (HRTF) parameter, are described. The audio system can generate binaural recordings using microphones that are worn by a user in everyday scenarios. The audio system can measure interaural parameter values of selected segments of the recordings, and the measurements can be accumulated over time. The interaural HRTF parameter can be estimated based on the measurements. The interaural HRTF parameter can be used to adapt a generic HRTF to generate an individualized HRTF for the user. Other aspects are also described and claimed.

Claims (39)

1. A method, comprising:

generating a binaural recording using a plurality of microphones worn by a user;

selecting, using a selection criteria, a plurality of segments of the binaural recording corresponding to sounds emitted at intermittent time points by discrete sound sources located in pseudo-anechoic environments;

measuring an interaural parameter value of each of the selected segments; and

estimating, based on the measured interaural parameter values, an interaural head-related transfer function (HRTF) parameter specific to the user.

2. The method of claim 1 , wherein the interaural HRTF parameter is selected from the group consisting of a maximum interaural time difference (ITD) and a maximum interaural level difference (ILD).

3. The method of claim 2 , wherein the sounds are unknown sounds, wherein the selection criteria includes an interaural coherence threshold, and wherein the selected segments have interaural coherences above the interaural coherence threshold.

4. The method of claim 2 , wherein the sounds are known sounds generated by a device, wherein the selection criteria includes a notification indicating emissions of the known sounds by the device at the intermittent time points, and wherein the selected segments occur at the intermittent time points.

5. The method of claim 2 , wherein the sounds are unknown sounds, wherein the selection criteria includes a match between the binaural recording and a predetermined sound classification profile, and wherein the selected segments match the predetermined sound classification profile.

6. The method of claim 1 further comprising:

selecting a generic HRTF for the user, wherein the generic HRTF includes one or more generic interaural HRTF parameter; and

adapting the generic HRTF based on the interaural HRTF parameter to generate an individualized HRTF of the user.

7. The method of claim 6 , wherein adapting the generic HRTF includes adjusting the generic interaural HRTF parameter based on the estimated interaural HRTF parameter to generate the individualized HRTF.

8. The method of claim 6 , wherein adapting the generic HRTF includes replacing the generic interaural HRTF parameter with the estimated interaural HRTF parameter to generate the individualized HRTF.

9. The method of claim 1 , wherein the interaural HRTF parameter is estimated based on a predetermined minimum number of interaural parameter value measurements.

10. An audio system, comprising:

a plurality of microphones to generate a binaural recording; and

one or more processors configured to:

select, using a selection criteria, a plurality of segments of the binaural recording corresponding to sounds emitted at intermittent time points by discrete sound sources located in pseudo-anechoic environments;

measure an interaural parameter value of each of the selected segments; and

estimate, based on the measured interaural parameter values, an interaural head-related transfer function (HRTF) parameter specific to a user.

11. The audio system of claim 10 , wherein the interaural HRTF parameter is selected from the group consisting of a maximum interaural time difference (ITD) and a maximum interaural level difference (ILD).

12. The audio system of claim 11 , wherein the sounds are unknown sounds, wherein the selection criteria includes an interaural coherence threshold, and wherein the selected segments have interaural coherences above the interaural coherence threshold.

13. The audio system of claim 10 , wherein the one or more processors are further configured to:

select a generic HRTF for the user, wherein the generic HRTF includes a generic interaural HRTF parameter; and

adapt the generic HRTF based on the interaural HRTF parameter to generate an individualized HRTF of the user.

14. The audio system of claim 10 further comprising a headset including the plurality of microphones, and one or more speakers connected to an audio source to play a user content signal.

15. The audio system of claim 14 further comprising a mobile device including the one or more processors and the audio source.

16. A non-transitory machine readable medium storing instructions executable by one or more processors of an audio system to cause the audio system to perform a method comprising:

generating a binaural recording using a plurality of microphones worn by a user;

selecting, using a selection criteria, a plurality of segments of the binaural recording corresponding to sounds emitted at intermittent time points by discrete sound sources located in pseudo-anechoic environments;

measuring an interaural parameter value of each of the selected segments; and

estimating, based on the measured interaural parameter values, an interaural head-related transfer function (HRTF) parameter specific to the user.

17. The non-transitory machine readable medium of claim 16 , wherein the sounds are unknown sounds, wherein the selection criteria includes an interaural coherence threshold, and wherein the selected segments have interaural coherences above the interaural coherence threshold.

18. The non-transitory machine readable medium of claim 16 , wherein the method further comprises:

selecting a generic HRTF for the user, wherein the generic HRTF includes a generic interaural HRTF parameter; and

adapting the generic HRTF based on the estimated interaural HRTF parameter to generate an individualized HRTF of the user.

19. The non-transitory machine readable medium of claim 18 , wherein adapting the generic HRTF includes adjusting the one or more generic HRTF parameter based on the estimated interaural HRTF parameter to generate the individualized HRTF.

20. The non-transitory machine readable medium of claim 18 , wherein adapting the generic HRTF includes replacing the generic interaural HRTF parameter with the estimated interaural HRTF parameter to generate the individualized HRTF.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2019
From: SATONGAR, DARIUS A.; JOHNSON, MARTIN E.; JUPIN, PETER VICTOR; SHEAFFER, JONATHAN D.
To: APPLE INC.
Reel/Frame 050282/0563 →
Continuity (1)
Provisional Application 62737668 · Sep 27, 2018
Cited By (2)
US 12,621,629 US 12,720,251