IP Library Granted Patent US 11,082,794
Granted Patent B2
US 11,082,794 · App. 17/006,280 · Granted Aug 3, 2021

Compensating for effects of headset on head related transfer functions

Inventors: David Lou Alon (Arugot D, IL); Maria Cuevas Rodriguez (Redmond, WA); Ravish Mehra (Tacoma, WA); Philip Robinson (Seattle, WA)
Assignee: Facebook Technologies, LLC
H04S7/304H04R1/403H04R3/12H04R5/027H04S7/301H04S2400/11H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,082,794
App. No.
17/006,280
Granted
Aug 3, 2021
Kind
B2
Abstract

An audio system captures audio data of test sounds through a microphone of a headset worn by a user. The test sounds are played by an external speaker, and the audio data includes audio data captured for different orientations of the headset with respect to the external speaker. A set of head-related transfer function (HRTFs) is calculated based at least in part on the audio data of the test sounds at the different orientations of the headset. A portion of the set of HRTFs is discarded to create an intermediate set of HRTFs. The discarded portion corresponding to one or more distortion regions that are based in part on wearing the headset. One or more HRTFs are generated that correspond to the discarded portion using at least some of the intermediate set of HRTFs to create an individualized set of HRTFs for the user.

Claims (53)

1. A method comprising:

calculating a set of head-related transfer function (HRTFs) based at least in part on audio data of test sounds captured at different orientations of a headset worn by a user, the set of HRTFs individualized to the user while wearing the headset;

determining a portion of the set of HRTFs to discard using a distortion mapping that identifies one or more distortion regions that are commonly distorted by the headset having a form factor that occludes at least a portion of a face of the user;

discarding the portion of the set of HRTFs to create an intermediate set of HRTFs, the discarded portion corresponding to the one or more distortion regions;

generating one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs;

combining at least some of the intermediate set of HRTFs with the generated one or more HRTFs to create a customized set of HRTFs that are individualized to the user and mimic actual HRTFs of the user without a headset; and

providing the customized set of HRTFs to the headset.

2. The method of claim 1 , further comprising:

selecting the distortion mapping from a plurality of distorting mappings that are each associated with different physical characteristics, the selecting based in part on physical characteristics of the user.

3. The method of claim 1 , further comprising:

measuring a first set of HRTFs with at least one test user wearing a test headset;

measuring a second set of HRTFs with the at least one test user not wearing the test headset; and

generating the distortion mapping based in part on comparisons between the first set of HRTFs and the second set of HRTFs.

4. The method of claim 3 , further comprising:

updating the distortion with one or more of the customized set of HRTFs.

5. The method of claim 1 , wherein the portion of the set to discard includes at least some HRTFs corresponding to orientations of the headset where sound from an external speaker was incident on the headset prior to reaching an ear canal of the user.

6. The method of claim 1 , wherein generating the one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs comprises:

interpolating at least some of the intermediate set of HRTFs to generate the one or more HRTFs that correspond to the discarded portion.

7. The method of claim 1 , further comprising:

receiving the audio data from the headset, wherein the headset captured the audio data for different orientations of the headset with respect to an external speaker.

8. The method of claim 1 , wherein the headset uses the customized set of HRTFs to present spatialized audio to the user.

9. The method of claim 1 , wherein the form factor is an eye-wear device or a head-mounted display.

10. A non-transitory computer-readable storage medium storing executable computer program instructions, the executable computer program instructions executed by one or more processors to perform steps comprising:

calculating a set of head-related transfer function (HRTFs) based at least in part on audio data of test sounds captured at different orientations of a headset worn by a user, the set of HRTFs individualized to the user while wearing the headset;

determining a portion of the set of HRTFs to discard using a distortion mapping that identifies one or more distortion regions that are commonly distorted by the headset having a form factor that occludes at least a portion of a face of the user;

discarding the portion of the set of HRTFs to create an intermediate set of HRTFs, the discarded portion corresponding to the one or more distortion regions;

generating one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs;

combining at least some of the intermediate set of HRTFs with the generated one or more HRTFs to create a customized set of HRTFs that are individualized to the user and mimic actual HRTFs of the user without a headset; and

providing the customized set of HRTFs to the headset.

11. The non-transitory computer-readable storage medium of claim 10 , further comprising executable computer program instructions to perform steps comprising:

selecting the distortion mapping from a plurality of distorting mappings that are each associated with different physical characteristics, the selecting based in part on physical characteristics of the user.

12. The non-transitory computer-readable storage medium of claim 10 , further comprising executable computer program instructions to perform steps comprising, further comprising:

measuring a first set of HRTFs with at least one test user wearing a test headset;

measuring a second set of HRTFs with the at least one test user not wearing the test headset; and

generating the distortion mapping based in part on comparisons between the first set of HRTFs and the second set of HRTFs.

13. The non-transitory computer-readable storage medium of claim 12 , further comprising executable computer program instructions to perform steps comprising:

updating the distortion mapping with one or more of the customized set of HRTFs.

14. The non-transitory computer-readable storage medium of claim 10 , wherein the portion of the set to discard includes at least some HRTFs corresponding to orientations of the headset where sound from an external speaker was incident on the headset prior to reaching an ear canal of the user.

15. The non-transitory computer-readable storage medium of claim 10 , wherein generating the one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs comprises:

interpolating at least some of the intermediate set of HRTFs to generate the one or more HRTFs that correspond to the discarded portion.

16. The non-transitory computer-readable storage medium of claim 10 , further comprising executable computer program instructions to perform steps comprising:

receiving the audio data from the headset, wherein the headset captured the audio data for different orientations of the headset with respect to an external speaker.

17. The non-transitory computer-readable storage medium of claim 10 , wherein the headset uses the customized set of HRTFs to present spatialized audio to the user.

18. A head-related Transfer Function (HRTF) system comprising:

one or more processors:

a non-transitory computer-readable storage medium storing executable computer program instructions, the instructions executable by the one or more processors to:

calculate a set of head-related transfer function (HRTFs) based at least in part on audio data of test sounds captured at different orientations of a headset worn by a user, the set of HRTFs individualized to the user while wearing the headset;

determine a portion of the set of HRTFs to discard using a distortion mapping that identifies one or more distortion regions that are commonly distorted by the headset having a form factor that occludes at least a portion of a face of the user;

discard the portion of the set of HRTFs to create an intermediate set of HRTFs, the discarded portion corresponding to the one or more distortion regions;

generate one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs;

combine at least some of the intermediate set of HRTFs with the generated one or more HRTFs to create a customized set of HRTFs that are individualized to the user and mimic actual HRTFs of the user without a headset; and

provide the customized set of HRTFs to the headset.

19. The HRTF system of claim 18 , wherein the distortion mapping is based in part on comparisons between a set of HRTFs measured with at least one test user wearing a test headset and a set of HRTFs measured with the at least one test user not wearing the test headset.

Assignments (1)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
Continuity (3)
Continuation 16562616 · Sep 6, 2019
Provisional Application 62798813 · Jan 30, 2019
Related Publication 20200396558A1 · Dec 17, 2020
Cited By (1)
US 12,621,629