IP Library Granted Patent US 10,798,515
Granted Patent B2
US 10,798,515 · App. 16/562,616 · Granted Oct 6, 2020

Compensating for effects of headset on head related transfer functions

Inventors: David Lou Alon (Arugot D, IL); Maria Cuevas Rodriguez (Redmond, WA); Ravish Mehra (Tacoma, WA); Philip Robinson (Seattle, WA)
Assignee: Facebook Technologies, LLC
H04S7/304H04R1/403H04R3/12H04R5/027H04S7/301H04S2400/11H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,798,515
App. No.
16/562,616
Granted
Oct 6, 2020
Kind
B2
Abstract

An audio system captures audio data of test sounds through a microphone of a headset worn by a user. The test sounds are played by an external speaker, and the audio data includes audio data captured for different orientations of the headset with respect to the external speaker. A set of head-related transfer function (HRTFs) is calculated based at least in part on the audio data of the test sounds at the different orientations of the headset. A portion of the set of HRTFs is discarded to create an intermediate set of HRTFs. The discarded portion corresponding to one or more distortion regions that are based in part on wearing the headset. One or more HRTFs are generated that correspond to the discarded portion using at least some of the intermediate set of HRTFs to create an individualized set of HRTFs for the user.

Claims (58)

1. A method comprising:

capturing audio data of test sounds through a microphone of a headset worn by a user, the test sounds played by an external speaker, and the audio data including audio data captured for different orientations of the headset with respect to the external speaker;

calculating a set of head-related transfer function (HRTFs) based at least in part on the audio data of the test sounds at the different orientations of the headset, the set of HRTFs individualized to the user while wearing the headset;

discarding a portion of the set of HRTFs to create an intermediate set of HRTFs, the discarded portion corresponding to one or more distortion regions that are based in part on wearing the headset; and

generating one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs to create an individualized set of HRTFs for the user.

2. The method of claim 1 , wherein the portion of the set to discard is determined using a distortion mapping that identifies the one or more distortion regions, wherein the distortion mapping is based in part on comparisons between a set of HRTFs measured with at least one test user wearing a test headset and a set of HRTFs measured with the at least one test user not wearing the test headset.

3. The method of claim 2 , wherein the distortion mapping, is one of a plurality of distortion mappings that are each associated with different physical characteristics, and wherein the method further comprises:

generating a query based on a characteristic of the user, wherein the query is used to identify the distortion mapping based on the characteristic of the user corresponding to a characteristic associated with the distortion mapping.

4. The method of claim 1 , wherein the portion of the set to discard includes at least some HRTFs corresponding to orientations of the headset where sound from the external speaker was incident on the headset prior to reaching an ear canal of the user.

5. The method of claim 1 , wherein generating the one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs comprises:

interpolating at least some of the intermediate set of HRTFs to generate the one or more HRTFs that correspond to the discarded portion.

6. The method of claim 1 , wherein capturing the audio data for different orientations of the headset with respect to the external speaker further comprises:

generating an indicator at a coordinate of a virtual space, the indicator corresponding to a specific orientation of headset worn by the user relative to an external speaker;

presenting, on a display of the headset, the indicator the coordinate in the virtual space;

determining that a first orientation of the headset relative to the external speaker is the specific orientation; and

instructing the external speaker to play a test sound while the headset is at the first orientation;

obtaining the audio data from the microphone.

7. The method of claim 1 , further comprising:

uploading the individualized set of HRTFs to a HRTF system, wherein the HRTF system uses at least some of the individualized set of HRTFs to update a distortion mapping generated from comparisons between a set of HRTFs measured with at least one test user wearing a test headset and a set of HRTFs measured with the at least one test user not wearing the test headset.

8. A non-transitory computer-readable storage medium storing executable computer program instructions, the instructions executable to perform steps comprising:

capturing audio data of test sounds through a microphone of a headset worn by a user, the test sounds played by an external speaker, and the audio data including audio data captured for different orientations of the headset with respect to the external speaker;

calculating a set of head-related transfer function (HRTFs) based at least in part on the audio data of the test sounds at the different orientations of the headset, the set of HRTFs individualized to the user while wearing the headset;

discarding a portion of the set of HRTFs to create an intermediate set of HRTFs, the discarded portion corresponding to one or more distortion regions that are based in part on wearing the headset; and

generating one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs to create an individualized set of HRTFs for the user.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the portion of the set to discard is determined using a distortion mapping that identifies the one or more distortion regions, wherein the distortion mapping is based in part on comparisons between a set of HRTFs measured with at least one test user wearing a test headset and a set of HRTFs measured with the at least one test user not wearing the test headset.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the distortion mapping, is one of a plurality of distortion mappings that are each associated with different physical characteristics, and wherein the method further comprises:

generating a query based on a characteristic of the user, wherein the query is used to identify the distortion mapping based on the characteristic of the user corresponding to a characteristic associated with the distortion mapping.

11. The non-transitory computer-readable storage medium of claim 8 , wherein the portion of the set to discard includes at least some HRTFs corresponding to orientations of the headset where sound from the external speaker was incident on the headset prior to reaching an ear canal of the user.

12. The non-transitory computer-readable storage medium of claim 8 , wherein generating the one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs comprises:

interpolating at least some of the intermediate set of HRTFs to generate the one or more HRTFs that correspond to the discarded portion.

13. The non-transitory computer-readable storage medium of claim 8 , wherein capturing the audio data for different orientations of the headset with respect to the external speaker further comprises:

generating an indicator at a coordinate of a virtual space, the indicator corresponding to a specific orientation of headset worn by the user relative to an external speaker;

presenting, on a display of the headset, the indicator the coordinate in the virtual space;

determining that a first orientation of the headset relative to the external speaker is the specific orientation;

instructing the external speaker to play a test sound while the headset is at the first orientation; and

obtaining the audio data from the microphone.

14. The non-transitory computer-readable storage medium of claim 8 , further comprising:

uploading the individualized set of HRTFs to a HRTF system, wherein the HRTF system uses at least some of the individualized set of HRTFs to update a distortion mapping generated from comparisons between a set of HRTFs measured with at least one test user wearing a test headset and a set of HRTFs measured with the at least one test user not wearing the test headset.

15. A system comprising:

an external speaker configured to play one or more test sounds;

a microphone assembly configured to capture audio data of the one or more test sounds; and

a headset configured to be worn by a user, comprising an audio controller configured to:

calculate a set of head-related transfer function (HRTFs) based at least in part on the audio data of the test sounds and at a plurality of different orientations of the headset, the set of HRTFs individualized to the user while wearing the headset;

discard a portion of the set of HRTFs to create an intermediate set of HRTFs, the portion corresponding to one or more distortion regions that are based in part on wearing the headset; and

generate one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs to create an individualized set of HRTFs for the user.

16. The system of claim 15 , wherein the portion of the set to discard is determined using a distortion mapping that identifies the one or more distortion regions, wherein the distortion mapping is based in part on comparisons between a set of HRTFs measured with at least one test user wearing a test headset and a set of HRTFs measured with the at least one test user not wearing the test headset.

17. The system of claim 16 , wherein the distortion mapping is one of a plurality of distortion mappings that are each associated with different physical characteristics, and wherein the audio system of the headset is further configured to:

send, to a server, a query based on a characteristic of the user, wherein the query is used to identify the distortion mapping based on the characteristic of the user corresponding to a characteristic associated with the distortion mapping; and

receive, from the server, the distortion mapping.

18. The system of claim 15 , wherein the portion of the set to discard includes at least some HRTFs corresponding to orientations of the headset where sound from the external speaker was incident on the headset prior to reaching an ear canal of the user.

19. The system of claim 15 , wherein the audio controller generating the one or more HRTFs that correspond to the discarded portion using at least some of the intermediate set of HRTFs comprises:

interpolating at least some of the intermediate set of HRTFs to generate the one or more HRTFs that correspond to the discarded portion.

20. The system of claim 15 , wherein the headset is further configured to:

generate an indicator at a coordinate of a virtual space, the indicator corresponding to a specific orientation of headset worn by the user relative to an external speaker;

present, on the display of the headset, the indicator the coordinate in the virtual space;

determine that a first orientation of the headset relative to the external speaker is the specific orientation;

instruct the external speaker to play a test sound while the headset is at the first orientation; and

obtain the audio data from the microphone.

Assignments (2)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2019
From: ALON, DAVID LOU; CUEVAS RODRIGUEZ, MARIA; MEHRA, RAVISH; ROBINSON, PHILIP
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 050359/0280 →
Continuity (2)
Provisional Application 62798813 · Jan 30, 2019
Related Publication 20200245091A1 · Jul 30, 2020