IP Library Granted Patent US 10,638,251
Granted Patent B2
US 10,638,251 · App. 16/209,608 · Granted Apr 28, 2020

Customizing head-related transfer functions based on monitored responses to audio content

Inventors: Philip Robinson (Seattle, WA); William Owen Brimijoin, II (Kirkland, WA); Henrik Gert Hassager (Redmond, WA)
Assignee: Facebook Technologies, LLC
H04S7/304H04R5/033H04S3/008H04S2400/01H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,638,251
App. No.
16/209,608
Granted
Apr 28, 2020
Kind
B2
Abstract

The present disclosure relates to a method and audio system for customizing a set of head-related transfer functions (HRTFs) for a user of the audio system to account for the user's bias in hearing. The audio system first presents, via one or more speakers on a headset, audio content to the user wearing the headset, the audio content generated using a set of HRTFs. The audio system monitors responses of the user to the audio content. The audio system customizes the set of HRTFs for the user based on at least one of the monitored responses. The audio system updates audio content using the customized set of HRTFs. The audio system presents the updated audio content to the user with the speakers on the headset.

Claims (74)

1. A method comprising:

presenting, via speakers on a headset, audio content to a user wearing the headset, the audio content generated using a set of head related transfer functions (HRTFs);

monitoring responses of the user to the audio content;

customizing the set of HRTFs for the user based on the monitored responses by:

determining a cluster of perceived origin directions, wherein each perceived origin direction of the cluster is a spatial direction in three-dimensional (3D) space where the audio content is perceived by the user to originate from,

determining a difference between a target presentation direction within the local area for the audio content and a direction of the cluster, and

adjusting an HRTF in the set of HRTFs based on the difference;

generating updated audio content using the customized set of HRTFs; and

presenting, via the speakers on the headset, the updated audio content to the user.

2. The method of claim 1 , further comprising:

generating the set of HRTFs, wherein the set of HRTFs are generated using one or more generic HRTFs that are based on a model of a human.

3. The method of claim 1 , wherein the responses of the user are selected from a group consisting of:

a position of a limb of the user;

a movement of a body of the user;

a movement of the headset;

an orientation of the headset;

a gaze location of the user;

an input from the user; and

any combination thereof.

4. The method of claim 1 , wherein the adjusting the HRTF in the set of HRTFs based on the difference, comprises:

adjusting the HRTF according to a lateralization bias, wherein the lateralization bias is a lateral differential between a perceived origin direction and the target presentation direction.

5. The method of claim 1 , wherein the adjusting the HRTF in the set of HRTFs based on the difference, comprises:

adjusting the HRTF according to an elevation bias, wherein the elevation bias is an elevation differential between a perceived origin direction and the target presentation direction.

6. The method of claim 1 , further comprising:

prompting the user to look at a perceived origin direction;

determining an orientation of the headset while the user looks at the perceived origin direction, wherein the orientation of the headset is one of the monitored responses; and

wherein the customizing the set of HRTFs for the user is based on the determined orientation.

7. An audio system comprising:

an audio assembly comprising one or more speakers configured to present audio content to a user of the audio system;

a monitoring assembly configured to monitor responses of the user to the audio content;

a controller configured to:

generate audio content using a set of head related transfer functions (HRTFs);

customize the set of HRTFs for the user based on at least one of the monitored responses by:

determining a cluster of perceived origin directions, wherein each perceived origin direction of the cluster is a spatial direction in three-dimensional (3D) space where the audio content is perceived by the user to originate from,

determining a difference between a target presentation direction within the local area for the audio content and a direction of the cluster, and

adjusting an HRTF in the set of HRTFs based on the difference; and

generate updated audio content using the customized set of HRTFs.

8. The audio system of claim 7 , wherein the controller is further configured to:

generate the set of HRTFs using one or more generic HRTFs that are based on a model of a human.

9. The audio system of claim 7 , wherein the responses of the user are selected from a group consisting of:

a position of a limb of the user as tracked by a tracking system;

a movement of a body of the user as tracked by the tracking system;

a movement of a head of the user as tracked by the tracking system;

a gaze location of the user as tracked by the tracking system;

an input as received by an input device; and

any combination thereof.

10. The audio system of claim 7 , wherein the controller is further configured to:

adjust the HRTF according to a lateralization bias, wherein the lateralization bias is a lateral differential between a perceived origin direction and the target presentation direction.

11. The audio system of claim 7 , wherein the controller is further configured to:

adjust the HRTF according to an elevation bias, wherein the elevation bias is an elevation differential between a perceived origin direction and the target presentation direction.

12. The audio system of claim 7 ,

wherein the audio system is further configured to prompt the user to look at a perceived origin direction;

wherein the monitoring assembly is further configured to determine an orientation of the headset while the user looks at the perceived origin direction, wherein the orientation of the headset is one of the monitored responses; and

wherein the controller is further configured to customize the set of HRTFs for the user is based on the determined orientation.

13. The audio system of claim 7 , wherein the audio system is a component of a headset.

14. A non-transitory computer-readable storage medium storing encoded instructions that, when executed by a processor, cause the processor to accomplish steps of:

presenting, via speakers on a headset, audio content to a user wearing the headset, the audio content generated using a set of head related transfer functions (HRTFs);

monitoring responses of the user to the audio content;

customizing the set of HRTFs for the user based on at least one of the monitored responses by:

determining a cluster of perceived origin directions, wherein each perceived origin direction of the cluster is a spatial direction in three-dimensional (3D) space where the audio content is perceived by the user to originate from,

determining a difference between a target presentation direction within the local area for the audio content and a direction of the cluster, and

adjusting an HRTF in the set of HRTFs based on the difference;

generating updated audio content using the customized set of HRTFs; and

presenting the updated audio content to the user.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the steps further comprise:

generating the set of HRTFs, wherein the set of HRTFs are generated using one or more generic HRTFs that are based on a model of a human.

16. The non-transitory computer-readable storage medium of claim 14 , wherein adjusting the HRTF in the set of HRTFs based on the difference, comprises:

adjusting the HRTF according to a lateralization bias, wherein the lateralization bias is a lateral differential between a perceived origin direction and the target presentation direction.

17. The non-transitory computer-readable storage medium of claim 14 , wherein adjusting the HRTF in the set of HRTFs based on the difference, comprises:

adjusting the HRTF according to an elevation bias, wherein the elevation bias is an elevation differential between a perceived origin direction and the target presentation direction.

18. The non-transitory computer-readable storage medium of claim 14 , wherein the steps further comprise:

prompting the user to look at a perceived origin direction;

determining an orientation of the headset while the user looks at the perceived origin direction, wherein the orientation of the headset is one of the monitored responses; and

wherein the customizing the set of HRTFs for the user is based on the determined orientation.

Assignments (2)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2018
From: ROBINSON, PHILIP; BRIMIJOIN, WILLIAM OWEN, II; HASSAGER, HENRIK GERT
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047730/0936 →
Continuity (2)
Provisional Application 62714950 · Aug 6, 2018
Related Publication 20200045491A1 · Feb 6, 2020