Binaural headphone rendering with head tracking
View Patent ↗A sound enhancement system (SES) that can enhance reproduction of sound emitted by headphones and other sound systems is disclosed. The SES improves sound reproduction by simulating a desired sound system without including unwanted artifacts typically associated with simulations of sound systems. The SES facilitates such improvements by transforming sound system outputs through a set of one or more binaural rendering filters derived from direct and indirect head-related transfer functions (HRTFs). Parameters of the binaural rendering filters are updated based on the head tracking angle of user wearing the headphones to render a stable stereo sound image. The head tracking angle may be determined from sensor data obtained from a digital gyroscope mounted in a headphone assembly.
1. A method for enhancing reproduction of sound comprising:
receiving an audio input signal at a first audio signal interface;
receiving an angular velocity signal from the digital gyroscope mounted to the headphone assembly;
calculating a head rotational angle as a fraction of a previous head rotational angle measurement when the angular velocity signal is less than a predetermined threshold for more than a predetermined sample count;
updating at least one binaural rendering filter in each of a pair of parametric head-related transfer function (HRTF) models based on the head rotational angle; and
transforming the audio input signal to an audio output signal using the at least one binaural rendering filter, the audio output signal including a left headphone output signal and a right headphone output signal.
2. The method of claim 1 , wherein the audio input signal is a multi-channel audio input signal.
3. The method of claim 1 , wherein the audio input signal is a mono-channel audio input signal.
4. The method of claim 1 , wherein updating the at least one binaural rendering filter based on the head rotational angle comprises retrieving parameters for the at least one binaural rendering filter from at least one look-up table based on the head rotational angle.
5. The method of claim 4 , wherein retrieving parameters for the at least one binaural rendering filter from the at least one look-up table based on the head rotational angle comprises:
generating a left table pointer index value and a right table pointer index value based on the head rotational angle; and
retrieving the parameters for the at least one binaural rendering filter from the at least one look-up table based on the left table pointer index value and the right table pointer index value.
6. The method of claim 1 , wherein the at least one binaural rendering filter comprises a shelving filter and a notch filter.
7. The method of claim 6 , wherein updating at least one binaural rendering filter based on the head rotational angle comprises updating a gain parameter for each of the shelving filter and the notch filter based on the head rotational angle.
8. The method of claim 1 , wherein the at least one binaural rendering filter further comprises an inter-aural time delay filter.
9. The method of claim 8 , wherein updating at least one binaural rendering filter based on the head rotational angle comprises updating a delay value for the inter-aural time delay filter based on the head rotational angle.
10. A system for enhancing reproduction of sound comprising:
a headphone assembly including a headband, a pair of headphones, and a digital gyroscope; and
a sound enhancement system (SES) for receiving an audio input signal from an audio source, the SES in communication with the digital gyroscope and the pair of headphones, the SES including:
a microcontroller unit (MCU) configured to
receive an angular velocity signal from the digital gyroscopes;
calculate a head rotational angle from the angular velocity signal when the angular velocity signal exceeds a predetermined threshold or is less than the predetermined threshold for less than a predetermined sample count;
gradually decrease the head rotational angle when the angular velocity signal is less than a predetermined threshold for more than a predetermined sample count; and
a digital signal processor (DSP) in communication with the MCU and including a pair of dynamic parametric head-related transfer function (HRTF) models configured to transform the audio input signal to an audio output signal, the pair of dynamic parametric HRTF models having at least a cross filter, wherein at least one parameter of the cross filter is updated based on the head rotational angle.
11. The system of claim 10 , wherein the cross filter comprises a shelving filter and a notch filter and wherein the at least one parameter of the cross filter includes a shelving filter gain and a notch filter gain.
12. The system of claim 10 , wherein the pair of dynamic parametric HRTF models further including an inter-aural time delay filter having a delay parameter, wherein the delay parameter is updated based on the head rotational angle.
13. The system of claim 10 , wherein the MCU is further configured to calculate a table pointer index value based on the head rotational angle and wherein the at least one parameter of the cross filter is updated using a look-up table according to the table pointer index value.
14. A method for enhancing reproduction of sound comprising:
receiving an audio input signal at a first audio signal interface;
receiving an angular velocity signal from the digital gyroscope mounted to the headphone assembly;
calculating a head rotational angle from the angular velocity signal when the angular velocity signal exceeds a predetermined threshold or is less than the predetermined threshold for less than a predetermined sample count;
updating at least one binaural rendering filter in each of a pair of parametric head-related transfer function (HRTF) models based on the head rotational angle; and
transforming the audio input signal to an audio output signal using the at least one binaural rendering filter, the audio output signal including a left headphone output signal and a right headphone output signal.
15. The method of claim 14 , wherein the at least one binaural rendering filter comprises a shelving filter and a notch filter, and wherein updating the at least one binaural rendering filter based on the head rotational angle comprises updating a gain parameter for each of the shelving filter and the notch filter based on the head rotational angle.
16. The method of claim 14 , wherein the at least one binaural rendering filter further comprises an inter-aural time delay filter, and wherein updating the at least one binaural rendering filter based on the head rotational angle comprises updating a delay value for the inter-aural time delay filter based on the head rotational angle.
17. The method of claim 14 , wherein updating the at least one binaural rendering filter based on the head rotational angle comprises retrieving parameters for the at least one binaural rendering filter from at least one look-up table based on the head rotational angle.
18. The method of claim 17 , wherein retrieving parameters for the at least one binaural rendering filter from the at least one look-up table based on the head rotational angle comprises:
generating a left table pointer index value and a right table pointer index value based on the head rotational angle; and
retrieving the parameters for the at least one binaural rendering filter from the at least one look-up table based on the left table pointer index value and the right table pointer index value.