Interaural time difference crossfader for binaural audio rendering
Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a first input audio signal is received, the first input audio signal corresponding to a source location in a virtual environment presented to the user via the wearable head device. The first input audio signal is processed to generate a left output audio signal and a right output audio signal. The left output audio signal is presented to the left ear of the user via a left speaker associated with the wearable head device. The right output audio signal is presented to the right ear of the user via a right speaker associated with the wearable head device. Processing the first input audio signal comprises applying a delay process to the first input audio signal to generate a left audio signal and a right audio signal; adjusting a gain of the left audio signal; adjusting a gain of the right audio signal; applying a first head-related transfer function (HRTF) to the left audio signal to generate the left output audio signal; and applying a second HRTF to the right audio signal to generate the right output audio signal. Applying the delay process to the first input audio signal comprises applying an interaural time delay (ITD) to the first input audio signal, the ITD determined based on the source location.
1. A method of presenting an audio signal to a user of a wearable head device, the method comprising:
receiving a first input audio signal, the first input audio signal corresponding to a first source location in a virtual environment presented to the user via the wearable head device, wherein the first source location corresponds to a first location of a virtual object in the virtual environment at a first time;
processing the first input audio signal to generate a left output audio signal and a right output audio signal, wherein processing the first input audio signal comprises:
applying a delay process to the first input audio signal to generate a left audio signal and a right audio signal;
determining a gain of the left audio signal;
determining a gain of the right audio signal;
applying a first head-related transfer function (HRTF) to the left audio signal to generate the left output audio signal; and
applying a second HRTF to the right audio signal to generate the right output audio signal;
presenting the left output audio signal to a first ear of the user via a first speaker associated with the wearable head device;
presenting the right output audio signal to a second ear of the user via a second speaker associated with the wearable head device, and
determining a second source location corresponding to a second location of the virtual object in the virtual environment at a second time, wherein:
the virtual object is at the first location in the virtual environment at the first time and the virtual object is at the second location in the virtual environment at the second time,
the wearable head device has a first orientation vector at the first time,
the wearable head device has a second orientation vector at the second time, and
the first location in the virtual environment relative to the first orientation vector is different from the second location in the virtual environment relative to the second orientation vector;
determining a first ear delay, said determining comprising:
determining a prior first ear delay corresponding to the first time,
determining a subsequent first ear delay corresponding to the second time, and
cross-fading between the prior first ear delay and the subsequent first ear delay; and
determining a second ear delay, said determining comprising:
determining a prior second ear delay corresponding to the first time,
determining a subsequent second ear delay corresponding to the second time, and
cross-fading between the prior second ear delay and the subsequent second ear delay,
wherein:
applying the delay process to the first input audio signal comprises applying an interaural time delay (ITD) to the first input audio signal, the ITD determined based on the first source location, the first ear delay, and the second ear delay.
2. The method of claim 1 , wherein the first ear delay is zero.
3. The method of claim 1 , wherein applying the delay process further comprises applying a filter to the first input audio signal.
4. The method of claim 1 , wherein applying the delay process further comprises:
applying a first filter to a first one or more of the first input audio signal, the left audio signal, and the right audio signal, and
applying a second filter to a second one or more of the first input audio signal, the left audio signal, and the right audio signal.
5. The method of claim 1 , wherein the first source location is a location closer to the first ear than to the second ear and the second source location is a location closer to the second ear than to the first ear.
6. The method of claim 1 , wherein the second source location is a location closer to the first ear than to the second ear and the first source location is a location closer to the second ear than to the first ear.
7. The method of claim 1 , wherein the first source location is a location closer than the second source location to the first ear, the first source location is a location closer to the first ear than to the second ear, and the second source location is a location closer to the first ear than to the second ear.
8. The method of claim 1 , wherein the second source location is a location closer than the first source location to the first ear, the first source location is a location closer to the first ear than to the second ear, and the second source location is a location closer to the first ear than to the second ear.
9. A system comprising:
a wearable head device having a first speaker and a second speaker; and
one or more processors configured to perform a method comprising:
receiving a first input audio signal, the first input audio signal corresponding to a first source location in a virtual environment presented to a user via the wearable head device, wherein the first source location corresponds to a first location of a virtual object in the virtual environment at a first time;
processing the first input audio signal to generate a left output audio signal and a right output audio signal, wherein processing the first input audio signal comprises:
applying a delay process to the first input audio signal to generate a left audio signal and a right audio signal;
determining a gain of the left audio signal;
determining a gain of the right audio signal;
applying a first head-related transfer function (HRTF) to the left audio signal to generate the left output audio signal; and
applying a second HRTF to the right audio signal to generate the right output audio signal;
presenting the left output audio signal to a first ear of the user via the first speaker;
presenting the right output audio signal to a second ear of the user via the second speaker; and
determining a second source location corresponding to a second location of the virtual object in the virtual environment at a second time, wherein:
the virtual object is at the first location in the virtual environment at the first time and the virtual object is at the second location in the virtual environment at the second time,
the wearable head device has a first orientation vector at the first time,
the wearable head device has a second orientation vector at the second time, and
the first location in the virtual environment relative to the first orientation vector is different from the second location in the virtual environment relative to the second orientation vector;
determining a first ear delay, said determining comprising:
determining a prior first ear delay corresponding to the first time,
determining a subsequent first ear delay corresponding to the second time, and
cross-fading between the prior first ear delay and the subsequent first ear delay; and
determining a second ear delay, said determining comprising:
determining a prior second ear delay corresponding to the first time,
determining a subsequent second ear delay corresponding to the second time, and
cross-fading between the prior second ear delay and the subsequent second ear delay,
wherein:
applying the delay process to the first input audio signal comprises applying an interaural time delay (ITD) to the first input audio signal, the ITD determined based on the first source location, the first ear delay, and the second ear delay.
10. The system of claim 9 , wherein the first ear delay is zero.
11. The system of claim 9 , wherein applying the delay process further comprises:
applying a first filter to a first one or more of the first input audio signal, the left audio signal, and the right audio signal, and
applying a second filter to a second one or more of the first input audio signal, the left audio signal, and the right audio signal.
12. The system of claim 9 , wherein the first source location is a location closer to the first ear than to the second ear and the second source location is a location closer to the second ear than to the first ear.
13. The system of claim 9 , wherein the first source location is a location closer than the second source location to the first ear, the first source location is a location closer to the first ear than to the second ear, and the second source location is a location closer to the first ear than to the second ear.
14. The system of claim 9 , wherein the second source location is a location closer than the first source location to the first ear, the first source location is a location closer to the first ear than to the second ear, and the second source location is a location closer to the first ear than to the second ear.
15. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving a first input audio signal, the first input audio signal corresponding to a first source location in a virtual environment presented to a user via a wearable head device, wherein the first source location corresponds to a first location of a virtual object in the virtual environment at a first time;
processing the first input audio signal to generate a left output audio signal and a right output audio signal, wherein processing the first input audio signal comprises:
applying a delay process to the first input audio signal to generate a left audio signal and a right audio signal;
determining a gain of the left audio signal;
determining a gain of the right audio signal;
applying a first head-related transfer function (HRTF) to the left audio signal to generate the left output audio signal; and
applying a second HRTF to the right audio signal to generate the right output audio signal;
presenting the left output audio signal to a first ear of the user via a first speaker associated with the wearable head device;
presenting the right output audio signal to a second ear of the user via a second speaker associated with the wearable head device, and
determining a second source location corresponding to a second location of the virtual object in the virtual environment at a second time, wherein:
the virtual object is at the first location in the virtual environment at the first time and the virtual object is at the second location in the virtual environment at the second time,
the wearable head device has a first orientation vector at the first time,
the wearable head device has a second orientation vector at the second time, and
the first location in the virtual environment relative to the first orientation vector is different from the second location in the virtual environment relative to the second orientation vector;
determining a first ear delay, said determining comprising:
determining a prior first ear delay corresponding to the first time,
determining a subsequent first ear delay corresponding to the second time, and
cross-fading between the prior first ear delay and the subsequent first ear delay; and
determining a second ear delay, said determining comprising:
determining a prior second ear delay corresponding to the first time,
determining a subsequent second ear delay corresponding to the second time, and
cross-fading between the prior second ear delay and the subsequent second ear delay,
wherein:
applying the delay process to the first input audio signal comprises applying an interaural time delay (ITD) to the first input audio signal, the ITD determined based on the first source location, the first ear delay, and the second ear delay.
16. The non-transitory computer-readable medium of claim 15 , wherein the first ear delay is zero.
17. The non-transitory computer-readable medium of claim 15 , wherein applying the delay process further comprises:
applying a first filter to a first one or more of the first input audio signal, the left audio signal, and the right audio signal, and
applying a second filter to a second one or more of the first input audio signal, the left audio signal, and the right audio signal.
18. The non-transitory computer-readable medium of claim 15 , wherein the first source location is a location closer to the first ear than to the second ear and the second source location is a location closer to the second ear than to the first ear.
19. The non-transitory computer-readable medium of claim 15 , wherein the first source location is a location closer than the second source location to the first ear, the first source location is a location closer to the first ear than to the second ear, and the second source location is a location closer to the first ear than to the second ear.
20. The non-transitory computer-readable medium of claim 15 , wherein the second source location is a location closer than the first source location to the first ear, the first source location is a location closer to the first ear than to the second ear, and the second source location is a location closer to the first ear than to the second ear.