Coordinated tracking for binaural audio rendering

1. A method, comprising:

receiving device orientation data corresponding to a device direction of a head-mounted device within an environment, wherein the head-mounted device is on a user;

causing the head-mounted device to output an audio output to render a virtual sound source at a first location within a global frame of reference in a source direction at an offset angle from the device direction;

receiving reference orientation data corresponding to a reference direction of a reference device within the environment, wherein the reference device is not on the user;

determining whether the environment is moving relative to the global frame of reference based on the reference orientation data indicating that the reference direction of the reference device has moved over a rotation angle; and

adjusting, in response to determining that the environment is moving relative to the global frame of reference regardless of whether the user is moving within the environment, the audio output of the head-mounted device to shift the source direction of the virtual sound source by the rotation angle of the reference device to render the virtual sound source at a second location within the global frame of reference in an adjusted source direction at the offset angle from the device direction.

2. The method of claim 1 , wherein the environment is determined to not be moving when the rotation angle is within a predetermined range of motion, and wherein the environment is determined to be moving when the rotation angle is outside of the predetermined range of motion.

3. The method of claim 2 further comprising receiving a re-centering input;

wherein adjusting the audio output includes rendering, in response to determining the environment is not moving and in response to receiving the re-centering input, the virtual sound source at the second location in the adjusted source direction at the offset angle from the device direction.

4. The method of claim 3 , wherein the re-centering input includes a manual input from a user.

5. The method of claim 2 further comprising:

determining an amount of a device angular change of the device direction; and

determining, in response to the amount of the device angular change being greater than a first predetermined angular change threshold, a rate of the device angular change over a predetermined duration;

wherein adjusting the audio output includes rendering, in response to determining the environment is moving and in response to the rate of the device angular change being less than a predetermined rate threshold, the virtual sound source at the second location in the adjusted source direction offset from the device direction by the offset angle.

6. The method of claim 5 , wherein the predetermined duration is based on the amount of the device angular change, wherein the predetermined duration is a first duration when the amount of the device angular change is less than a second predetermined angular change threshold, wherein the predetermined duration is a second duration when the amount of the device angular change is more than the second predetermined angular change threshold, and wherein the second duration is less than the first duration.

7. The method of claim 2 further comprising determining the rotation angle of the reference direction.

8. The method of claim 7 further comprising determining, in response to the rotation angle being greater than a predetermined angular change threshold, a rate of angular change of the reference direction over a predetermined duration;

wherein adjusting the audio output is in response to the rate of angular change being less than a predetermined rate threshold.

9. A binaural sound reproduction system, comprising:

a head-mounted device including a device sensor to output device orientation data corresponding to a device direction of the head-mounted device within an environment, wherein the head-mounted device is on a user;

a reference device having a reference sensor to output reference orientation data corresponding to a reference direction of the reference device within the environment, wherein the reference device is not on the user; and

an audio processor configured to

output an audio output to render a virtual sound source at a first location within a global frame of reference in a source direction at an offset angle from the device direction,

determine whether the environment is moving relative to the global frame of reference based on the reference orientation data indicating that the reference direction of the reference device has moved over a rotation angle, and

adjust, in response to determining that the environment is moving relative to the global frame of reference regardless of whether the user is moving within the environment, the audio output of the head-mounted device to shift the source direction of the virtual sound source by the rotation angle of the reference device to render the virtual sound source at a second location within the global frame of reference in an adjusted source direction at the offset angle from the device direction.

10. The binaural sound reproduction system of claim 9 , wherein the audio processor is further configured to

determine that the environment is not moving when the rotation angle is within a predetermined range of motion, and

determine that the environment is moving when the rotation angle is outside of the predetermined range of motion.

11. The binaural sound reproduction system of claim 10 , wherein the head-mounted device further includes a re-centering input switch to receive a re-centering input from a user, and wherein the audio processor is further configured to

receive the re-centering input from the re-centering input switch, and

adjust the audio output, in response to receiving the re-centering input, to render the virtual sound source at the second location in the adjusted source direction at the offset angle from the device direction.

12. The binaural sound reproduction system of claim 11 , wherein the re-centering input switch is a physical button to receive a manual press by the user.

13. The binaural sound reproduction system of claim 10 , wherein the audio processor is further configured to:

determine an amount of a device angular change of the device direction; and

determine, in response to the amount of the device angular change being greater than a first predetermined angular change threshold, a rate of the device angular change over a predetermined duration;

wherein the audio processor adjusts the audio output in response to determining the environment is moving and in response to the rate of the device angular change being less than a predetermined rate threshold to render the virtual sound source at the second location in the adjusted source direction offset from the device direction by the offset angle.

14. The binaural sound reproduction system of claim 13 , wherein the predetermined duration is based on the amount of the device angular change, wherein the predetermined duration is a first duration when the amount of the device angular change is less than a second predetermined angular change threshold, wherein the predetermined duration is a second duration when the amount of the device angular change is more than the second predetermined angular change threshold, and wherein the second duration is less than the first duration.

15. The binaural sound reproduction system of claim 10 , wherein the audio processor is further configured to determine the rotation angle of the reference direction.

16. The binaural sound reproduction system of claim 15 wherein the audio processor is further configured to determine, in response to the rotation angle being greater than a predetermined angular change threshold, a rate of angular change of the reference direction over a predetermined duration;

wherein the audio processor adjusts the audio output in response to the rate of the reference angular change being less than a predetermined rate threshold.

17. A non-transitory machine-readable medium having instructions, which when executed by a processor of a binaural sound reproduction system, causes the binaural sound reproduction system to perform a method, comprising:

receiving device orientation data corresponding to a device direction of a head-mounted device within an environment, wherein the head-mounted device is on a user;

causing the head-mounted device to output an audio output to render a virtual sound source at a first location within a global frame of reference in a source direction at an offset angle from the device direction;

receiving reference orientation data corresponding to a reference direction of a reference device within the environment, wherein the reference device is not on the user;

determining whether the environment is moving relative to the global frame of reference based on whether the reference orientation data indicates that the reference direction of the reference device has moved over a rotation angle within a predetermined range of motion; and

adjusting, in response to determining that the environment is moving relative to the global frame of reference regardless of whether the user is moving within the environment, the audio output of the head-mounted device to shift the virtual sound source by the rotation angle of the reference device to render the virtual sound source at a second location within the global frame of reference in an adjusted source direction at the offset angle from the device direction.

18. The non-transitory machine-readable medium of claim 17 having further instructions to cause the binaural sound reproduction system to perform the method further comprising receiving a re-centering input;

wherein adjusting the audio output includes rendering, in response to determining the environment is not moving and in response to receiving the re-centering input, the virtual sound source at the second location in the adjusted source direction at the offset angle from the device direction.

19. The non-transitory machine-readable medium of claim 17 having further instructions to cause the binaural sound reproduction system to perform the method further comprising:

determining an amount of a device angular change of the device direction; and

determining, in response to the amount of the device angular change being greater than a first predetermined angular change threshold, a rate of the device angular change over a predetermined duration;

wherein adjusting the audio output includes rendering, in response to determining the environment is moving and in response to the rate of the device angular change being less than a predetermined rate threshold, the virtual sound source at the second location in the adjusted source direction offset from the device direction by the offset angle.

20. The non-transitory machine-readable medium of claim 17 having further instructions to cause the binaural sound reproduction system to perform the method further comprising determining the rotation angle of the reference direction.