Delayed audio following
Disclosed herein are systems and methods for presenting mixed reality audio. In an example method, audio is presented to a user of a wearable head device. A first position of the user's head at a first time is determined based on one or more sensors of the wearable head device. A second position of the user's head at a second time later than the first time is determined based on the one or more sensors. An audio signal is determined based on a difference between the first position and the second position. The audio signal is presented to the user via a speaker of the wearable head device. Determining the audio signal comprises determining an origin of the audio signal in a virtual environment. Presenting the audio signal to the user comprises presenting the audio signal as if originating from the determined origin. Determining the origin of the audio signal comprises applying an offset to a position of the user's head.
1. A system comprising:
a wearable head device having a speaker and one or more sensors; and
one or more processors configured to perform a method comprising:
determining, based on the one or more sensors, a first orientation of a user's head at a first time;
determining, based on the one or more sensors, a second orientation of the user's head at a second time later than the first time;
determining, based on a difference between the first orientation and the second orientation, an audio signal; and
presenting the audio signal to the user via the speaker, wherein:
said determining the audio signal comprises determining an origin of the audio signal relative to the user's head;
said presenting the audio signal to the user comprises presenting the audio signal as if originating from the determined origin;
said determining the origin of the audio signal relative to the user's head comprises applying an offset to a position of the user's head;
said determining the audio signal further comprises determining a velocity in a virtual environment; and
said presenting the audio signal to the user further comprises presenting the audio signal as if the origin is in motion with the determined velocity.
2. The system of claim 1 , wherein said determining the origin of the audio signal further comprises determining the origin of the audio signal based on a rate of change of an orientation of the user's head.
3. The system of claim 2 , wherein said determining the origin of the audio signal further comprises:
in accordance with a determination that the rate of change exceeds a threshold, determining that the origin comprises a first origin; and
in accordance with a determination that the rate of change does not exceed the threshold, determining that the origin comprises a second origin different from the first origin.
4. The system of claim 1 , wherein said determining the origin of the audio signal further comprises:
in accordance with a determination that a magnitude of the offset is below a threshold, determining that the origin comprises a first origin; and
in accordance with a determination that the magnitude of the offset is not below the threshold, determining that the origin comprises a second origin different from the first origin.
5. The system of claim 1 , wherein
the determined velocity comprises an angular velocity.
6. The system of claim 1 , wherein:
said determining the velocity comprises determining the velocity based on a difference between the first orientation of the user's head and the second orientation of the user's head.
7. The system of claim 1 , wherein the user's head comprises a reference point and said determining the origin of the audio signal relative to the user's head comprises applying the offset to the reference point.
8. A method of presenting audio to a user of a wearable head device, the method comprising:
determining, based on one or more sensors of the wearable head device, a first orientation of the user's head at a first time;
determining, based on the one or more sensors, a second orientation of the user's head at a second time later than the first time;
determining, based on a difference between the first orientation and the second orientation, an audio signal; and
presenting the audio signal to the user via a speaker of the wearable head device, wherein:
said determining the audio signal comprises determining an origin of the audio signal relative to the user's head;
said presenting the audio signal to the user comprises presenting the audio signal as if originating from the determined origin;
said determining the origin of the audio signal relative to the user's head comprises applying an offset to a position of the user's head;
said determining the audio signal further comprises determining a velocity in a virtual environment; and
said presenting the audio signal to the user further comprises presenting the audio signal as if the origin is in motion with the determined velocity.
9. The method of claim 8 , wherein said determining the origin of the audio signal further comprises determining the origin of the audio signal based on a rate of change of an orientation of the user's head.
10. The method of claim 9 , wherein said determining the origin of the audio signal further comprises:
in accordance with a determination that the rate of change exceeds a threshold, determining that the origin comprises a first origin; and
in accordance with a determination that the rate of change does not exceed the threshold, determining that the origin comprises a second origin different from the first origin.
11. The method of claim 8 , wherein said determining the origin of the audio signal further comprises:
in accordance with a determination that a magnitude of the offset is below a threshold, determining that the origin comprises a first origin; and
in accordance with a determination that the magnitude of the offset is not below the threshold, determining that the origin comprises a second origin different from the first origin.
12. The method of claim 8 , wherein the determined velocity comprises an angular velocity.
13. The method of claim 8 , wherein:
said determining the velocity comprises determining the velocity based on a difference between the first orientation of the user's head and the second orientation of the user's head.
14. The method of claim 8 , wherein the user's head comprises a reference point and said determining the origin of the audio signal relative to the user's head comprises applying the offset to the reference point.
15. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method of presenting audio to a user of a wearable head device, the method comprising:
determining, based on one or more sensors of the wearable head device, a first orientation of the user's head at a first time;
determining, based on the one or more sensors, a second orientation of the user's head at a second time later than the first time;
determining, based on a difference between the first orientation and the second orientation, an audio signal; and
presenting the audio signal to the user via a speaker of the wearable head device, wherein:
said determining the audio signal comprises determining an origin of the audio signal relative to the user's head;
said presenting the audio signal to the user comprises presenting the audio signal as if originating from the determined origin;
said determining the origin of the audio signal relative to the user's head comprises applying an offset to a position of the user's head;
said determining the audio signal further comprises determining a velocity in a virtual environment; and
said presenting the audio signal to the user further comprises presenting the audio signal as if the origin is in motion with the determined velocity.
16. The non-transitory computer-readable medium of claim 15 , wherein said determining the origin of the audio signal further comprises determining the origin of the audio signal based on a rate of change of an orientation of the user's head.
17. The non-transitory computer-readable medium of claim 16 , wherein said determining the origin of the audio signal further comprises:
in accordance with a determination that the rate of change exceeds a threshold, determining that the origin comprises a first origin; and
in accordance with a determination that the rate of change does not exceed the threshold, determining that the origin comprises a second origin different from the first origin.
18. The non-transitory computer-readable medium of claim 15 , wherein said determining the origin of the audio signal further comprises:
in accordance with a determination that a magnitude of the offset is below a threshold, determining that the origin comprises a first origin; and
in accordance with a determination that the magnitude of the offset is not below the threshold, determining that the origin comprises a second origin different from the first origin.
19. The non-transitory computer-readable medium of claim 15 , wherein the determined velocity comprises an angular velocity.
20. The non-transitory computer-readable medium of claim 15 , wherein:
said determining the velocity comprises determining the velocity based on a difference between the first orientation of the user's head and the second orientation of the user's head.