Immersive audio platform
Disclosed herein are systems and methods for presenting audio content in mixed reality environments. A method may include receiving a first input from an application program; in response to receiving the first input, receiving, via a first service, an encoded audio stream; generating, via the first service, a decoded audio stream based on the encoded audio stream; receiving, via a second service, the decoded audio stream; receiving a second input from one or more sensors of a wearable head device; receiving, via the second service, a third input from the application program, wherein the third input corresponds to a position of one or more virtual speakers; generating, via the second service, a spatialized audio stream based on the decoded audio stream, the second input, and the third input; presenting, via one or more speakers of the wearable head device, the spatialized audio stream.
1. A system comprising:
a wearable head device comprising one or more sensors and one or more speakers; and
one or more processors configured to perform a method comprising:
receiving a first input from the one or more sensors of the wearable head device, wherein the first input indicates a movement of the wearable head device from a first position to a second position;
receiving a second input, wherein the second input indicates a position of one or more virtual speakers;
receiving a spatialized audio signal, wherein the spatialized audio signal is generated based on the first input and the second input, wherein the spatialized audio signal is associated with one of a static mode and dynamic mode; and
in accordance with a determination that the spatialized audio signal is associated with a per-screen spatialized audio and in response to receiving the first input:
in accordance with a determination that the spatialized audio stream is associated with the static mode, presenting, via the one or more speakers of the wearable head device, the spatialized audio signal based on a distance from the first position to the position of the one or more virtual speakers; and
in accordance with a determination that the spatialized audio stream is associated with the dynamic mode, presenting, via the one or more speakers of the wearable head device, the spatialized audio signal based on a distance from the second position to the position of the one or more virtual speakers.
2. The system of claim 1 , wherein the first input represents the first position of the wearable head device.
3. The system of claim 1 , wherein the first input represents the second position of the wearable head device.
4. The system of claim 1 , wherein the second input is associated with a position of the wearable head device.
5. The system of claim 1 , wherein the one or more sensors comprises an inertial measurement unit, a camera, a microphone, an electromagnetic receiver, or any combination thereof.
6. The system of claim 1 , wherein the second input is associated with a position of a physical object in an environment of the wearable head device.
7. The system of claim 1 , wherein the position of the one or more virtual speakers is determined based on a position of a physical object in an environment of the wearable head device.
8. The system of claim 1 , wherein the method further comprises receiving an audio stream, wherein the spatialized audio signal is generated based on the audio stream.
9. The system of claim 1 , wherein:
the spatialized audio signal comprises one or more audio channels, and
the one or more audio channels comprises a subwoofer channel.
10. The system of claim 1 , wherein:
the wearable head device further comprises a display, and
the position of the one or more virtual speakers is determined based on a content presented via the display.
11. The system of claim 10 , wherein the content comprises a virtual screen.
12. A method comprising:
receiving a first input from one or more sensors of a wearable head device, wherein the first input indicates a movement of the wearable head device from a first position to a second position;
receiving a second input, wherein the second input indicates a position of one or more virtual speakers;
receiving a spatialized audio signal, wherein the spatialized audio signal is generated based on the first input and the second input, wherein the spatialized audio signal is associated with one of a static mode and dynamic mode; and
in accordance with a determination that the spatialized audio signal is associated with a per-screen spatialized audio and in response to receiving the first input:
in accordance with a determination that the spatialized audio stream is associated with the static mode, presenting, via one or more speakers of the wearable head device, the spatialized audio signal based on a distance from the first position to the position of the one or more virtual speakers; and
in accordance with a determination that the spatialized audio stream is associated with the dynamic mode, presenting, via the one or more speakers of the wearable head device, the spatialized audio signal based on a distance from the second position to the position of the one or more virtual speakers.
13. The method of claim 12 , wherein the first input represents the first position of the wearable head device.
14. The method of claim 12 , wherein the first input represents the second position of the wearable head device.
15. The method of claim 12 , wherein the second input is associated with a position of the wearable head device.
16. The method of claim 12 , wherein the one or more sensors comprises an inertial measurement unit, a camera, a microphone, an electromagnetic receiver, or any combination thereof.
17. The method of claim 12 , wherein the position of the one or more virtual speakers is determined based on a position of a physical object in an environment of the wearable head device.
18. The method of claim 12 , further comprising receiving an audio stream, wherein the spatialized audio signal is generated based on the audio stream.
19. The method of claim 12 , further comprising presenting, via a display of the wearable head device, a content, wherein the position of the one or more virtual speakers is determined based on the content.
20. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving a first input from one or more sensors of a wearable head device, wherein the first input indicates a movement of the wearable head device from a first position to a second position;
receiving a second input, wherein the second input indicates a position of one or more virtual speakers;
receiving a spatialized audio signal, wherein the spatialized audio signal is generated based on the first input and the second input, wherein the spatialized audio signal is associated with one of a static mode and dynamic mode; and
in accordance with a determination that the spatialized audio signal is associated with a per-screen spatialized audio and in response to receiving the first input:
in accordance with a determination that the spatialized audio stream is associated with the static mode, presenting, via one or more speakers of the wearable head device, the spatialized audio signal based on a distance from the first position to the position of the one or more virtual speakers; and
in accordance with a determination that the spatialized audio stream is associated with the dynamic mode, presenting, via the one or more speakers of the wearable head device, the spatialized audio signal based on a distance from the second position to the position of the one or more virtual speakers.