Immersive audio platform
Disclosed herein are systems and methods for presenting audio content in mixed reality environments. A method may include receiving a first input from an application program; in response to receiving the first input, receiving, via a first service, an encoded audio stream; generating, via the first service, a decoded audio stream based on the encoded audio stream; receiving, via a second service, the decoded audio stream; receiving a second input from one or more sensors of a wearable head device; receiving, via the second service, a third input from the application program, wherein the third input corresponds to a position of one or more virtual speakers; generating, via the second service, a spatialized audio stream based on the decoded audio stream, the second input, and the third input; presenting, via one or more speakers of the wearable head device, the spatialized audio stream.
1. A system comprising:
a wearable head device comprising one or more sensors and one or more speakers; and
one or more processors configured to perform a method comprising:
receiving a spatialized audio signal, wherein the spatialized audio signal is generated based on a position of a virtual speaker and is associated with one of a static mode and dynamic mode; and
in accordance with a determination that the spatialized audio signal is associated with a per-screen spatialized audio and in response to a movement of the wearable head device from a first position to a second position:
in accordance with a determination that the spatialized audio signal is associated with the static mode, presenting the spatialized audio signal via the one or more speakers of the wearable head device based on a distance from the first position to the position of the virtual speaker, wherein the determination that the spatialized audio signal is associated with the static mode comprises determining that the spatialized audio signal is associated with first content; and
in accordance with a determination that the spatialized audio signal is associated with the dynamic mode, presenting the spatialized audio signal via the one or more speakers of the wearable head device based on a distance from the second position to the position of the virtual speaker, wherein the determination that the spatialized audio signal is associated with the dynamic mode comprises determining that the spatialized audio signal is associated with second content, different from the first content.
2. The system of claim 1 , wherein:
the method further comprises receiving, from the one or more sensors, an input representing the first position, and
the input indicates the movement of the wearable head device from the first position to the second position.
3. The system of claim 1 , wherein:
the method further comprises receiving, from the one or more sensors, an input representing the second position, and
the input indicates the movement of the wearable head device from the first position to the second position.
4. The system of claim 1 , wherein:
the method further comprises receiving an input associated with a position of the wearable head device, and
the input indicates a position of the virtual speaker.
5. The system of claim 1 , wherein the one or more sensors comprises any of an inertial measurement unit, a camera, a microphone, an electromagnetic receiver, or any combination thereof.
6. The system of claim 1 , wherein:
the method further comprises receiving an input associated with a position of a physical object in an environment of the wearable head device, and
the input indicates a position of the virtual speaker.
7. The system of claim 1 , wherein the position of the virtual speaker is determined based on a position of a physical object in an environment of the wearable head device.
8. The system of claim 1 , wherein the method further comprises receiving an audio stream, and wherein the spatialized audio signal is generated based on the audio stream.
9. The system of claim 1 , wherein:
the spatialized audio signal comprises one or more audio channels, and
the one or more audio channels comprises a subwoofer channel.
10. The system of claim 1 , wherein:
the wearable head device further comprises a display, and
the position of the virtual speaker is determined based on content presented via the display.
11. The system of claim 10 , wherein the content comprises a virtual screen.
12. A method comprising:
receiving a spatialized audio signal, wherein the spatialized audio signal is generated based on a position of a virtual speaker and is associated with one of a static mode and dynamic mode; and
in accordance with a determination that the spatialized audio signal is associated with a per-screen spatialized audio and in response to a movement of a wearable head device from a first position to a second position:
in accordance with a determination that the spatialized audio signal is associated with the static mode, presenting the spatialized audio signal via one or more speakers of the wearable head device based on a distance from the first position to the position of the virtual speaker, wherein the determination that the spatialized audio signal is associated with the static mode comprises determining that the spatialized audio signal is associated with first content; and
in accordance with a determination that the spatialized audio signal is associated with the dynamic mode, presenting the spatialized audio signal via the one or more speakers of the wearable head device based on a distance from the second position to the position of the virtual speaker, wherein the determination that the spatialized audio signal is associated with the dynamic mode comprises determining that the spatialized audio signal is associated with second content, different from the first content.
13. The method of claim 12 , further comprising receiving, from one or more sensors of the wearable head device, an input representing the first position, wherein the input indicates the movement of the wearable head device from the first position to the second position.
14. The method of claim 12 , further comprising receiving, from one or more sensors of the wearable head device, an input representing the second position, wherein the input indicates the movement of the wearable head device from the first position to the second position.
15. The method of claim 12 , further comprising receiving an input associated with a position of the wearable head device, wherein the input indicates a position of the virtual speaker.
16. The method of claim 12 , wherein the wearable head device further comprises one or more sensors comprising any of an inertial measurement unit, a camera, a microphone, an electromagnetic receiver, or any combination thereof.
17. The method of claim 12 , wherein the position of the virtual speaker is determined based on a position of a physical object in an environment of the wearable head device.
18. The method of claim 12 , further comprising receiving an audio stream, wherein the spatialized audio signal is generated based on the audio stream.
19. The method of claim 12 , further comprising presenting content via a display of the wearable head device, wherein the position of the virtual speaker is determined based on the content.
20. A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving a spatialized audio signal, wherein the spatialized audio signal is generated based on a position of a virtual speaker and is associated with one of a static mode and dynamic mode; and
in accordance with a determination that the spatialized audio signal is associated with a per-screen spatialized audio and in response to a movement of a wearable head device from a first position to a second position:
in accordance with a determination that the spatialized audio signal is associated with the static mode, presenting the spatialized audio signal via one or more speakers of the wearable head device based on a distance from the first position to the position of the virtual speaker, wherein the determination that the spatialized audio signal is associated with the static mode comprises determining that the spatialized audio signal is associated with first content; and
in accordance with a determination that the spatialized audio signal is associated with the dynamic mode, presenting the spatialized audio signal via the one or more speakers of the wearable head device based on a distance from the second position to the position of the virtual speaker, wherein the determination that the spatialized audio signal is associated with the dynamic mode comprises determining that the spatialized audio signal is associated with second content, different from the first content.