IMMERSIVE AUDIO PLATFORM
Disclosed herein are systems and methods for presenting audio content in mixed reality environments. A method may include receiving a first input from an application program; in response to receiving the first input, receiving, via a first service, an encoded audio stream; generating, via the first service, a decoded audio stream based on the encoded audio stream; receiving, via a second service, the decoded audio stream; receiving a second input from one or more sensors of a wearable head device; receiving, via the second service, a third input from the application program, wherein the third input corresponds to a position of one or more virtual speakers; generating, via the second service, a spatialized audio stream based on the decoded audio stream, the second input, and the third input; presenting, via one or more speakers of the wearable head device, the spatialized audio stream.
1 . A system comprising:
one or more speakers; and
one or more processors configured to perform a method comprising:
receiving an audio signal associated with a virtual speaker at a first virtual speaker position and further associated with first content; and
in accordance with a movement of a listener from a first listener position to a second listener position:
in accordance with a determination that the first content is associated with a first mode, presenting the audio signal to the listener via the one or more speakers based on a distance from the first listener position to the first virtual speaker position; and
in accordance with a determination that the first content is associated with a second mode, presenting the audio signal to the listener via the one or more speakers based on a distance from the second listener position to the first virtual speaker position.
2 . The system of claim 1 , wherein:
in accordance with the determination that the first content is associated with the first mode, the audio signal is presented further based on a direction from the first listener position to the first virtual speaker position; and
in accordance with the determination that the first content is associated with the second mode, the audio signal is presented further based on a direction from the second listener position to the first virtual speaker position.
3 . The system of claim 1 , wherein the method further comprises presenting the audio signal according to a per-screen spatialization.
4 . The system of claim 1 , wherein:
in accordance with the determination that the first content is associated with the first mode, said presenting the audio signal comprises presenting the audio signal further in accordance with a determination that the first virtual speaker is associated with the first mode; and
in accordance with the determination that the first content is associated with the second mode, said presenting the audio signal comprises presenting the audio signal further in accordance with a determination that the first virtual speaker is associated with the second mode.
5 . The system of claim 1 , wherein the method further comprises:
receiving a second audio signal associated with a second virtual speaker at a second virtual speaker position and further associated with the first content; and
in accordance with the movement of the listener from the first listener position to the second listener position:
in accordance with a determination that the second virtual speaker is associated with the first mode, presenting the second audio signal to the listener via the one or more speakers based on a distance from the first listener position to the second virtual speaker position; and
in accordance with a determination that the second virtual speaker is associated with the second mode, presenting the second audio signal to the listener via the one or more speakers based on a distance from the second listener position to the second virtual speaker position.
6 . The system of claim 1 , further comprising a wearable head device comprising one or more sensors and the one or more speakers.
7 . The system of claim 6 , wherein the method further comprises determining, via the one or more sensors, the movement of the listener.
8 . The system of claim 6 , wherein the one or more sensors comprises an inertial measurement unit, a camera, a microphone, an electromagnetic receiver, or any combination thereof.
9 . The system of claim 1 , wherein the first virtual speaker position is determined based on a position of a physical object in an environment of the listener.
10 . The system of claim 9 , wherein the position of the physical object is identified via one or more sensors of a wearable head device.
11 . The system of claim 1 , wherein the method further comprises receiving an audio stream, and wherein the audio signal is generated based on the audio stream.
12 . The system of claim 1 , wherein:
the virtual speaker is associated with one or more audio channels, and
the one or more audio channels comprises a subwoofer channel.
13 . The system of claim 1 , wherein the first virtual speaker position is determined based on the first content.
14 . The system of claim 1 , wherein the first content comprises a virtual screen.
15 . A method, comprising:
receiving an audio signal associated with a virtual speaker at a first virtual speaker position and further associated with first content; and
in accordance with a movement of a listener from a first listener position to a second listener position:
in accordance with a determination that the first content is associated with a first mode, presenting the audio signal to the listener via one or more speakers based on a distance from the first listener position to the first virtual speaker position; and
in accordance with a determination that the first content is associated with a second mode, presenting the audio signal to the listener via the one or more speakers based on a distance from the second listener position to the first virtual speaker position.
16 . The method of claim 15 , wherein:
in accordance with the determination that the first content is associated with the first mode, the audio signal is presented further based on a direction from the first listener position to the first virtual speaker position; and
in accordance with the determination that the first content is associated with the second mode, the audio signal is presented further based on a direction from the second listener position to the first virtual speaker position.
17 . The method of claim 15 , wherein:
in accordance with the determination that the first content is associated with the first mode, said presenting the audio signal comprises presenting the audio signal further in accordance with a determination that the first virtual speaker is associated with the first mode; and
in accordance with the determination that the first content is associated with the second mode, said presenting the audio signal comprises presenting the audio signal further in accordance with a determination that the first virtual speaker is associated with the second mode.
18 . The method of claim 15 , further comprising:
receiving a second audio signal associated with a second virtual speaker at a second virtual speaker position and further associated with the first content; and
in accordance with the movement of the listener from the first listener position to the second listener position:
in accordance with a determination that the second virtual speaker is associated with the first mode, presenting the second audio signal to the listener via the one or more speakers based on a distance from the first listener position to the second virtual speaker position; and
in accordance with a determination that the second virtual speaker is associated with the second mode, presenting the second audio signal to the listener via the one or more speakers based on a distance from the second listener position to the second virtual speaker position.
19 . The method of claim 15 , wherein a wearable head device comprises the one or more speakers.
20 . A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform a method comprising:
receiving an audio signal associated with a virtual speaker at a first virtual speaker position and further associated with first content; and
in accordance with a movement of a listener from a first listener position to a second listener position:
in accordance with a determination that the first content is associated with a first mode, presenting the audio signal to the listener via one or more speakers based on a distance from the first listener position to the first virtual speaker position; and
in accordance with a determination that the first content is associated with a second mode, presenting the audio signal to the listener via the one or more speakers based on a distance from the second listener position to the first virtual speaker position.