SPATIAL AUDIO FOR INTERACTIVE AUDIO ENVIRONMENTS
Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reflection of the input audio signal in a surface of the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source, and further based on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.
1 . A method comprising:
determining an intermediate audio signal, the intermediate audio signal corresponding to a reflection of an input audio signal by a surface of a virtual environment, wherein:
said determining the intermediate audio signal comprises encoding the input audio signal based on a location of a listener,
the location of the listener is determined via one or more sensors of a wearable head device, and
the intermediate audio signal is associated with a first plurality of channels;
associating the intermediate audio signal with a bus, wherein the bus is associated with the first plurality of channels; and
presenting, via the bus, an output audio signal to the listener, wherein:
the output audio signal is determined via decoding the intermediate audio signal to produce a decoded intermediate audio signal, and
the decoded intermediate audio signal is associated with a second plurality of channels, different from the first plurality of channels.
2 . The method of claim 1 , wherein the one or more sensors comprise one or more microphones.
3 . The method of claim 1 , wherein the one or more sensors comprise one or more cameras.
4 . The method of claim 1 , wherein the output audio signal is presented to the listener via one or more speakers associated with the wearable head device.
5 . The method of claim 1 , further comprising displaying to the listener, concurrently with the presentation of the output audio signal, a view of the virtual environment.
6 . The method of claim 1 , wherein the intermediate signal is determined based on an acoustic property of the virtual environment, the acoustic property determined via the one or more sensors.
7 . The method of claim 6 , further comprising retrieving the acoustic property from a database.
8 . The method of claim 6 , wherein said retrieving the acoustic property comprises:
identifying the acoustic property based on the location of the listener.
9 . The method of claim 6 , wherein the acoustic property is determined via a first device, and the intermediate audio signal is determined via a second device different from the first device.
10 . The method of claim 1 , wherein the intermediate audio signal is decoded via an ambisonics decoder.
11 . The method of claim 1 , wherein:
the virtual environment is part of a mixed reality environment,
the surface of the virtual reality environment comprises a surface of the mixed reality environment,
the intermediate audio signal is associated with a sound source, and
a location of the sound source comprises a location of the mixed reality environment.
12 . A system, comprising:
one or more speakers;
one or more sensors; and
one or more processors configured to perform a method comprising:
determining an intermediate audio signal, the intermediate audio signal corresponding to a reflection of an input audio signal by a surface of a virtual environment, wherein:
said determining the intermediate audio signal comprises encoding the input audio signal based on a location of a listener,
the location of the listener is determined via the one or more sensors, and
the intermediate audio signal is associated with a first plurality of channels;
associating the intermediate audio signal with a bus, wherein the bus is associated with the first plurality of channels; and
presenting, via the bus and the one or more speakers, an output audio signal to the listener, wherein:
the output audio signal is determined via decoding the intermediate audio signal to produce a decoded intermediate audio signal, and
the decoded intermediate audio signal is associated with a second plurality of channels, different from the first plurality of channels.
13 . The system of claim 12 , wherein the one or more sensors comprise one or more microphones.
14 . The system of claim 12 , wherein the one or more sensors comprise one or more cameras.
15 . The system of claim 12 , wherein the one or more sensors and the one or more speakers are associated with a wearable head device configured to be worn by the listener.
16 . The system of claim 12 , further comprising a display, wherein the method further comprises displaying to the listener, concurrently with the presentation of the output audio signal, a view of the virtual environment.
17 . The system of claim 12 , wherein the intermediate signal is determined based on an acoustic property of the virtual environment, the acoustic property determined via the one or more sensors.
18 . The system of claim 17 , wherein the acoustic property is determined via a first device, and the intermediate audio signal is determined via a second device different from the first device.
19 . The system of claim 12 , wherein:
the virtual environment is part of a mixed reality environment,
the surface of the virtual reality environment comprises a surface of the mixed reality environment,
the intermediate audio signal is associated with a sound source, and
a location of the sound source comprises a location of the mixed reality environment.
20 . A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
determining an intermediate audio signal, the intermediate audio signal corresponding to a reflection of an input audio signal by a surface of a virtual environment, wherein:
said determining the intermediate audio signal comprises encoding the input audio signal based on a location of a listener,
the location of the listener is determined via one or more sensors of a wearable head device, and
the intermediate audio signal is associated with a first plurality of channels;
associating the intermediate audio signal with a bus, wherein the bus is associated with the first plurality of channels; and
presenting, via the bus, an output audio signal to the listener, wherein:
the output audio signal is determined via decoding the intermediate audio signal to produce a decoded intermediate audio signal, and
the decoded intermediate audio signal is associated with a second plurality of channels, different from the first plurality of channels.