Spatial audio for interactive audio environments
Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reflection of the input audio signal in a surface of the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source, and further based on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.
1. A method comprising:
determining, based on a location of a sound source and further based on an acoustic property of a virtual environment, an intermediate audio signal, the intermediate audio signal corresponding to a reflection of an input audio signal by a surface of the virtual environment, wherein:
said determining the intermediate audio signal comprises encoding the input audio signal based on the location of the sound source, and
the intermediate audio signal is associated with a first plurality of channels;
associating the intermediate audio signal with a bus, wherein the bus is associated with the first plurality of channels; and
presenting, via the bus, an output audio signal to a listener, wherein:
the output audio signal is determined via decoding the intermediate audio signal to produce a decoded intermediate audio signal, and
the decoded intermediate audio signal is associated with a second plurality of channels, different from the first plurality of channels.
2. The method of claim 1 , wherein the acoustic property of the virtual environment is determined via one or more sensors.
3. The method of claim 2 , wherein the one or more sensors comprise one or more microphones.
4. The method of claim 2 , wherein the one or more sensors comprise one or more cameras.
5. The method of claim 2 , wherein:
the one or more sensors are associated with a wearable head device configured to be worn by the listener, and
the output audio signal is presented to the listener via one or more speakers associated with the wearable head device.
6. The method of claim 1 , further comprising displaying to the listener, concurrently with the presentation of the output audio signal, a view of the virtual environment.
7. The method of claim 1 , further comprising retrieving the acoustic property from a database, wherein the acoustic property is determined via one or more sensors.
8. The method of claim 7 , wherein the retrieving the acoustic property comprises:
determining, based on an output of the one or more sensors, a location of the listener; and
identifying the acoustic property based on the location of the listener.
9. The method of claim 1 , wherein the intermediate audio signal is decoded via an ambisonics decoder.
10. The method of claim 1 , wherein the acoustic property is determined via a first device, and the intermediate audio signal is determined via a second device different from the first device.
11. The method of claim 1 , wherein:
the virtual environment is part of a mixed reality environment,
the surface of the virtual reality environment comprises a surface of the mixed reality environment, and
the location of the sound source comprises a location of the mixed reality environment.
12. A system, comprising:
one or more speakers; and
one or more processors configured to perform a method comprising:
determining, based on a location of a sound source and further based on an acoustic property of a virtual environment, an intermediate audio signal, the intermediate audio signal corresponding to a reflection of an input audio signal by a surface of the virtual environment, wherein:
said determining the intermediate audio signal comprises encoding the input audio signal based on the location of the sound source, and
the intermediate audio signal is associated with a first plurality of channels;
associating the intermediate audio signal with a bus, wherein the bus is associated with the first plurality of channels; and
presenting, via the bus and the one or more speakers, an output audio signal to a listener, wherein:
the output audio signal is determined via decoding the intermediate audio signal to produce a decoded intermediate audio signal, and
the decoded intermediate audio signal is associated with a second plurality of channels, different from the first plurality of channels.
13. The system of claim 12 , further comprising one or more sensors, wherein the acoustic property of the virtual environment is determined via the one or more sensors.
14. The system of claim 13 , wherein the one or more sensors comprise one or more microphones.
15. The system of claim 13 , wherein the one or more sensors comprise one or more cameras.
16. The system of claim 13 , wherein:
the one or more sensors and the one or more speakers are associated with a wearable head device configured to be worn by the listener.
17. The system of claim 12 , further comprising a display, wherein the method further comprises displaying to the listener, via the display and concurrently with the presentation of the output audio signal, a view of the virtual environment.
18. The system of claim 12 , wherein the acoustic property is determined via a first device, and the intermediate audio signal is determined via a second device different from the first device.
19. The system of claim 12 , wherein:
the virtual environment is part of a mixed reality environment,
the surface of the virtual reality environment comprises a surface of the mixed reality environment, and
the location of the sound source comprises a location of the mixed reality environment.
20. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
determining, based on a location of a sound source and further based on an acoustic property of a virtual environment, an intermediate audio signal, the intermediate audio signal corresponding to a reflection of an input audio signal by a surface of the virtual environment, wherein:
said determining the intermediate audio signal comprises encoding the input audio signal based on the location of the sound source, and
the intermediate audio signal is associated with a first plurality of channels;
associating the intermediate audio signal with a bus, wherein the bus is associated with the first plurality of channels; and
presenting, via the bus, an output audio signal to a listener, wherein:
the output audio signal is determined via decoding the intermediate audio signal to produce a decoded intermediate audio signal, and
the decoded intermediate audio signal is associated with a second plurality of channels, different from the first plurality of channels.