Efficient rendering of virtual soundfields
An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.
1. A method of spatially rendering an audio signal, the method comprising:
determining a model of a virtual environment;
determining a spatial configuration of the virtual environment;
determining a plurality of signals associated with the spatial configuration and the model;
determining whether an energy level of the plurality of signals exceeds a predetermined threshold;
in accordance with a determination that the energy level exceeds the predetermined threshold, decoding one or more signals of the plurality of signals, the energy level corresponding to the one or more signals; and
rendering the audio signal based on the one or more decoded signals.
2. The method of claim 1 , further comprising:
in accordance with a determination that the energy level exceeds the predetermined threshold, applying the one or more signals to a head related transfer function (HRTF);
in accordance with a determination that the energy level does not exceed the predetermined threshold, forgoing applying the one or more signals to the HRTF.
3. The method of claim 1 , wherein decoding the one or more signals comprises applying a first set of processing blocks to the one or more signals, and wherein the method further comprises:
in accordance with a determination that the energy level does not exceed the predetermined threshold, bypassing a second set of processing blocks, the second set of processing blocks associated with one or more inactive virtual speakers.
4. The method of claim 3 , wherein the bypass of the second set of processing blocks includes forgoing transmitting the one or more signals to a decoder, the decoder comprising the second set of processing blocks.
5. The method of claim 3 , further comprising:
in accordance with a determination that the energy level exceeds the predetermined threshold, transmitting the one or more signals to the decoder, the decoder comprising the first set of processing blocks.
6. The method of claim 5 , further comprising:
in accordance with a determination that the energy level exceeds the predetermined threshold, applying the one or more signals to an HRTF, the one or more signals received from the decoder.
7. The method of claim 1 ,
wherein determining the model of the virtual environment comprises:
receiving one or more input sound signals from a direct sound source and from a reflection sound source;
modifying the one or more input sound signals to simulate a doppler effect;
applying a delay to the one or more input sound signals; and
panning the one or more sound signals across a plurality of virtual speakers, and wherein decoding the one or more signals comprises:
determining one or more virtualized sounds associated with a movement of one or more of the direct sound source, the reflection sound source, and a user.
8. A system to spatially render an audio signal, the system comprising:
a wearable head device configured to provide the audio signal to a user; and
one or more processors configured to execute a method comprising:
determining a model of a virtual environment;
determining a spatial configuration of the virtual environment;
determining a plurality of signals associated with the spatial configuration and the model;
determining whether an energy level of the plurality of signals exceeds a predetermined threshold;
in accordance with a determination that the energy level exceeds the predetermined threshold, decoding one or more signals of the plurality of signals, the energy level corresponding to the one or more signals; and
rendering the audio signal based on the one or more decoded signals.
9. The system of claim 8 , wherein the method further comprises:
in accordance with a determination that the energy level exceeds the predetermined threshold, applying the one or more signals to a head related transfer function (HRTF);
in accordance with a determination that the energy level does not exceed the predetermined threshold, forgoing applying the one or more signals to the HRTF.
10. The system of claim 8 , wherein decoding the one or more signals comprises applying a first set of processing blocks to the one or more signals, and wherein the method further comprises:
in accordance with a determination that the energy level does not exceed the predetermined threshold, bypassing a second set of processing blocks, the second set of processing blocks associated with one or more inactive virtual speakers.
11. The system of claim 10 , wherein the bypass of the second set of processing blocks includes forgoing transmitting the one or more signals to a decoder, the decoder comprising the second set of processing blocks.
12. The system of claim 11 , wherein the method further comprises:
in accordance with a determination that the energy level exceeds the predetermined threshold, transmitting the one or more signals to the decoder, the decoder comprising the first set of processing blocks.
13. The system of claim 12 , wherein the method further comprises:
in accordance with a determination that the energy level exceeds the predetermined threshold, applying the one or more signals to an HRTF, the one or more signals received from the decoder.
14. The system of claim 8 ,
wherein determining the model of the virtual environment comprises:
receiving one or more input sound signals from a direct sound source and from a reflection sound source;
modifying the one or more input sound signals to simulate a doppler effect;
applying a delay to the one or more input sound signals; and
panning the one or more sound signals across a plurality of virtual speakers, and wherein decoding the one or more signals comprises:
determining one or more virtualized sounds associated with a movement of one or more of the direct sound source, the reflection sound source, and a user.