Methods and systems for generating audio for an extended reality world

1. A method comprising:

accessing, by an acoustics generation system, acoustic propagation data representative of characteristics affecting propagation of a virtual sound to an avatar within an extended reality world being experienced by a user associated with the avatar;

decoding, by the acoustics generation system, time-domain audio data representative of the virtual sound from a first encoded audio data format to a raw audio data format;

transforming, by the acoustics generation system, the time-domain audio data in the raw audio data format into frequency-domain audio data representative of the virtual sound;

generating, by the acoustics generation system based on the acoustic propagation data and the frequency-domain audio data, a frequency-domain binaural audio signal representative of the virtual sound as experienced by the avatar when the propagation of the virtual sound to the avatar is simulated in accordance with the characteristics affecting the propagation; and

preparing, by the acoustics generation system, the frequency-domain binaural audio signal for presentation to the user as the user experiences the extended reality world by way of the avatar.

2. The method of claim 1 , wherein:

the acoustics generation system is implemented on a multi-access-edge compute (“MEG”) server; and

the accessing of the acoustic propagation data includes receiving the acoustic propagation data from at least one of:

a media player device separate from the MEC server and used by the user to experience the extended reality world, or

a world management server separate from the MEC server and used for managing world data associated with a plurality of users that includes the user.

3. The method of claim 1 , wherein the frequency-domain audio data comprises audio data for a plurality of distinct frequency components of the virtual sound including a first frequency component associated with a first frequency and a second frequency component associated with a second frequency.

4. The method of claim 3 , wherein the generating of the frequency-domain binaural audio signal comprises independently simulating a first attenuation of the first frequency component and a second attenuation of the second frequency component, the first attenuation simulated based on the first frequency and the second attenuation simulated based on the second frequency.

5. The method of claim 3 , wherein the generating of the frequency-domain binaural audio signal comprises independently simulating a first diffraction of the first frequency component and a second diffraction of the second frequency component, the first diffraction simulated based on the first frequency and the second diffraction based on the second frequency.

6. The method of claim 3 , wherein the generating of the frequency-domain binaural audio signal comprises independently simulating a first absorption of the first frequency component and a second absorption of the second frequency component, the first absorption simulated based on the first frequency and the second absorption based on the second frequency.

7. The method of claim 1 , wherein the preparing of the frequency-domain binaural audio signal for presentation to the user includes:

transforming the frequency-domain binaural audio signal into a time-domain binaural audio signal; and

transmitting, by way of a network, the time-domain binaural audio signal to a media player device used by the user to experience the extended reality world.

8. The method of claim 1 , wherein the preparing of the frequency-domain binaural audio signal for presentation to the user includes:

transforming the frequency-domain binaural audio signal into a time-domain binaural audio signal;

encoding the time-domain binaural audio signal in an encoded audio data format; and

transmitting, by way of a network, the time-domain binaural audio signal in the encoded audio data format to a media player device used by the user to experience the extended reality world.

9. The method of claim 1 , wherein:

the accessed acoustic propagation data includes real-time head pose data dynamically indicating a location and an orientation of a virtual head of the avatar with respect to a sound source originating the virtual sound within the extended reality world; and

the generating of the frequency-domain binaural audio signal comprises applying, to audio data representative of the virtual sound, a head-related transfer function based on the real-time head pose data.

10. The method of claim 1 , further comprising:

accessing, by the acoustics generation system, audio data representative of a first virtual sound and a second virtual sound presented to the avatar within the extended reality world, the first and second virtual sounds originating, respectively, from a first virtual sound source at a first virtual location within the extended reality world and a second virtual sound source at a second virtual location within the extended reality world distinct from the first virtual location; and

wherein the virtual sound incorporates the first and second virtual sounds such that:

the acoustic propagation data is representative of characteristics affecting propagation of the first and second virtual sounds to the avatar, and

the frequency-domain binaural audio signal is representative of the first and second virtual sounds as experienced by the avatar when the first and second virtual sounds propagate to the avatar from the respective first and second virtual locations.

11. A system comprising:

a memory storing instructions; and

a processor communicatively coupled to the memory and configured to execute the instructions to:

access acoustic propagation data representative of characteristics affecting propagation of a virtual sound to an avatar within an extended reality world being experienced by a user associated with the avatar;

decode time-domain audio data representative of the virtual sound from a first encoded audio data format to a raw audio data format;

transform the time-domain audio data in the raw audio data format into frequency-domain audio data representative of the virtual sound;

generate, based on the acoustic propagation data and the frequency-domain audio data, a frequency-domain binaural audio signal representative of the virtual sound as experienced by the avatar when the propagation of the virtual sound to the avatar is simulated in accordance with the characteristics affecting the propagation; and

prepare the frequency-domain binaural audio signal for presentation to the user as the user experiences the extended reality world by way of the avatar.

12. The system of claim 11 , wherein:

the memory and the processor are implemented within a multi-access-edge compute (“MEG”) server; and

the accessing of the acoustic propagation data includes receiving the acoustic propagation data from at least one of:

a media player device separate from the MEC server and used by the user to experience the extended reality world, or

a world management server separate from the MEC server and used for managing world data associated with a plurality of users that includes the user.

13. The system of claim 11 , wherein:

the frequency-domain audio data comprises audio data for a plurality of distinct frequency components of the virtual sound including a first frequency component associated with a first frequency and a second frequency component associated with a second frequency; and

the generating of the frequency-domain binaural audio signal comprises independently simulating at least one of:

a first attenuation of the first frequency component and a second attenuation of the second frequency component, the first attenuation simulated based on the first frequency and the second attenuation simulated based on the second frequency,

a first diffraction of the first frequency component and a second diffraction of the second frequency component, the first diffraction simulated based on the first frequency and the second diffraction based on the second frequency, or

a first absorption of the first frequency component and a second absorption of the second frequency component, the first absorption simulated based on the first frequency and the second absorption based on the second frequency.

14. The system of claim 11 , wherein the preparing of the frequency-domain binaural audio signal for presentation to the user includes:

transforming the frequency-domain binaural audio signal into a time-domain binaural audio signal; and

transmitting, by way of a network, the time-domain binaural audio signal to a media player device used by the user to experience the extended reality world.

15. The system of claim 11 , wherein the preparing of the frequency-domain binaural audio signal for presentation to the user includes:

transforming the frequency-domain binaural audio signal into a time-domain binaural audio signal;

encoding the time-domain binaural audio signal in an encoded audio data format; and

transmitting, by way of a network, the time-domain binaural audio signal in the encoded audio data format to a media player device used by the user to experience the extended reality world.

16. The system of claim 11 , wherein:

the accessed acoustic propagation data includes real-time head pose data dynamically indicating a location and an orientation of a virtual head of the avatar with respect to a sound source originating the virtual sound within the extended reality world; and

the generating of the frequency-domain binaural audio signal comprises applying, to audio data representative of the virtual sound, a head-related transfer function based on the real-time head pose data.

17. The system of claim 11 , wherein:

the processor is further configured to execute the instructions to access audio data representative of a first virtual sound and a second virtual sound presented to the avatar within the extended reality world, the first and second virtual sounds originating, respectively, from a first virtual sound source at a first virtual location within the extended reality world and a second virtual sound source at a second virtual location within the extended reality world distinct from the first virtual location; and

the virtual sound incorporates the first and second virtual sounds such that:

the acoustic propagation data is representative of characteristics affecting propagation of the first and second virtual sounds to the avatar, and

the frequency-domain binaural audio signal is representative of the first and second virtual sounds as experienced by the avatar when the first and second virtual sounds propagate to the avatar from the respective first and second virtual locations.

18. A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a computing device to:

access acoustic propagation data representative of characteristics affecting propagation of a virtual sound to an avatar within an extended reality world being experienced by a user associated with the avatar;

decode time-domain audio data representative of the virtual sound from a first encoded audio data format to a raw audio data format;

transform the time-domain audio data in the raw audio data format into frequency-domain audio data representative of the virtual sound;

generate, based on the acoustic propagation data and the frequency-domain audio data, a frequency-domain binaural audio signal representative of the virtual sound as experienced by the avatar when the propagation of the virtual sound to the avatar is simulated in accordance with the characteristics affecting the propagation; and

prepare the frequency-domain binaural audio signal for presentation to the user as the user experiences the extended reality world by way of the avatar.

19. The non-transitory computer-readable medium of claim 18 , wherein the preparing of the frequency-domain binaural audio signal for presentation to the user includes:

transforming the frequency-domain binaural audio signal into a time-domain binaural audio signal; and

transmitting, by way of a network, the time-domain binaural audio signal to a media player device used by the user to experience the extended reality world.

20. The non-transitory computer-readable medium of claim 18 , wherein the preparing of the frequency-domain binaural audio signal for presentation to the user includes:

transforming the frequency-domain binaural audio signal into a time-domain binaural audio signal;

encoding the time-domain binaural audio signal in an encoded audio data format; and

transmitting, by way of a network, the time-domain binaural audio signal in the encoded audio data format to a media player device used by the user to experience the extended reality world.