Method and apparatus for spatial audio reproduction using directional room impulse responses interpolation

1. A method for spatial audio reproduction based on directional room impulse responses, the method being performed by a processor that executes at least one instruction stored in memory, the method comprising:

selecting measurement points around a listener based on a location of the listener;

calculating a directional room impulse response (D-RIR) for the location of the listener based on directional room impulse responses (D-RIRs) for the measurement points around the listener; and

reproducing spatial audio at the location of the listener based on the D-RIR at the location of the listener.

2. The method of claim 1 , wherein the calculating comprises calculating the D-RIR for the location of the listener by interpolating the D-RIRs for the plurality of measurement points around the listener for the location of the listener.

3. The method of claim 2 , wherein the calculating comprises:

extracting an attenuation level, a delay, and a direction of arrival of reflection from each of the multiple D-RIRs previously measured for the plurality of measurement points around the listener; and

calculating the D-RIR for the location of the listener by interpolating the D-RIR information, extracted from the multiple D-RIRs previously measured for the plurality of measurement points around the listener, for the location of the listener.

4. The method of claim 1 , wherein the calculating comprises:

obtaining D-RIRs arriving at the measurement points around the listener from at least one sound source;

interpolating the D-RIRs, arriving at the measurement points around the listener from the at least one sound source, for the location of the listener; and

obtaining a D-RIR arriving at the location of the listener from the at least one sound source based on results of the interpolation.

5. The method of claim 4 , wherein:

the D-RIRs for the plurality of measurement points around the listener are signals obtained using ambisonic microphones; and

obtaining the D-RIRs arriving at the measurement points comprises:

detecting intervals of reflection components based on modeling using ambisonic microphones; and

calculating directions of arrival of reflections.

6. The method of claim 1 , wherein the calculating the D-RIR for the location of the listener comprises:

obtaining D-RIRs arriving at the measurement points around the listener from the at least one first sound source;

performing first interpolation on the D-RIRs, arriving at the measurement points around the listener from the at least one first sound source, for a location of a new second sound source;

performing second interpolation on D-RIRs, arriving at the measurement points around the listener from the second sound source obtained as a result of the first interpolation, for the location of the listener; and

obtaining a D-RIR, arriving at the location of the listener from the second sound source, based on results of the second interpolation.

7. The method of claim 1 , wherein the selecting comprises selecting two or more measurement points around the listener from among a plurality of virtual listener measurement points each having a D-RIR arriving from at least one sound source based on relative locations of the plurality of virtual listener measurement points and the location of the listener.

8. The method of claim 1 , wherein the selecting comprises selecting the measurement points around the listener from among a plurality of virtual listener measurement points that are distributed in a given space in a virtual reality environment having six degrees of freedom (6DoF) and each of the plurality of virtual listener measurement points have a D-RIR.

9. The method of claim 1 , wherein the calculating comprises calculating the D-RIR for the location of the listener using the D-RIRs previously obtained for the measurement points around the listener in a given space in a virtual reality environment having 6DoF.

10. A method for spatial audio reproduction based on directional room impulse responses, the method being performed by a processor that executes at least one instruction stored in memory, the method comprising:

selecting virtual listener locations as measurement points based on spatial information and at least one sound source location; and

obtaining directional room impulse responses (D-RIRs) for the virtual listener locations from the at least one sound source;

wherein the D-RIRs for the virtual listener locations from the at least one sound source comprise responses to sound arriving directly at the virtual listener locations from the at least one sound source, and responses to sound reflected within a given space and arriving at the virtual listener locations, based on information about the given space in a six degrees of freedom (6DoF) virtual reality environment.

11. An apparatus for spatial audio reproduction based on directional room impulse responses, the apparatus comprising:

memory configured to store at least one instruction; and

a processor configured to execute the at least one instruction;

wherein the processor is further configured to execute the at least one instruction to:

select measurement points around a listener based on the location of the listener;

calculate a directional room impulse response (D-RIR) for the location of the listener based on directional room impulse responses (D-RIRs) for the measurement points around the listener; and

reproduce spatial audio at the location of the listener based on the D-RIR for the location of the listener.

12. The apparatus of claim 11 , wherein the processor is further configured to execute the at least one instruction to calculate the D-RIR for the location of the listener by interpolating the D-RIRs for the plurality of measurement points around the listener for the location of the listener.

13. The apparatus of claim 12 , wherein the processor is further configured to execute the at least one instruction to:

extract an attenuation level, a delay, and a direction of arrival of reflection from each of the multiple D-RIRs previously measured for the plurality of measurement points around the listener; and

calculate the D-RIR for the location of the listener by interpolating the D-RIR information, extracted from the multiple D-RIRs previously measured for the plurality of measurement points around the listener, for the location of the listener.

14. The apparatus of claim 11 , wherein the processor is further configured to execute the at least one instruction to:

obtain D-RIRs arriving at the measurement points around the listener from at least one sound source;

interpolate the D-RIRs, arriving at the measurement points around the listener from the at least one sound source, for the location of the listener; and

obtain a D-RIR arriving at the location of the listener from the at least one sound source based on results of the interpolation.

15. The apparatus of claim 11 , wherein:

the D-RIRs for the plurality of measurement points around the listener are signals obtained using ambisonic microphones; and

the processor is further configured to execute the at least one instruction to obtain the D-RIRs arriving at the measurement points by detecting intervals of reflection components based on modeling using ambisonic microphones and calculating directions of arrival of reflections.

16. The apparatus of claim 11 , wherein the processor is further configured to execute the at least one instruction to:

obtain D-RIRs arriving at the measurement points around the listener from the at least one first sound source;

perform first interpolation on the D-RIRs, arriving at the measurement points around the listener from the at least one first sound source, for a location of a new second sound source;

perform second interpolation on D-RIRs, arriving at the measurement points around the listener from the second sound source obtained as a result of the first interpolation, for the location of the listener; and

obtain a D-RIR, arriving at the location of the listener from the second sound source, based on results of the second interpolation.

17. The apparatus of claim 11 , wherein the processor is further configured to execute the at least one instruction to select two or more measurement points around the listener from among a plurality of virtual listener measurement points each having a D-RIR arriving from at least one sound source based on relative locations the plurality of virtual listener measurement points and the location of the listener.

18. The apparatus of claim 11 , wherein the processor is further configured to execute the at least one instruction to select the measurement points around the listener from among a listener measurement points that are plurality of virtual distributed in a given space in a virtual reality environment having six degrees of freedom (6DoF) and each of the plurality of virtual listener measurement points have a D-RIR.

19. The apparatus of claim 11 , wherein the processor is further configured to execute the at least one instruction to calculate the D-RIR for the location of the listener using the D-RIRs previously obtained for the measurement points around the listener in a given space in a virtual reality environment having 6DoF.

20. The apparatus of claim 11 , wherein:

the processor is further configured to execute the at least one instruction to:

select virtual listener locations as measurement points based on spatial information and at least one sound source location; and

obtain D-RIRs for the virtual listener locations from the at least one sound source; and

wherein the D-RIRs for the virtual listener locations from the at least one sound source comprise responses to sound arriving directly at the virtual listener locations from the at least one sound source, and responses to sound reflected within a given space and arriving at the virtual listener locations, based on information about the given space in a six degrees of freedom (6DoF) virtual reality environment.