Seamless rendering of audio elements with both interior and exterior representations
A method ( 700 ) for spatial audio rendering of an audio element having an extent ( 101 ). The method includes determining (s 702 ) that a listener is within a transition region that is outside of the extent. The method also includes determining (s 704 ) a first interior rendering with an interior set of virtual loudspeakers. The method also includes determining (s 706 ) an exterior rendering with an exterior set of virtual loudspeakers, wherein the exterior set of virtual loudspeakers comprises first and second virtual loudspeakers. The method also includes, in response to determining that the listener is within the transition region, determining (s 708 ) a transition rendering, wherein the transition rendering includes the interior set of virtual loudspeakers with two loudspeakers in the interior set of virtual loudspeakers replaced by third and fourth virtual loudspeakers, the third and fourth virtual loudspeakers being based on the first and second virtual loudspeakers of the exterior set of virtual loudspeakers. The method also includes rendering (s 710 ) the transition rendering for the listener.
1. A method for spatial audio rendering of an audio element having an extent, the method comprising:
determining that a listener is within a transition region that is outside of the extent;
determining a first interior rendering with an interior set of virtual loudspeakers;
determining an exterior rendering with an exterior set of virtual loudspeakers, wherein the exterior set of virtual loudspeakers comprises first and second virtual loudspeakers;
in response to determining that the listener is within the transition region, determining a transition rendering, wherein the transition rendering includes the interior set of virtual loudspeakers with two loudspeakers in the interior set of virtual loudspeakers replaced by third and fourth virtual loudspeakers, the third and fourth virtual loudspeakers being based on the first and second virtual loudspeakers of the exterior set of virtual loudspeakers; and
rendering the transition rendering for the listener.
2. The method of claim 1 , wherein the transition region comprises points outside of the extent within a threshold distance of the extent.
3. The method of claim 2 , wherein the threshold distance of the extent is a fixed value or a function of a position of the listener with respect to a boundary of the extent.
4. The method of claim 1 , wherein the third virtual loudspeakers has a position based on interpolating positions of the first virtual loudspeaker and the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the third virtual loudspeaker, and the fourth virtual loudspeakers has a position based on interpolating positions of the second virtual loudspeaker and the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the fourth virtual loudspeaker.
5. The method of claim 1 , further comprising determining a second interior rendering by rotating the interior set of virtual loudspeakers based on a surface normal of the extent.
6. The method of claim 5 , wherein a front speaker of the interior set of virtual loudspeakers is aligned with a negative direction of the surface normal of the extent when rotated.
7. The method of claim 1 , wherein rendering the transition rendering for the listener comprises cross-fading the audio signal of the first virtual loudspeaker of the exterior set of virtual loudspeakers with the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the third virtual loudspeaker and cross-fading the audio signal of the second virtual loudspeaker of the exterior set of virtual loudspeakers with the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the fourth virtual loudspeaker.
8. The method of claim 1 , the method further comprising:
when rendering the transition rendering for the listener, determining that the listener is either outside the extent or within an internal fade region that is inside of the extent;
in response to determining that the listener is either outside the extent or within the internal fade region, determining a second interior rendering, wherein the second interior rendering applies a gain g F to a virtual loudspeaker in the interior set of virtual loudspeakers located in a rear hemisphere; and
rendering the second interior rendering for the listener.
9. The method of claim 8 , wherein the internal fade region comprises points inside of the extent within a threshold distance of a boundary of the extent.
10. The method of claim 8 , wherein, when the listener is outside the extent, then the gain gF is 0, and when the listener is within an internal fade region, then the gain
g
F
=
-
d
D
F
,
where d is a distance of the listener from a boundary of the extent and D F is a constant.
11. A node for spatial audio rendering of an audio element having an extent, the node being configured to:
determine that a listener is within a transition region that is outside of the extent;
determine a first interior rendering with an interior set of virtual loudspeakers;
determine an exterior rendering with an exterior set of virtual loudspeakers, wherein the exterior set of virtual loudspeakers comprises first and second virtual loudspeakers;
in response to determining that the listener is within the transition region, determine a transition rendering, wherein the transition rendering includes the interior set of virtual loudspeakers with two loudspeakers in the interior set of virtual loudspeakers replaced by third and fourth virtual loudspeakers, the third and fourth virtual loudspeakers being based on the first and second virtual loudspeakers of the exterior set of virtual loudspeakers; and
render the transition rendering for the listener.
12. The node of claim 11 , wherein the transition region comprises points outside of the extent within a threshold distance of the extent.
13. The node of claim 12 , wherein the threshold distance of the extent is a fixed value or a function of a position of the listener with respect to a boundary of the extent.
14. The node of claim 11 , wherein the third virtual loudspeakers has a position based on interpolating positions of the first virtual loudspeaker and the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the third virtual loudspeaker, and the fourth virtual loudspeakers has a position based on interpolating positions of the second virtual loudspeaker and the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the fourth virtual loudspeaker.
15. The node of claim 11 , further being adapted to determine a second interior rendering by rotating the interior set of virtual loudspeakers based on a surface normal of the extent.
16. The node of claim 15 , wherein a front speaker of the interior set of virtual loudspeakers is aligned with a negative direction of the surface normal of the extent when rotated.
17. The node of claim 11 , wherein rendering the transition rendering for the listener comprises cross-fading the audio signal of the first virtual loudspeaker of the exterior set of virtual loudspeakers with the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the third virtual loudspeaker and cross-fading the audio signal of the second virtual loudspeaker of the exterior set of virtual loudspeakers with the one of the two loudspeakers in the interior set of virtual loudspeakers that is replaced by the fourth virtual loudspeaker.
18. The node of claim 11 , the node being further adapted to:
when rendering the transition rendering for the listener, determine whether the listener is either outside the extent or within an internal fade region that is inside of the extent;
in response to determining that the listener is either outside the extent or within the internal fade region, determine a second interior rendering, wherein the second interior rendering applies a gain g F to a virtual loudspeaker in the interior set of virtual loudspeakers located in a rear hemisphere; and
render the second interior rendering for the listener.
19. The node of claim 18 , wherein the internal fade region comprises points inside of the extent within a threshold distance of a boundary of the extent.
20. The node of claim 18 , wherein, when the listener is outside the extent, then the gain gF is 0, and when the listener is within an internal fade region, then the gain
g
F
=
-
d
D
F
,
where d is a distance of the listener from a boundary of the extent and D F is a constant.