Method of rendering an audio element having a size, corresponding apparatus and computer program
A method ( 1900 ) for rendering an audio element ( 102 ) is provided. The method comprises obtaining (s 1902 ) size information indicating a size of a representation of the audio element and/or distance information indicating a distance between the audio element and a listener. The method also comprises, based on the size information and/or the distance information, determining (s 1904 ) a number of virtual loudspeakers to use for rendering the audio element.
1 . A method for rendering an audio element, the method comprising:
obtaining size information indicating a size of a representation of the audio element and/or distance information indicating a distance between the audio element and a listener position; and
based on the size information and/or the distance information, determining a number of virtual loudspeakers to use for rendering the audio element, wherein
the size of the representation is a width of the representation and/or a height of the representation,
the method comprises determining (i) a width angle value associated with the width of the representation and the distance and/or (ii) a height angle value associated with the height of the representation and the distance, and
the number of the virtual loudspeakers to use for rendering the audio element is determined based on the width angle value and/or the height angle value.
2 . The method of claim 1 , the method comprising:
(i) comparing the width angle value with a first threshold value; and
(ii) comparing the height angle value with a second threshold value, wherein
the number of the virtual loudspeakers to use for rendering the audio element is determined based on the comparison (i) and/or the comparison (ii).
3 . The method of claim 2 , wherein
the number of the virtual loudspeakers to use for rendering the audio element is determined to be a first value if (i) the width angle value is less than the first threshold value and (ii) the height angle value is less than the second threshold value,
the number of the virtual loudspeakers to use for rendering the audio element is determined to be a second value if (i) the width angle value is greater than or equal to the first threshold value and (ii) the height angle value is less than the second threshold value,
the number of the virtual loudspeakers to use for rendering the audio element is determined to be the second value if (i) the width angle value is less than the first threshold value and (ii) the height angle value is greater than or equal to the second threshold value, and
the number of the virtual loudspeakers to use for rendering the audio element is determined to be a third value if (i) the width angle value is greater than or equal to the first threshold value and (ii) the height angle value is greater than or equal to the second threshold value.
4 . The method of claim 1 , wherein
the width angle value is determined based on
sin
c
×
a
2
or the height angle value is determined based on
sin
c
×
e
2
,
where c is a constant,
a is an angle formed by a line between the listener position and a first point on a first side of the representation and a line between the listener position and a second point on a second side of the representation,
the first side is opposite to the second side,
e is an angle formed by a line between the listener position and a third point on a third side of the representation and a line between the listener position and a fourth point on a fourth side of the representation, and
the third side is opposite to the fourth side.
5 . The method of claim 1 , the method further comprising:
determining positions of the virtual loudspeakers, wherein
the positions of the virtual loudspeakers are determined based on a boundary of the representation.
6 . The method of claim 5 , wherein
the determined number of the virtual loudspeakers is one, and
the position of the virtual loudspeaker is the center of the representation.
7 . The method of claim 5 , wherein
the determined number of the virtual loudspeakers is more than two,
the virtual loudspeakers comprise a first virtual loudspeaker, a second virtual loudspeaker, and a third virtual loudspeaker,
a position of the first virtual loudspeaker is the center of the representation, and
a position of the second virtual loudspeaker and a position of the third virtual loudspeaker are symmetric with respect to a line through the position of the first virtual loudspeaker.
8 . The method of claim 1 , the method further comprising:
obtaining changed distance information indicating a changed distance between the audio element and the listener position; and
based on the size information and the changed distance information, re-determining a number of virtual loudspeakers to use for rendering the audio element.
9 . The method of claim 8 , wherein
the determined number of the virtual loudspeakers is 1 and the virtual loudspeakers of which the number is determined includes a first virtual loudspeaker,
the redetermined number of the virtual loudspeakers is 3 and the virtual loudspeakers of which the number is redetermined includes the first virtual loudspeaker, a second virtual loudspeaker, and a third virtual loudspeaker, and
an audio gain associated with the second virtual loudspeaker and/or an audio gain associated with the third virtual loudspeaker is a function of an angle formed by a line between the listener position and a position of the second virtual loudspeaker and a line between the listener position and a position of the third virtual loudspeaker.
10 . The method of claim 1 , the method further comprising:
obtaining changed distance information indicating a changed distance between the audio element and the listener position; and
based on the size information and the changed distance information, obtaining an updated representation of the audio element and determining an updated number of virtual loudspeakers to use for the updated representation of the audio element.
11 . The method of claim 10 , wherein
the determined representation of the audio element is a one-dimensional, 1D, representation of the audio element, and
the determined updated representation of the audio element is a two-dimensional, 2D, representation of the audio element,
the 1D representation of the audio element comprises a first virtual loudspeaker, a second virtual loudspeaker, and a third virtual loudspeaker,
the 2D representation of the audio element comprises the first virtual loudspeaker, the second virtual loudspeaker, the third virtual loudspeaker, a fourth virtual loudspeaker, and a fifth virtual loudspeaker, and
the method further comprises (i) moving the second virtual loudspeaker from a first coordinate towards a first boundary coordinate of the updated representation of the audio element and (ii) moving the third virtual loudspeaker from a second coordinate towards a second boundary coordinate of the updated representation of the audio element.
12 . The method of claim 11 , wherein
a current coordinate of the second virtual loudspeaker depends on (the first coordinate×(1−f(e))+the first boundary coordinate×f(e)),
a current coordinate of the third virtual loudspeaker depends on (the second coordinate×(1−f(e))+the second boundary coordinate×f(e)), and
e is a value of an angle related to a width or a height of the 2D representation.
13 . The method of claim 11 , the method further comprising:
determining an audio gain associated with the fourth virtual loudspeaker and/or an audio gain associated with the fifth virtual loudspeaker, wherein
the audio gain associated with the fourth virtual loudspeaker and/or the audio gain associated with the fifth virtual loudspeaker is a function, ƒ, of (i) a width angle associated with the width of the updated representation of the audio element and the distance and/or (ii) a height angle associated with the height of the updated representation of the audio element and the distance.
14 . The method of claim 13 , wherein the function is
f
(
p
)
=
{
0
,
p
<
p
st
g
(
p
)
,
p
st
≤
p
≤
p
end
0.5
,
p
>
p
end
,
where
p is equal to (c 1 ×the width angle or the height angle), p st is a lower threshold value, p end is a higher threshold value, c 1 is a constant, and g(p) is a function of which an output value increases as p increases.
15 . The method of claim 14 , wherein g(p) is greater than 0 but is less than or equal to 0.5.
16 . The method of claim 13 , wherein
the audio gain associated with the second virtual loudspeaker and/or the audio gain associated with the third virtual loudspeaker is set based on (1−f(p)).
17 . The method of claim 10 , wherein
the determined representation of the audio element is a point representation of the audio element,
the determined updated representation of the audio element is a two-dimensional, 2D, representation of the audio element,
the point representation of the audio element comprises a first virtual loudspeaker,
the 2D representation of the audio element comprises the first virtual loudspeaker, a second virtual loudspeaker, a third virtual loudspeaker, a fourth virtual loudspeaker, and a fifth virtual loudspeaker,
the method further comprises moving one or more of the second virtual loudspeaker, the third virtual loudspeaker, the fourth virtual loudspeaker, and the fifth virtual loudspeaker using a moving path function,
the moving path function is a function of (i) a width angle associated with the width of the updated representation of the audio element and the distance and (ii) a height angle associated with the height of the updated representation of the audio element and the distance.
18 . An apparatus for rendering an audio element, the apparatus comprising:
a memory; and
processing circuitry coupled to the memory, wherein the apparatus is configured to:
obtain size information indicating a size of a representation of the audio element and/or distance information indicating a distance between the audio element and a listener position; and
based on the size information and/or the distance information, determine a number of virtual loudspeakers to use for rendering the audio element, wherein
the size of the representation is a width of the representation and/or a height of the representation,
the method comprises determining (i) a width angle value associated with the width of the representation and the distance and/or (ii) a height angle value associated with the height of the representation and the distance, and
the number of the virtual loudspeakers to use for rendering the audio element is determined based on the width angle value and/or the height angle value.
19 . A non-transitory computer readable storage medium storing a computer program, the computer program comprising computer program code, which, when run on processing circuitry of a device for rendering an audio element causes the device to:
obtain size information indicating a size of a representation of the audio element and/or distance information indicating a distance between the audio element and a listener position; and
based on the size information and/or the distance information, determine a number of virtual loudspeakers to use for rendering the audio element, wherein
the size of the representation is a width of the representation and/or a height of the representation,
the method comprises determining (i) a width angle value associated with the width of the representation and the distance and/or (il) a height angle value associated with the height of the representation and the distance, and
the number of the virtual loudspeakers to use for rendering the audio element is determined based on the width angle value and/or the height angle value.