Method and apparatus for determining for the compression of an HOA data frame representation a lowest integer number of bits required for representing non-differential gain values
View Patent ↗When compressing an HOA data frame representation, a gain control ( 15, 151 ) is applied for each channel signal before it is perceptually encoded ( 16 ). The gain values are transferred in a differential manner as side information. However, for starting decoding of such streamed compressed HOA data frame representation absolute gain values are required, which should be coded with a minimum number of bits. For determining such lowest integer number (β e ) of bits the HOA data frame representation (C(k)) is rendered in spatial domain to virtual loudspeaker signals lying on a unit sphere, followed by normalization of the HOA data frame representation (C(k)). Then the lowest integer number of bits is set to: (AA).
1. A method for determining for the compression of a Higher Order Ambisonics (HOA) data frame representation (C(k)) a lowest integer number β e of bits for describing representations of non-differential gain values corresponding to amplitude changes as an exponent of two (2 e ) for channel signals of the HOA data frames, wherein each channel signal in each frame comprises a group of sample values and wherein to each channel signal of each one of the HOA data frames a differential gain value is assigned, wherein the differential gain value causes a change of amplitudes of first sample values of a channel signal in a current HOA data frame ((k−2)) with respect to second sample values of a channel signal in a previous HOA data frame ((k−3)), and wherein resulting gain adapted channel signals are encoded in an encoder,
and wherein the HOA data frame representation was rendered in a spatial domain to O virtual loudspeaker signals w j (t), wherein positions of the virtual loudspeakers are lying on a unit sphere and are targeted to be distributed uniformly on that unit sphere, said rendering being represented by a matrix multiplication w(t)=(Ψ) −1 ·c(t), wherein w(t) is a vector containing all virtual loudspeaker signals, Ψ is a virtual loudspeaker positions mode matrix, and c(t) is a vector of the corresponding HOA coefficient sequences of the HOA data frame representation,
and wherein said HOA data frame representation (C(k)) was normalised such that
w
(
t
)
∞
=
max
1
≤
j
≤
0
w
j
(
t
)
≤
1
∀
t
,
the method including:
forming channel signals by:
a) for representing predominant sound signals (x(t)) in the channel signals, multiplying a vector of HOA coefficient sequences c(t) by a mixing matrix A, wherein mixing matrix A represents a linear combination of coefficient sequences of a normalised HOA data frame representation;
b) for representing an ambient component c AMB (t) in the channel signals, subtracting the predominant sound signals from the normalised HOA data frame representation, and transforming a resulting minimum ambient component C AMB,MIN (t) by computing w MIN (t)=Ψ MIN −1 ·c AMB,MIN (t), wherein ∥Ψ MIN −1 ∥ 2 <1 and Ψ MIN is a mode matrix for said minimum ambient component c AMB,MIN (t);
c) selecting part of the HOA coefficient sequences c(t) that relate to coefficient sequences of the ambient HOA component to which a spatial transform is applied;
determining the integer number β e of bits based on β e =└log 2 (└log 2 (√{square root over (K MAX )}·O)┘+1)┘, wherein K MAX =max 1≤N≤N MAX K(N, Ω 1 (N) , . . . , Ω O (N) ), N is the order, N MAX is a maximum order of interest, Ω 1 (N) , . . . , Ω O (N) are directions of said virtual loudspeakers, O=(N+1) 2 is the number of HOA coefficient sequences, and K is a ratio between the squared Euclidean norm ∥Ψ∥ 2 £ of said mode matrix and O.
2. A method according to claim 1 , wherein, in addition to said transformed minimum ambient component, non-transformed ambient coefficient sequences of the ambient component c AMB (t) are contained in the channel signal.
3. A method according to claim 1 , wherein the representations of non-differential gain values (2 e ) associated with said channel signals of specific ones of said HOA data frames are transferred as side information wherein each one of them is represented by β e bits.
4. A method according to claim 1 , wherein the integer number β e of bits is set to β e =└log 2 (└log 2 (√{square root over (K MAX )}·O)┘+e MAX +1)┘, wherein e MAX >0 serves for increasing the number of bits β e based on a determination that the amplitudes of the sample values of a channel signal before gain control are lower than a threshold value.
5. A method according to claim 1 , wherein √{square root over (K MAX )}=1.5.
6. A method according to claim 1 , wherein said mixing matrix A is determined such as to minimise the Euclidean norm of the residual between the original HOA representation and that of the predominant sound signals, by taking the Moore-Penrose pseudo inverse of a mode matrix formed of all vectors representing directional distribution of monaural predominant sound signals.
7. A method according to claim 1 , wherein based on a determination that the positions of the O virtual loudspeaker signals do not match positions assumed for the computation of β e , including:
computing the mode matrix Ψ based on the non-matching virtual loudspeaker positions;
computing the Euclidean norm ∥Ψ∥ 2 of the mode matrix;
computing a maximally allowed amplitude value
γ
=
min
(
1
,
O
·
K
MAX
,
DES
Ψ
2
)
which replaces a maximum allowed amplitude in said normalising,
wherein
K
MAX
,
DES
=
max
1
≤
N
≤
N
MAX
,
DES
K
(
N
,
Ω
DES
,
1
(
N
)
,
…
,
Ω
DES
,
O
(
N
)
)
,
N is the order, O=(N+1) 2 is the number of HOA coefficient sequences, K is a ratio between the squared Euclidean norm of said mode matrix and O, and where N MAX,DES is the order of interest and Ω DES,1 (N) , . . . , Ω DES,O (N) are for each order the directions of the virtual loudspeakers that were assumed for the implementation of said compression of said HOA data frame representation (C(k)), such that β e was chosen by β e =└log 2 (└log 2 (√{square root over (K MAX,DES )}·O)┘+1)┘ in order to code the exponents (e) to base ‘2’ of said non-differential gain values.
8. An apparatus for determining for the compression of a Higher Order Ambisonics (HOA) data frame representation (C(k)) a lowest integer number β e of bits for describing representations of non-differential gain values corresponding to amplitude changes as an exponent of two (2 e ) for channel signals of the HOA data frames,
wherein each channel signal in each frame comprises a group of sample values and wherein to each channel signal of each one of the HOA data frames a differential gain value is assigned, wherein the differential gain value causes a change of amplitudes of first sample values of a channel signal in a current HOA data frame ((k−2)) with respect to second sample values of a channel signal in a previous HOA data frame ((k−3)), and wherein resulting gain adapted channel signals are encoded in an encoder,
and wherein the HOA data frame representation (C(k)) was rendered in a spatial domain to O virtual loudspeaker signals w j (t), wherein positions of the virtual loudspeakers are lying on a unit sphere and are targeted to be distributed uniformly on that unit sphere, said rendering being represented by a matrix multiplication w(t)=(Ψ) −1 ·c(t), wherein w(t) is a vector containing all virtual loudspeaker signals, Ψ is a virtual loudspeaker positions mode matrix, and c(t) is a vector of the corresponding HOA coefficient sequences of the HOA data frame representation,
and wherein said HOA data frame representation (C(k)) was normalised such that
w
(
t
)
∞
=
max
1
≤
j
≤
0
w
j
(
t
)
≤
1
∀
t
,
said apparatus including:
a processor configured to form said channel signals by:
a) for representing predominant sound signals (x(t)) in said channel signals, multiplying said vector of HOA coefficient sequences c(t) by a mixing matrix A, wherein mixing matrix A represents a linear combination of coefficient sequences of a normalised HOA data frame representation;
b) for representing an ambient component c AMB (t) in the channel signals, subtracting the predominant sound signals from the normalised HOA data frame representation, and transforming a resulting minimum ambient component C AMB,MIN (t) by computing w MIN (t)=Ψ MIN −1 ·c AMB,MIN (t), wherein ∥Ψ MIN −1 ∥ 2 <1 and Ψ MIN is a mode matrix for said minimum ambient component c AMB,MIN (t);
c) selecting part of the HOA coefficient sequences c(t) that relate to coefficient sequences of the ambient HOA component to which a spatial transform is applied;
the processor further configured to determine the integer number β e of bits based on β e =└log 2 (└log 2 (√{square root over (K MAX )}·O)┘+1)┘,
wherein K MAX =max 1≤N≤NMAX K(N, Ω 1 (N) , . . . , Ω O (N) ),N is the order, N MAX is a maximum order of interest, Ω 1 (N) , . . . , Ω O (N) are directions of said virtual loudspeakers, O=(N+1) 2 is the number of HOA coefficient sequences, and K is a ratio between the squared Euclidean norm ∥Ψ∥ 2 2 of said mode matrix and O.
9. An apparatus according to claim 8 , wherein, in addition to said transformed minimum ambient component, non-transformed ambient coefficient sequences of the ambient component c AMB (t) are contained in the channel signal.
10. An apparatus according to claim 8 , wherein the representations of non-differential gain values (2 e ) associated with said channel signals of specific ones of said HOA data frames are transferred as side information wherein each one of them is represented by β e bits.
11. An apparatus according to claim 8 , wherein the integer number β e of bits is set to β e =└log 2 (└log 2 (√{square root over (K MAX )}·O)┘+e MAX +1)┘, wherein e MAX >0 serves for increasing the number of bits β e based on a determination that the amplitudes of the sample values of a channel signal before gain control are lower than a threshold value.
12. An apparatus according to claim 8 , wherein √{square root over (K MAX )}=1.5.
13. An apparatus according to claim 8 , wherein said mixing matrix A is determined such as to minimise the Euclidean norm of the residual between the original HOA representation and that of the predominant sound signals, by taking the Moore-Penrose pseudo inverse of a mode matrix formed of all vectors representing directional distribution of monaural predominant sound signals.
14. An apparatus according to claim 8 , wherein the processor is further configured to determine, based on a determination that the positions of the O virtual loudspeaker signals do not match positions assumed for the computation of β e :
computing the mode matrix Ψ based on the non-matching virtual loudspeaker positions;
computing the Euclidean norm ∥Ψ∥ 2 of the mode matrix;
computing a maximally allowed amplitude value
γ
=
min
(
1
,
O
·
K
MAX
,
DES
Ψ
2
)
which replaces a maximum allowed amplitude in said normalising,
wherein
K
MAX
,
DES
=
max
1
≤
N
≤
N
MAX
,
DES
K
(
N
,
Ω
DES
,
1
(
N
)
,
…
,
Ω
DES
,
O
(
N
)
)
,
N is the order, O=(N+1) 2 is the number of HOA coefficient sequences, K is a ratio between the squared Euclidean norm of said mode matrix and O, and where N MAX,DES is the order of interest and Ω DES,1 (N) , . . . , Ω DES,0 (N) are for each order the directions of the virtual loudspeakers that were assumed for the implementation of said compression of said HOA data frame representation (C(k)), such that β e was chosen by β e =└log 2 (└log 2 (√{square root over (K MAX,DES )}·O)┘+1)┘ in order to code the exponents (e) to base ‘2’ of said non-differential gain values.
15. A method of decoding a compressed Higher Order Ambisonics (HOA) sound representation of a sound or sound field, the method comprising:
receiving a bit stream containing the compressed HOA representation, wherein the bitstream includes a number of HOA coefficients corresponding to the compressed HOA representation, and
decoding the compressed HOA representation based on a lowest integer number β e , wherein the lowest integer number β e is determined based on β e =└log 2 (└log 2 (√{square root over (K MAX )}·O)┘+1)┘,
wherein K MAX =max 1≤N≤N MAX K(N, Ω 1 (N) , . . . , Ω O (N) ), N is the order, N MAX is a maximum order of interest, Ω 1 (N) , . . . , Ω O (N) are directions of said virtual loudspeakers, O=(N+1) 2 is the number of HOA coefficient sequences, and K is a ratio between the squared Euclidean norm ∥Ψ∥ 2 2 of said mode matrix and O.
16. The method of claim 15 , wherein K MAX =1.5.
17. An apparatus for decoding a compressed Higher Order Ambisonics (HOA) sound representation of a sound or sound field, the apparatus comprising:
a processor configured to receive a bit stream containing the compressed HOA representation, wherein the bitstream includes a number of HOA coefficients corresponding to the compressed HOA representation, and the processor further configured to decode the compressed HOA representation based on a lowest integer number β e , wherein the lowest integer number β e is determined based on β e =└log 2 (└log 2 (√{square root over (K MAX )}·O)┘+1)┘,
wherein K MAX =max 1≤N≤N MAX K(N, Ω 1 (N) , . . . , Ω O (N) ), N is the order, N MAX is a maximum order of interest, Ω 1 (N) , . . . , Ω O (N) are directions of said virtual loudspeakers, O=(N+1) 2 is the number of HOA coefficient sequences, and K is a ratio between the squared Euclidean norm ∥Ψ∥ 2 2 of said mode matrix and O.
18. The apparatus of claim 17 , wherein K MAX =1.5.