IP Library › Granted Patent US 12,664,992
Granted Patent B2
US 12,664,992 · App. 18/245,028 · Granted Jun 23, 2026

Spatial audio parameter encoding and associated decoding

Inventor: Adriana Vasilache (Tampere, FI)
Assignee: NOKIA TECHNOLOGIES OY
G10L19/032G10L19/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,664,992
App. No.
18/245,028
Granted
Jun 23, 2026
Kind
B2
Abstract

An apparatus comprising means configured to: obtain a multichannel audio signal; obtain direction parameter values associated with at least two time-frequency parts of the multichannel audio signal, the direction parameter values associated with at least two time-frequency parts comprising an elevation element and an azimuth element associated with at least two time-frequency parts; and compand encode the obtained direction parameter values, the means configured to compand encode the obtained direction parameter values is further configured to: quantize the elevation element; determine a companding function based on the quantized elevation element and/or multichannel audio signal format; generate a companded azimuth element based on the companding function applied to the azimuth element; and quantize the companded azimuth element.

Claims (42)

1 . An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to with the at least one processor, cause the apparatus to:

obtain direction parameter values associated with each of at least two time-frequency tile of a multichannel audio signal, the direction parameter values associated with each time-frequency tile comprises an elevation element and an azimuth element; and

compand encode each obtained direction parameter values, by the apparatus being caused to for each obtained parameter value:

quantize the elevation element;

determine a companding function based on the quantized elevation element and/or multichannel audio signal format;

generate a companded azimuth element based on the companding function applied to the azimuth element; and

quantize the companded azimuth element.

2 . The apparatus as claimed in claim 1 , wherein the apparatus is further caused to decompand the quantized companded azimuth element based on an inverse of the companding function.

3 . The apparatus as claimed in claim 2 , wherein the apparatus caused to compand encode each obtained direction parameter value is further caused to generate a codeword for each quantized elevation element and decompanded quantized companded azimuth element.

4 . The apparatus as claimed in claim 1 , wherein the apparatus caused to determine a companding function based on the quantized elevation element and/or multichannel audio signal format is caused to determine a companding function based on the quantized elevation element and the multichannel audio signal format.

5 . The apparatus as claimed in claim 4 , wherein the apparatus caused to compand encode each obtained direction parameter value is further caused to determine a quantization error for the compand encode and an average elevation encode, wherein the apparatus caused to determine an average elevation encode is configured to:

quantize an average elevation element for a sub-band within a frame; and

quantize the azimuth element based on a quantization grid with variable borders, and wherein the means is configured to select a compand encode output or an average elevation encode output based on the quantization error.

6 . The apparatus as claimed in claim 1 , wherein the apparatus caused to compand encode each obtained direction parameter value is further caused to generate a codeword for each quantized elevation element and quantized companded azimuth element.

7 . The apparatus as claimed in claim 1 , wherein the apparatus is further caused to determine a quantization grid based on an allocated number of bits for encoding each sub-band within a frame comprising sub-bands and time blocks based on a value of an energy ratio value associated with each obtained direction parameter value, wherein the apparatus caused to quantize the elevation element is caused to quantize the elevation element based on the quantization grid, and the apparatus caused to quantize the companded azimuth element is caused to quantize the companded azimuth based on the quantization grid.

8 . An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to with the at least one processor, cause the apparatus to:

obtain at least one encoded bitstream comprising: an encoded multichannel audio signal and compand encoded direction parameter values, the compand encoded direction parameter values are associated with at least two time-frequency tiles of the encoded multichannel audio signal, and each compand encoded direction parameter values comprises an encoded elevation element and a compand encoded azimuth element; and for each compand encoded direction parameter value:

decode the encoded elevation element;

determine a decompanding function based on the encoded elevation element and/or multichannel audio signal format; and

generate a decompanded azimuth element based on the decompanding function applied to the companded encoded azimuth element.

9 . The apparatus as claimed in claim 8 , wherein the apparatus caused to determine a decompanding function based on the encoded elevation element and/or multichannel audio signal format is further caused to determine a decompanding function based on the encoded elevation element and the multichannel audio signal format.

10 . The apparatus as claimed in claim 8 , wherein the apparatus caused to decode the encoded elevation element is further caused to decode a codeword for each encoded elevation element.

11 . The apparatus as claimed in claim 8 , wherein the apparatus is further caused to determine a quantization grid based on an allocated number of bits for encoding each sub-band within a frame comprising sub-bands and time blocks based on a value of an energy ratio value associated with the obtained direction parameter values, wherein the apparatus caused to decode a codeword for each encoded elevation element is caused to decode the encoded elevation element based on the quantization grid.

12 . A method comprising:

obtaining direction parameter values associated with each of at least two time-frequency tiles of a multichannel audio signal, the direction parameter values associated with each time-frequency tile comprises an elevation element and an azimuth element; and

compand encoding each obtained direction parameter values, wherein compand encoding each obtained direction parameter values comprises:

quantizing the elevation element;

determining a companding function based on the quantized elevation element and/or multichannel audio signal format;

generating a companded azimuth element based on the companding function applied to the azimuth element; and

quantizing the companded azimuth element.

13 . The method as claimed in claim 12 , further comprising decompanding the quantized companded azimuth element based on an inverse of the companding function.

14 . The method as claimed in claim 13 , wherein compand encoding each obtained direction parameter value further comprises generating a codeword for each quantized elevation element and decompanded quantized companded azimuth element.

15 . The method as claimed in claim 12 , wherein determining a companding function based on the quantized elevation element and/or multichannel audio signal format further comprises determining a companding function based on the quantized elevation element and the multichannel audio signal format.

16 . The method as claimed in claim 12 , wherein compand encoding each obtained direction parameter value further comprises generating a codeword for each quantized elevation element and quantized companded azimuth element.

17 . A method comprising:

obtaining at least one encoded bitstream comprising: an encoded multichannel audio signal and compand encoded direction parameter values, the compand encoded direction parameter values are associated with at least two time-frequency tiles of the encoded multichannel audio signal, and each compand encoded direction parameter value comprises an encoded elevation element and a companded encoded azimuth element; and for each compand encoded direction parameter value the method comprises:

decoding the encoded elevation element;

determining a decompanding function based on the encoded elevation element and/or encoded multichannel audio signal format; and

generating a decompanded azimuth element based on the decompanding function applied to the companded encoded azimuth element.

18 . The method as claimed in claim 17 , wherein the determining a decompanding function based on the encoded elevation element further and/or encoded multichannel audio signal format comprises determining a decompanding function based on the encoded elevation element and the encoded multichannel audio signal format.

19 . The method as claimed in claim 17 , wherein decoding the encoded elevation element further comprises decoding a codeword for each encoded elevation element.

20 . The method as claimed in claim 19 , further comprising determining a quantization grid based on an allocated number of bits for encoding each sub-band within a frame comprising sub-bands and time blocks based on a value of an energy ratio value associated with the obtained direction parameter values, wherein decoding a codeword for each encoded elevation element comprises decoding the encoded elevation element based on the quantization grid.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2023
From: VASILACHE, ADRIANA
To: NOKIA TECHNOLOGIES OY
Reel/Frame 063225/0078 →
Priority Claims (1)
GB 2014572 · Sep 16, 2020 · national
Continuity (1)
Related Publication 20230410823A1 · Dec 21, 2023
References Cited (35)
US 20070094027A1 · Vasilache · 2007 [cited by applicant]
US 20150332682A1 · Kim · 2015 [cited by examiner]
US 20160142850A1 · Borss · 2016 [cited by examiner]
US 20170011751A1 · Fueg et al. · 2017 [cited by applicant]
US 20190066701A1 · Fatus et al. · 2019 [cited by applicant]
US 20200058311A1 · Goodwin · 2020 [cited by examiner]
US 20200265851A1 · Fuchs et al. · 2020 [cited by applicant]
US 20200273467A1 · Laaksonen et al. · 2020 [cited by applicant]
US 20200273473A1 · Fuchs · 2020 [cited by examiner]
CN 102610234A · 2012 [cited by applicant]
CN 111276153A · 2020 [cited by applicant]
CN 111316353A · 2020 [cited by applicant]
GB 2575305A · 2020 [cited by applicant]
GB 2592896A · 2021 [cited by applicant]
WO 2006111294A1 · 2006 [cited by applicant]
WO 2015036349A1 · 2015 [cited by applicant]
WO WO2015028715A1 · 2015 [cited by examiner]
WO 2020070377A1 · 2020 [cited by applicant]
WO 2021136879A1 · 2021 [cited by applicant]
C. Yang, R. Hu, X. Wang, Y. Yang, M. Zhang and W. Chen, “3D audio coding approach based on spatial perception features,” in China Communications, vol. 14, No. 11, pp. 126-140, Nov. 2017, doi: 10.1109/CC.2017.8233656 (Ye… [cited by examiner]
B. Matschkal and J. B. Huber, “Spherical Logarithmic Quantization,” in IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, No. 1, pp. 126-140, Jan. 2010, doi: 10.1109/TASL.2009.2024383 (Year: 2010). [cited by examiner]
Search Report received for corresponding United Kingdom Patent Application No. 2014572.8, dated Mar. 5, 2021, 4 pages. [cited by applicant]
International Search Report and Written Opinion received for corresponding Patent Cooperation Treaty Application No. PCT/FI2021/050556, dated Dec. 16, 2021, 19 pages. [cited by applicant]
Li et al., “The Perceptual Lossless Quantization of Spatial Parameter for 3D Audio Signals”, International Conference on Multimedia Modeling, 2017, pp. 381-392. [cited by applicant]
Gao et al., “JND-based spatial parameter quantization of multichannel audio signals”, EURASIP Journal on Audio, Speech, and Music Processing, Article No. 13, 2016, pp. 1-18. [cited by applicant]
Pauly, “Lecture 12: Digital Communication”, Stanford, Lecture Notes, Oct. 31, 2021, 22 pages. [cited by applicant]
Office action received for corresponding Canadian Patent Application No. 3192976, dated Sep. 10, 2024, 4 pages. [cited by applicant]
Office action received for corresponding European Patent Application No. 21868790.3, dated Aug. 11, 2025, 4 pages. [cited by applicant]
Extended European Search Report received for corresponding European Patent Application No. 21868790.3, dated Jul. 15, 2024, 5 pages. [cited by applicant]
Office action received for corresponding Indian Patent Application No. 202317026821, dated Dec. 13, 2024, 5 pages. [cited by applicant]
Office Action for Chinese Application No. 202180076939.4 dated Nov. 21, 2025, 8 pages. [cited by applicant]
Intention to Grant for European Application No. 21868790.3 dated May 15, 2025, 7 pages. [cited by applicant]
International Search Report and Written Opinion for Patent Cooperation Treaty Application No. PCT/FI2021/050556 dated Dec. 16, 2021, 19 pages. [cited by applicant]
IPEA/409—International Preliminary Report on Patentability Mailed on Mar. 30, 2023 for WO Application No. PCT/FI21/050556, 14 page(s). [cited by applicant]
Notice of Allowance for Chinese Application No. 202180076939.4 dated Apr. 13, 2026, 4 pages. [cited by applicant]