IP Library Granted Patent US 12,400,667
Granted Patent B2
US 12,400,667 · App. 17/998,866 · Granted Aug 26, 2025

Spatial audio parameter encoding and associated decoding

Inventors: Tapani Johannes Pihlajakuja (Kellokoski, FI); Adriana Vasilache (Tampere, FI)
Assignee: NOKIA TECHNOLOGIES OY
G10L19/008G10L19/032G10L25/21G10L2019/0004G10L19/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,400,667
App. No.
17/998,866
Granted
Aug 26, 2025
Kind
B2
Abstract

An apparatus comprising means configured to: obtain at least one direction parameter value for a time-frequency part of at least one audio signal ( 301 ); obtain at least one energy ratio for the time-frequency part ( 301 ), wherein each energy ratio is associated with a respective direction parameter value; generate respective at least one modified energy ratio from the at least one energy ratio for the time-frequency part ( 304 ); determine a quantization spatial resolution for encoding the at least one obtained direction parameter value based on the at least one modified energy ratio ( 305 ); and encode the obtained direction parameter values based on the quantization spatial resolution ( 306 ).

Claims (46)

1. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

obtain at least two direction parameter values for a time-frequency tile of at least one audio signal;

obtain at least two direct-to-total energy ratios for the time-frequency tile, wherein respective ones of the at least two direct-to-total energy ratios are associated with a respective direction parameter value;

generate a combined ratio value from the at least two direct-to-total energy ratios;

for a largest direct-to-total energy ratio of the at least two direct-to-total energy ratios, generate a first modified energy ratio as the combined ratio value;

for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio, generate a second modified energy ratio as the direct-to-total energy ratio divided by the largest direct-to-total energy ratio and multiplied by the combined ratio value;

determine a quantization spatial resolution for encoding the at least two direction parameter values based on the first modified energy ratio and the second modified energy ratio generated for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio; and

encode the at least two direction parameter values based on the quantization spatial resolution.

2. The apparatus as claimed in claim 1 , wherein respective ones of the at least two direct-to-total energy ratios comprise a quantized direct-to-total energy ratio.

3. The apparatus as claimed in claim 2 , wherein the apparatus caused to obtain the at least two direct-to-total energy ratios for the time-frequency tile, wherein respective ones of the at least two direct-to-total energy ratios are associated with a respective direction parameter value, is caused to:

analyze the at least one audio signal to obtain at least two unquantized direct-to-total energy ratios for the time-frequency tile; and

quantize the at least two unquantized direct-to-total energy ratios for the time-frequency tile to generate at least two quantized direct-to-total energy ratios.

4. The apparatus as claimed in claim 3 , wherein the apparatus caused to quantize the at least two unquantized direct-to-total energy ratios for the time-frequency tile to generate at least two quantized direct-to-total energy ratios is caused to:

quantize a first of the at least two unquantized direct-to-total energy ratios for the time-frequency tile with a first codebook;

quantize a second of the at least two unquantized direct-to-total energy ratios for the time-frequency tile with a second codebook, wherein the first codebook and the second codebook are one of:

a same resolution such that encoding of the second of the at least two unquantized direct-to-total energy ratios requires fewer bits to encode than the first of the at least two unquantized direct-to-total energy ratios; and

a different resolution such that encoding of the second of the at least two unquantized direct-to-total energy ratios is encoded with a greater resolution than the first of the at least two unquantized direct-to-total energy ratios.

5. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

obtain at least one encoded bitstream comprising:

at least two direction parameter values for a time-frequency tile of at least one audio signal;

at least two direct-to-total energy ratios for the time-frequency tile, wherein respective ones of the at least two direct-to-total energy ratios are associated with a respective direction parameter value;

decode the at least two direct-to-total energy ratios for the time-frequency tile;

generate a combined ratio value from the at least two direct-to-total energy ratios;

for a largest direct-to-total energy ratio of the at least two direct-to-total energy ratios, generate a first modified energy ratio as the combined ratio value;

for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio, generate a second modified energy ratio as the direct-to-total energy ratio divided by the largest direct-to-total energy ratio and multiplied by the combined ratio value;

determine a quantization spatial resolution for decoding the at least two direction parameter values based on the first modified energy ratio and the second modified energy ratio generated for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio; and

decode the at least two direction parameter values based on the quantization spatial resolution.

6. The apparatus as claimed in claim 5 , wherein respective ones of the at least two direct-to-total energy ratios comprise a quantized direct-to-total energy ratio.

7. A method comprising:

obtaining at least two direction parameter values for a time-frequency tile of at least one audio signal;

obtaining at least two direct-to-total energy ratios for the time-frequency tile, wherein respective ones of the at least two direct-to-total energy ratios are associated with a respective direction parameter value;

generating a combined ratio value from the at least two direct-to-total energy ratios;

for a largest direct-to-total energy ratio of the at least two direct-to-total energy ratios, generating a first modified energy ratio as the combined ratio value;

for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio, generating a second modified energy ratio as the direct-to-total energy ratio divided by the largest direct-to-total energy ratio and multiplied by the combined ratio value;

determining a quantization spatial resolution for encoding the at least two direction parameter values based on the first modified energy ratio and the second modified energy ratio generated for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio; and

encoding the at least two direction parameter values based on the quantization spatial resolution.

8. A method comprising:

obtaining at least one encoded bitstream comprising:

at least two direction parameter values for a time-frequency tile of at least one audio signal;

at least two direct-to-total energy ratio for the time-frequency part, wherein respective ones of the two direct-to-total energy ratios are associated with a respective direction parameter value;

decoding the at least two direct-to-total energy ratios for the time-frequency tile;

generating a combined ratio value from the at least two direct-to-total energy ratios;

for a largest direct-to-total energy ratio of the at least two direct-to-total energy ratios, generating a first modified energy ratio as the combined ratio value;

for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio, generating a second modified energy ratio as the direct-to-total energy ratio divided by the largest direct-to-total energy ratio and multiplied by the combined ratio value;

determining a quantization spatial resolution for decoding the at least two direction parameter values based on the first modified energy ratio and the second modified energy ratio generated for respective ones of the at least two direct-to-total energy ratios other than the largest direct-to-total energy ratio; and

decoding the at least two direction parameter values based on the quantization spatial resolution.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 23, 2022
From: JOHANNES PIHLAJAKUJA, TAPANI; VASILACHE, ADRIANA
To: NOKIA TECHNOLOGIES OY
Reel/Frame 062192/0852 →
Priority Claims (1)
GB 2008735 · Jun 9, 2020 · national
Continuity (1)
Related Publication 20230197087A1 · Jun 22, 2023
References Cited (28)
US 6542863B1 · Surucu · 2003 [cited by examiner]
US 8462716B1 · Li · 2013 [cited by examiner]
US 9263050B2 · Daniel et al. · 2016 [cited by applicant]
US 11030530B2 · Frinken · 2021 [cited by examiner]
US 20130254191A1 · He · 2013 [cited by examiner]
US 20150149166A1 · Jang · 2015 [cited by examiner]
US 20150221313A1 · Purnhagen · 2015 [cited by examiner]
US 20190132674A1 · Vilkamo · 2019 [cited by examiner]
GB 2577698A · 2020 [cited by applicant]
WO 2006111294A1 · 2006 [cited by applicant]
WO 2018091776A1 · 2018 [cited by applicant]
WO 2019086757A1 · 2019 [cited by applicant]
WO 2019097018A1 · 2019 [cited by applicant]
WO 2019234290A1 · 2019 [cited by applicant]
WO 2020008105A1 · 2020 [cited by applicant]
WO 2020016479A1 · 2020 [cited by applicant]
WO 2020089510A1 · 2020 [cited by applicant]
WO 2020193865A1 · 2020 [cited by applicant]
WO 2021048468A1 · 2021 [cited by applicant]
WO 2021130405A1 · 2021 [cited by applicant]
“Description of the IVAS MASA C Reference Software”, 3GPP TSG-SA4#106 meeting, S4-191167, Agenda: 7.5, Nokia Corporation, Oct. 21-25, 2019, pp. 1-16. [cited by applicant]
“Proposal for MASA common metadata and metadata structure”, 3GPP TSG-SA4#101 meeting, S4-181353, Agenda: 7.5, Nokia Corporation, Nov. 19-23, 2018, pp. 1-4. [cited by applicant]
Search Report received for corresponding United Kingdom Patent Application No. 2008735.9, dated Dec. 4, 2020, 3 pages. [cited by applicant]
International Search Report and Written Opinion received for corresponding Patent Cooperation Treaty Application No. PCT/FI2021/050273, dated Aug. 11, 2021, 18 pages. [cited by applicant]
Li et al., “The Perceptual Lossless Quantization of Spatial Parameter for 3D Audio Signals”, International Conference on Multimedia Modeling, 2017, pp. 381-392. [cited by applicant]
Office action received for corresponding Indian Patent Application No. 202347000399, dated Feb. 21, 2023, 5 pages. [cited by applicant]
Extended European Search Report received for corresponding European Patent Application No. 21821369.2, dated Mar. 5, 2024, 10 pages. [cited by applicant]
Office Action for European Application No. 21821369.2 dated May 26, 2025, 5 pages. [cited by applicant]