IP Library Granted Patent US 12,451,147
Granted Patent B2
US 12,451,147 · App. 17/788,155 · Granted Oct 21, 2025

Spatial audio parameter encoding and associated decoding

Inventors: Tapani Pihlajakuja (Kellokoski, FI); Adriana Vasilache (Tampere, FI); Mikko-Ville Laitinen (Espoo, FI); Anssi Rämö (Tampere, FI); Lasse Laaksonen (Tampere, FI)
Assignee: NOKIA TECHNOLOGIES OY
G10L19/008G10L19/032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,451,147
App. No.
17/788,155
Granted
Oct 21, 2025
Kind
B2
Abstract

An apparatus comprising means configured to: obtain at least one parameter value ( 106 ) associated with at least two time-frequency parts of at least one audio signal ( 104 ); obtain at least one similarity value based on the at least one parameter value ( 106 ) associated with the at least two time-frequency parts of at least one audio signal ( 104 ); determine at least one group of time-frequency parts from the at least two time-frequency parts of at least one audio signal ( 104 ), the at least one group of time-frequency parts based on the at least one similarity value; and generate for the at least one group of time-frequency parts at least one associated group parameter ( 204 ), the at least one group parameter ( 204 ) based on the at least one parameter value ( 106 ) associated with the time-frequency parts.

Claims (24)

1 . An apparatus, for spatial audio encoding, comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:

obtain at least one first parameter value comprising a direction and a direct-to-total ratio for a first time-frequency tile of at least one audio signal and at least one second parameter value comprising a direction and a direct-to-total ratio for a second time-frequency tile of the at least one audio signal;

obtain a similarity value from an entry of a similarity decision matrix, wherein the similarity value is a flag indicating a similarity between the direction and the direct-to-total ratio for the first time-frequency tile and the direction and the direct-to-total ratio for the second time-frequency tile;

form at least one group of time-frequency tiles comprising the first time-frequency tile and the second time-frequency tile by determining an ordered list of time-frequency tiles from which the at least one group of time-frequency tiles is selected, wherein the ordered list of time-frequency tiles (i) determines the order by which the time-frequency tiles are grouped, (ii) comprises the first and second time-frequency tiles, and (iii) is based on a descending order of directive energy of the time-frequency tiles, and wherein the at least one group of time-frequency tiles is formed based on the similarity value; and

generate for the at least one group of time-frequency tiles at least one group parameter value based on the at least one first parameter value and the at least one second parameter value.

2 . The apparatus as claimed in claim 1 , wherein the similarity value is determined by:

determining a first weighted direction vector from the direction for the first time-frequency tile and determining a second weighted direction vector from the direction for the second time-frequency tile;

determining a vector length from the first weighted vector and the second weighted vector;

determining an importance value from the vector length; and

determining the similarity value based on a comparison between the importance value and a threshold.

3 . The apparatus as claimed in claim 1 , wherein the first weighted direction vector and the second weighted direction vector are frequency weighted for restricting group selection such that the at least one group contains time-frequency tiles that are within a defined frequency band distance.

4 . The apparatus as claimed in claim 1 , wherein the at least one group comprises at least two groups and the apparatus is further caused to combine at least two of the groups of time-frequency tiles based on the associated group parameters being substantially similar.

5 . The apparatus as claimed in claim 1 , wherein the apparatus is further caused to generate at least one indicator configured to identify group members of the at least one group.

6 . The apparatus as claimed in claim 1 , wherein the at least one first parameter value and the at least one second parameter value further comprise at least one of:

at least one spread coherence associated with at least one direction value;

at least one distance associated with at least one direction value;

at least one surround coherence;

at least one diffuse-to-total ratio; and

at least one remainder-to-total ratio.

7 . A method for spatial audio encoding, the method comprising:

obtaining at least one first parameter value comprising a direction and a direct-to-total ratio for a first time-frequency tile of at least one audio signal and at least one second parameter value comprising a direction and a direct-to-total ratio for a second time-frequency tile of the at least one audio signal;

obtaining a similarity value from an entry of a similarity decision, wherein the similarity value is a flag indicating a similarity between the direction and the direct-to-total ratio for the first time-frequency tile and the direction and the direct-to-total ratio for the second time-frequency tile;

forming at least one group of time-frequency tiles comprising the first time-frequency tile and the second time-frequency tile by determining an ordered list of time-frequency tiles from which the at least one group of time-frequency tiles is selected, wherein the ordered list of time-frequency tiles (i) determines the order by which the time-frequency tiles are grouped, (ii) comprises the first and second time-frequency tiles, and (iii) is based on a descending order of directive energy of the time-frequency tiles, and wherein the at least one group of time-frequency tiles is formed based on the similarity value; and

generating for the at least one group of time-frequency tiles at least one group parameter value based on the at least one first parameter value and the at least one second parameter value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2022
From: PIHLAJAKUJA, TAPANI JOHANNES; LAITINEN, MIKKO-VILLE ILARI; LAAKSONEN, LASSE JUHANI; VASILACHE, ADRIANA; RÄMÖ, ANSSI SAKARI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 060277/0551 →
Priority Claims (1)
GB 1919452 · Dec 31, 2019 · national
Continuity (1)
Related Publication 20230335141A1 · Oct 19, 2023
References Cited (24)
US 20090198356A1 · Goodwin · 2009 [cited by examiner]
US 20190132674A1 · Vilkamo · 2019 [cited by examiner]
US 20200265851A1 · Fuchs · 2020 [cited by examiner]
GB 2549532A · 2017 [cited by applicant]
GB 2574238A · 2019 [cited by applicant]
GB 2590650A · 2021 [cited by applicant]
GB 2590651A · 2021 [cited by applicant]
WO 2007040349A1 · 2007 [cited by applicant]
WO 2010012478A2 · 2010 [cited by applicant]
WO WO2017182714A1 · 2017 [cited by examiner]
WO 2018091776A1 · 2018 [cited by applicant]
WO 2019086757A1 · 2019 [cited by applicant]
WO WO2019097018A1 · 2019 [cited by examiner]
WO 2019234290A1 · 2019 [cited by applicant]
WO 2020008105A1 · 2020 [cited by applicant]
WO 2020070377A1 · 2020 [cited by applicant]
WO 2020089510A1 · 2020 [cited by applicant]
WO 2020193865A1 · 2020 [cited by applicant]
“Proposal for MASA common metadata and metadata structure”, 3GPP TSG-SA4#101 meeting, S4 (18)1353, Agenda: 7.5, Nokia Corporation, Nov. 19-23, 2018, pp. 1-4. [cited by applicant]
Search Report received for corresponding United Kingdom Patent Application No. 1919452.1, dated May 28, 2020, 3 pages. [cited by applicant]
International Search Report and Written Opinion received for corresponding Patent Cooperation Treaty Application No. PCT/FI2020/050831, dated Apr. 6, 2021, 29 pages. [cited by applicant]
Yang et al., “Multi-channel Object-Based Spatial Parameter Compression Approach for 3D Audio”, Advances in Multimedia Information Processing, 2015, pp. 354-364. [cited by applicant]
“Proposal for MASA format”, 3GPP TSG-SA4#102 meeting, S4 (19)0121, Agenda: 7.5, Nokia Corporation, Jan. 28-Feb. 1, 2019, pp. 1-10. [cited by applicant]
Extended European Search Report received for corresponding European Patent Application No. 20908590.1, dated Jan. 17, 2024, 10 pages. [cited by applicant]