IP Library › Granted Patent US 12,707,224
Granted Patent B2
US 12,707,224 · App. 18/269,871 · Granted Aug 11, 2026

Method and apparatus for scene dependent listener space adaptation

Inventors: Jussi Artturi Leppanen (Tampere, FI); Sujeet Shyamsundar Mate (Tampere, FI); Lasse Juhani Laaksonen (Tampere, FI); Arto Juhani Lehtiniemi (Lempaala, FI)
Assignee: Nokia Technologies Oy
H04S7/304H04S2400/11H04S2400/15H04S2420/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,707,224
App. No.
18/269,871
Granted
Aug 11, 2026
Kind
B2
Abstract

An apparatus for rendering a combined audio scene including circuitry configured to: obtain information configured to define, for a first audio scene, a first audio scene parameter; obtain further information configured to define, for a further audio scene, a further audio scene parameter; identify a location for a modification of at least in part the first audio scene, the location being configurable at least partially based on the further audio scene parameter; and prepare the combined audio scene for rendering, by modifying at least in part the first audio scene based on the further audio scene parameter such that the rendering of the combined audio scene incorporates the modified at least in part first audio scene based on the identified location using the further scene parameter.

Claims (66)

1 . An apparatus for rendering a combined audio scene, the apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to:

obtain information configured to define, for a first audio scene, a first audio scene parameter;

obtain further information configured to define, for a further audio scene, a further audio scene parameter, wherein the further audio scene parameter is configured to enable adding of a window to the first audio scene;

identify a location for a modification of at least in part the first audio scene, the location being configurable at least partially based on the further audio scene parameter, wherein the location comprises a location for adding of the window; and

prepare the combined audio scene for rendering, with modifying at least in part the first audio scene based on the further audio scene parameter such that the rendering of the combined audio scene incorporates the modified at least in part first audio scene based on the identified location using the further audio scene parameter, wherein the window is configured to enable combination of the further audio scene to the first audio scene via the window.

2 . The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to:

obtain information configured to define, for the first audio scene, the first audio scene parameter defining a first audio scene geometry.

3 . The apparatus as claimed in claim 2 , wherein the instructions, when executed with the at least one processor, cause the apparatus to:

identify the location for the modification of at least in part of the first audio scene to identify the location for the modification of at least in part of the first audio scene geometry further based on the information configured to define the first audio scene geometry.

4 . The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to:

define a further audio scene geometry and further audio scene acoustic characteristics within a received bitstream comprising: at least one-further audio scene parameter configured to define the further audio scene geometry; the further audio scene acoustic characteristics; and at least one audio source parameter.

5 . The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to

define the further audio scene parameter comprising further audio scene information configured to control the modification of at least in part the first audio scene.

6 . The apparatus as claimed in claim 5 , wherein the further audio scene information configured to control the modification of at least in part the first audio scene comprises at least one of:

a window size parameter configured to define a size of the window for modifying at least in part the first audio scene;

a window material parameter configured to define a material to be used in the window for modifying at least in part the first audio scene;

a window offset parameter configured to define an offset for a window position with respect to the location for the modification of at least in part the first audio scene;

a window orientation parameter configured to define an orientation for a panel position with respect to the location for the modification of at least in part the first audio scene;

an acoustic environment parameter configured to define at least in part the first audio scene; or

a mode parameter configured to define whether the further audio scene information is applicable based on a user interaction input.

7 . The apparatus as claimed in claim 5 , wherein the further audio scene information configured to control the modification of at least in part the first audio scene further comprises at least one of:

geometry information associated with the further audio scene;

a position of at least one audio element within the further audio scene;

a shape of at least one audio element within the further audio scene;

an acoustic material property of at least one audio element within the further audio scene;

a scattering property of at least one audio element within the further audio scene;

a transmission property of at least one audio element within the further audio scene;

a reverberation time property of at least one audio element within the further audio scene; or

a diffuse-to-direct sound ratio property of at least one audio element within the further audio scene.

8 . The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to

obtain at least one of: a further audio scene geometry; or further audio scene acoustic characteristics.

9 . The apparatus as claimed in claim 8 , wherein the instructions, when executed with the at least one processor, cause the apparatus to

define the further audio scene parameter within an encoder information format.

10 . The apparatus as claimed in claim 1 , wherein the further audio scene is a virtual scene.

11 . The apparatus as claimed in claim 1 , wherein the first audio scene is a physical space, and the first audio scene parameter defines a physical space geometry.

12 . The apparatus as claimed in claim 11 , wherein the instructions, when executed with the at least one processor, cause the apparatus to:

obtain sensor information from at least one sensor positioned within the physical space; and

determine at least one physical space parameter based on the sensor information.

13 . The apparatus as claimed in claim 11 , wherein the first audio scene parameter is within a listening space description file format.

14 . The apparatus as claimed in claim 1 , wherein the defined first audio scene parameter comprises at least one mesh element defining a first audio scene geometry.

15 . The apparatus as claimed in claim 14 , wherein the at least one mesh element comprises at least one vertex parameter and at least one face parameter, wherein the at least one vertex parameter defines a position relative to a mesh origin position and the at least one face parameter comprises a vertex identifier configured to identify vertices defining a geometry of a face and a material parameter identifying an acoustic parameter defining an acoustic property associated with the face.

16 . The apparatus as claimed in claim 15 , wherein the material parameter identifying the acoustic parameter defining the acoustic property associated with the face comprises at least one of:

a scattering property of the face;

a transmission property of the face;

a reverberation time property of the face; or

a diffuse-to-direct sound ratio property of the face.

17 . The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to:

identify at least one surface of the first audio scene based on the identified location for the modification of at least in part the first audio scene based on the further audio scene parameter;

identify a normal associated with the at least one surface of the first audio scene;

orient the window relative to the at least one surface of the first audio scene, the window being associated with the further audio scene parameter;

project edges and vertices associated with the window to the at least one surface of the first audio scene;

split the at least one surface of the first audio scene into non-overlapping polygons based on the projected edges and vertices; and

set material properties for the non-overlapping polygons based on the further audio scene parameter.

18 . The apparatus as claimed in claim 17 , wherein the non-overlapping polygons are non-overlapping triangular faces.

19 . A method for an apparatus rendering a combined audio scene, the method comprising:

obtaining information configured to define, for a first audio scene, a first audio scene parameter;

obtaining further information configured to define, for a further audio scene, a further audio scene parameter, wherein the further audio scene parameter is configured to enable adding of a window to the first audio scene;

identifying a location for a modification of at least in part the first audio scene, the location being configurable at least partially based on the further audio scene parameter, wherein the location comprises a location for adding of the window; and

preparing the combined audio scene for rendering, with modifying at least in part the first audio scene based on the further audio scene parameter such that the rendering of the combined audio scene incorporates the modified at least in part first audio scene based on the identified location using the further audio scene parameter, wherein the window is configured to enable combination of the further audio scene to the first audio scene via the window.

20 . A non-transitory computer-readable medium comprising instructions stored thereon for performing at least the following:

obtaining information configured to define, for a first audio scene, a first audio scene parameter;

obtaining further information configured to define, for a further audio scene, a further audio scene parameter, wherein the further audio scene parameter is configured to enable adding of a window to the first audio scene;

identifying a location for a modification of at least in part the first audio scene, the location being configurable at least partially based on the further audio scene parameter, wherein the location comprises a location for adding of the window; and

preparing the combined audio scene for rendering, with modifying at least in part the first audio scene based on the further audio scene parameter such that the rendering of the combined audio scene incorporates the modified at least in part first audio scene based on the identified location using the further audio scene parameter, wherein the window is configured to enable combination of the further audio scene to the first audio scene via the window.