Granted Patent B2

US 12,598,440 · App. 18/286,841 · Granted Apr 7, 2026

Inventors: Tommy Falk (Spånga, SE); Werner De Bruijn (Stockholm, SE)

Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)

H04S7/30

Abstract

Claims (110)

1 . A method for rendering an at least partially occluded audio element having an extent, wherein a projection of the audio element includes at least i) a first sub-area associated with at least a first virtual loudspeaker and ii) a second sub-area associated with at least a second virtual loudspeaker, the method comprising:

determining that at least the first sub-area of the projection of the audio element is at least partially occluded;

determining a first occlusion amount (O 1 ) for the first sub-area;

using the first occlusion amount (O 1 ) for the first sub-area, calculating a first gain factor (g 1 ) for the first sub-area;

using the first gain factor (g 1 ) and a first virtual loudspeaker signal for the first virtual loudspeaker to produce a first modified virtual loudspeaker signal for the first virtual loudspeaker; and

rendering the audio element using at least:

i) the first modified virtual loudspeaker signal for the first virtual loudspeaker; and

ii) a second virtual loudspeaker signal for the second virtual loudspeaker or a second modified virtual loudspeaker signal for the second virtual loudspeaker.

2 . The method of claim 1 , further comprising moving the first virtual loudspeaker from an initial position to a new position and then generating the first virtual loudspeaker signal using information indicating the new position.

3 . The method of claim 1 , wherein using the first gain factor (g 1 ) and the first virtual loudspeaker signal for the first virtual loudspeaker to produce the first modified virtual loudspeaker signal for the first virtual loudspeaker comprises modifying the first virtual loudspeaker signal such that the first modified loudspeaker signal is equal to: g 1 *VS 1 , where g 1 is the first gain factor that is calculated using the first occlusion amount (O 1 ) and VS 1 is the first virtual loudspeaker signal.

4 . The method of claim 3 , wherein

g

⁢

1

=

(

1

-

0.01

*

O

⁢

1

)

⁢

or

g

⁢

1

=

sqrt

⁢

(

1

-

0.01

*

O

⁢

1

)

.

5 . The method of claim 1 , wherein

determining the first occlusion amount (O 1 ) for the first sub-area comprises obtaining an occlusion factor for the occluding object and determining a percentage of a first sub-area of the projection of the audio element that is covered by the occluding object.

6 . The method of claim 5 , wherein obtaining the occlusion factor comprises selecting the occlusion factor (OF) from a set of occlusion factors, wherein each OF included in the set of occlusion factors is associated with a different frequency range, and the selection is based on a frequency associated with the audio element such that the selected OF is associated with a frequency range that encompasses the frequency associated with the audio element.

7 . The method of claim 5 , wherein determining the occlusion amount (O 1 ) comprises calculating O 1 =Of 1 *P, where Of 1 is the occlusion factor and P is the percentage.

8 . The method of claim 1 , further comprising:

determining a second occlusion amount (O 2 ) for the second sub-area;

using the second occlusion amount (O 2 ) for the second sub-area, calculating a second gain factor (g 2 ) for the second sub-area;

using the second gain factor (g 2 ) and the second virtual loudspeaker signal for the second virtual loudspeaker to produce the second modified virtual loudspeaker signal for the second virtual loudspeaker; and

rendering the audio element using at least:

i) the first modified virtual loudspeaker signal for the first virtual loudspeaker; and

ii) the second modified virtual loudspeaker signal for the second virtual loudspeaker, wherein

determining the second occlusion amount (O 2 ) comprises determining a percentage of a second sub-area of the projection of the audio element that is covered by the occluding object.

9 . A non-transitory computer readable storage medium storing a computer program comprising instructions which when executed by processing circuitry of an audio renderer apparatus causes the audio renderer apparatus to perform the method of claim 1 .

10 . An audio rendering apparatus for rendering an at least partially occluded audio element having an extent, wherein a projection of the audio element includes at least i) a first sub-area associated with at least a first virtual loudspeaker and ii) a second sub-area associated with at least a second virtual loudspeaker, the audio rendering apparatus comprising:

memory and processing circuitry coupled to the memory, wherein the audio rendering apparatus is configured to:

determine that at least the first sub-area of the projection of the audio element is at least partially occluded;

determine a first occlusion amount (O 1 ) for the first sub-area;

use the first occlusion amount ( 1 ) for the first sub-area, calculating a first gain factor (g 1 ) for the first sub-area;

use the first gain factor (g 1 ) and a first virtual loudspeaker signal for the first virtual loudspeaker to produce a first modified virtual loudspeaker signal for the first virtual loudspeaker; and

render the audio element using at least:

i) the first modified virtual loudspeaker signal for the first virtual loudspeaker; and

ii) a second virtual loudspeaker signal for the second virtual loudspeaker or a second modified virtual loudspeaker signal for the second virtual loudspeaker.

11 . The audio rendering apparatus of claim 10 , further being configured to perform the step of moving the first virtual loudspeaker from an initial position to a new position and then generating the first virtual loudspeaker signal using information indicating the new position.

12 . The audio rendering apparatus of claim 10 , wherein using the first gain factor (g 1 ) and the first virtual loudspeaker signal for the first virtual loudspeaker to produce the first modified virtual loudspeaker signal for the first virtual loudspeaker comprises modifying the first virtual loudspeaker signal such that the modified loudspeaker signal is equal to: g 1 *VS 1 , where g 1 is the first gain factor that is calculated using the first occlusion amount (O 1 ) and VS 1 is the first virtual loudspeaker signal.

13 . The audio rendering apparatus of claim 12 , wherein

g

⁢

1

=

(

1

-

0.01

*

O

⁢

1

)

⁢

or

g

⁢

1

=

sqrt

⁢

(

1

-

0.01

*

O

⁢

1

)

.

14 . The audio rendering apparatus of claim 10 , wherein

determining the first occlusion amount (O 1 ) for the first sub-area comprises obtaining an occlusion factor for the occluding object and determining a percentage of a first sub-area of the projection of the audio element that is covered by the occluding object.

15 . The audio rendering apparatus of claim 14 , wherein obtaining the occlusion factor comprises selecting the occlusion factor (OF) from a set of occlusion factors, wherein each OF included in the set of occlusion factors is associated with a different frequency range, and the selection is based on a frequency associated with the audio element such that the selected OF is associated with a frequency range that encompasses the frequency associated with the audio element.

16 . The audio rendering apparatus of claim 14 , wherein determining the occlusion amount (O 1 ) comprises calculating O 1 =Of 1 *P, where Of 1 is the occlusion factor and P is the percentage.

17 . The audio rendering apparatus of claim 10 , further being configured to perform the steps of:

determining a second occlusion amount (O 2 ) for the second sub-area;

using the second occlusion amount 02 ) for the second sub-area, calculating a second gain factor (g 2 ) for the second sub-area;

using the second gain factor (g 2 ) and the second virtual loudspeaker signal for the second virtual loudspeaker to produce the second modified virtual loudspeaker signal for the second virtual loudspeaker;

rendering the audio element using at least:

i) the first modified virtual loudspeaker signal for the first virtual loudspeaker; and

ii) the second modified virtual loudspeaker signal for the second virtual loudspeaker, wherein

determining the second occlusion amount (O 2 ) comprises determining a percentage of a second sub-area of the projection of the audio element that is covered by the occluding object.

Assignments (1)

Continuity (2)

References Cited (19)