Granted Patent B2

US 12,555,586 · App. 18/538,708 · Granted Feb 17, 2026

Inventors: Yuan Gao (Beijing, CN); Shuai Liu (Beijing, CN); Bingyin Xia (Beijing, CN); Bin Wang (Shenzhen, CN); Zhe Wang (Beijing, CN)

Assignee: HUAWEI TECHNOLOGIES CO., LTD.

G10L19/008G10L25/21H04S7/30

Abstract

Claims (74)

1 . A method for encoding a three-dimensional audio signal, comprising:

obtaining a current frame of a three-dimensional audio signal;

obtaining coding efficiency of an initial virtual speaker for the current frame based on the current frame of the three-dimensional audio signal, wherein the initial virtual speaker for the current frame belongs to a set of candidate virtual speakers;

when the coding efficiency of the initial virtual speaker for the current frame meets a preset condition, determining an updated virtual speaker for the current frame from the set of candidate virtual speakers, and encoding the current frame based on the updated virtual speaker for the current frame, to obtain a first bitstream; and

when the coding efficiency of the initial virtual speaker for the current frame does not meet the preset condition, encoding the current frame based on the initial virtual speaker for the current frame, to obtain a second bitstream;

wherein the preset condition comprises the coding efficiency of the initial virtual speaker for the current frame is less than a first threshold.

2 . The method according to claim 1 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

obtaining a reconstructed current frame of a reconstructed three-dimensional audio signal based on the initial virtual speaker for the current frame; and

determining the coding efficiency of the initial virtual speaker for the current frame based on energy of the reconstructed current frame and energy of the current frame.

3 . The method according to claim 2 , wherein the energy of the reconstructed current frame is determined based on a coefficient of the reconstructed current frame, and the energy of the current frame is determined based on a coefficient of the current frame.

4 . The method according to claim 1 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

obtaining a reconstructed current frame of a reconstructed three-dimensional audio signal based on the initial virtual speaker for the current frame;

obtaining a residual signal of the current frame based on the current frame of the three-dimensional audio signal and the reconstructed current frame of the reconstructed three-dimensional audio signal;

obtaining an energy sum of energy of a virtual speaker signal of the current frame and energy of the residual signal; and

determining the coding efficiency of the initial virtual speaker for the current frame based on a ratio of the energy of the virtual speaker signal of the current frame to the energy sum.

5 . The method according to claim 2 , wherein obtaining the reconstructed current frame of the reconstructed three-dimensional audio signal comprises:

determining a virtual speaker signal of the current frame based on the initial virtual speaker for the current frame; and

determining the reconstructed current frame based on the virtual speaker signal of the current frame.

6 . The method according to claim 1 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

determining a quantity of sound sources based on the current frame of the three-dimensional audio signal; and

determining the coding efficiency of the initial virtual speaker for the current frame based on a quantity of initial virtual speakers for the current frame and the quantity of sound sources.

7 . The method according to claim 1 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

determining a quantity of sound sources based on the current frame of the three-dimensional audio signal;

determining a virtual speaker signal of the current frame based on the initial virtual speaker for the current frame; and

determining the coding efficiency of the initial virtual speaker for the current frame based on a quantity of virtual speaker signals of the current frame and the quantity of sound sources of the three-dimensional audio signal.

8 . The method according to claim 1 , wherein determining the updated virtual speaker for the current frame from the set of candidate virtual speakers comprises:

when the coding efficiency of the initial virtual speaker for the current frame is less than a second threshold, using a preset virtual speaker in the set of candidate virtual speakers as the updated virtual speaker for the current frame, wherein the second threshold is less than the first threshold; or

when the coding efficiency of the initial virtual speaker for the current frame is less than the first threshold and greater than the second threshold, using a virtual speaker for a previous frame as the updated virtual speaker for the current frame, wherein the virtual speaker for the previous frame is a virtual speaker used for encoding the previous frame of the three-dimensional audio signal.

9 . A system, comprising:

an encoder comprising at least one processor and a memory coupled to the at least one processor to store instructions, which when executed by the at least one processor, cause the encoder to perform the method according to claim 1 ; and

a decoder comprising at least one processor and a memory coupled to the at least one processor to store instructions, which when executed by the at least one processor, cause the decoder to decode a bitstream generated by the encoder.

10 . An encoder, comprising:

at least one processor; and

a memory configured to store a computer program, which when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

obtaining a current frame of a three-dimensional audio signal;

obtaining coding efficiency of an initial virtual speaker for the current frame based on the current frame of the three-dimensional audio signal, wherein the initial virtual speaker for the current frame belongs to a set of candidate virtual speakers;

when the coding efficiency of the initial virtual speaker for the current frame meets a preset condition, determining an updated virtual speaker for the current frame from the set of candidate virtual speakers, and encoding the current frame based on the updated virtual speaker for the current frame, to obtain a first bitstream; and

when the coding efficiency of the initial virtual speaker for the current frame does not meet the preset condition, encoding the current frame based on the initial virtual speaker for the current frame, to obtain a second bitstream;

wherein the preset condition comprises the coding efficiency of the initial virtual speaker for the current frame is less than a first threshold.

11 . The encoder according to claim 10 ,

wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

obtaining a reconstructed current frame of a reconstructed three-dimensional audio signal based on the initial virtual speaker for the current frame; and

determining the coding efficiency of the initial virtual speaker for the current frame based on energy of the reconstructed current frame and energy of the current frame.

12 . The encoder according to claim 11 , wherein the energy of the reconstructed current frame is determined based on a coefficient of the reconstructed current frame, and the energy of the current frame is determined based on a coefficient of the current frame.

13 . The encoder according to claim 10 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

obtaining a reconstructed current frame of a reconstructed three-dimensional audio signal based on the initial virtual speaker for the current frame;

obtaining a residual signal of the current frame based on the current frame of the three-dimensional audio signal and the reconstructed current frame of the reconstructed three-dimensional audio signal;

obtaining an energy sum of energy of a virtual speaker signal of the current frame and energy of the residual signal; and

determining the coding efficiency of the initial virtual speaker for the current frame based on a ratio of the energy of the virtual speaker signal of the current frame to the energy sum.

14 . The encoder according to claim 11 , wherein obtaining the reconstructed current frame of the reconstructed three-dimensional audio signal comprises:

determining a virtual speaker signal of the current frame based on the initial virtual speaker for the current frame; and

determining the reconstructed current frame based on the virtual speaker signal of the current frame.

15 . The encoder according to claim 10 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

determining a quantity of sound sources based on the current frame of the three-dimensional audio signal; and

determining the coding efficiency of the initial virtual speaker for the current frame based on a quantity of initial virtual speakers for the current frame and the quantity of sound sources.

16 . The encoder according to claim 10 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

determining a quantity of sound sources based on the current frame of the three-dimensional audio signal;

determining a virtual speaker signal of the current frame based on the initial virtual speaker for the current frame; and

determining the coding efficiency of the initial virtual speaker for the current frame based on a quantity of virtual speaker signals of the current frame and the quantity of sound sources of the three-dimensional audio signal.

17 . A non-transitory computer-readable storage medium comprising computer software instructions, which when executed by at least one processor, cause the at least one processor to perform operations, the operations comprising:

obtaining a current frame of a three-dimensional audio signal;

obtaining coding efficiency of an initial virtual speaker for the current frame based on the current frame of the three-dimensional audio signal, wherein the initial virtual speaker for the current frame belongs to a set of candidate virtual speakers;

when the coding efficiency of the initial virtual speaker for the current frame meets a preset condition, determining an updated virtual speaker for the current frame from the set of candidate virtual speakers, and encoding the current frame based on the updated virtual speaker for the current frame, to obtain a first bitstream; and

when the coding efficiency of the initial virtual speaker for the current frame does not meet the preset condition, encoding the current frame based on the initial virtual speaker for the current frame, to obtain a second bitstream;

wherein the preset condition comprises the coding efficiency of the initial virtual speaker for the current frame is less than a first threshold.

18 . The non-transitory computer-readable storage medium according to claim 17 , wherein obtaining the coding efficiency of the initial virtual speaker for the current frame comprises:

obtaining a reconstructed current frame of a reconstructed three-dimensional audio signal based on the initial virtual speaker for the current frame; and

determining the coding efficiency of the initial virtual speaker for the current frame based on energy of the reconstructed current frame and energy of the current frame.

19 . A non-transitory computer-readable storage medium comprising a bitstream obtained by using a method for encoding a three-dimensional audio signal, the method comprising:

obtaining a current frame of a three-dimensional audio signal;

obtaining coding efficiency of an initial virtual speaker for the current frame based on the current frame of the three-dimensional audio signal, wherein the initial virtual speaker for the current frame belongs to a set of candidate virtual speakers;

when the coding efficiency of the initial virtual speaker for the current frame meets a preset condition, determining an updated virtual speaker for the current frame from the set of candidate virtual speakers, and encoding the current frame based on the updated virtual speaker for the current frame, to obtain a first bitstream; and

when the coding efficiency of the initial virtual speaker for the current frame does not meet the preset condition, encoding the current frame based on the initial virtual speaker for the current frame, to obtain a second bitstream;

wherein the preset condition comprises the coding efficiency of the initial virtual speaker for the current frame is less than a first threshold.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (51)