Granted Patent B2

US 12,283,281 · App. 17/772,497 · Granted Apr 22, 2025

Inventors: Rishabh Tyagi (Sydney, AU); Juan Felix Torres (Darlinghurst, AU); Stefanie Brown (Lewisham, AU)

Assignee: Dolby Laboratories Licensing Corporation

G10L19/032G10L19/008G10L19/167

Abstract

Claims (26)

1. A method of encoding an immersive voice and audio services (IVAS) bitstream, the method comprising:

receiving, using one or more processors, an input audio signal;

downmixing, using the one or more processors, the input audio signal into one or more downmix channels and spatial metadata associated with one or more channels of the input audio signal;

obtaining using the one or more processors, a set of one or more target bitrates for the one or more downmix channels and a set of metadata quantization levels for the spatial metadata from a bitrate distribution control table;

determining, using the one or more processors, a combination of the one or more target bitrates for the one or more downmix channels;

determining, using the one or more processors, a metadata quantization level from the set of metadata quantization levels using a bitrate distribution process, wherein the bitrate distribution process adjusts at least one of the target bitrates or at least one of the metadata quantization levels of the spatial metadata based at least in part on a bitrate budget for the IVAS bitstream;

quantizing and coding, using the one or more processors, the spatial metadata using the metadata quantization level;

generating, using the one or more processors and the combination of one or more target bitrates, a downmix bitstream for the one or more downmix channels;

combining, using the one or more processors, the downmix bitstream, the quantized and coded spatial metadata and the coded set of metadata quantization levels into the IVAS bitstream; and

outputting, streaming or storing the IVAS bitstream for playback on an IVAS- enabled device.

2. The method of claim 1 , wherein the input audio signal is a four-channel first order Ambisonic (FoA) audio signal, three-channel planar FoA signal or a two-channel stereo audio signal.

3. The method of claim 1 , wherein the one or more target bitrates are bitrates of one or more instances of a mono audio coder/decoder (codec).

4. The method of claim 1 , wherein the mono audio codec is an enhanced voice services (EVS) codec and the downmix bitstream is an EVS bitstream.

5. The method of claim 1 , wherein obtaining, using the one or more processors, the set of one or more target bitrates for the one or more downmix channels and the set of metadata quantization levels for the spatial metadata using the bitrate distribution control table, further comprises:

identifying a row in the bitrate distribution control table using a table index that includes one or more of a format of the input audio signal, a bandwidth of the input audio signal, an allowed spatial coding tool, a transition mode and a mono downmix backward compatible mode; and

extracting from the identified row of the bitrate distribution control table, one or more of a target bitrate, a bitrate ratio, a minimum bitrate and bitrate deviation steps, wherein the bitrate ratio indicates a ratio in which a total bitrate is to be distributed between the downmix audio signal channels, the minimum bitrate is a value below which the total bitrate is not allowed to go and the bitrate deviation steps are target bitrate reduction steps when a first priority for the downmix signals is higher than or equal to, or lower, than a second priority of the spatial metadata; and

wherein determining the combination of the one or more bitrates for the one or more downmix channels and the spatial metadata is based on one or more of the target bitrate, the bitrate ratio, the minimum bitrate and the bitrate deviation steps.

6. The method of claim 1 , wherein quantizing and coding the spatial metadata for the one or more channels of the input audio signal using a the set of metadata quantization levels is performed in a quantization loop that applies increasingly coarse quantization strategies based on a difference between a target metadata bit rate and an actual metadata bitrate.

7. The method of claim 1 , wherein the quantization is determined in accordance with a mono codec priority and a spatial metadata priority based on properties extracted from the input audio signal and channel banded co-variance values.

8. The method of claim 1 , wherein the input audio signal is a stereo signal and the downmix signals include a representation of a mid-signal, residuals from the stereo signal and the spatial metadata.

9. The method of claim 1 , wherein the spatial metadata includes prediction coefficients (PR), cross-prediction coefficients (C) and decorrelation coefficients (P) for a spatial reconstructor (SPAR) format and prediction coefficients (PR) or decorrelation coefficients (PR) for complex advanced coupling (CACPL) format.

10. The method of claim 1 , wherein obtaining, using the one or more processors, the set of one or more target bitrates for the one or more downmix channels using the bitrate distribution control table, further comprises:

identifying a row in the bitrate distribution control table using a table index that includes one or more of a format of the input audio signal, a bandwidth of the input audio signal and a IVAS bitrate; and

extracting, from the identified row of the bitrate distribution control table, one or more of a target bitrate, a minimum bitrate, and a maximum bitrate for each of the one or more downmix channels, wherein the minimum bitrate and maximum bitrate define a bitrate range for the bitrate of the downmix channel, and wherein the target bitrate is a preferred bitrate for the downmix channel; and

computing, a total downmix bitrate by subtracting the metadata bitrate and IVAS header bitrate from the total IVAS bitrate; and

determining, the combination of the one or more bitrates for the one or more downmix channels based on one or more of the target bitrate, the minimum bitrate, the maximum bitrate, the total downmix bitrate and a priority assigned to the one or more downmix channels.

Assignments (1)

Continuity (3)

References Cited (34)