IP Library Granted Patent US 10,146,500
Granted Patent B2
US 10,146,500 · App. 15/253,646 · Granted Dec 4, 2018

Transform-based audio codec and method with subband energy smoothing

Inventors: Elias Nemer (Irvine, CA); Jeffrey K. Thompson (Sammamish, WA); Antonius Kalker (Mountain View, CA)
Assignee: DTS, Inc.
G06F3/165G10L19/032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,146,500
App. No.
15/253,646
Granted
Dec 4, 2018
Kind
B2
Abstract

A transform-based codec and method with energy smoothing for mitigating vector quantization errors (such as “birdies”) during the encoding process. Embodiments of the codec and method use an encoder to apply in combination an orthogonal transformation and a vector permutation to frequency transform coefficients. In some embodiments the transformation is performed first followed by the permutation and in other embodiments the order is reversed. The order used is reversed at the decoder. A smoothing parameter containing the level of energy smoothing to be applied is passed from the encoder to the decoder and used by both to compute a transform matrix and an inverse transform matrix. In some embodiments the transform matrix is a fraction Hadamard matrix that is invertible, energy preserving, controllable, and stable.

Claims (28)

1. A method for processing an audio signal, comprising:

using an encoder to apply an orthogonal transformation and a vector permutation to frequency transform coefficients of the audio signal to generate processed frequency transform coefficients;

quantizing the processed frequency transform coefficients to obtain quantized processed frequency transform coefficients;

packing the quantized processed frequency transform coefficients into an encoded bitstream; and

using a decoder to process the encoded bitstream and reverse operations of the encoder and recover the audio signal.

2. The method of claim 1 , wherein the orthogonal transformation is any power of 2 greater than or equal to 4.

3. The method of claim 1 , further comprising applying the orthogonal transformation and the vector permutation to the frequency transform coefficients only once.

4. The method of claim 1 , further comprising applying the orthogonal transformation and the vector permutation to the frequency transform coefficients more than once.

5. The method of claim 1 , wherein the orthogonal transformation is variable and further comprising controlling the orthogonal transformation by a smoothing parameter that is a function at least one codec metric.

6. The method of claim 1 , wherein a size of a permutated sequence of the vector permutation is any value greater than or equal to a size of the orthogonal transformation.

7. The method of claim 1 , further comprising applying the vector permutation to a frequency transform coefficient vector containing the frequency transform coefficients to rearrange elements of the frequency transform coefficient vector according to a permutation rule, the frequency transform coefficient vector having a vector length.

8. The method of claim 7 , further comprising applying the orthogonal transformation, which is a transform matrix of size M, to the frequency transform coefficient vector.

9. The method of claim 8 , further comprising applying the transform matrix to M number of points at a time of the frequency transform coefficient vector, wherein the vector length is greater than or equal to M.

10. A method for encoding an audio signal to mitigate musical noise artifacts, comprising:

dividing the audio signal into a plurality of frequency subbands;

computing a transform matrix for each subband;

applying an orthogonal transformation to frequency transform coefficients in each subband using the transform matrix and applying interleaving to the frequency transform coefficients to obtain processed frequency transform coefficients, where the orthogonal transformation is any power of 2 greater than or equal to 4; and

vector quantizing and bit packing the processed frequency coefficients into an encoded bitstream representative of the audio signal such that musical artifacts are mitigated.

11. The method of claim 10 , further comprising:

computing a spectrum flatness for each subband; and

determining a smoothing parameter from the spectrum flatness that includes an energy smoothing level that represents an amount of energy smoothing to apply to each subband.

12. The method of claim 11 , further comprising transmitting the smoothing parameter in the encoded bitstream from an encoder to a decoder.

13. The method of claim 11 , further comprising using the smoothing parameter to compute the transform matrix.

14. The method of claim 13 , wherein computing a transform matrix for each subband further comprises:

computing a transform parameter as a function of the smoothing parameter, a length of a subband being processed, and a number of pulses of a vector quantizer; and

using the transform parameter to compute the transform matrix.

15. The method of claim 10 wherein the orthogonal transformation is applied first to the frequency transform coefficients and the interleaving is applied after the orthogonal transformation is applied.

16. The method of claim 10 wherein the interleaving is applied first to the frequency transform coefficients and the orthogonal transformation is applied after the interleaving is applied.

Assignments (5)
PARTIAL RELEASE OF SECURITY INTEREST IN PATENTS Recorded Oct 27, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: VEVEO LLC (F.K.A. VEVEO, INC.); DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 061786/0675 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2020
From: ROYAL BANK OF CANADA
To: TESSERA, INC.; INVENSAS BONDING TECHNOLOGIES, INC. (F/K/A ZIPTRONIX, INC.); FOTONATION CORPORATION (F/K/A DIGITALOPTICS CORPORATION AND F/K/A DIGITALOPTICS CORPORATION MEMS); INVENSAS CORPORATION; TESSERA ADVANCED TECHNOLOGIES, INC; DTS, INC.; DTS LLC; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 052920/0001 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
SECURITY INTEREST Recorded Dec 2, 2016
From: INVENSAS CORPORATION; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; ZIPTRONIX, INC.; DIGITALOPTICS CORPORATION; DIGITALOPTICS CORPORATION MEMS; DTS, LLC; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 040797/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2016
From: NEMER, ELIAS; THOMPSON, JEFFREY; KALKER, ANTONIUS
To: DTS, INC.
Reel/Frame 039767/0679 →
Continuity (1)
Related Publication 20180060023A1 · Mar 1, 2018