IP Library Granted Patent US 12,489,894
Granted Patent B2
US 12,489,894 · App. 17/442,699 · Granted Dec 2, 2025

Content adaptive transform precision for video coding

Inventors: Louis Kerofsky (San Diego, CA); Yuwen He (San Diego, CA); Philippe Hanhart (La Conversion, CH)
Assignee: InterDigital VC Holdings, Inc.
H04N19/12H04N19/126H04N19/14H04N19/176H04N19/18H04N19/60
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,489,894
App. No.
17/442,699
Granted
Dec 2, 2025
Kind
B2
Abstract

Systems, methods, and instrumentalities are disclosed for obtaining coded video data comprising quantized transform coefficients for a plurality of blocks, obtaining a first precision factor associated with a first block for performing at least one decoding function on the first block, obtaining a second precision factor associated with a second block for performing the at least one decoding function on the second block, and performing the at least one decoding function on the quantized transform coefficients for the first block using the first precision factor and on the quantized transform coefficients for the second block using the second precision factor.

Claims (32)

1 . An apparatus comprising a processor configured to perform:

obtaining coded video data comprising quantized transform coefficients for a plurality of blocks;

obtaining a first content-dependent precision factor associated with a first block for performing at least one decoding function on the first block, wherein the first content-dependent precision factor is obtained based on a first magnitude of the transform coefficients associated with a first source content associated with the first block independent of a first bit-depth associated with the first block, and wherein the first content-dependent precision factor is a first minimum shift associated with reducing the first magnitude of the transform coefficients to an inverse transform processing range;

obtaining a second content-dependent precision factor associated with a second block for performing the at least one decoding function on the second block, wherein the second content-dependent precision factor is obtained based on a second magnitude of the transform coefficients associated with a second source content associated with the second block independent of a second bit-depth associated with the second block, and wherein the second content-dependent precision factor is a second minimum shift associated with reducing the second magnitude of the transform coefficients to the inverse transform processing range; and

performing the at least one decoding function on the quantized transform coefficients for the first block using the first content-dependent precision factor and on the quantized transform coefficients for the second block using the second content-dependent precision factor.

2 . The apparatus of claim 1 , wherein the first content-dependent precision factor associated with the first block and the second content-dependent precision factor associated with the second block are further obtained from the coded video data.

3 . The apparatus of claim 1 , wherein the first content-dependent precision factor and the second content-dependent precision factor are different.

4 . The apparatus of claim 1 , wherein the at least one decoding function comprises dequantization or inverse transformation, the first content-dependent precision factor comprises a first dequantization shift, the second content-dependent precision factor comprises a second dequantization shift, and the first content-dependent precision factor and the second content-dependent precision factor comprise a mid-transform shift.

5 . The apparatus of claim 4 , wherein obtaining the first content-dependent precision factor associated with the first block comprises determining the mid-transform shift associated with the first block based on the bounds on an absolute magnitude of an output of a first inverse transform, and the at least one decoding function comprises a second inverse transform.

6 . The apparatus of claim 1 , wherein the first content-dependent precision factor comprises a dequantization shift and a mid-transform shift, and wherein the mid-transform shift associated with the first block is determined based on the dequantization shift associated with the first block.

7 . A method comprising:

obtaining coded video data comprising quantized transform coefficients for a plurality of blocks;

obtaining a first content-dependent precision factor associated with a first block for performing at least one decoding function on the first block, wherein the first content-dependent precision factor is obtained based on a first magnitude of the transform coefficients associated with a first source content associated with the first block independent of a first bit-depth associated with the first block, and wherein the first content-dependent precision factor is a first minimum shift associated with reducing the first magnitude of the transform coefficients to an inverse transform processing range;

obtaining a second content-dependent precision factor associated with a second block for performing the at least one decoding function on the second block, wherein the second content-dependent precision factor is obtained based on a second magnitude of the transform coefficients associated with a second source content associated with the second block independent of a second bit-depth associated with the second block, and wherein the second content-dependent precision factor is a second minimum shift associated with reducing the second magnitude of the transform coefficients to the inverse transform processing range; and

performing the at least one decoding function on the quantized transform coefficients for the first block using the first content-dependent precision factor and on the quantized transform coefficients for the second block using the second content-dependent precision factor.

8 . The method of claim 7 , wherein the first content-dependent precision factor associated with the first block and the second content-dependent precision factor associated with the second block are further obtained from the coded video data.

9 . The method of claim 7 , wherein the first content-dependent precision factor and the second content-dependent precision factor are different.

10 . The method of claim 7 , wherein the at least one decoding function comprises dequantization or inverse transformation, the first content-dependent precision factor comprises a first dequantization shift, the second content-dependent precision factor comprises a second dequantization shift, and the first content-dependent precision factor and the second content-dependent precision factor comprise a mid-transform shift.

11 . The method of claim 10 , wherein obtaining the first content-dependent precision factor associated with the first block comprises determining the mid-transform shift associated the first block based on the bounds on an absolute magnitude of an output of a first inverse transform, and the at least one decoding function comprises a second inverse transform.

12 . The method of claim 7 , wherein the first content-dependent precision factor comprises a dequantization shift and a mid-transform shift, and wherein the mid-transform shift associated with the first block is determined based on the dequantization shift associated with the first block.

13 . An apparatus comprising a processor configured to perform:

obtaining prediction residual data for a plurality of blocks of video data;

analyzing the prediction residual data to determine a magnitude input to represent a block;

determining a first content-dependent precision factor associated with a first block for performing at least one encoding function on the first block, wherein the first content-dependent precision factor is determined based on a first magnitude input associated with a first source content associated with the first block independent of a first bit-depth associated with the first block, and wherein the first content-dependent precision factor is a first minimum shift associated with reducing the first magnitude of the transform coefficients to an inverse transform processing range;

determining a second content-dependent precision factor associated with a second block for performing the at least one encoding function on the second block, wherein the second content-dependent precision factor is determined based on a second magnitude input associated a second source content associated with the second block independent of a second bit-depth associated with the second block, and wherein the second content-dependent precision factor is a second minimum shift associated with reducing the second magnitude of the transform coefficients to an inverse transform processing range; and

performing the at least one encoding function on the input for the first block using the first content-dependent precision factor and on the input for the second block using the second content-dependent precision factor.

14 . The apparatus of claim 13 , wherein the at least one encoding function comprises at least one of a horizontal transform or a quantization.

15 . The apparatus of claim 13 , wherein the processor is further configured to further perform:

include an indication of the first content-dependent precision factor for the first block and an indication of the second content-dependent precision factor for the second block in a bitstream representing the video data.

16 . The apparatus of claim 15 , wherein the indication of the first content-dependent precision factor comprises a number of fraction bits for performing at least one decoding function.

17 . The apparatus of claim 13 , wherein analyzing the prediction residual data to determine a largest magnitude input to represent a block is performed before vertical transformation.

18 . The apparatus of claim 13 , wherein the first content-dependent precision factor and the second content-dependent precision factor are different.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2024
From: VID SCALE, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 068284/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2021
From: KEROFSKY, LOUIS; HE, YUWEN; HANHART, PHILIPPE
To: VID SCALE, INC.
Reel/Frame 058399/0684 →
Continuity (2)
Provisional Application 62823738 · Mar 26, 2019
Related Publication 20220132123A1 · Apr 28, 2022
References Cited (23)
US 8923406B2 · Mrak et al. · 2014 [cited by applicant]
US 10327008B2 · Chien et al. · 2019 [cited by applicant]
US 10575015B2 · Lee et al. · 2020 [cited by applicant]
US 20170093434A1 · Greenebaum · 2017 [cited by examiner]
US 20190052878A1 · Zhao et al. · 2019 [cited by applicant]
US 20200014956A1 · Rosewarne · 2020 [cited by examiner]
US 20210029369A1 · Sjöberg · 2021 [cited by examiner]
US 20210099721A1 · Tsukuba · 2021 [cited by examiner]
CN 103202016A · 2013 [cited by applicant]
CN 103404141A · 2013 [cited by applicant]
CN 105120272A · 2015 [cited by applicant]
CN 109076225A · 2018 [cited by applicant]
Bordes et al., “Description of SDR, HDR and 360° Video Coding Technology Proposal by Qualcomm and Technicolor—Medium Complexity Version”, JVET-J0022R1, Qualcomm, Technicolor, Joint Video Experts Team (JVET) of ITU-T SG … [cited by applicant]
Dong et al., “Non-CE5: Improved Transform Skipping Mode”, JCTVC-H0141, InterDigital Communication, LLC, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting: San Jo… [cited by applicant]
Fuldseth et al., “Transform Design for HEVC with 16 Bit Intermediate Data Representation”, JCTVC-E243, Cisco Systems, Texas Instruments Inc., Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/I… [cited by applicant]
ISO/IEC, “High Efficiency Video Coding”, Rec. ITU-T H.265 and ISO/IEC 23008-2, Apr. 2013, 317 pages. [cited by applicant]
ITU-T, “Advanced Video Coding for Generic Audiovisual Services”, Recommendation H.264 and ISO/IEC 14496-10, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Video, Ma… [cited by applicant]
ITU-T, “Generic Coding of Moving Pictures and Associated Audio Information—Part 2: Video”, International Standard 13818-2, Recommendation ITU-T H.262, International Organization for Standardization (ISO) and the Interna… [cited by applicant]
ITU-T, “Line Transmission on Non-Telephone Signals—Video Codec for Audiovisual Services at p×64 Kbit/Sec”, CCITT, Recommendation H.261, Geneva, 1990, 32 pages. [cited by applicant]
Kerofsky et al., “Transform Dynamic Range Analysis”, JCTVC-E333, Sharp Labs of America, Joint Collaborative Team on Video Coding (JCT- VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting: Geneva, Mar. 16-23, 2… [cited by applicant]
Kerofsky, Louis, “16-Bit DC Coefficient Reconstruction”, JVT-1025, Sharp Labs of America, Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), 7th Meeting: San Diego, Califo… [cited by applicant]
Kerofsky, Louis, “Notes on JVT IDCT”, JVT-C24, Sharp Labs of America, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), 3rd Meeting: Fairfax, Virginia, USA, May 6-10, 2002,… [cited by applicant]
Yeo et al., “Dynamic Range Analysis in High Efficiency Video Coding Residual Coding and Reconstruction”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, No. 7, Jul. 2013, pp. 1131-1136. [cited by applicant]