IP Library Granted Patent US 12,382,043
Granted Patent B2
US 12,382,043 · App. 17/570,046 · Granted Aug 5, 2025

Quantizer design

Inventors: Madhu Peringassery Krishnan (Mountain View, CA); Xin Zhao (San Diego, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/124G06N3/02H04N19/119H04N19/184H04N19/189
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,382,043
App. No.
17/570,046
Granted
Aug 5, 2025
Kind
B2
Abstract

A method, computer program, and computer system for video coding is provided. Video data including one or more quantized coefficients is received. One or more index values associated with the quantized coefficients are mapped to one or more step values based on an exponential mapping. The video data is decoded based on the one or more step values.

Claims (31)

1. A method for decoding video data, executable by a processor, comprising:

receiving video data comprising one or more quantized coefficients;

mapping one or more quantization index values associated with the quantized coefficients to one or more quantization step sizes based on a piecewise exponential mapping from a quantization index value to a corresponding quantization step size, wherein the piecewise exponential mapping comprises two or more portions applying different respective exponential mappings; and

decoding the video data by performing an inverse quantization based on the one or more quantization step sizes.

2. The method of claim 1 , wherein a first range associated with the one or more quantization index values is dependent on an internal bit-depth associated with the video data.

3. The method of claim 2 , wherein the first range is larger for larger internal bit-depths.

4. The method of claim 1 , wherein the exponential mapping is performed according to: quantization step=A*B quantization index value/c.

5. The method of claim 4 , wherein A, B, and C are constants for at least a subset of the one or more quantization index values.

6. The method of claim 4 , wherein A, B, and C are constants for all of the one or more quantization index values.

7. The method of claim 4 , wherein B is equal to 2.

8. The method of claim 4 , wherein A is selected from the group consisting of: 4, 8, 16, 19, 24, and 32.

9. The method of claim 4 , wherein C is a value corresponding to an upper bound of a range of the one or more quantization index values.

10. The method of claim 4 , wherein C is a value in a range from 3 to 64.

11. The method of claim 1 , wherein the video data further comprises one or more second quantized coefficients, and wherein one or more second quantization index values associated with the one or more second quantized coefficients are mapped to one or more second quantization step sizes based on a linear mapping.

12. The method of claim 11 , wherein the linear mapping is performed according to: quantization step=X*quantization index value+Y.

13. The method of claim 12 , wherein X is selected from the group consisting of: 1, 2, 4, and 8.

14. The method of claim 12 , wherein Y is selected from the group consisting of: 4, 8, 16, and 32.

15. A method for encoding video data, executable by a processor, comprising:

receiving video data;

generating one or more coefficients from the video data;

mapping one or more quantization index values associated with the coefficients to one or more quantization step sizes based on a piecewise exponential mapping from a quantization index value to a corresponding quantization step size, wherein the piecewise exponential mapping comprises two or more portions applying different respective exponential mappings; and

encoding the video data by performing a quantization of the one or more coefficients based on the one or more quantization step sizes.

16. The method of claim 15 , further comprising signaling the encoded video data in a video bitstream.

17. The method of claim 15 , wherein a first range associated with the one or more quantization index values is dependent on an internal bit-depth associated with the video data.

18. The method of claim 15 , further comprising generating one or more second coefficients, wherein one or more second quantization index values associated with the one or more second coefficients are mapped to one or more second quantization step sizes based on a non-exponential mapping.

19. A non-transitory computer-readable storage medium storing a video bitstream that is generated by a video encoding method, the method comprising:

receiving video data;

generating one or more coefficients from the video data;

mapping one or more quantization index values associated with the coefficients to one or more quantization step sizes based on a piecewise exponential mapping from a quantization index value to a corresponding quantization step size, wherein the piecewise exponential mapping comprises two or more portions applying different respective exponential mappings; and

encoding the video data by performing a quantization of the one or more coefficients based on the one or more quantization step sizes.

20. The non-transitory computer-readable storage medium of claim 19 , wherein the video bitstream comprises the encoded video data that includes a set of quantized coefficients.

Continuity (3)
Continuation 17098825 · Nov 16, 2020
Provisional Application 63035642 · Jun 5, 2020
Related Publication 20220159257A1 · May 19, 2022
References Cited (66)
US 10225607B1 · Bai et al. · 2019 [cited by applicant]
US 20020136319A1 · Olszewski · 2002 [cited by applicant]
US 20030099291A1 · Kerofsky · 2003 [cited by applicant]
US 20190289289A1 · Jung · 2019 [cited by examiner]
US 20200099930A1 · Gish · 2020 [cited by examiner]
US 20200134466A1 · Weintraub · 2020 [cited by examiner]
CN 101087421A · 2007 [cited by applicant]
JP 2003101418A · 2003 [cited by applicant]
KR 1020200000828A · 2020 [cited by applicant]
Notification of Reasons for Refusal dated Mar. 28, 2023 from the Japanese Patent Office in application No. 2022-523235. [cited by applicant]
Extended European Search Report dated Jul. 19, 2022 in European Application No. 21818095.8. [cited by applicant]
Jun Fang et al., “Post-Training Piecewise Linear Quantization for Deep Neural Networks”, arxiv.org, 2020, pp. 1-19 (19 pages total). [cited by applicant]
Yinghua Li et al., “A Novel Piecewise Nonlinear Companding Transform for PAPR Reduction in GFDM”, 10th International Conference on Wireless Communications and Signal Processing, 2018, pp. 1-5 (5 pages total). [cited by applicant]
De Rivaz et al., “AV1 Bitstream & Decoding Process Specification”, Version 1.0.0 with Errata 1, 2018, The Alliance for Open Media (681 pages total). [cited by applicant]
Bross et al., “General Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression with Capability beyond HEVC”, IEEE Transactions on Circuits and Systems for Video Technology, 2019, pp. 1-… [cited by applicant]
Chang et al., “Intra prediction using multiple reference lines for the versatile video coding standard”, Proc. SPIE 11137, Applications of Digital Image Processing XLII, 1113716 (Sep. 6, 2019) (8 pages total). [cited by applicant]
Racape et al., “CE3-related: Wide-angle intra prediction for non-square blocks”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, JVET-K05… [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, JVET-K1001-v6 (141 pages total). [cited by applicant]
Bross et al., “CE3: Multiple reference line intra prediction (Test 1.1.1, 1.1.2, 1.1.3 and 1.1.4)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, … [cited by applicant]
Zhao et al., “CE6: On 8-bit primary transform core (Test 6.1.3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, JVET-L0285-r1 (18 pages tota… [cited by applicant]
Zhao et al., “CE6: Fast DST-7/DCT-8 with dual implementation support (Test 6.2.3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, JVET-M… [cited by applicant]
Zhao et al., “CE6-related: Unified LFNST using block size independent kernel”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, JVET-O0539… [cited by applicant]
Zhao et al., “Non-CE6: Configurable max transform size in VVC”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, JVET-O0545-v2 (6 pages to… [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, JVET-O2001-vE (455 pages total). [cited by applicant]
Zhang et al., “Fast Adaptive Multiple Transform for Versatile Video Coding”, 2019 Data Compression Conference, IEEE, pp. 63-72 (10 pages total). [cited by applicant]
Zhang et al., “Fast DST-7/DCT-8 with Dual Implementation Support for Versatile Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology, 2020 IEEE, pp. 1-17 (17 pages total). [cited by applicant]
Zhao et al., “Novel Statistical Modeling, Analysis and Implementation of Rate-Distortion Estimation for H.264/AVC Coders”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, No. 5, May 2010, pp. 64… [cited by applicant]
Zhao et al., “NSST: Non-Separable Secondary Transforms for Next Generation Video Coding”, 2016 Picture Coding Symposium (PCS), Nuremberg, 2016, pp. 1-5 (5 pages total). [cited by applicant]
Zhao et al., “Low-Complexity Intra Prediction Refinements for Video Coding”, 2018 Picture Coding Symposium (PCS), San Francisco, CA, 2018, pp. 139-143 (5 pages total). [cited by applicant]
Zhao et al., “Joint Separable and Non-Separable Transforms for Next-Generation Video Coding”, IEEE Transactions on Image Processing, vol. 27, No. 5, pp. 2514-2525, May 2018 (13 pages total). [cited by applicant]
Zhao et al., “Coupled Primary and Secondary Transform for Next Generation Video Coding”, 2018 IEEE Visual Communications and Image Processing (VCIP), Taichung, Taiwan, 2018, pp. 1-4 (4 pages total). [cited by applicant]
Zhao et al., “CE3-related: Unified MPM list based on CE3-3.3 and CE3-3.5.1”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, JVET-N0394-r2 (… [cited by applicant]
Zhao et al., “Wide Angular Intra Prediction for Versatile Video Coding”, 2019 Data Compression Conference (DCC), Snowbird, UT, USA, 2019, pp. 53-62 (10 pages total). [cited by applicant]
Chen et al., “Screen Content Coding Using Non-Square Intra Block Copy for HEVC”, 2014 IEEE International Conference on Multimedia and Expo (ICME), Chengdu, 2014, pp. 1-6 (6 pages total). [cited by applicant]
Guo et al., “Inter-layer Adaptive Filtering for Scalable Extension of HEVC”, 2013 Picture Coding Symposium (PCS), San Jose, CA, 2013, pp. 165-168 (4 pages total). [cited by applicant]
Guo et al., “Inter-layer Intra Mode Prediction for Scalable Extension of HEVC”, 2013 Picture Coding Symposium (PCS), San Jose, CA, 2013, pp. 317-320 (4 pages total). [cited by applicant]
Lai et al., “Low Latency Directional Filtering for Inter-layer Prediction in Scalable Video Coding using HEVC”, 2013 Picture Coding Symposium (PCS), San Jose, CA, 2013, pp. 269-272 (4 pages total). [cited by applicant]
Lai et al., “Combined Temporal and Inter-layer Prediction for Scalable Video Coding using HEVC”, 2013 Picture Coding Symposium (PCS), San Jose, CA, 2013, pp. 117-120 (4 pages total). [cited by applicant]
Liu et al., “Global/Local Motion-Compensated Frame Interpolation for Low Bitrate Video”, Apr. 2000, Proceedings of SPIE—The International Society for Optical Engineering 3974 (12 pages total). [cited by applicant]
Liu et al., “Nonlinear motion-compensated interpolation for low-bit-rate video”, Proc. SPIE 4115, Applications of Digital Image Processing XXIII, (Dec. 28, 2000), pp. 203-213 (12 pages total). [cited by applicant]
Liu et al., “MCI-embedded motion-compensated prediction for quality enhancement of frame interpolation”, Proc. SPIE 4209, Multimedia Systems and Applications III, (Mar. 22, 2001), pp. 251-261 (12 pages total). [cited by applicant]
Liu et al., “Bit Allocation for Video Coding with Temporal-Spatial Tradeoff”, Advances in Multimedia Information Processing—PCM 2001. PCM 2001. Lecture Notes in Computer Science, vol. 2195., pp. 466-473 (10 pages total). [cited by applicant]
Liu et al., “Improved Video Coding via Adaptive Selection of Generalized Motion Prediction Modes for B Frames”, Picture Coding Symposium 2001, pp. 358-361 (4 pages total). [cited by applicant]
Liu et al., “Complexity Reduction of Joint Temporal-Spatial Bit Allocation Using R-D Models for Video Streaming”, IEEE ICIP 2002, pp. 729-732 (4 pages total). [cited by applicant]
Liu et al., “MPEG Video Transcoding with Joint Temporal-Spatial Rate Control”, Proc. SPIE 4790, Applications of Digital Image Processing XXV, (Nov. 21, 2002), pp. 278-289 (13 pages total). [cited by applicant]
Liu et al., “Joint Temporal-Spatial Rate Control with Approximating Rate-Distortion Models”, ⋅ Proceedings of SPIE—The International Society for Optical Engineering, 2002, 4671:746-755 (10 pages total). [cited by applicant]
Liu et al., “Joint Temporal-Spatial Rate Control for Adaptive Video Transcoding”, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No. 03TH8698), Baltimore, MD, USA, 2003, pp. II-225 (4 … [cited by applicant]
Liu et al., “Hybrid global-local motion compensated frame interpolation for low bit rate video coding”, J. Vis. Commun. Image R., vol. 14 (2003) pp. 61-79 (19 pages total). [cited by applicant]
Liu et al., “Efficient MPEG-2 to MPEG-4 Video Transcoding”, Proc. SPIE 5022, Image and Video Communications and Processing 2003, (May 7, 2003), pp. 186-195 (10 pages total). [cited by applicant]
Liu et al., “Joint Temporal-Spatial Bit Allocation for Video Coding With Dependency”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, No. 1, Jan. 2005, pp. 15-26 (12 pages total). [cited by applicant]
Liu et al., “Video Prediction Block Structure and the Emerging High Efficiency Video Coding Standard”, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, Hol… [cited by applicant]
Liu et al., “Rectangular Partitioning for Intra Prediction in HEVC”, 2012 Visual Communications and Image Processing, San Diego, CA, 2012, pp. 1-6 (6 pages total). [cited by applicant]
Lou et al., “Complexity and Memory Efficient GOP Structures Supporting VCR Functionalities in H.264/AVC”, 2008 IEEE International Symposium on Circuits and Systems, Seattle, WA, 2008, pp. 636-639 (4 pages total). [cited by applicant]
Lou et al., “Trick-Play Optimization for H.264 Video Decoding”, Journal of Information Hiding and Multimedia Signal Processing, 2009, pp. 1-13 (15 pages total). [cited by applicant]
Pu et al., “Palette Mode Coding in HEVC Screen Content Coding Extension”, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 6, No. 4, Dec. 2016, pp. 420-432 (13 pages total). [cited by applicant]
Liu et al., “Bit-depth Scalable Coding for High Dynamic Range Video”, Proc. SPIE 6822, Visual Communications and Image Processing 2008, 68220O (Jan. 28, 2008) (12 pages total). [cited by applicant]
Sun et al., “Palette Mode—A New Coding Tool in Screen Content Coding Extensions of HEVC”, 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, 2015, pp. 2409-2413 (5 pages total). [cited by applicant]
Sun et al., “Improved Palette Index Map Coding on HEVC SCC”, 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, 2016, pp. 4210-4214 (5 pages total). [cited by applicant]
Xu et al., “PU Level Intra Block Copying with Flipping Mode”, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific, Siem Reap, 2014, pp. 1-7 (7 pages total). [cited by applicant]
Xu et al., “Block Vector Prediction in Intra Block Copy for HEVC Screen Content Coding”, 2015 Data Compression Conference, Snowbird, UT, 2015, pp. 273-282 (10 pages total). [cited by applicant]
Xu et al., “Intra Block Copy in HEVC Screen Content Coding Extensions”, IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 6, No. 4, pp. 1-11, Dec. 2016 (11 pages total). [cited by applicant]
Zhang et al., “Intra Mode Coding in HEVC Standard”, 2012 Visual Communications and Image Processing, San Diego, CA, 2012, pp. 1-6 (6 pages total). [cited by applicant]
Written Opinion dated Jun. 30, 2021, from International Searching Authority in International Application No. PCT/US2021/033820. [cited by applicant]
International Search Report dated Jun. 30, 2021, from International Searching Authority in International Application No. PCT/US2021/033820. [cited by applicant]
Office Action issued Oct. 12, 2023 in Korean Application No. 10-2022-7007561. [cited by applicant]
Tencent America LLC, European Office Action, EP Patent Application No. 21818095.8, Sep. 24, 2024, 6 pgs. [cited by applicant]