IP Library Granted Patent US 12,375,716
Granted Patent B2
US 12,375,716 · App. 18/609,880 · Granted Jul 29, 2025

Transform coefficient coding

Inventors: Tung Nguyen (Berlin, DE); Heiner Kirchhoffer (Berlin, DE); Detlev Marpe (Berlin, DE)
Assignee: Dolby Video Compression, LLC
H04N19/60H03M7/4018H03M7/4075H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,716
App. No.
18/609,880
Granted
Jul 29, 2025
Kind
B2
Abstract

An idea used herein is to use the same function for the dependency of the context and the dependency of the symbolization parameter on previously coded/decoded transform coefficients. Using the same function—with varying function parameter—may even be used with respect to different transform block sizes and/or frequency portions of the transform blocks in case of the transform coefficients being spatially arranged in transform blocks. A further variant of this idea is to use the same function for the dependency of a symbolization parameter on previously coded/decoded transform coefficients for different sizes of the current transform coefficient's transform block, different information component types of the current transform coefficient's transform block and/or different frequency portions the current transform coefficient is located within the transform block.

Claims (42)

1. A decoder for decoding a data stream comprising an encoded video including information related to a plurality of transform coefficients associated with the encoded video, the decoder comprising:

a context adaptive entropy decoder configured for, for a current transform coefficient in a transform coefficient block, entropy decoding, using a processor, a first symbol based on a context, wherein the context is determined based on an operation involving a first previously decoded transform coefficient;

an extractor configured for, using the processor, extracting a second symbol of the current transform coefficient from the data stream;

a desymbolizer configured for, for the current transform coefficient, mapping the second symbol to a transform coefficient level based on a symbolization parameter, wherein the symbolization parameter is determined based on the operation involving a second previously decoded transform coefficient and an information component type including a color component type related to the transform coefficient block; and

a picture decoder configured for applying, using a processor, predictive coding based on a prediction residual signal to reconstruct a block of a picture of the video, wherein the prediction residual signal is associated with the first symbol and the transform coefficient level,

wherein the decoder is configured for determining the first previously decoded transform coefficient based on a relative spatial arrangement of the first previously decoded transform coefficient relative to the current transform coefficient, wherein the spatial arrangement is based on a scan position of the current transform coefficient in the transform coefficient block.

2. The decoder according to claim 1 , wherein the decoder is further configured for extracting, from the data stream, information on a position of a last non-zero transform coefficient among transform coefficients of a transform coefficient block along a predetermined scan order, wherein the plurality of transform coefficients encompasses the transform coefficients of the transform coefficient block from the last non-zero transform coefficient along the scan order to a DC transform coefficient of the transform coefficient block.

3. The decoder according to claim 2 , wherein the desymbolizer is further configured for using a first symbolization scheme for mapping of the first symbol of the last non-zero transform coefficient to a level less than or equal to a maximum level, wherein a zero level does not apply for the last transform coefficient.

4. The decoder according to claim 2 , wherein the context adaptive entropy decoder is further configured for entropy decoding the first symbol for the last non-zero transform coefficient using a context that is different from a context used in entropy decoding the first symbol of a transform coefficient other than the last non-zero transform coefficient.

5. The decoder according to claim 2 , wherein the context adaptive entropy decoder traverses the transform coefficients of the transform coefficient block in a scan order leading from the last non-zero transform coefficient to the DC transform coefficient of the transform coefficient block.

6. The decoder according to claim 1 , wherein the decoder is configured for decoding the plurality of transform coefficients from the data stream in two scans, wherein the context adaptive entropy decoder is configured for entropy decoding the first symbol for the transform coefficients from the data stream in an order corresponding to a first scan of the transform coefficients, and the extractor is configured for subsequently extracting, from the data stream, the second symbols, for the transform coefficients for which the first symbols are mapped onto a maximum level, in an order corresponding to a second scan of the transform coefficients.

7. The decoder according to claim 1 , wherein the decoder is configured for decoding the plurality of transform coefficients from the data stream sequentially in one scan, wherein the second symbols are interspersed within the data stream between first symbols of the transform coefficients, and wherein the context adaptive entropy decoder and the extractor are configured for, for each transform coefficient in a scan order of the one scan, extracting, from the data stream, the second symbols of respective transform coefficients for which the first symbols are mapped onto a maximum level immediately subsequent to the context adaptive entropy decoder's entropy decoding of the first symbols of the respective transform coefficients for which the first symbols are mapped onto the maximum level.

8. The decoder according to claim 1 , wherein the extractor is configured for extracting the second symbol from the data stream directly or using entropy decoding using a fixed probability distribution.

9. The decoder according to claim 1 , wherein the desymbolizer is configured for mapping the first symbol to a transform coefficient level less than or equal to a maximum level associated with the first symbol based on a truncated unary binarization scheme.

10. The decoder according to claim 1 , wherein the desymbolizer is further configured for mapping the second symbol based on a Rice code.

11. An encoder for encoding into a data stream information related to a plurality of transform coefficients associated with a video, the encoder comprising:

a picture encoder configured for applying, using a processor, predictive coding on a block of a picture of the video to obtain a prediction residual signal related to the block;

a context adaptive entropy encoder configured for, for a current transform coefficient in a transform coefficient block related to the prediction residual signal, entropy encoding, using a processor, a first symbol based on a context, wherein the context is determined based on an operation involving a first previously encoded transform coefficient; and

a symbolizer configured for mapping, using a processor, a transform coefficient level of the current transform coefficient to a second symbol based on a symbolization parameter, wherein the symbolization parameter is determined based on the operation involving a second encoded transform coefficient and an information component type including a color component type related to the transform coefficient block,

wherein the encoder is configured for determining the first previously encoded transform coefficient based on a relative spatial arrangement of the first previously encoded transform coefficient relative to the current transform coefficient, wherein the spatial arrangement is based on a scan position of the current transform coefficient in the transform coefficient block.

12. The encoder according to claim 11 , wherein the encoder is further configured for inserting, into the data stream, information on a position of a last non-zero transform coefficient among transform coefficients of a transform coefficient block along a predetermined scan order, wherein the plurality of transform coefficients encompasses the transform coefficients of the transform coefficient block from the last non-zero transform coefficient along the scan order to a DC transform coefficient of the transform coefficient block.

13. The encoder according to claim 12 , wherein the context adaptive entropy encoder is configured for entropy encoding the first symbol for the last non-zero transform coefficient using a context that is different from a context used in entropy encoding the first symbol of a transform coefficient other than the last non-zero transform coefficient.

14. The encoder according to claim 12 , wherein the context adaptive entropy encoder traverses the transform coefficients of the transform coefficient block in a scan order leading from the last non-zero transform coefficient to the DC transform coefficient of the transform coefficient block.

15. The encoder according to claim 11 , wherein the encoder is configured to encoding the plurality of transform coefficients into the data stream in two scans, wherein the context adaptive entropy encoder is configured for entropy encoding the first symbol for the transform coefficients into the data stream in an order corresponding to a first scan of the transform coefficients,

the encoder comprises an inserter configured for subsequently inserting into the data stream the second symbols, for the transform coefficients for which the first symbols are mapped onto a maximum level, in an order corresponding to a second scan of the transform coefficients.

16. The encoder according to claim 11 , wherein the encoder is configured for encoding the plurality of transform coefficients into the data stream sequentially in one scan, wherein second symbols are interspersed within the data stream between first symbols of the transform coefficients, and

wherein the context adaptive entropy encoder and an inserter of the encoder are configured for, for each transform coefficient in a scan order of the one scan, inserting, into the data stream, the second symbols of respective transform coefficients for which the first symbols are mapped onto a maximum level, immediately subsequent to the context adaptive entropy encoder's entropy encoding of the first symbols of the respective transform coefficients for which the first symbols are mapped onto the maximum level.

17. The encoder according to claim 11 , further comprising an inserter configured for inserting the second symbol into the data stream directly or using entropy encoding using a fixed probability distribution.

18. The encoder according to claim 11 , wherein the symbolizer is configured for mapping the first symbol to a transform coefficient level less than or equal to the maximum level based on a truncated unary binarization scheme.

19. The encoder according to claim 11 , wherein the symbolizer is configured for mapping the second symbol based on a Rice code.

20. A method for decoding a data stream including information related to a plurality of transform coefficients associated with a video encoded into the data stream, comprising:

entropy decoding, for a current transform coefficient in a transform coefficient block, a first symbol based on a context, wherein the context is determined based on an operation involving a first previously decoded transform coefficient;

extracting a second symbol of the current transform coefficient from the data stream;

mapping, for the current transform coefficient, the second symbol to a transform coefficient level based on a symbolization parameter, wherein the symbolization parameter is determined based on the operation involving a second previously decoded transform coefficient and an information component type including a color component type related to the transform coefficient block; and

applying predictive coding based on a prediction residual signal to reconstruct a block of a picture of the video, wherein the prediction residual signal is associated with the first symbol and the transform coefficient level,

wherein the first previously decoded transform coefficient is determined based on a relative spatial arrangement of the first previously decoded transform coefficient relative to the current transform coefficient, wherein the spatial arrangement is based on a scan position of the current transform coefficient in the transform coefficient block.

21. The method according to claim 20 , further comprising:

extracting, from the data stream, information on a position of a last non-zero transform coefficient among transform coefficients of a transform coefficient block along a predetermined scan order,

wherein the plurality of transform coefficients encompasses the transform coefficients of the transform coefficient block from the last non-zero transform coefficient along the scan order to a DC transform coefficient of the transform coefficient block.

22. The method according to claim 20 , further comprising:

mapping the first symbol to a transform coefficient level less than or equal to a maximum level based on a truncated unary binarization scheme.

23. The method according to claim 22 , wherein the mapping of the second symbol is based on a Rice code.

Assignments (2)
CHANGE OF NAME Recorded Jan 30, 2026
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 074536/0781 →
CHANGE OF NAME Recorded Nov 26, 2024
From: GE VIDEO COMPRESSION, LLC
To: DOLBY VIDEO COMPRESSION, LLC
Reel/Frame 069450/0772 →
Continuity (12)
Continuation 18188744 · Mar 23, 2023
Continuation 17136716 · Dec 29, 2020
Continuation 16985572 · Aug 5, 2020
Continuation 16745696 · Jan 17, 2020
Continuation 16522884 · Jul 26, 2019
Continuation 16285761 · Feb 26, 2019
Continuation 15948085 · Apr 9, 2018
Continuation 15621702 · Jun 13, 2017
Continuation 14335439 · Jul 18, 2014
Continuation PCTEP2013051053 · Jan 21, 2013
Provisional Application 61588849 · Jan 20, 2012
Related Publication 20240305822A1 · Sep 12, 2024
References Cited (82)
US 7088271B2 · Marpe et al. · 2006 [cited by applicant]
US 7218790B2 · Smirnov · 2007 [cited by applicant]
US 9106913B2 · Rajals · 2015 [cited by applicant]
US 9197890B2 · Rajals · 2015 [cited by applicant]
US 9338449B2 · Rajals · 2016 [cited by applicant]
US 20030156652A1 · Wise · 2003 [cited by applicant]
US 20050038837A1 · Marpe et al. · 2005 [cited by applicant]
US 20060023795A1 · Kim · 2006 [cited by applicant]
US 20070223579A1 · Bao · 2007 [cited by applicant]
US 20080162432A1 · Wang · 2008 [cited by applicant]
US 20090096643A1 · Chang · 2009 [cited by applicant]
US 20100232720A1 · Tsai et al. · 2010 [cited by applicant]
US 20100316118A1 · Li · 2010 [cited by applicant]
US 20110096834A1 · Cheon et al. · 2011 [cited by applicant]
US 20120014454A1 · Budagavi · 2012 [cited by applicant]
US 20120121011A1 · Coban et al. · 2012 [cited by applicant]
US 20120243615A1 · Tu · 2012 [cited by applicant]
US 20130224051A1 · Okada et al. · 2013 [cited by applicant]
US 20140348247A1 · Tsukuba et al. · 2014 [cited by applicant]
US 20160100192A1 · Sze et al. · 2016 [cited by applicant]
AU 2016204082B2 · 2016 [cited by applicant]
CN 1379366 · 2002 [cited by applicant]
CN 1656817A · 2005 [cited by applicant]
CN 1735209A · 2006 [cited by applicant]
CN 1741616A · 2006 [cited by applicant]
CN 101115201A · 2008 [cited by applicant]
CN 101682770A · 2010 [cited by applicant]
CN 101883280A · 2010 [cited by applicant]
CN 101908070A · 2010 [cited by applicant]
CN 102017634A · 2011 [cited by applicant]
CN 102273080A · 2011 [cited by applicant]
CN 104365107A · 2015 [cited by applicant]
EP 2999123A1 · 2016 [cited by applicant]
JP 2009100474A · 2009 [cited by applicant]
JP 201135682A · 2011 [cited by applicant]
JP 2011035681A · 2011 [cited by applicant]
JP 2011114369A · 2011 [cited by applicant]
JP 4886755B2 · 2012 [cited by applicant]
JP 2013524707A · 2013 [cited by applicant]
JP 2013223051A · 2013 [cited by applicant]
JP 2013537737A · 2013 [cited by applicant]
JP 6542831B2 · 2019 [cited by applicant]
RU 2406258C2 · 2010 [cited by applicant]
RU 2010101116A · 2011 [cited by applicant]
TW 201142759A · 2011 [cited by applicant]
WO 2009092454A1 · 2009 [cited by applicant]
WO 2011128268A1 · 2011 [cited by applicant]
WO 2011128303A2 · 2011 [cited by applicant]
WO 2011142279A1 · 2011 [cited by applicant]
WO 2012005551A2 · 2012 [cited by applicant]
WO 2012095488A2 · 2012 [cited by applicant]
WO 20131079081A1 · 2013 [cited by applicant]
Detlev Marpe, Member, IEEE, Heiko Schwarz, and Thomas Wiegand, “Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard”, IEEE Transactions on Circuits and Systems for Video Technolog… [cited by examiner]
Davide Bardone, Elias S. G. Carotti, Juan Carlos De Martin, “Adaptive Golomb Codes For Level Binarization In The H.264/AVC FRExt Lossless Mode”, 2008 IEEE International Symposium on Signal Processing and Information Tec… [cited by examiner]
Final Office Action issued in corresponding U.S. Appl. No. 16/985,572 dated Nov. 10, 2022. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 16/985,572 dated Apr. 13, 2022. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 16/985,572 dated May 5, 2021. [cited by applicant]
Vetro A., et al., “Antialiasing for 30 Displays”, [online], Apr. 27, 2007, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-IT VCEG (ISO/IEC JTC1/SC29/WG1 1 and ITU-T SG16 Q.6), Document: JVT-W060, [Searched an Oct. 1, 2012… [cited by applicant]
Luthra, A. (Chair.), “Draft use cases for the scalable enhancement of HEVC (vl)”, [online], Nov. 2011, Joint Collaborative Team an Video Coding (JCT-Ve) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, M22558, [Searched an… [cited by applicant]
Kameyama, Wataru, et al., “Impress Standard Textbook Series, Textbook on Digital Broadcasting in the era of IPTV”, 1st ed., Apr. 1, 2010, Impress R&D col, Lid., p. 122, ISBN: 978-8443-2853-7, 10 pages. [cited by applicant]
Joshi, R., et al., “AHG19: Modifications to HE transform coefficient coding for transform skip mode”, [online], Nov. J5, 2011, Joint Collaborative Team on Video Coding (JCT-Ve) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG… [cited by applicant]
Bross, B. et al., WD4: Working Draft 4 of High-Efficiency Video Coding, [online], Aug. 9, 2011, Joint Collaborative Team on Video Coding (JCT-Ve) of ITU-T SG16 WP3 and ISO/IECJTC1/SC29/WG11, Document: JCTVC-F803_d0 vers… [cited by applicant]
Nguyen, T. et al., “Reduced-Complexity Entropy Coding of Transform Coefficient Levels Using Truncated Golomb-Rice Codes in Video Compression”, 18th IEEE International Conferences on Image Processing, Sep. 11, 2011, pp. … [cited by applicant]
Nguyen, T. et al., “Entropy Coding of Syntax Elements Related to Block Structures and Transform Coefficient Levels in HEVC”, Proceedings of SPIE, vol. 8499, Oct. 25, 2012, pp. 84990S-1-84990S-II. [cited by applicant]
Notice of Allowance U.S. Appl. No. 15/621,702 dated Jan. 10, 2018. [cited by applicant]
Nguyen, T. et al. Reduced-complexity entropy coding of transform coefficient levels using a combination of VLC and PIPE, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4t… [cited by applicant]
Hisao Sasai and Takahiro Nishi, Non-CE 11: Modified Context Derivation for last coefficient flag, Joint Collaborative Team on Video Coding {JCT-Ve) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting: Geneva, CH, … [cited by applicant]
Jian Lou, Umin Wang and Xue Fang, On coeff_abs_level_minus3 coding, Joint Collaborative Team on Video Coding (JCT-Ve) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting: Geneva, CH, Nov. 2011, JCTVC-G0700-r5, pp.… [cited by applicant]
T_ Nguyen, D. Marpe and T. Wiegand, Non-Cell: Proposed Cleanup for Transform Coefficient Coding, Joint Collaborative Team on Video Coding {JCT-Ve) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 8th Meeting: San Jose, CA,… [cited by applicant]
Non-final Office Action U.S. Appl. No. 15/948,085 dated Aug. 2, 2018. [cited by applicant]
Sole et al., “CEII Unified scans for the significance map and coefficient level coding in high efficiency”, Joint Collaborative Team on Video Coding {JCT-Ve) of ITU-TSG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6TH Meeting Tori… [cited by applicant]
Notice of Allowance U.S. Appl. No. 15/948,085 dated Nov. 26, 2018. [cited by applicant]
Notice of Allowance U.S. Appl. No. 16/285,761 dated May 1, 2019. [cited by applicant]
Notice of Allowance mailed Oct. 17, 2019 in U.S. Appl. No. 16/522,884. [cited by applicant]
Notice of Allowance mailed Apr. 3, 2020 in U.S. Appl. No. 16/745,696. [cited by applicant]
Office Action issued in corresponding U.S. Appl. No. 15/621,702 dated Jul. 31, 2017. [cited by applicant]
Tung Nguyen et al., “Reduced-complexity entropy coding of transform coefficient levels using truncated Golomb-Rice codes in video compression”, Image Processing {ICIP), 2011 18th IEEE International Conference on IEEE, S… [cited by applicant]
Sasai, H., et al., “Non-CEII: Modified Context Derivation for last coefficient flag”, [online], Nov. 25, 2011, Joint Collaborative Team on Video Coding (JCT-Ve) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Document: JC… [cited by applicant]
A. Kiely, “Selecting the Golomb Parameter in Rice Coding”, ipnpr.jpl.nasa.gov, IPN Progress Report 42-159, Nov. 15, 2004 (Year: 2004). [cited by applicant]
Sole et al., “CEII Unified scans for the significance map and coefficient level coding in high efficiency”, Joint Coliaborative Team on Video Coding (JCT-Ve) of ITU-TSG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting Tori… [cited by applicant]
Vetro A., et al., “Antialiasing for 30 Displays”, [online], Apr. 27, 2007, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-IT VCEG (ISO/IEC JTC1/SC29/WG1 1 and ITU-T SG16 Q.6), Document: JVT-W060, [Searched an Oct. 1, 2012… [cited by applicant]
Supervised by Okubo Sakae, “Textbook on H.264/AVC, rev. 3rd ed.”, 1st ed. Jan. 1, 2009, Impress R&D, Co., Ltd., p. 86-87, ISBN: 978-4-8443-2664-9. (Document indicating well-known art). [cited by applicant]