IP Library › Granted Patent US 12,335,479
Granted Patent B2
US 12,335,479 · App. 18/613,855 · Granted Jun 17, 2025

Image processing device and method

Inventor: Takeshi Tsukuba (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
H04N19/13H04N19/157H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,479
App. No.
18/613,855
Granted
Jun 17, 2025
Kind
B2
Abstract

A predetermined context variable is assigned, according to a device, system, or method, to a first bin of a bin sequence obtained by binarizing an adaptive orthogonal transform identifier indicating a mode of adaptive orthogonal transform in image encoding and context encoding is performed for the first bin of the bin sequence. Furthermore, a predetermined context variable is assigned to a first bin of a bin sequence obtained by binarizing an adaptive orthogonal transform identifier indicating a mode of inverse adaptive orthogonal transform in image decoding and context decoding is performed for the first bin of the bin sequence.

Claims (27)

1. An image processing device comprising:

circuitry configured to decode image data that has been encoded by assignment of a predetermined context variable to a first bin of a bin sequence obtained by binarizing an adaptive orthogonal transform identifier indicating a mode of adaptive orthogonal transform in image encoding, the first bin of the bin sequence being context encoded,

wherein the image data has further been encoded by assignment of predetermined context variables different from one another to the first bin to a fourth bin of the bin sequence, the first bin to the fourth bin of the bin sequence having been context encoded.

2. An image processing method comprising:

decoding image data that has been encoded by assigning a predetermined context variable to a first bin of a bin sequence obtained by binarizing an adaptive orthogonal transform identifier indicating a mode of adaptive orthogonal transform in image encoding, and the first bin of the bin sequence having been context encoded,

wherein the image data has further been encoded by assignment of predetermined context variables different from one another to the first bin to a fourth bin of the bin sequence, the first bin to the fourth bin of the bin sequence having been context encoded.

3. An image processing device comprising:

circuitry configured to decode image data that has been encoded by assignment of a context variable based on a parameter regarding a block size to a first bin of a bin sequence obtained by binarizing an adaptive orthogonal transform identifier indicating a mode of adaptive orthogonal transform in image encoding, and the first bin of the bin sequence having been context encoded.

4. The image processing device according to claim 3 , wherein

the parameter regarding a block size is a difference between a logarithmic value of a long side of a transformation block and a logarithmic value of a minimum transformation block size to which the adaptive orthogonal transform is applicable.

5. The image processing device according to claim 3 , wherein

the parameter regarding a block size is a minimum value between a difference between a logarithmic value of a long side of a transformation block and a logarithmic value of a minimum transformation block size to which the adaptive orthogonal transform is applicable, and a predetermined threshold value.

6. The image processing device according to claim 3 , wherein

the parameter regarding a block size is a result of right-bit shifting a minimum value between a difference between a logarithmic value of a long side of a transformation block and a logarithmic value of a minimum transformation block size to which the adaptive orthogonal transform is applicable, and a predetermined threshold value.

7. The image processing device according to claim 3 , wherein

the image data has further been encoded by assignment of a context variable according to whether or not the parameter regarding a block size is equal to or larger than a predetermined threshold value that was applied during context encoding.

8. The image processing device according to claim 3 , wherein

the adaptive orthogonal transform identifier has been binarized to a bin sequence configured by one bit indicating whether or not a transform type is other than a transform type DCT2×DCT2 and two bits indicating another transform type, and the bin sequence having been encoded.

9. The image processing device according to claim 3 , wherein

the adaptive orthogonal transform identifier has been binarized for each component during the encoding.

10. An image processing method comprising:

decoding image data that has been encoded by assigning a context variable based on a parameter regarding a block size to a first bin of a bin sequence obtained by binarizing an adaptive orthogonal transform identifier indicating a mode of adaptive orthogonal transform in image encoding, the first bin of the bin sequence having been context encoded during encoding.

11. The image processing device according to claim 1 , wherein the adaptive orthogonal transform identifier is context encoded for each component identifier of the transform block.

12. The image processing device according to claim 11 , wherein a context variable corresponding to the component identifier is assigned to the first bin of the bin sequence and perform context encoding.

13. The image processing device according to claim 1 , wherein a secondary transform identifier indicating the mode of secondary transform in image encoding is context encoded.

14. The image processing device according to claim 13 , wherein the secondary transform identifier is context encoded for each treeType.

15. The image processing device according to claim 14 , wherein each bin of the bin sequence obtained by binarizing the secondary transform identifier is assigned a different context variable prior to context encoding.

Continuity (3)
Continuation 17606460
Provisional Application 62863396 · Jun 19, 2019
Related Publication 20240236323A1 · Jul 11, 2024
References Cited (49)
US 5454011A · Shimoyoshi · 1995 [cited by applicant]
US 5490170A · Akagiri et al. · 1996 [cited by applicant]
US 6563549B1 · Sethuraman · 2003 [cited by examiner]
US 7251371B2 · Kobayashi · 2007 [cited by examiner]
US 7596279B2 · Sugimoto et al. · 2009 [cited by applicant]
US 7630563B2 · Irvine · 2009 [cited by examiner]
US 7778331B2 · Sato · 2010 [cited by applicant]
US 7860160B2 · Shimazaki · 2010 [cited by applicant]
US 7916959B2 · Adachi · 2011 [cited by applicant]
US 8189674B2 · Shigemoto · 2012 [cited by examiner]
US 8422808B2 · Adachi · 2013 [cited by applicant]
US 8442334B2 · Drugeon et al. · 2013 [cited by applicant]
US 8902988B2 · Sole Rojals et al. · 2014 [cited by applicant]
US 8913666B2 · Sole Rojals et al. · 2014 [cited by applicant]
US 10554977B2 · Fu et al. · 2020 [cited by applicant]
US 10827186B2 · Moccagatta et al. · 2020 [cited by applicant]
US 11496752B2 · Lasserre et al. · 2022 [cited by applicant]
US 11665367B2 · Tsukuba · 2023 [cited by applicant]
US 20090034856A1 · Moriya · 2009 [cited by applicant]
US 20120082213A1 · Sekiguchi · 2012 [cited by applicant]
US 20120106630A1 · Sugimoto et al. · 2012 [cited by applicant]
US 20120328026A1 · Sole Rojals · 2012 [cited by applicant]
US 20130028326A1 · Moriya · 2013 [cited by examiner]
US 20130177069A1 · Sze · 2013 [cited by applicant]
US 20130294502A1 · Kazui · 2013 [cited by applicant]
US 20130322540A1 · Yamori et al. · 2013 [cited by applicant]
US 20150312588A1 · Yamamoto · 2015 [cited by applicant]
US 20170006306A1 · Yamori et al. · 2017 [cited by applicant]
US 20180160118A1 · Tsukuba · 2018 [cited by applicant]
US 20180220159A1 · Won · 2018 [cited by applicant]
US 20190104322A1 · Tsukuba · 2019 [cited by applicant]
CN 102917215A · 2013 [cited by applicant]
CN 103119849A · 2013 [cited by applicant]
CN 109792522A · 2019 [cited by applicant]
JP 2008312229A · 2008 [cited by applicant]
KR 20110019140A · 2011 [cited by applicant]
International Search Report and Written Opinion mailed on Jul. 21, 2020, received for PCT Application PCT/ JP2020/018617, Filed on May 8, 2020, 12 pages including English Translation. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 4)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1 /SC 29 /WG 11, JVET-M1001-v1, 13 Meeting, Jan. 9-18, 2019, 25 Pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 5)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N1001-v8, 14th Meeting, Mar. 27, 2019, 20 Pages. [cited by applicant]
Rosewarne et al., “CE6-related: RST Binarization”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0105-v2, 14th Meeting, Mar. 19-27, 2019, 4 Pages. [cited by applicant]
Salehifar et al., “CE 6-1.1 (a, b): Selection of MTS Candidates”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC Jtc 1/SC 29/WG 11, JVET-L0292-V3, 12th Meeting, Oct. 3-12, 2018, 7 Pages. [cited by applicant]
Tsukuba et al., “Non-CE6: Context Modeling for MTS Index Coding”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11, JVET-00354-v2, 15th Meeting, Jul. 3-12, 2019, 5 Pages. [cited by applicant]
Cao (Hikvision) X et al: “CE6-related: Simplification on MTS CU flag coding”, 125. MPEG Meeting; Jan. 14, 2019-Jan. 18, 2019; Marrakech; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11). [cited by applicant]
Deng (Bytedance) Z et al: “Non-CE6: Reduced contexts and context coded bins for MTS index coding”. 15. JVET Meeting; Jul. 3, 2019-Jul. 12, 2019; Gothenburg; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 an… [cited by applicant]
Nalci (Qualcomm) A et al: “Non-CE6: A Simplification for MTS Index Signaling”, 15. JVET Meeting; Jul. 3, 2019-Jul. 12, 2019; Gothenburg; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T SG.16). [cited by applicant]
Marpe et al., 2003, “Context-Based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard” (pp. 620-636) (Year: 2003). [cited by applicant]
Tu et al., 2002, IEEE Publication, “Context-Based Entropy Coding of Block Transform Coefficients for Image Compression” (pp. 1271-1283). (Year: 2002). [cited by applicant]
Kiho Choi, Kwang Pyo Choi, CE6-related:Simplification on MTS kernel derivation, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018. [cited by applicant]
Benjamin Bross et al.: “Versatile Video Coding (Draft 5)”, Joint Video Experts Team (JVET), of ITU-T SG 16 WP 3 and ISO/I EC JTC 1 /SC 29/WG 11, JVET-N1001-vS, 14th Meeting, Jun. 11, 2019 (Jun. 11, 2019), pp. 308-320 , … [cited by applicant]