IP Library Granted Patent US 12,375,642
Granted Patent B2
US 12,375,642 · App. 17/690,947 · Granted Jul 29, 2025

Image encoding device, image encoding method, image decoding device, image decoding method, and non-transitory computer-readable storage medium

Inventor: Masato Shima (Tokyo, JP)
Assignee: Canon Kabushiki Kaisha
H04N19/105H04N19/176H04N19/186H04N19/61
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,375,642
App. No.
17/690,947
Granted
Jul 29, 2025
Kind
B2
Abstract

The block to be encoded is encoded using a first quantization parameter corresponding to a coefficient of each color component in the block to be encoded when it is determined that orthogonal transform processing is to be performed on the coefficient of each color component in the block to be encoded, and the block to be encoded is encoded using a second quantization parameter obtained by correcting the first quantization parameter when it is determined that orthogonal transform processing is not to be performed on the coefficient of each color component in the block to be encoded. A predetermined determination based on the first quantization parameter and a predetermined value is performed, and the second quantization parameter is derived by correcting the first quantization parameter in accordance with a determination result of the predetermined determination.

Claims (55)

1. An image encoding device that generates a bitstream by encoding an image having a plurality of components including at least a luma component and a chroma component, the image encoding device comprising:

a determination unit configured to determine whether transform processing is performed on the chroma component in a block to be encoded; and

an encoding unit configured to encode the chroma component in the block to be encoded using a first quantization parameter corresponding to the chroma component in the block to be encoded when the determination unit determines that transform processing is performed on the chroma component in the block to be encoded,

wherein, when the first quantization parameter is smaller than a reference value and the determination unit determines that transform processing is not performed on the chroma component in the block to be encoded, the encoding unit encodes the chroma component in the block to be encoded using the reference value as a quantization parameter,

wherein the reference value is a value defining a minimum value of the quantization parameter when the determination unit determines that transform processing is not performed,

wherein the encoding unit encodes, into the bitstream, information indicating difference between a constant value and the reference value defining the minimum value which is variable, as information indicating the reference value,

wherein the constant value is 4 which corresponds to a value of the quantization parameter corresponding to the quantization step being 1, and

wherein the reference value and the information indicating the reference value are commonly used in the plurality of components including at least the luma component and the chroma component.

2. The image encoding device according to claim 1 , wherein the encoding unit encodes the information into a header of a sequence in the bitstream.

3. An image decoding device that decodes a bitstream generated by encoding an image having a plurality of components including at least a luma component and a chroma component, the image decoding device comprising:

a derivation unit configured to derive a first quantization parameter corresponding to the chroma component in a block to be decoded based on information decoded from the bitstream;

a determination unit configured to determine whether transform processing is performed on the chroma component in the block to be decoded; and

a decoding unit configured to decode the chroma component in the block to be decoded using the first quantization parameter when the determination unit determines that transform processing is performed on the chroma component in the block to be decoded,

wherein, when the first quantization parameter is smaller than a reference value and the determination unit determines that transform processing is not performed on the chroma component in the block to be decoded, the decoding unit decodes the chroma component in the block to be decoded using the reference value as a quantization parameter,

wherein the reference value is a value defining a minimum value of the quantization parameter when the determination unit determines that transform processing is not performed,

wherein the decoding unit decodes, from the bitstream, information indicating difference between a constant value and the reference value defining the minimum value which is variable, as information indicating the reference value,

wherein the constant value is 4 which corresponds to a value of the quantization parameter corresponding to the quantization step being 1, and

wherein the reference value and the information indicating the reference value are commonly used in the plurality of components including at least the luma component and the chroma component.

4. The image decoding device according to claim 3 , wherein the decoding unit decodes the information from a header of a sequence in the bitstream.

5. An image encoding method that generates a bitstream by encoding an image having a plurality of components including at least a luma component and a chroma component, the image encoding method comprising:

determining whether transform processing is performed on the chroma component in a block to be encoded;

encoding the chroma component in the block to be encoded using a first quantization parameter corresponding to the chroma component in the block to be encoded when it is determined that transform processing is performed on the chroma component in the block to be encoded; and

when the first quantization parameter is smaller than a reference value and it is determined that transform processing is not performed on the chroma component in the block to be encoded, encoding the chroma component in the block to be encoded using the reference value as a quantization parameter,

wherein the reference value is a value defining a minimum value of the quantization parameter when it is determined that transform processing is not performed,

wherein the image encoding method further comprising encoding, into the bitstream, information indicating difference between a constant value and the reference value defining the minimum value which is variable, as information indicating the reference value,

wherein the constant value is 4 which corresponds to a value of the quantization parameter corresponding to the quantization step being 1, and

wherein the reference value and the information indicating the reference value are commonly used in the plurality of components including at least the luma component and the chroma component.

6. The image encoding method according to claim 5 , wherein the information is encoded into a header of a sequence in the bitstream.

7. An image decoding method that decodes a bitstream generated by encoding an image having a plurality of components including at least a luma component and a chroma component, the image decoding method comprising:

deriving a first quantization parameter corresponding to the chroma component in a block to be decoded based on information decoded from the bitstream;

determining whether transform processing is performed on the chroma component in the block to be decoded;

decoding the chroma component in the block to be decoded using the first quantization parameter, when it is determined that transform processing is performed on the chroma component in the block to be decoded; and

decoding, when the first quantization parameter is smaller than a reference value and it is determined that transform processing is not performed on the chroma component in the block to be decoded, the chroma component in the block to be decoded using the reference value as a quantization parameter,

wherein the reference value is a value defining a minimum value of the quantization parameter when it is determined that transform processing is not performed,

wherein the image decoding method further comprises decoding, from the bitstream, information indicating difference between a constant value and the reference value defining the minimum value which is variable, as information indicating the reference value,

wherein the constant value is 4 which corresponds to a value of the quantization parameter corresponding to the quantization step being 1, and

wherein the reference value and the information indicating the reference value are commonly used in the plurality of components including at least the luma component and the chroma component.

8. The image decoding method according to claim 7 , wherein the information is decoded from a header of a sequence in the bitstream.

9. A non-transitory computer-readable storage medium for storing a program causing a computer of an image encoding device that generates a bitstream by encoding an image having a plurality of components including at least a luma component and a chroma component, to function as:

a determination unit configured to determine whether transform processing is performed on the chroma component in a block to be encoded; and

an encoding unit configured to encode the chroma component in the block to be encoded using a first quantization parameter corresponding to the chroma component in the block to be encoded when the determination unit determines that transform processing is performed on the chroma component in the block to be encoded,

wherein, when the first quantization parameter is smaller than a reference value and the determination unit determines that transform processing is not performed on the chroma component in the block to be encoded, the encoding unit encodes the chroma component in the block to be encoded using the reference value as a quantization parameter,

wherein the reference value is a value defining a minimum value of the quantization parameter when the determination unit determines that transform processing is not performed,

wherein the encoding unit encodes, into the bitstream, information indicating difference between a constant value and the reference value defining the minimum value which is variable, as information indicating the reference value,

wherein the constant value is 4 which corresponds to a value of the quantization parameter corresponding to the quantization step being 1, and

wherein the reference value and the information indicating the reference value are commonly used in the plurality of components including at least the luma component and the chroma component.

10. A non-transitory computer-readable storage medium for storing a program causing a computer of an image decoding device that decodes a bitstream generated by encoding an image having a plurality of components including at least a luma component and a chroma component, to function as:

a derivation unit configured to derive a first quantization parameter corresponding to the chroma component in a block to be decoded based on information decoded from the bitstream;

a determination unit configured to determine whether transform processing is performed on the chroma component in the block to be decoded; and

a decoding unit configured to decode the chroma component in the block to be decoded using the first quantization parameter when the determination unit determines that transform processing is performed on the chroma component in the block to be decoded

wherein, when the first quantization parameter is smaller than a reference value and the determination unit determines that transform processing is not performed on the chroma component in the block to be decoded, the decoding unit decodes the chroma component in the block to be decoded using the reference value as a quantization parameter,

wherein the reference value is a value defining a minimum value of the quantization parameter when the determination unit determines that transform processing is not performed,

wherein the decoding unit decodes, from the bitstream, information indicating difference between a constant value and the reference value defining the minimum value which is variable, as information indicating the reference value,

wherein the constant value is 4 which corresponds to a value of the quantization parameter corresponding to the quantization step being 1, and

wherein the reference value and the information indicating the reference value are commonly used in the plurality of components including at least the luma component and the chroma component.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2022
From: SHIMA, MASATO
To: CANON KABUSHIKI KAISHA
Reel/Frame 059537/0848 →
Priority Claims (1)
JP 2019-168858 · Sep 17, 2019 · national
Continuity (2)
Continuation PCTJP2020029946 · Aug 5, 2020
Related Publication 20220201288A1 · Jun 23, 2022
References Cited (32)
US 9596479B2 · Liu · 2017 [cited by applicant]
US 20040179596A1 · Song et al. · 2004 [cited by applicant]
US 20130294524A1 · Van Der Auwera · 2013 [cited by examiner]
US 20160227247A1 · Zou · 2016 [cited by applicant]
US 20170085891A1 · Seregin et al. · 2017 [cited by applicant]
US 20170332091A1 · Maeda · 2017 [cited by applicant]
US 20180278934A1 · Andersson · 2018 [cited by examiner]
US 20210006794A1 · Karczewicz · 2021 [cited by examiner]
CN 102918843A · 2013 [cited by applicant]
CN 104221383A · 2014 [cited by applicant]
CN 105580368A · 2016 [cited by applicant]
JP 2015521826A · 2015 [cited by applicant]
JP 2016103804A · 2016 [cited by applicant]
JP 2017060177A · 2017 [cited by applicant]
JP 2018532319A · 2018 [cited by applicant]
KR 20180056687A · 2018 [cited by applicant]
WO 2014001547A2 · 2014 [cited by applicant]
WO 2015012600A1 · 2015 [cited by applicant]
WO 2017049119A1 · 2017 [cited by applicant]
WO 2019003676A1 · 2019 [cited by applicant]
WO 2021003241A1 · 2021 [cited by applicant]
Nguyen et al. (“Non-CE8: Minimum Allowed QP for Transform Skip Mode”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Document: JVET-o040… [cited by examiner]
Tsukuba et al. (“AHG13/Non-CE6/CE8: Chroma Transform Skip”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, Document: JVET-N0123-v2) (Year: … [cited by examiner]
Tsukuba, Takeshi, et al., CE8: Chroma Transform Skip (CE8-3.2), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Doc. No. JVET-00081-v2. [cited by applicant]
Zhao, Jie, er al., Non-GE8: Minimum QP for Palette Escape Coding, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 16th Meeting: Geneva, CH, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, D… [cited by applicant]
Chao, Yung-Hsuan, et al., Non-CE8: Minimum QP for escape mode in palette, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC I/SC 29/ WG 11, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, Doc. No. JVET-P047… [cited by applicant]
Nguyen, Tung et al., Non-CE8: Minimum Allowed QP for Transform Skip Mode, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/ WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Doc. No. JVET-… [cited by applicant]
Tsukuba, Takeshi, et al., AHG13/Non-CE6/CE8: Chroma Transform Skip, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WC 11, 14th Meeting: Geneva, CH, Mar. 19-27, 2019, Doc. No. JVET-N0123-v2. [cited by applicant]
Karczewicz, Marta, et al., Non-CE8: Minimum QP for Transform Skip Mode, Joint Video Experts Team (JVET) of ITU-T SG I6 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 2019, pp. 1-3, Doc. No. JVET-… [cited by applicant]
Takeshi Tsukuba, et al., AHG13/Non-CE6/CE8: Chroma Transform Skip, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Geneva, CH, Mar. 19-27, 2019, Doc. No. JVET-N0123-v1. [cited by applicant]
Tsukuba, Takeshi, et al., CE8: Chroma Transform Skip (CE8-3.2), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, Doc. No. JVET-O0081-v1. [cited by applicant]
Wang Ning et al., Fast transform skip mode decision for high efficiency video coding, Journal of image and graphics, Feb. 2015, vol. 20, No. 2, Beijing, China. [cited by applicant]