IP Library › Granted Patent US 12,513,287
Granted Patent B2
US 12,513,287 · App. 18/779,733 · Granted Dec 30, 2025

Image encoding/decoding method and device

Inventor: Ki Baek Kim (Seoul, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N19/105H04N19/176H04N19/186H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,513,287
App. No.
18/779,733
Granted
Dec 30, 2025
Kind
B2
Abstract

An image prediction method according to the present invention may comprise: identifying a reference pixel region designated for obtaining correlation information; determining a reference pixel processing configuration on the basis of determination of the availability of the reference pixel region; and performing intra prediction according to the determined reference pixel processing. As described above, performing intra prediction on the basis of the availability of a reference pixel according to the present invention can improve encoding performance.

Claims (60)

1 . A method of decoding an image, comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

determining whether the color copy mode is applied for the current chroma block in the image;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block and the color copy mode is applied for the current chroma block;

deriving correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block to generate a prediction block; and

reconstructing the current chroma block based on the prediction block and a residual block for the current chroma block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, a position of the first pixel corresponding to the current pixel being determined based on a chroma format of the image and position of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

2 . The method of claim 1 , the method further comprising:

obtaining, from a bitstream, first information indicating whether the color copy mode is supported,

wherein whether the color copy mode is supported for the current chroma block is determined based on the first information.

3 . The method of claim 1 , wherein the correlation information is derived using only some of pixels in the reference region.

4 . The method of claim 1 , wherein a number of the correlation information to be applied to the down-sampled luma block is greater than or equal to 3.

5 . A method of encoding an image, comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

determining whether the color copy mode is applied for the current chroma block in the image;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block and the color copy mode is applied for the current chroma block;

determining correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block to generate a prediction block; and

encoding a residual block for the current chroma block, the residual block being obtained based on the current chroma block and the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, a position of the first pixel corresponding to the current pixel being determined based on a chroma format of the image and position of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

6 . A non-transitory computer readable medium having stored thereon instructions that when executed by a processor perform a method, comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in an image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

determining whether the color copy mode is applied for the current chroma block in the image;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block and the color copy mode is applied for the current chroma block;

deriving correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block to generate a prediction block; and

encoding a residual block for the current chroma block, the residual block being obtained based on the current chroma block and the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, a position of the first pixel corresponding to the current pixel being determined based on a chroma format of the image and position of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

7 . A non-transitory computer readable recording medium storing a bitstream that is generated by a method of encoding an image, the method comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

determining whether the color copy mode is applied for the current chroma block in the image;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block and the color copy mode is applied for the current chroma block;

determining correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block to generate a prediction block; and

encoding a residual block for the current chroma block, the residual block being obtained based on the current chroma block and the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, a position of the first pixel corresponding to the current pixel being determined based on a chroma format of the image and position of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

8 . A method of transmitting a bitstream generated by an image encoding method, the image encoding method comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

determining whether the color copy mode is applied for the current chroma block in the image;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block and the color copy mode is applied for the current chroma block;

determining correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block to generate a prediction block; and

encoding a residual block for the current chroma block, the residual block being obtained based on the current chroma block and the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, a position of the first pixel corresponding to the current pixel being determined based on a chroma format of the image and position of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

Priority Claims (3)
KR 10-2018-0034174 · Mar 25, 2018 · national
KR 10-2018-0034882 · Mar 27, 2018 · national
KR 10-2018-0085679 · Jul 24, 2018 · national
Continuity (5)
Continuation 18437885 · Feb 9, 2024
Continuation 18366399 · Aug 7, 2023
Continuation 17874536 · Jul 27, 2022
Division 16980680
Related Publication 20240380880A1 · Nov 14, 2024
References Cited (71)
US 11956425B2 · Kim · 2024 [cited by applicant]
US 20110032987A1 · Lee et al. · 2011 [cited by applicant]
US 20140105276A1 · Nakamura et al. · 2014 [cited by applicant]
US 20150063457A1 · Gamei et al. · 2015 [cited by applicant]
US 20150382009A1 · Chen et al. · 2015 [cited by applicant]
US 20160182913A1 · Joshi et al. · 2016 [cited by applicant]
US 20160241861A1 · Choe et al. · 2016 [cited by applicant]
US 20170332095A1 · Zou et al. · 2017 [cited by applicant]
US 20170366818A1 · Zhang et al. · 2017 [cited by applicant]
US 20180063527A1 · Chen · 2018 [cited by examiner]
US 20180077426A1 · Zhang et al. · 2018 [cited by applicant]
US 20190028731A1 · Chuang et al. · 2019 [cited by applicant]
US 20190356909A1 · Lainema · 2019 [cited by applicant]
US 20200177911A1 · Aono · 2020 [cited by examiner]
US 20210329282A1 · Lee · 2021 [cited by applicant]
CN 103460700A · 2013 [cited by applicant]
CN 107079166A · 2017 [cited by applicant]
JP 201334163A · 2013 [cited by applicant]
JP 2013141187A · 2013 [cited by applicant]
JP 2023120392A · 2023 [cited by applicant]
KR 101566290B1 · 2015 [cited by applicant]
KR 1020160045243A · 2016 [cited by applicant]
KR 101633459B1 · 2016 [cited by applicant]
KR 101768173B1 · 2017 [cited by applicant]
RU 2501161C2 · 2013 [cited by applicant]
RU 2491758C2 · 2013 [cited by applicant]
RU 2574831C2 · 2016 [cited by applicant]
RU 2639679C2 · 2017 [cited by applicant]
WO 2009074089A1 · 2009 [cited by applicant]
WO 2012165039A1 · 2012 [cited by applicant]
WO WO2015004884A1 · 2015 [cited by applicant]
WO 2016066028A1 · 2016 [cited by applicant]
WO 2016100859A1 · 2016 [cited by applicant]
WO WO2016140090A1 · 2016 [cited by applicant]
WO 2017018664A1 · 2017 [cited by applicant]
WO 2015005418A1 · 2017 [cited by applicant]
WO 2017036045A1 · 2017 [cited by applicant]
WO 2017118411A1 · 2017 [cited by applicant]
WO WO2017118409A1 · 2017 [cited by applicant]
WO WO2017130696A1 · 2017 [cited by applicant]
WO 2017148345A1 · 2017 [cited by applicant]
WO 2017165391A1 · 2017 [cited by applicant]
WO 2017200771A1 · 2017 [cited by applicant]
WO 2018012808A1 · 2018 [cited by applicant]
WO 2018053293A1 · 2018 [cited by applicant]
Li Li, et al, “An Efficient Four-Parameter Affine Motion Model for Video Coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, Issue: 8, Aug. 2018, pp. 1934-1948. [cited by applicant]
Jianle Chen, et al., “Algorithm Description of Joint Exploration Test Model 6 (JEM 6),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 6th Meeting: Hobart, AU, Mar. 31-Apr. 7, 201… [cited by applicant]
Han Huang, et al., “Control-Point Representation and Differential Coding Affine-Motion Compensation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, No. 10, Oct. 2013. [cited by applicant]
Bross, B., et al. “High efficiency video coding (HEVC) text specification draft 8.” JCTVC-J1003_d0, 10th Meeting: Stockholm, SE, Jul. 11-20, 2012, (10 pages in English). [cited by applicant]
Guo, Mei, et al. “Intra Chroma LM Mode with Reduced Line Buffer.” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting: Torino, Italy. vol. 5, Jul. 2011. (5 pages i… [cited by applicant]
International Search Report issued on Jul. 2, 2019 corresponds in International Patent Application No. PCT/KR2019/003443 (2 pages in English and 2 pages in Korean). [cited by applicant]
Korean Office Action issued on May 8, 2020 corresponds in Korean Patent Application No. 10-2019-0033765 (8 pages in Korean). [cited by applicant]
Korean Office Action issued on Dec. 18, 2020 corresponds in Korean Patent Application No. 10-2019-0033765 (4 pages in Korean). [cited by applicant]
Li, Jiahao et al., “Multiple line-based intra prediction”, [cited by applicant]
Rosewarne, C. et al., “High Efficiency Video Coding (HEVC) Test Model 16 (HM 16) Improved Encoder Description Update 7”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 25… [cited by applicant]
Russian Office Action issued on Dec. 28, 2020 corresponds in Russian Patent Application No. 2020134634 (7 pages in English and 12 pages in Russian). [cited by applicant]
Seregin, Vadim et al., “Neighbor based intra most probable modes list derivation”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016. (pp… [cited by applicant]
Suzuki, Teruhiko et al., “Description of SDR and HDR video coding technology proposal by Sony”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, US, Apr. 10-20,… [cited by applicant]
Van der Auwera et al., “Description of Core Experiment 3: Intra Prediction and Mode Coding”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, USA, Apr. 10-20, 2… [cited by applicant]
Zhang, Kai et al., “Enhanced Cross-component Linear Model Intra-prediction”, [cited by applicant]
Zhang, Kai, et al. “Multi-Model Based Cross-Component Linear Model Chroma Intra-Prediction for Video Coding.” 2017 IEEE Visual Communications and Image Processing (VCIP) 2017. (4 pages in English). [cited by applicant]
Zhang, Li et al., “Multiple Direct Modes for chroma intra coding”, [cited by applicant]
Zhang, Tao, et al. “Improving Chroma Intra Prediction for HEVC.” 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) Sep. 9, 2021. (6 pages in English). [cited by applicant]
Zhang, Xingyu, et al. “New Chroma Intra Prediction Modes Based on Linear Model for HEVC.” 2012 19th IEEE International Conference on Image Processing, 2012. (4 pages in English). [cited by applicant]
Zhang, Xiang, et al. “A Joint Compression Scheme of Video Feature Descriptors and Visual Content.” IEEE Transactions on Image Processing 26.2 (2016): 633-647. [cited by applicant]
“Control-Point Representation and Differential Coding Affine-Motion Compensation,” Han Huang, et al., IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, No. 10, Oct. 2013, pp. 1651-1660. [cited by applicant]
Zhang, et al. “Multi-model Based Cross-component Linear Model Chroma Intra-prediction for Video Coding,” 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA, 2017, pp. 1-4. [cited by applicant]
Zhang, et al. “New Chroma Intra Prediction Modes Based On Linear Model for HEVC,” 2012 19th IEEE International Conference on Image Processing, Orlando, FL, USA, 2012, pp. 197-200. [cited by applicant]
Kei Kawamura, et al. “Non-RCE1: Chroma intra prediction with mode-dependent reduced reference,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Vienna, … [cited by applicant]
Jianle Chen, et al. “Algorithm Description of Joint Exploration Test Model 6 (JEM 6),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 6th Meeting: Hobart, AU, Mar. 31-Apr. 7, 2017… [cited by applicant]
Han Huang, et al. “Control-Point Representation and Differential Coding Affine-Motion Compensation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, No. 10, Oct. 2013, pp. 1651-1660. [cited by applicant]