IP Library Granted Patent US 12,519,933
Granted Patent B2
US 12,519,933 · App. 18/779,749 · Granted Jan 6, 2026

Image encoding/decoding method and device

Inventor: Ki Baek Kim (Seoul, KR)
Assignee: B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.
H04N19/105H04N19/176H04N19/186H04N19/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,519,933
App. No.
18/779,749
Granted
Jan 6, 2026
Kind
B2
Abstract

An image prediction method according to the present invention may comprise: identifying a reference pixel region designated for obtaining correlation information; determining a reference pixel processing configuration on the basis of determination of the availability of the reference pixel region; and performing intra prediction according to the determined reference pixel processing. As described above, performing intra prediction on the basis of the availability of a reference pixel according to the present invention can improve encoding performance.

Claims (55)

1 . A method of decoding an image, comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block;

deriving correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block for generating a prediction block of the current chroma block; and

reconstructing the current chroma block based on the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, positions of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

2 . The method of claim 1 , the method further comprising:

obtaining, from a bitstream, first information indicating whether the color copy mode is supported,

wherein whether the color copy mode is supported for the current chroma block is determined based on the first information.

3 . The method of claim 1 , wherein the correlation information is derived using only some of pixels in the reference region.

4 . The method of claim 1 , wherein a number of the correlation information to be applied to the down-sampled luma block is greater than or equal to 3.

5 . A method of encoding an image, comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block;

determining correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block for generating a prediction block of the current chroma block; and

encoding the current chroma block based on the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, positions of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

6 . A non-transitory computer readable medium having stored thereon instructions that when executed by a processor perform a method, comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in an image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block;

deriving correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block for generating a prediction block of the current chroma block; and

encoding the current chroma block based on the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, positions of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

7 . A non-transitory computer readable medium storing a bitstream generated by a method of encoding an image, the method comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block;

determining correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block for generating a prediction block of the current chroma block; and

encoding the current chroma block based on the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, positions of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

8 . A method of transmitting a bitstream generated by an image encoding method, the image encoding method comprising:

determining whether a color copy mode is supported for a current chroma block of a first color space in the image, wherein the color copy mode is a mode of predicting the current chroma block of the first color space by using a luma block of a second color space reconstructed before the current chroma block;

down-sampling the luma block corresponding to the current chroma block in response to the determination that the color copy mode is supported for the current chroma block;

determining correlation information for the color copy mode based on a pre-determined reference region, wherein the correlation information represents a correlation between the current chroma block and the luma block, and the correlation information is expressed by a weight parameter and an offset parameter to be applied to the down-sampled luma block;

predicting the current chroma block by applying the correlation information to the down-sampled luma block for generating a prediction block of the current chroma block; and

encoding the current chroma block based on the prediction block,

wherein the reference region includes at least one of a neighboring region of the current chroma block or a neighboring region of the luma block,

wherein a number of reference pixel lines belonging to the reference region used for deriving the correlation information is adaptively determined based on a determination of whether the current chroma block is located on a boundary of a maximum coding block,

wherein the down-sampling of the luma block is performed using a first pixel of the luma block corresponding to a current pixel of the current chroma block and a plurality of neighboring pixels adjacent to the first pixel, positions of the plurality of neighboring pixels being determined based on a chroma format of the image, and

wherein the neighboring pixels include at least one of a right neighboring pixel, a bottom neighboring pixel or a bottom-right neighboring pixel.

Priority Claims (3)
KR 10-2018-0034174 · Mar 25, 2018 · national
KR 10-2018-0034882 · Mar 27, 2018 · national
KR 10-2018-0085679 · Jul 24, 2018 · national
Continuity (5)
Continuation 18437885 · Feb 9, 2024
Continuation 18366399 · Aug 7, 2023
Continuation 17874536 · Jul 27, 2022
Division 16980680
Related Publication 20240380881A1 · Nov 14, 2024
References Cited (71)
US 11956425B2 · Kim · 2024 [cited by applicant]
US 20110032987A1 · Lee et al. · 2011 [cited by applicant]
US 20140105276A1 · Nakamura et al. · 2014 [cited by applicant]
US 20150063457A1 · Gamei et al. · 2015 [cited by applicant]
US 20150382009A1 · Chen et al. · 2015 [cited by applicant]
US 20160182913A1 · Joshi et al. · 2016 [cited by applicant]
US 20160241861A1 · Choe et al. · 2016 [cited by applicant]
US 20170332095A1 · Zou et al. · 2017 [cited by applicant]
US 20170366818A1 · Zhang et al. · 2017 [cited by applicant]
US 20180063527A1 · Chen · 2018 [cited by examiner]
US 20180077426A1 · Zhang et al. · 2018 [cited by applicant]
US 20190028731A1 · Chuang et al. · 2019 [cited by applicant]
US 20190356909A1 · Lainema · 2019 [cited by applicant]
US 20200177911A1 · Aono · 2020 [cited by examiner]
US 20210329282A1 · Lee · 2021 [cited by applicant]
CN 103460700A · 2013 [cited by applicant]
CN 107079166A · 2017 [cited by applicant]
JP 201334163A · 2013 [cited by applicant]
JP 2013141187A · 2013 [cited by applicant]
JP 2023120392A · 2023 [cited by applicant]
KR 101566290B1 · 2015 [cited by applicant]
KR 1020160045243A · 2016 [cited by applicant]
KR 101633459B1 · 2016 [cited by applicant]
KR 101768173B1 · 2017 [cited by applicant]
RU 2501161C2 · 2013 [cited by applicant]
RU 2491758C2 · 2013 [cited by applicant]
RU 2574831C2 · 2016 [cited by applicant]
RU 2639679C2 · 2017 [cited by applicant]
WO 2009074089A1 · 2009 [cited by applicant]
WO 2012165039A1 · 2012 [cited by applicant]
WO WO2015004884A1 · 2015 [cited by applicant]
WO 2016066028A1 · 2016 [cited by applicant]
WO 2016100859A1 · 2016 [cited by applicant]
WO WO2016140090A1 · 2016 [cited by applicant]
WO 2017018664A1 · 2017 [cited by applicant]
WO 2015005418A1 · 2017 [cited by applicant]
WO 2017036045A1 · 2017 [cited by applicant]
WO 2017118411A1 · 2017 [cited by applicant]
WO WO2017118409A1 · 2017 [cited by applicant]
WO WO2017130696A1 · 2017 [cited by applicant]
WO 2017148345A1 · 2017 [cited by applicant]
WO 2017165391A1 · 2017 [cited by applicant]
WO 2017200771A1 · 2017 [cited by applicant]
WO 2018012808A1 · 2018 [cited by applicant]
WO 2018053293A1 · 2018 [cited by applicant]
Zhang, Xiang, et al. “A Joint Compression Scheme of Video Feature Descriptors and Visual Content.” IEEE Transactions on Image Processing 26.2 (2016): 633-647. [cited by applicant]
Bross, B., et al. “High efficiency video coding (HEVC) text specification draft 8.” JCTVC-J1003_d0, 10th Meeting: Stockholm, SE, Jul. 11-20, 2012, (10 pages in English). [cited by applicant]
Guo, Mei, et al. “Intra Chroma LM Mode with Reduced Line Buffer.” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 6th Meeting: Torino, Italy. vol. 5, Jul. 2011. (5 pages i… [cited by applicant]
International Search Report issued on Jul. 2, 2019 corresponds in International Patent Application No. PCT/KR2019/003443 (2 pages in English and 2 pages in Korean). [cited by applicant]
Korean Office Action issued on May 8, 2020 corresponds in Korean Patent Application No. 10-2019-0033765 (8 pages in Korean). [cited by applicant]
Korean Office Action issued on Dec. 18, 2020 corresponds in Korean Patent Application No. 10-2019-0033765 (4 pages in Korean). [cited by applicant]
Li, Jiahao et al., “Multiple line-based intra prediction”, [cited by applicant]
Rosewarne, C. et al., “High Efficiency Video Coding (HEVC) Test Model 16 (HM 16) Improved Encoder Description Update 7”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 25… [cited by applicant]
Russian Office Action issued on Dec. 28, 2020 corresponds in Russian Patent Application No. 2020134634 (7 pages in English and 12 pages in Russian). [cited by applicant]
Seregin, Vadim et al., “Neighbor based intra most probable modes list derivation”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 3rd Meeting: Geneva, CH, May 26-Jun. 1, 2016. (pp… [cited by applicant]
Suzuki, Teruhiko et al., “Description of SDR and HDR video coding technology proposal by Sony”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, US, Apr. 10-20,… [cited by applicant]
Van der Auwera et al., “Description of Core Experiment 3: Intra Prediction and Mode Coding”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, USA, Apr. 10-20, 2… [cited by applicant]
Zhang, Kai et al., “Enhanced Cross-component Linear Model Intra-prediction”, [cited by applicant]
Zhang, Kai, et al. “Multi-Model Based Cross-Component Linear Model Chroma Intra-Prediction for Video Coding.” 2017 IEEE Visual Communications and Image Processing (VCIP) 2017. (4 pages in English). [cited by applicant]
Zhang, Li et al., “Multiple Direct Modes for chroma intra coding”, [cited by applicant]
Zhang, Tao, et al. “Improving Chroma Intra Prediction for HEVC.” 2016 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) Sep. 9, 2021. (6 pages in English). [cited by applicant]
Zhang, Xingyu, et al. “New Chroma Intra Prediction Modes Based on Linear Model for HEVC.” 2012 19th IEEE International Conference on Image Processing, 2012. (4 pages in English). [cited by applicant]
“Control-Point Representation and Differential Coding Affine-Motion Compensation,” Han Huang, et al., IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, No. 10, Oct. 2013, pp. 1651-1660. [cited by applicant]
Jianle Chen, et al., “Algorithm Description of Joint Exploration Test Model 6 (JEM 6),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WVG 11, 6th Meeting: Hobart, AU, Mar. 31-Apr. 7, 20… [cited by applicant]
Han Huang, et al., “Control-Point Representation and Differential Coding Affine-Motion Compensation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 23, No. 10, Oct. 2013. [cited by applicant]
Li Li, et al, “An Efficient Four-Parameter Affine Motion Model for Video Coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, Issue: 8, Aug. 2018, pp. 1934-1948. [cited by applicant]
Zhang, et al. “Multi-model Based Cross-component Linear Model Chroma Intra-prediction for Video Coding,” 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA, 2017, pp. 1-4. [cited by applicant]
Zhang, et al. “New Chroma Intra Prediction Modes Based on Linear Model for HEVC,” 2012 19th IEEE International Conference on Image Processing, Orlando, FL, USA, 2012, pp. 197-200. [cited by applicant]
Kei Kawamura, et al. “Non-RCE1: Chroma intra prediction with mode-dependent reduced reference,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting: Vienna, … [cited by applicant]
Jianle Chen, et al. “Algorithm Description of Joint Exploration Test Model 6 (JEM 6),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 6th Meeting: Hobart, AU, 31 Mar.-Apr. 7, 2017… [cited by applicant]
Han Huang, et al. “Control-Point Representation and Differential Coding Affine-Motion Compensation,” IEEE Transactions On Circuits and Systems for Video Technology, vol. 23, No. 10, Oct. 2013, pp. 1651-1660. [cited by applicant]