IP Library Granted Patent US 12,445,641
Granted Patent B2
US 12,445,641 · App. 17/256,586 · Granted Oct 14, 2025

Image encoding/decoding method and apparatus for throughput enhancement, and recording medium storing bitstream

Inventors: Sung Chang Lim (Daejeon, KR); Jung Won Kang (Daejeon, KR); Ha Hyun Lee (Seoul, KR); Jin Ho Lee (Daejeon, KR); Hui Yong Kim (Daejeon, KR); Dae Yeon Kim (Seoul, KR); Dong Jin Park (Seoul, KR); Myoung Hun Jang (Seongnam-si, KR); Wook Je Jeong (Gwacheon-si, KR)
Assignees: Electronics and Telecommunications Research Institute; CHIPS&MEDIA, INC
H04N19/57H04N19/119H04N19/176H04N19/184H04N19/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,445,641
App. No.
17/256,586
Granted
Oct 14, 2025
Kind
B2
Abstract

There is provided an image encoding/decoding method and apparatus. The image decoding method comprises decoding information on whether or not to perform motion information refinement from a bitstream, obtaining second motion information for first motion information on a current block on the basis of the information and reconstructing at least one of the current block and a neighboring block of the current block by using at least one of the first motion information and the second motion information.

Claims (49)

1. A method of decoding an image, the method comprising:

constructing a motion vector candidate list including a spatial motion vector and a temporal motion vector, from a neighboring block in a current picture including a current block and a col-block of the current block in a different picture from the current picture;

deriving a first motion vector of the current block using the motion vector candidate list;

decoding information on whether or not to perform motion vector refinement from a bitstream;

obtaining a second motion vector of the current block by refining the first motion vector of the current block based on the information on whether or not to perform motion vector refinement; and

reconstructing the current block by performing inter-prediction based on the second motion vector;

wherein constructing the motion vector candidate list comprises:

entering a motion vector of the neighboring block as the spatial motion vector;

obtaining a refined motion vector of the col-block;

scaling the refined motion vector of the col-block; and

entering the scaled refined motion vector of the col-block as the temporal motion vector, and

wherein the motion vector of the neighboring block is excluded from the motion vector candidate list when the neighboring block is included in a region including the current block, the region being derived based on size information from the bitstream.

2. The method of claim 1 , wherein the information on whether or not to perform motion vector refinement is signaled through at least one of a parameter set or video parameter set, a sequence parameter set, a subpicture parameter set, a picture parameter set, an adaptation parameter set, a slice header, a tile header, and a brick header.

3. The method of claim 1 , wherein the refined second motion vector is obtained by using a pixel value indicated by a candidate motion vector in a region within an LO reference picture for the current block, and using a pixel value indicated by a vector opposite to the candidate motion vector in a region within an L 1 reference picture for the current block. 9 - 10 .

4. A method of encoding an image, the method comprising:

constructing a motion vector candidate list including a spatial motion vector and a temporal motion vector, from a neighboring block in a current picture including a current block and a col-block of the current block in a different picture from the current picture;

determining a first motion vector of the current block using the motion vector candidate list;

determining whether or not to perform motion vector refinement;

obtaining a second motion vector of the current block by refining the first motion vector of the current block based on the determination of whether or not to perform motion vector refinement;

reconstructing the current block by performing inter-prediction based on the second motion vector; and

encoding information on whether or not to perform motion vector refinement based on the determination of whether or not to perform motion vector refinement,

wherein constructing the motion vector candidate list comprises:

entering a motion vector of the neighboring block as the spatial motion vector;

obtaining a refined motion vector of the col-block;

scaling the refined motion vector of the col-block; and

entering the scaled refined motion vector of the col-block as the temporal motion vector, and

wherein the motion vector of the neighboring block is excluded from the motion vector candidate list when the neighboring block is included in a region including the current block, the region being derived based on size information from a bitstream.

5. The method of claim 4 , wherein the information on whether or not to perform motion vector refinement is signaled through at least one of a parameter set or video parameter set, a sequence parameter set, a subpicture parameter set, a picture parameter set, an adaptation parameter set, a slice header, a tile header, and a brick header.

6. A method comprising:

obtaining a bitstream for an image, the bitstream for the image being generated by an image encoding method; and

transmitting the bitstream,

wherein the image encoding method comprises:

constructing a motion vector candidate list including a spatial motion vector and a temporal motion vector, from a neighboring block in a current picture including a current block and a col-block of the current block in a different picture from the current picture;

determining a first motion vector of the current block using the motion vector candidate list;

determining whether or not to perform motion vector refinement;

obtaining a second motion vector of the current block by refining the first motion vector of the current block based on the determination of whether or not to perform motion vector refinement;

reconstructing the current block by performing inter-prediction based on the second motion vector; and

encoding information on whether or not to perform motion vector refinement based on the determination of whether or not to perform motion vector refinement, wherein constructing the motion vector candidate list comprises:

entering a motion vector of the neighboring block as the spatial motion vector;

obtaining a refined motion vector of the col-block;

scaling the refined motion vector of the col-block; and

entering the scaled refined motion vector of the col-block as the temporal motion vector, and

wherein the motion vector of the neighboring block is excluded from the motion vector candidate list when the neighboring block is included in a region including the current block, the region being derived based on size information from the bitstream.

7. The method of claim 1 , wherein the first motion vector of the current block which is not refined is used for determining a boundary strength of deblocking filtering.

8. The method of claim 1 , wherein the refined second motion vector is obtained by partitioning the current block into at least one subblock and performing motion vector refinement on the at least one subblock, when at least one of a width and a height of the current block is greater than 16 .

9. The method of claim 8 , wherein an initial motion vector on the current block is used as initial motion vector of the subblock.

10. The method of claim 4 , wherein the first motion vector of the current block which is not refined is used for determining a boundary strength of deblocking filtering.

11. The method of claim 4 , wherein the refined second motion vector is obtained by partitioning the current block into at least one subblock and performing motion vector refinement on the at least one subblock, when at least one of a width and a height of the current block is greater than 16 .

12. The method of claim 11 , wherein an initial motion vector on the current block is used as initial motion vector of the subblock.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2020
From: LIM, SUNG CHANG; KANG, JUNG WON; LEE, HA HYUN; LEE, JIN HO; KIM, HUI YONG; KIM, DAE YEON; PARK, DONG JIN; JANG, MYOUNG HUN; JEONG, WOOK JE
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE; CHIPS&MEDIA, INC
Reel/Frame 054758/0412 →
Priority Claims (3)
KR 10-2018-0075705 · Jun 29, 2018 · national
KR 10-2018-0108548 · Sep 11, 2018 · national
KR 10-2019-0024880 · Mar 4, 2019 · national
Continuity (1)
Related Publication 20210274217A1 · Sep 2, 2021
References Cited (32)
US 20050058196A1 · Fernandes · 2005 [cited by examiner]
US 20090245351A1 · Watanabe · 2009 [cited by examiner]
US 20100046620A1 · Kang · 2010 [cited by examiner]
US 20110222605A1 · Kashiwagi · 2011 [cited by examiner]
US 20130044809A1 · Chong · 2013 [cited by examiner]
US 20130215968A1 · Jeong · 2013 [cited by examiner]
US 20130315309A1 · Lin · 2013 [cited by examiner]
US 20140254679A1 · Ramasubramonian · 2014 [cited by examiner]
US 20160286232A1 · Li · 2016 [cited by examiner]
US 20170214932A1 · Huang · 2017 [cited by examiner]
US 20180176596A1 · Jeong et al. · 2018 [cited by applicant]
US 20180241998A1 · Chen · 2018 [cited by examiner]
US 20180338154A1 · Huang · 2018 [cited by examiner]
US 20190020895A1 · Liu · 2019 [cited by examiner]
US 20190141333A1 · Lee · 2019 [cited by applicant]
US 20190208223A1 · Galpin · 2019 [cited by examiner]
US 20200404323A1 · Esenlik · 2020 [cited by examiner]
CN 108141604A · 2018 [cited by applicant]
KR 100772576B1 · 2007 [cited by applicant]
KR 1020150145688A · 2015 [cited by applicant]
KR 1020160087209A · 2016 [cited by applicant]
KR 1020170059422A · 2017 [cited by applicant]
KR 1020170131448A · 2017 [cited by applicant]
KR 1020180061060A · 2018 [cited by applicant]
WO 0186962A1 · 2001 [cited by applicant]
WO 2016160605A1 · 2016 [cited by applicant]
WO 2017188566A1 · 2017 [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 4 (VTM 4)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 2019, … [cited by applicant]
Office Action for CN 201980044126.X by China National Intellectual Property Administration dated Nov. 23, 2023. [cited by applicant]
Bross, Benjamin et al. “Versatile Video Coding (Draft 4),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. Jan. 2019. doc: JVET-M1001-v5. [cited by applicant]
Sakazume, Satoru et al. “Description of video coding technology proposal by JVC,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11. Apr. 2010. doc: JCTVC-A108. [cited by applicant]
Esenlik, Semih et al. “Description of Core Experiment 9 (CE9): Decoder Side Motion Vector Derivation,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11. Apr. 2018. doc: JVET-J1029_r4. [cited by applicant]