IP Library Granted Patent US 12,348,714
Granted Patent B2
US 12,348,714 · App. 18/353,962 · Granted Jul 1, 2025

Image encoding device and image decoding device using triangular prediction mode, and image encoding method and image decoding method performed thereby

Inventors: Seungsoo Jeong (Suwon-si, KR); Anish Tamse (Suwon-si, KR); Minsoo Park (Suwon-si, KR); Minwoo Park (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N19/119H04N19/105H04N19/176H04N19/52H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,714
App. No.
18/353,962
Granted
Jul 1, 2025
Kind
B2
Abstract

An image decoding method including: obtaining, from a bitstream, information related to a triangle prediction mode for a current block; splitting the current block into two triangular partitions, according to the information related to a triangle prediction mode; generating a merge list for a triangle prediction mode, according to a merge list generation method in a regular merge mode; selecting a motion vector for the two triangular partitions according to information indicating the motion vector from among motion vectors included in the merge list; obtaining, from a reference image, prediction blocks corresponding to the two triangular partitions, based on the motion vector; and reconstructing the current block, based on a final prediction block.

Claims (29)

1. An image decoding method performed by an image decoding apparatus, the image decoding method comprising:

when a size of a current block is equal to or greater than a predetermined value, obtaining information indicating whether an inter-intra combination mode is applied to the current block;

when the information indicates that the inter-intra combination mode is not applied to the current block, obtaining, from a bitstream, partition shape information for the current block, first motion vector related information for a first partition and second motion vector related information for a second partition;

obtaining a first prediction sample using a motion vector of a first candidate block indicated by the first motion vector related information among a plurality of candidate blocks included in a merge list;

obtaining a second prediction sample using a motion vector of a second candidate block indicated by the second motion vector related information among the plurality of candidate blocks included in the merge list;

determining a weight value for the first prediction sample and the second prediction sample using the partition shape information;

obtaining a third prediction sample by combining the first prediction sample and the second prediction sample using the weight value; and

reconstructing the current block by using the third prediction sample.

2. An image decoding apparatus comprising:

an entropy decoder configured to, when a size of a current block is equal to or greater than a predetermined value, obtain information indicating whether an inter-intra combination mode is applied to the current block, and when the information indicates that the inter-intra combination mode is not applied to the current block, obtain, from a bitstream, partition shape information for the current block, first motion vector related information for a first partition and second motion vector related information for a second partition; and

a prediction decoder configured to obtain a first prediction sample using a motion vector of a first candidate block indicated by the first motion vector related information among a plurality of candidate blocks included in a merge list, obtain a second prediction sample using a motion vector of a second candidate block indicated by the second motion vector related information among the plurality of candidate blocks included in the merge list, determine a weight value for the first prediction sample and the second prediction sample using the partition shape information, obtain a third prediction sample by combining the first prediction sample and the second prediction sample by using the weight value, and reconstruct the current block by using the third prediction sample.

3. An image encoding method performed by an image encoding apparatus, the image encoding method comprising:

when a size of a current block is equal to or greater than a predetermined value, determining whether an inter-intra combination mode is applied to the current block;

when it is determined that the inter-intra combination mode is not applied to the current block, determining a partition shape for the current block, and selecting, among a plurality of candidate blocks comprised in a merge list, a first candidate block for a first partition and a second candidate block for a second partition; and

generating a bitstream comprising information indicating whether the inter-intra combination mode is applied to the current block, first motion vector related information indicating the first candidate block, second motion vector related information indicating the second candidate block, and partition shape information for the current block,

wherein the current block corresponds to a third prediction sample obtained by combining a first prediction sample and a second prediction sample,

the first prediction sample is determined based on a motion vector of the first candidate block, and the second prediction sample is determined based on a motion vector of the second candidate block, and

the first prediction sample and the second prediction sample are combined based on a weight value determined using the partition shape information.

4. A method for recording a bitstream into a non-transitory computer-readable medium, the method comprising:

when a size of a current block is equal to or greater than a predetermined value, determining whether an inter-intra combination mode is applied to the current block;

when it is determined that the inter-intra combination mode is not applied to the current block, determining a partition shape for the current block, and selecting, among a plurality of candidate blocks comprised in a merge list, a first candidate block for a first partition and a second candidate block for a second partition;

generating the bitstream comprising information indicating whether the inter-intra combination mode is applied to the current block, first motion vector related information indicating the first candidate block, second motion vector related information indicating the second candidate block, and partition shape information for the current block; and

recording the bitstream into the non-transitory computer-readable medium,

wherein the current block corresponds to a third prediction sample obtained by combining a first prediction sample and a second prediction sample,

the first prediction sample is determined based on a motion vector of the first candidate block, and the second prediction sample is determined based on a motion vector of the second candidate block, and

the first prediction sample and the second prediction sample are combined based on a weight value determined using the partition shape information.

5. A method for transmitting a bitstream, the method comprising:

generating the bitstream by the image encoding method of claim 3 ; and

transmitting the bitstream to a receiver.

Continuity (3)
Continuation 17416984
Provisional Application 62783662 · Dec 21, 2018
Related Publication 20230362370A1 · Nov 9, 2023
References Cited (68)
US 10356413B1 · Sim · 2019 [cited by examiner]
US 10477205B1 · Sim · 2019 [cited by examiner]
US 10666940B2 · Park et al. · 2020 [cited by applicant]
US 10798375B2 · Piao et al. · 2020 [cited by applicant]
US 10819978B2 · Tamse et al. · 2020 [cited by applicant]
US 10999595B2 · Lin et al. · 2021 [cited by applicant]
US 12088788B2 · Jeong et al. · 2024 [cited by applicant]
US 20110200111A1 · Chen · 2011 [cited by examiner]
US 20170332099A1 · Lee et al. · 2017 [cited by applicant]
US 20170339425A1 · Jeong et al. · 2017 [cited by applicant]
US 20180249156A1 · Heo · 2018 [cited by examiner]
US 20180343455A1 · Jang · 2018 [cited by examiner]
US 20180376149A1 · Zhang · 2018 [cited by examiner]
US 20190014334A1 · Samuelsson · 2019 [cited by examiner]
US 20190045195A1 · Gokhale · 2019 [cited by examiner]
US 20190273921A1 · Abe · 2019 [cited by examiner]
US 20190306511A1 · Jang · 2019 [cited by examiner]
US 20190335181A1 · Abe · 2019 [cited by examiner]
US 20190335208A1 · Lim et al. · 2019 [cited by applicant]
US 20200007882A1 · Abe · 2020 [cited by examiner]
US 20200162736A1 · Seok · 2020 [cited by examiner]
US 20200221108A1 · Xu · 2020 [cited by examiner]
US 20200228832A1 · Tsai · 2020 [cited by examiner]
US 20200296386A1 · Giladi · 2020 [cited by examiner]
US 20200304810A1 · Moon · 2020 [cited by examiner]
US 20200366923A1 · Zhang · 2020 [cited by examiner]
US 20200389671A1 · Zhao · 2020 [cited by examiner]
US 20210127131A1 · Lim et al. · 2021 [cited by applicant]
US 20220321875A1 · Jeong et al. · 2022 [cited by applicant]
CN 107925759A · 2018 [cited by applicant]
CN 108293131A · 2018 [cited by applicant]
CN 108476319A · 2018 [cited by applicant]
EP 3891975 · 2020 [cited by applicant]
KR 1020170059423A · 2017 [cited by applicant]
KR 1020170084055A · 2017 [cited by applicant]
KR 1020180061041A · 2018 [cited by applicant]
KR 1020180080166A · 2018 [cited by applicant]
KR 1020180082330A · 2018 [cited by applicant]
WO 2018026118A1 · 2018 [cited by applicant]
WO 2018074825A1 · 2018 [cited by applicant]
WO 2018084523A1 · 2018 [cited by applicant]
WO 2019039324A1 · 2019 [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 3),” Document: JVET-L1001-v7, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Oct. 2018, Total 223 pages, XP030215992. [cited by applicant]
Communication dated Jan. 4, 2023, issued by the India Intellectual Property Office in Indian Patent Application No. 202127025156. [cited by applicant]
Communication dated Jul. 20, 2022 issued by the Korean Intellectual Property Office in KR Application No. KR Patent Application No. 10-2021-7019226. [cited by applicant]
Communication dated Mar. 22, 2022 issued by the Korean Intellectual Property Office in KR Application No. 10-2021-7019226. [cited by applicant]
Communication dated Nov. 16, 2022, issued by the European Patent Office in counterpart European Application No. 19899211.7. [cited by applicant]
Communication dated Oct. 27, 2022, issued by the Korean Intellectual Property Office in Korean Patent Application No. 10-2021-7019226. [cited by applicant]
International Preliminary Report on Patentability with a Translation of Written Opinion in International Application No. PCT/KR2019/018217, issued on Apr. 26, 2021. [cited by applicant]
International Search Report (PCT/ISA/210) issued by the International Searching Authority in International Application No. PCT/KR2019/018217, issued on Apr. 8, 2020. [cited by applicant]
Liao et al., “CE10.3.1.b: Triangular prediction unit mode,” Document: JVET-L0124-v2, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG11, Oct. 2018, Total 13 pages, XP030194820. [cited by applicant]
Max Blaser, et al., CE10: Results on Geometric Partitioning (Experiments 3.2.a-3.2.c), Joint Video Experts Team, JVET-L0417, Oct. 2018, 5 pages. [cited by applicant]
Max Blaser, et al., “Description of SDR and 360 video coding technoogy proposal by RWTH Aachen University”, Joint Video Experts Team (JVET), JVET-J0023-v1, Apr. 2018, 102 pages. [cited by applicant]
Ru-Ling Liao et al., “CE10.3.1.b: Triangular prediction unit mode”, Joint Video Exploration Team (JVET), JVET-L0124-v2, Oct. 3-12, 2018, pp. 1-8 (8 pages total). [cited by applicant]
Tadamasa Toma, et al., “Description of SDR video coding technology proposal by Panasonic”, Joint Video Experts Team, JVET-J0020-v1, Apr. 2018, 75 pages. [cited by applicant]
Wang et al., “Non-CE10: Triangle prediction merge list construction,” Document: JVET-M0233-vl, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Jan. 2019, Total 3 pages, XP030213499. [cited by applicant]
Office Action issued on Nov. 14, 2023 by the Japanese Patent Office in corresponding JP Patent Application No. 2021-534365. [cited by applicant]
Office Action issued on Mar. 28, 2024 by the Chinese Patent Office in corresponding CN Patent Application No. 201980085114.1. [cited by applicant]
Communication dated Oct. 14, 2024 issued by the Chinese Patent Office in Chinese Patent Application No. 201980085114.1. [cited by applicant]
Communication dated May 24, 2024 issued by the Mexico Patent Office in MX Patent Application No. MX/a/2021/007166. [cited by applicant]
Office Action dated Nov. 5, 2024, issued by Indian Patent Office in Indian Patent Application No. 202328035783. [cited by applicant]
Office Action dated Nov. 7, 2024, issued by Indian Patent Office in Indian Patent Application No. 202328035840. [cited by applicant]
Office Action dated Nov. 7, 2024, issued by Indian Patent Office in Indian Patent Application No. 202328035859. [cited by applicant]
Benjamin Bross et al., “Versatile Video Coding (Draft 7)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-P2001-v9, 16th Meeting: Geneva, CH, Oct. 1-11, 2019, 496 pages. [cited by applicant]
Jianle Chen et al. “Algorithm description for Versatile Video Coding and Test Model 5 (VTM 5)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N1002-v1, 14th Meeting: Geneva, CH,… [cited by applicant]
Communication issued on Jan. 30, 2025 by the Indian Patent Office in corresponding IN Patent Application No. 202328035821. [cited by applicant]
Office Action issued on Mar. 11, 2025 by the Japanese Patent Office in corresponding JP Patent Application No. 2024-079961. [cited by applicant]
Communication dated Apr. 28, 2025, issued by the European Patent Office in European Application No. 19899211.7. [cited by applicant]