IP Library Granted Patent US 12,425,624
Granted Patent B2
US 12,425,624 · App. 18/438,398 · Granted Sep 23, 2025

Video coding using intra sub-partition coding mode

Inventors: Yi-Wen Chen (San Diego, CA); Xiaoyu Xiu (San Diego, CA); Xianglin Wang (San Diego, CA); Tsung-Chuan Ma (San Diego, CA)
Assignee: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
H04N19/44H04N19/105H04N19/119H04N19/132H04N19/159H04N19/176H04N19/186H04N19/46H04N19/593
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,425,624
App. No.
18/438,398
Granted
Sep 23, 2025
Kind
B2
Abstract

A method of video coding comprises independently generating a respective intra prediction for each of a plurality of corresponding sub-partitions. Each respective intra prediction is generated using a plurality of reference samples from a current coding block. Illustratively, no reconstructed sample from a first sub-partition of the plurality of corresponding sub-partitions is used to generate a respective intra prediction for any other sub-partition of the plurality of corresponding sub-partitions, and each of the plurality of corresponding sub-partitions has a width less than or equal to 2.

Claims (42)

1. A method of video encoding, comprising:

performing an intra prediction for a plurality of sub-partitions of a coding block in a Intra Sub-Partition (ISP) mode in response to determining that the plurality of sub-partitions meet first conditions for the intra prediction, wherein the coding block has a square shape or a rectangular shape,

wherein performing the intra prediction for the plurality of sub-partitions of the coding block comprises:

merging at least two sub-partitions of the plurality of sub-partitions into one prediction region for the intra prediction, and

generating predicted samples for the one prediction region in the intra prediction based on a plurality of reference samples of the coding block adjacent to the one prediction region,

wherein the first conditions comprise that the plurality of sub-partitions are a plurality of vertical sub-partitions and each of the sub-partitions has a width less than or equal to 2.

2. The method of claim 1 , wherein no reconstructed sample from one sub-partition of the at least two sub-partitions is used to perform the intra prediction for any other sub-partition of the at least two sub-partitions.

3. The method of claim 1 , further comprising:

generating a set of predicted samples for the plurality of vertical sub-partitions using a vertical prediction mode with a mode index larger than 50.

4. The method of claim 1 , further comprising performing the intra prediction for samples in the one prediction region independently and in parallel.

5. The method of claim 1 , wherein the plurality of sub-partitions includes a last sub-partition, and the method further comprises signaling a coefficients block flag (CBF) value for the last sub-partition.

6. The method of claim 5 , wherein the plurality of sub-partitions includes a last sub-partition, and the method further comprises inferring a coefficients block flag (CBF) value for the last sub-partition at an encoder.

7. The method of claim 6 , wherein the coefficients block flag (CBF) value is inferred as one or zero.

8. The method of claim 1 , wherein multiple prediction samples for the intra prediction are generated in parallel for the plurality of sub-partitions.

9. An apparatus of video encoding, comprising:

one or more processors;

a non-transitory computer-readable memory storing instructions executable by the one or more processors,

wherein the one or more processors are configured to:

perform an intra prediction for a plurality of sub-partitions of a coding block in a Intra Sub-Partition (ISP) mode in response to determining that the plurality of sub-partitions meet first conditions for the intra prediction, wherein the coding block has a square shape or a rectangular shape,

wherein performing the intra prediction for the plurality of sub-partitions of the coding block comprises:

merging at least two sub-partitions of the plurality of sub-partitions into one prediction region for the intra prediction, and

generating predicted samples for the one prediction region in the intra prediction based on a plurality of reference samples of the coding block adjacent to the one prediction region,

wherein the first conditions comprise that the plurality of sub-partitions are a plurality of vertical sub-partitions and each of the sub-partitions has a width less than or equal to 2.

10. The apparatus of claim 9 , wherein no reconstructed sample from one sub-partition of the at least two sub-partitions is used to perform the intra prediction for any other sub-partition of the at least two sub-partitions.

11. The apparatus of claim 9 , wherein, the one or more processors are further configured to:

generate a set of predicted samples for the plurality of vertical sub-partitions using a vertical prediction mode with a mode index larger than 50.

12. The apparatus of claim 9 , wherein, the one or more processors are further configured to: perform the intra prediction for the plurality of vertical sub-partitions independently and in parallel.

13. The apparatus of claim 9 , wherein the plurality of sub-partitions includes a last sub-partition, and the method further comprises signaling a coefficients block flag (CBF) value for the last sub-partition.

14. The apparatus of claim 13 , wherein the plurality of sub-partitions includes a last sub-partition, and the method further comprises inferring a coefficients block flag (CBF) value for the last sub-partition at an encoder.

15. The apparatus of claim 14 , wherein the coefficients block flag (CBF) value is inferred as one or zero.

16. A non-transitory computer readable storage medium storing a bitstream generated by the encoding method comprising:

performing an intra prediction for a plurality of sub-partitions of a coding block in a Intra Sub-Partition (ISP) mode in response to determining that the plurality of sub-partitions meet first conditions for the intra prediction, wherein the coding block has a square shape or a rectangular shape,

wherein performing the intra prediction for the plurality of sub-partitions of the coding block comprises:

merging at least two sub-partitions of the plurality of sub-partitions into one prediction region for the intra prediction, and

generating predicted samples for the one prediction region in the intra prediction based on a plurality of reference samples of the coding block adjacent to the one prediction region,

wherein the first conditions comprise that the plurality of sub-partitions are a plurality of vertical sub-partitions and each of the sub-partitions has a width less than or equal to 2.

17. The non-transitory computer readable storage medium of claim 16 , wherein no reconstructed sample from one sub-partition of the at least two sub-partitions is used to perform the intra prediction for any other sub-partition of the at least two sub-partitions.

18. The non-transitory computer readable storage medium of claim 16 , wherein the encoding operations further comprises:

generating a set of predicted samples for the plurality of vertical sub-partitions using a vertical prediction mode with a mode index larger than 50.

19. The non-transitory computer readable storage medium of claim 16 , wherein the encoding operations further comprises:

performing the intra prediction for the plurality of vertical sub-partitions independently and in parallel.

20. The non-transitory computer readable storage medium of claim 16 , wherein the encoding operations further comprises: signaling a coefficients block flag (CBF) value for a last sub-partition in the plurality of sub-partitions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2024
From: CHEN, YI-WEN; XIU, XIAOYU; WANG, XIANGLIN; MA, TSUNG-CHUAN
To: BEIJING DAJIA INTERNET INFORMATION TECHNOLOGY CO., LTD.
Reel/Frame 066439/0103 →
Continuity (4)
Continuation 17393364 · Aug 3, 2021
Continuation PCTUS2020016888 · Feb 5, 2020
Provisional Application 62801214 · Feb 5, 2019
Related Publication 20240195998A1 · Jun 13, 2024
References Cited (69)
US 8976870B1 · Cismas · 2015 [cited by applicant]
US 9749622B2 · Merkle et al. · 2017 [cited by applicant]
US 11683486B2 · Kang et al. · 2023 [cited by applicant]
US 11758143B2 · Deng · 2023 [cited by examiner]
US 20130136175A1 · Wang et al. · 2013 [cited by applicant]
US 20140092963A1 · Wang · 2014 [cited by applicant]
US 20160014416A1 · Hinz et al. · 2016 [cited by applicant]
US 20170230671A1 · Kim et al. · 2017 [cited by applicant]
US 20170339403A1 · Min et al. · 2017 [cited by applicant]
US 20170347103A1 · Yu et al. · 2017 [cited by applicant]
US 20180302620A1 · Koo et al. · 2018 [cited by applicant]
US 20190149828A1 · Jeong et al. · 2019 [cited by applicant]
US 20190387226A1 · Lee · 2019 [cited by applicant]
US 20200077089A1 · Lee · 2020 [cited by applicant]
US 20200244980A1 · Zhao et al. · 2020 [cited by applicant]
US 20200252608A1 · Ramasubramonian et al. · 2020 [cited by applicant]
US 20200280742A1 · Ramasubramonian et al. · 2020 [cited by applicant]
US 20200366895A1 · De Luxán Hernández et al. · 2020 [cited by applicant]
US 20210136373A1 · De Luxán Hernández et al. · 2021 [cited by applicant]
US 20210195199A1 · Choi et al. · 2021 [cited by applicant]
US 20210227208A1 · Lee · 2021 [cited by applicant]
US 20210306666A1 · Lee · 2021 [cited by applicant]
US 20210360240A1 · Lee · 2021 [cited by applicant]
US 20210368205A1 · Chen · 2021 [cited by examiner]
CN 107113444A · 2017 [cited by applicant]
JP 2022518612A · 2022 [cited by applicant]
KR 20140049098A · 2014 [cited by applicant]
KR 1020150064163A · 2015 [cited by applicant]
KR 1020180059367A · 2018 [cited by applicant]
KR 1020180065953A · 2018 [cited by applicant]
WO 2017142327A1 · 2017 [cited by applicant]
Japanese Intellectual Property Office, “Notice of Reasons for Refusal”, issued in Application No. 2023-077868 dated on Jul. 16, 2024, with English Translation, (4p). [cited by applicant]
Japanese Intellectual Property Office, “Notice of Reasons for Refusal”, issued in Application No. 2021-545471 dated on Mar. 26, 2024, with English Translation, (2p). [cited by applicant]
Korean Intellectual Property Office, “Notice of Office Action”, issued in Application No. 10-2022-7003953 dated on Sep. 19, 2024, with English Translation, (9p). [cited by applicant]
Santiago De Luxán Hernández et al., “CE3: Line-based intra coding mode (Tests 2.1.1 and 2.1.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-L0076-v2, 12th Meeting: Macao, CN,… [cited by applicant]
Santiago De-Luxán Hernández et al., “CE3: Intra Sub-Partitions Coding Mode (Tests 1.1.1 and 1.1.2),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-M0102-v5, 13th Meeting: Marrak… [cited by applicant]
Office Action Issued in Application No. U.S. Appl. No. 17/393,367 dated Apr. 1, 2024, (21p). [cited by applicant]
Andrew Segall et al, “Parallel intra prediction for video coding”,28th Picture Coding Symposium, PCS2010, Dec. 10, 2010, (4p). [cited by applicant]
First Offce Action issued in Korean Patent Application No. 10-2021-7024197 dated Dec. 6, 2021 with the English ranslation, (17p). [cited by applicant]
Santiago De-Luxan-Hernandez et al., “CE3: Intra Sub-Partitions Coding Mode(Tests 1.1.1 and 1.1.2)”,Joint Video Experts Team(JVET), Document: JVET-M0102-v5, Jan. 17, 2019, (12p). [cited by applicant]
First Office Action issued for corresponding Japanese Patent Application 2021-545471 mailed on Feb. 8, 2022, with English Translation, (6P). [cited by applicant]
Zhi-Yi Lin et al., “CE3-related:Shared reference samples for multiple chroma intra CBs”, Joint Video Experts Team JVET), Jan. 16, 2019, (5p). [cited by applicant]
Third Office Action and search report issued on Feb. 25, 2023 for counterpart Chinese patent application No. 202111101969.4, along with machine English translation, (7p). [cited by applicant]
Decision of Refusal by the Japan Patent Office issued for corresponding Japanese Patent Application No. 2021-545471 mailed on Jan. 10, 2023 along with machine English translation, (2p). [cited by applicant]
Second Office Action and search report issued on Nov. 3, 2022 for counterpart Chinese patent application No. 202111101969.4, along with machine English translation, (12p). [cited by applicant]
Examination Report issued to Indian Application No. 202147033756 dated May 25, 2022 with partial English ranslation, (7p). [cited by applicant]
Second Office Action of Korean Patent Application No. 10-2021-7024197 dated Apr. 22, 2022 with English translation (9p). [cited by applicant]
Jeeyoon Park et al., CE3-related: Modified Chroma Intra Mode Coding,Joint Video Experts Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,JVET-M0324, 13th Meeting:Marrakech, MA, pp. 1-6, Jan. 18, 2019, (6p). [cited by applicant]
Yu-Chen Sun et al., CE8-related:Context modeling on palette mode fag,Joint Video Experts Team(JVET)of ITU-T SG 16WP 3 and ISO/EC JTC 1/SC 29WG 11,JVET-M0419, 13th Meeting:Marrakech, MA, pp. 1-3, Jan. 18, 2019 (3p). [cited by applicant]
Po-Han Lin et al, CEIO-related:Simplifcation of intra prediction n CI IP, Joint Video Experts Team(JVET)of ITU-T $G 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11,JVET-M0525-v2,13th Meeting:Marrakech, MA pp. 1-3, Jan. 18, 2019, … [cited by applicant]
Santiago De-Luxán-Hernández, et al., “CE3: Intra Sub-Partitions Coding Mode(Tests 1.1.1 and 1.1.2)”, Joint Video Experts Team(JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29WG 1113th Meeting: Marrakech, MA, Jan. 9-18, … [cited by applicant]
MediaTek Inc., Zhi-Yi Lin,et al, “CE3 related: Shared reference samples for multiple chroma intra CBs”, Joint Video Experts Team(JVET)of ITU-TSG 16WP 3and ISO/IEC JTC1/SC29WG 1113th Meeting: Marrakech, MA, Jan. 9-18, 20… [cited by applicant]
Decision of Rejection issued on Jun. 16, 2023 for counterpart Chinese Patent Application No. 202111101969.4.along with English translation, (14p). [cited by applicant]
First Office Action issued of Chinese Patent Application No. 202111101969.4 dated Jul. 18, 2022 with English ranslation, (10p). [cited by applicant]
Search Report issued in Chinese Patent Application No. 202111101969.4 dated Jul. 18, 2022 with English translation (5p). [cited by applicant]
Extended European Search Report issued in Application No. 20753053.6 dated on Jul. 22, 2022, (6p). [cited by applicant]
First Office Action issued of European Patent Application No. 20753053.6 dated Aug. 3, 2022,(7p). [cited by applicant]
Decision of Rejection issued of Korean patent application No. 10-2021-7024197 dated Aug. 16, 2022, with the English translation, (5p). [cited by applicant]
Decision on Dismissal of Amendent issued of Korean patent application No. 10-2021-7024197 dated Aug. 16, 2022 with the English translation, (4p). [cited by applicant]
Santiago De Luxan Henandez(Fraunhofer HHI) et al. “CE3:Line-based intra coding mode(Tests 2.1.1 and 2.1.2)”, Joint Video Experts Team(JVET)of ITU-T SG 16 WP 3and SO/IEC JTC 1/SC 29WG11, JVET-L0076-v2,12th Meetng, Macao,… [cited by applicant]
Jianle Chen et al. “Algorithm description for Versatile Video Coding and Test Model 4(VTM 4)”, Joint Video Experts Team(JVET)of ITU-TSG 16WP 3and ISO/IEC JTC 1/SC29WG11,JVET-M1002-v2, 13th Meeting, Marrakech, MA, Jan. 9… [cited by applicant]
Adarsh K.Ramasubramonian(Qualcomm Inc.) et al. “AHG16/Non-CE3:On 1xN and 2xN subpartitions in intra subpartition coding”, Jont Video Experts Team(JVET)of ITU-T SG 16 WP 3and ISO/IEC JTC1/SC 29/WG11,JVET-N0432,14th Meeti… [cited by applicant]
Santiago De Luxan Hemandez(Fraunhofer HHI) et al. “Non-CE3: ISP with independent sub-parttions for certain block| sizes”, Joint Video Experts Team(JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29WG11, JVET-N0372-v1, 14t… [cited by applicant]
Second Offce Action issued of Japanese Patent Application No. 2021-545471 dated Jul. 12, 2022 with English ranslation, (7p). [cited by applicant]
Intemational Search Report and Written Opinion of PCT Application No. PCT/CN2020/016888 dated May 28, 2020, (11p). [cited by applicant]
Second Office Action of EP Application No. 20753053.6 issued on Apr. 28, 2025, (6p). [cited by applicant]
First Office Action of Korean Application No. 10-2022-7003953 dated Jun. 20, 2025, (15p). [cited by applicant]
Santiago De-Luxan-Hernandez, et al., “Non-CE3: ISP with independent sub-partitions for certain block sizes”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-N0371-v1, 14th Meeting… [cited by applicant]
Geert V.A. et al., “CE3-1.7: on 1xN and 2xN subblocks of ISP with vertical intramode restriction”, JVETO0107 v2 Jun. 25, 2019, (4p). [cited by applicant]