IP Library › Granted Patent US 12,739,362
Granted Patent B2
US 12,739,362 · App. 18/942,242 · Granted Sep 15, 2026

Method and device for video signal processing

Inventor: Ki Baek Kim (Seo-gu, KR)
Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
H04N19/105H04N19/119H04N19/132H04N19/159H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,739,362
App. No.
18/942,242
Granted
Sep 15, 2026
Kind
B2
Abstract

A method and device for video signal processing are provided. The method includes: an intra prediction mode of a current block is determined, a reference sample for intra prediction of the current block is determined, a predetermined matrix is determined based on the intra prediction mode, and the current block is predicted based on the reference sample and the matrix. The operation of predicting the current block based on the reference sample and the matrix includes a prediction block is generated by applying the matrix to the reference sample.

Claims (69)

1 . A method for video signal processing, performed by a decoder, comprising:

determining an intra prediction mode of a current block;

determining a reference sample used for an intra prediction of the current block;

determining a predetermined matrix based on the intra prediction mode; and

predicting the current block based on the reference sample and the matrix, comprising:

generating a prediction block by applying the matrix to the reference sample, wherein the prediction block is generated at predetermined positions in the current block;

performing interpolation on the current block based on at least one of the following: the prediction block or reconstructed samples adjacent to the current block; and

performing re-arrangement on all or part of prediction samples of the generated prediction block.

2 . The method according to claim 1 , wherein determining the reference sample comprises:

determining a neighboring region of the current block; and

performing down-sampling on the determined neighboring region, wherein the neighboring region is divided into a plurality of sample groups, the sample group comprises one or more samples, a representative value of the sample group is determined as the reference sample, and the representative value is one of the following: an average, a minimum, a maximum, a mode value and an intermediate value.

3 . The method according to claim 1 , wherein the predetermined positions in the current block are determined based on a ratio of the size of the current block to a size of a sampling block.

4 . The method according to claim 1 , wherein the matrix is determined from a plurality of matrix groups by further consideration of a size and shape of the current block.

5 . A method for video signal processing, performed by an encoder, comprising:

determining an intra prediction mode of a current block;

determining a reference sample used for an intra prediction of the current block;

determining a predetermined matrix based on the intra prediction mode; and

predicting the current block based on the reference sample and the matrix, comprising:

generating a prediction block by applying the matrix to the reference sample, wherein the prediction block is generated at predetermined positions in the current block;

performing interpolation on the current block based on at least one of the following: the prediction block or reconstructed samples adjacent to the current block; and

performing re-arrangement on all or part of prediction samples of the generated prediction block.

6 . The method according to claim 5 , wherein determining the reference sample comprises:

determining a neighboring region of the current block; and

performing down-sampling on the determined neighboring region, wherein the neighboring region is divided into a plurality of sample groups, the sample group comprises one or more samples, a representative value of the sample group is determined as the reference sample, and the representative value is one of the following: an average, a minimum, a maximum, a mode value and an intermediate value.

7 . The method according to claim 5 , wherein the predetermined positions in the current block are determined based on a ratio of the size of the current block to a size of a sampling block.

8 . The method according to claim 5 , wherein the matrix is determined from a plurality of matrix groups by further consideration of a size and shape of the current block.

9 . A decoder, comprising:

a processor; and

a memory, wherein the memory is configured to store computer programs capable of running in the processor, and when the computer programs are run by the processor, the processor is configured to:

determine an intra prediction mode of a current block;

determine a reference sample used for an intra prediction of the current block;

determine a predetermined matrix based on the intra prediction mode; and

generate a prediction block by applying the matrix to the reference sample, wherein the prediction block is generated at predetermined positions in the current block;

wherein the processor is further configured to:

perform interpolation on the current block based on at least one of the following: the prediction block or reconstructed samples adjacent to the current block; and

perform re-arrangement on all or part of prediction samples of the generated prediction block.

10 . The decoder according to claim 9 , wherein the processor is further configured to:

determine a neighboring region of the current block; and

perform down-sampling on the determined neighboring region, wherein the neighboring region is divided into a plurality of sample groups, the sample group comprises one or more samples, a representative value of the sample group is determined as the reference sample, and the representative value is one of the following: an average, a minimum, a maximum, a mode value and an intermediate value.

11 . The decoder according to claim 9 , wherein the predetermined positions in the current block are determined based on a ratio of the size of the current block to a size of a sampling block.

12 . The decoder according to claim 9 , wherein the matrix is determined from a plurality of matrix groups by further consideration of a size and shape of the current block.

13 . An encoder, comprising:

a processor; and

a memory, wherein the memory is configured to store computer programs capable of running in the processor, and when the computer programs are run by the processor, the processor is configured to:

determine an intra prediction mode of a current block;

determine a reference sample used for an intra prediction of the current block;

determine a predetermined matrix based on the intra prediction mode; and

generate a prediction block by applying the matrix to the reference sample, wherein the prediction block is generated at predetermined positions in the current block;

wherein the processor is further configured to:

perform interpolation on the current block based on at least one of the following: the prediction block or reconstructed samples adjacent to the current block; and

perform re-arrangement on all or part of prediction samples of the generated prediction block.

14 . The encoder according to claim 13 , wherein the processor is configured to:

determine a neighboring region of the current block; and

perform down-sampling on the determined neighboring region, wherein the neighboring region is divided into a plurality of sample groups, the sample group comprises one or more samples, a representative value of the sample group is determined as the reference sample, and the representative value is one of the following: an average, a minimum, a maximum, a mode value and an intermediate value.

15 . The encoder according to claim 13 , wherein the predetermined positions in the current block are determined based on a ratio of the size of the current block to a size of a sampling block.

16 . The encoder according to claim 13 , wherein the matrix is determined from a plurality of matrix groups by further consideration of a size and shape of the current block.

17 . A non-transitory computer-readable storage medium, having a computer program and a bitstream stored thereon, wherein the computer program, when executed by a processor, enables the processor to perform steps of a method for video signal processing to generate the bitstream, wherein the method for video signal processing comprises:

determining an intra prediction mode of a current block;

determining a reference sample used for an intra prediction of the current block;

determining a predetermined matrix based on the intra prediction mode; and

predicting the current block based on the reference sample and the matrix, comprising:

generating a prediction block by applying the matrix to the reference sample, wherein the prediction block is generated at predetermined positions in the current block;

performing interpolation on the current block based on at least one of the following: the prediction block or reconstructed samples adjacent to the current block; and

performing re-arrangement on all or part of prediction samples of the generated prediction block.

18 . The non-transitory computer-readable storage medium according to claim 17 , wherein determining the reference sample comprises:

determining a neighboring region of the current block; and

performing down-sampling on the determined neighboring region, wherein the neighboring region is divided into a plurality of sample groups, the sample group comprises one or more samples, a representative value of the sample group is determined as the reference sample, and the representative value is one of the following: an average, a minimum, a maximum, a mode value and an intermediate value.

19 . The non-transitory computer-readable storage medium according to claim 17 , wherein the predetermined positions in the current block are determined based on a ratio of the size of the current block to a size of a sampling block.

20 . The non-transitory computer-readable storage medium according to claim 17 , wherein the matrix is determined from a plurality of matrix groups by further consideration of a size and shape of the current block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2024
From: KIM, KI BAEK
To: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Reel/Frame 069222/0309 →
Priority Claims (1)
KR 10-2018-0107255 · Sep 7, 2018 · national
Continuity (4)
Continuation 17932627 · Sep 15, 2022
Continuation 17192733 · Mar 4, 2021
Continuation PCTKR2019011554 · Sep 6, 2019
Related Publication 20250071261A1 · Feb 27, 2025
References Cited (151)
US 8705619B2 · Nguyen · 2014 [cited by applicant]
US 9036704B2 · Park · 2015 [cited by applicant]
US 9392284B2 · Park · 2016 [cited by applicant]
US 9426470B2 · Park · 2016 [cited by applicant]
US 9426471B2 · Park · 2016 [cited by applicant]
US 9445097B2 · Park · 2016 [cited by applicant]
US 9769479B2 · Park · 2017 [cited by applicant]
US 9788006B2 · Lee · 2017 [cited by applicant]
US 9912946B2 · Park · 2018 [cited by applicant]
US 10171823B2 · Yamamoto · 2019 [cited by applicant]
US 10341656B2 · Park · 2019 [cited by applicant]
US 10404980B1 · Zhao · 2019 [cited by applicant]
US 10666937B2 · Zhao · 2020 [cited by applicant]
US 10798414B2 · Lee · 2020 [cited by applicant]
US 10819987B2 · Jang · 2020 [cited by applicant]
US 10979727B2 · Hannuksela · 2021 [cited by applicant]
US 11218716B2 · Yu · 2022 [cited by applicant]
US 11272175B2 · Wang · 2022 [cited by applicant]
US 11336907B2 · Ma · 2022 [cited by applicant]
US 11425389B2 · Deng · 2022 [cited by examiner]
US 11425390B2 · Lim · 2022 [cited by examiner]
US 11477439B2 · Kim · 2022 [cited by examiner]
US 11528506B2 · Ma · 2022 [cited by applicant]
US 11627329B2 · Yu · 2023 [cited by applicant]
US 11831918B2 · Nam · 2023 [cited by applicant]
US 11943447B2 · Lim · 2024 [cited by examiner]
US 12137206B2 · Kim · 2024 [cited by examiner]
US 12143570B2 · Kim · 2024 [cited by examiner]
US 20080219576A1 · Jung et al. · 2008 [cited by applicant]
US 20110280304A1 · Jeon · 2011 [cited by applicant]
US 20120140821A1 · Drugeon · 2012 [cited by applicant]
US 20120170649A1 · Chen · 2012 [cited by applicant]
US 20120218432A1 · Liu · 2012 [cited by applicant]
US 20120236929A1 · Liu · 2012 [cited by applicant]
US 20130251036A1 · Lee · 2013 [cited by applicant]
US 20140219334A1 · Park · 2014 [cited by applicant]
US 20140226720A1 · Park · 2014 [cited by applicant]
US 20140247883A1 · Lee et al. · 2014 [cited by applicant]
US 20150222891A1 · Park · 2015 [cited by applicant]
US 20150222892A1 · Park · 2015 [cited by applicant]
US 20150222897A1 · Park · 2015 [cited by applicant]
US 20150222929A1 · Park · 2015 [cited by applicant]
US 20160198189A1 · Lee et al. · 2016 [cited by applicant]
US 20160353103A1 · Park · 2016 [cited by applicant]
US 20170359595A1 · Zhang et al. · 2017 [cited by applicant]
US 20180152701A1 · Park · 2018 [cited by applicant]
US 20180176594A1 · Zhang et al. · 2018 [cited by applicant]
US 20180288408A1 · Ikai et al. · 2018 [cited by applicant]
US 20180343455A1 · Jang et al. · 2018 [cited by applicant]
US 20190191155A1 · Ko et al. · 2019 [cited by applicant]
US 20190238835A1 · Lee · 2019 [cited by applicant]
US 20190289287A1 · Park · 2019 [cited by applicant]
US 20190306511A1 · Jang · 2019 [cited by examiner]
US 20190313116A1 · Lee · 2019 [cited by applicant]
US 20200099925A1 · Lee · 2020 [cited by applicant]
US 20200322611A1 · Salehifar et al. · 2020 [cited by applicant]
US 20200329234A1 · Lee · 2020 [cited by applicant]
US 20200366900A1 · Jun et al. · 2020 [cited by applicant]
US 20200366935A1 · Salehifar et al. · 2020 [cited by applicant]
US 20210105459A1 · Lee · 2021 [cited by applicant]
US 20210105460A1 · Lee · 2021 [cited by applicant]
US 20210105461A1 · Lee · 2021 [cited by applicant]
US 20210227260A1 · Lee · 2021 [cited by applicant]
US 20210344929A1 · Choi · 2021 [cited by examiner]
US 20220279161A1 · Lim et al. · 2022 [cited by applicant]
CL 202003275 · 2020 [cited by applicant]
CN 104838650A · 2015 [cited by applicant]
CN 105208385A · 2015 [cited by applicant]
CN 108134940A · 2018 [cited by applicant]
CN 108353185A · 2018 [cited by applicant]
CN 108370441A · 2018 [cited by applicant]
EP 2388999A2 · 2011 [cited by applicant]
EP 2388999A3 · 2013 [cited by applicant]
JP 2014531154A · 2014 [cited by applicant]
JP 2017017742A · 2017 [cited by applicant]
JP 2017216601A · 2017 [cited by applicant]
KR 20080082143A · 2008 [cited by applicant]
KR 20180000303A · 2018 [cited by applicant]
KR 20180001479A · 2018 [cited by applicant]
RU 2586017C2 · 2016 [cited by applicant]
WO 2017068856A1 · 2017 [cited by applicant]
WO 2017209328A1 · 2017 [cited by applicant]
WO 2019072921A1 · 2019 [cited by applicant]
WO 2019185808A1 · 2019 [cited by applicant]
Intra Prediction via Edge-Based Inpainting; Liu—2008; (Year: 2008). [cited by examiner]
Efficient multiple line-based intra prediction; Li—2016; (Year: 2016). [cited by examiner]
(Matrix based Intra prediction) filetype_ pdf—Google Search—2026. (Year: 2026). [cited by examiner]
Data driven Intra prediction modes in the development of VVC; Pfaff—2020. (Year: 2020). [cited by examiner]
Extension of Matrix-Based Intra Prediction to 4_4_4 Chroma Formats; 2021. (Year: 2021). [cited by examiner]
Intra Prediction Using Multiple Reference Lines for Video Coding; Li—2017. (Year: 2017). [cited by examiner]
First Office Action of the Canadian application No. 3111982, issued on Apr. 11, 2022. 5 pages. [cited by applicant]
First Office Action of the Japanese application No. 2021-512701, issued on Sep. 26, 2023. 12 pages with English translation. [cited by applicant]
Pfaff (Fraunhofer) J et al: “CE3: Affine linear weighted intra prediction (CE3-4.1, CE3-4.2)”, 14. JVET Meeting; Mar. 19, 2019-Mar. 27, 2019; Geneva; (The Joint Video Exploration Team of ISO/IEC JTC1/SC29/WG11 and ITU-T… [cited by applicant]
Oral Examination of the European application No. 19858139.9, issued on Jul. 20, 2023. 10 pages. [cited by applicant]
First Office Action of the Israeli application No. 281221, issued on Jun. 21, 2023. 3 pages. [cited by applicant]
Supplementary European Search Report in the European application No. 19858139.9, mailed on Sep. 2, 2021. 8 pages. [cited by applicant]
Written Opinion of the International Search Authority in the international application No. PCT/KR2019/011554, mailed on Dec. 17, 2019. 8 pages with English translation. [cited by applicant]
First Office Action of the Vietnamese application No. 1-2021-01662, issued on Mar. 27, 2024. 3 pages with English translation. [cited by applicant]
First Office Action of the Australian application No. 2019336038, issued on May 7, 2024. 3 pages. [cited by applicant]
Pfaff, J. et al., “Intra prediction modes based on neural networks”, Document: JVET-J0037, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 10th Meeting, San Diego, Apr. 10, 2018. pp. 1-… [cited by applicant]
Final Office Action of the U.S. Appl. No. 17/932,585, issued on May 29, 2024. 13 pages. [cited by applicant]
Final Office Action of the U.S. Appl. No. 17/932,632, issued on Jun. 3, 2024. 10 pages. [cited by applicant]
Final Office Action of the U.S. Appl. No. 17/932,636, issued on Jun. 3, 2024. 10 pages. [cited by applicant]
First Office Action of the Malaysian application No. PI2021001129, issued on Aug. 22, 2024. 3 pages. [cited by applicant]
Second Office Action of the Mexican application No. MX/a/2021/002608, issued on Jun. 21, 2024. 14 pages with English translation. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/932,585, issued on Aug. 7, 2024. 9 pages. [cited by applicant]
Notice of Advisory Action of the U.S. Appl. No. 17/932,585, issued on Aug. 7, 2024. 17 pages. [cited by applicant]
Notice of Advisory Action of the U.S. Appl. No. 17/932,632, issued on Aug. 14, 2024. 16 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/932,632, issued on Aug. 14, 2024. 13 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/932,636, issued on Aug. 15, 2024. 13 pages. [cited by applicant]
Decision to Refuse of the European application No. 19858139.9, issued on Feb. 8, 2024. 11 pages. [cited by applicant]
First Office Action of the Mexican application No. MX/a/2021/002608, issued on Jan. 26, 2024. 11 pages with English translation. [cited by applicant]
Hearing Notice of the Indian application No. 202117007628, issued on Jan. 18, 2024. 3 pages with English translation. [cited by applicant]
First Office Action of the U.S. Appl. No. 17/932,585, issued on Dec. 20, 2023. 34 pages. [cited by applicant]
First Office Action of the U.S. Appl. No. 17/932,632, issued on Jan. 2, 2024. 50 pages. [cited by applicant]
First Office Action of the U.S. Appl. No. 17/932,636, issued on Jan. 3, 2024. 50 pages. [cited by applicant]
International Search Report in the international application No. PCT/KR2019/011554, mailed on Dec. 17, 2019. 5 pages with English translation. [cited by applicant]
Dong Liu, AL. “Intra Prediction via Edge-Based Inpainting”, Year: 2008. pp. 1-10. [cited by applicant]
Jiahao Li, AL. “Efficient multiple line-based intra prediction for HEVC”, Year: 2016. pp. 1-11. [cited by applicant]
Jiahao Li, AL. “Intra Prediction Using Multiple Reference Lines for Video Coding”, Year: 2017. pp. 1-10. [cited by applicant]
Yuebing Jiang, AL. “A Unified and Pipelined Hardware Architecture for Implementing Intra Prediction in HEVC”; Year: 2014. pp. 1-4. [cited by applicant]
Helle, AL. “CE3-related: Non-linear weighted intra prediction (cross-check report in JVETK0262)”,Joint Video Experts Team (JVET)of ITU-T SG 16 WP 3 and ISO/IEC JTC I/SC 29/WG11 11th Meeting: Ljubljana, SI, Jul. 10-18, 2… [cited by applicant]
Non-Final Office Action of the U.S. Appl. No. 17/192,733, issued on Apr. 27, 2021. 16 pages. [cited by applicant]
Final Office Action of the U.S. Appl. No. 17/192,733, issued on Aug. 23, 2021. 10 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/192,733, issued on Jun. 8, 2022. 16 pages. [cited by applicant]
Advisory Action of the U.S. Appl. No. 17/192,733, issued on Nov. 16, 2021. 3 pages. [cited by applicant]
Notice of Final Rejection of the Korean application No. 10-2019-0110217, issued on Sep. 22, 2025. [cited by applicant]
First Office Action of the U.S. Appl. No. 17/932,627, issued on Dec. 26, 2023. 45 pages. [cited by applicant]
Final Office Action of the U.S. Appl. No. 17/932,627, issued on May 30, 2024. 14 pages. [cited by applicant]
Notice of Allowance of the U.S. Appl. No. 17/932,627, issued on Aug. 21, 2024. 13 pages. [cited by applicant]
First Office Action of the Chilean application No. 202100527, issued on Jan. 20, 2022. 19 pages with English translation. [cited by applicant]
Office Action of the Indian application No. 202117007628, issued on Jan. 27, 2022. 5 pages with English translation. [cited by applicant]
Albrecht M et al:“Description of SDR, HDR, and 360° video coding technology proposal by Fraunhofer HHI”, 10. JVET Meeting; Apr. 10, 2018-Apr. 20, 2018;San Oiego;(The Joint VIOEO Exploration Team of ISO/IEC JTC1/SC29/WG1… [cited by applicant]
Helle (Fraunhofer) P et al:“CE3-related: Non-linear weighted intra prediction (cross-check report in JVET-K0262)”,11. JVET Meeting; Jul. 11, 2018-Jul. 18, 2018; Ljubljana; (The Joint Video Exploration Team of ISO/ IEC J… [cited by applicant]
First Office Action of the European application No. 19858139.9, issued on Mar. 9, 2022. 7 pages. [cited by applicant]
First Office Action of the Korean application No. 10-2019-0110217, issued on Jan. 24, 2025. 11 pages with English translation. [cited by applicant]
First Office Action of the Chinese application No. 202310426208.9, issued on Mar. 28, 2025. 23 pages with English translation. [cited by applicant]
First Office Action of the Chinese application No. 202310429492.5, issued on Mar. 28, 2025. 23 pages with English translation. [cited by applicant]
First Office Action of the Russian application No. 2021109293, issued on Feb. 13, 2023. 12 pages with English translation. [cited by applicant]
First Office Action of the Chinese application No. 202110462138.3, issued on Oct. 31, 2022. 23 pages with English translation. [cited by applicant]
Second Office Action of the European application No. 19858139.9, issued on Jan. 11, 2023. 5 pages. [cited by applicant]
Second Office Action of the Canadian application No. 3111982, issued on Jan. 11, 2023. 5 pages. [cited by applicant]
Benjamin Bross, Jianle Chen, and Shan Liu, Versatile Video Coding (Draft 6), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-O2001 (version 14), 15th Meeting: Gothenburg, SE, Jul.… [cited by applicant]
First Office Action of the Japanese application No. 2025-049777, issued on Jan. 9, 2026. [cited by applicant]
First Office Action of the Japanese application No. 2025-049811, issued on Jan. 9, 2026. [cited by applicant]
Notice of Allowance of the Japanese application No. 2024-029883, issued on Feb. 28, 2025. [cited by applicant]
Notice of Allowance of the Japanese application No. 2024-029923, issued on Feb. 28, 2025. [cited by applicant]
First Office Action of the Israeli application No. 318997, issued on Jun. 25, 2026. [cited by applicant]
First Office Action of the Israeli application No. 318995, issued on Jun. 23, 2026. [cited by applicant]
First Office Action of the Chinese application No. 202511969121.1, issued on May 26, 2026. [cited by applicant]
First Office Action of the Israeli application No. 318996, issued on Jun. 21, 2026. [cited by applicant]