IP Library Granted Patent US 12,335,472
Granted Patent B2
US 12,335,472 · App. 18/620,351 · Granted Jun 17, 2025

Methods for palette prediction

Inventors: Ru-Ling Liao (Beijing, CN); Mohammed Golam Sarwer (Cupertino, CA); Yan Ye (San Diego, CA); Xuan Huang (Beijing, CN)
Assignee: Alibaba Group Holding Limited
H04N19/117H04N19/105H04N19/176H04N19/186H04N19/46H04N19/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,472
App. No.
18/620,351
Granted
Jun 17, 2025
Kind
B2
Abstract

The present disclosure provides a computer-implemented method for encoding video. The method includes: receiving a video frame for processing; generating one or more coding units of the video frame; and processing one or more coding units using one or more palette predictors having palette entries, wherein each palette entry of the one or more palette predictors has a corresponding reuse flag, and wherein a number of reuse flags for each palette predictor is set to a fixed number for a corresponding coding unit.

Claims (45)

1. A method for generating a bitstream, comprising:

receiving a video sequence;

encoding one or more frames of the video sequence; by:

generating two or more coding units for a frame, wherein each coding unit of the two or more coding units have one or more coding blocks;

determining whether at least one of a first coding block of two neighboring coding blocks and a second coding block of the two neighboring coding blocks is coded in an intra prediction mode; and

setting a boundary filter strength based on the first coding block or the second coding block, wherein:

the boundary filter strength is set to 2 in response to one of the first coding block and the second coding block being coded in the intra prediction mode;

the boundary filter strength is set to 2 in response to the first coding block and the second coding block being not coded in the intra prediction mode and one of the first coding block and the second coding block is coded in a CIIP (combined inter and intra prediction) mode; and

the boundary filter strength is set to 1 in response to the first coding block and the second coding block being not coded in the CIIP mode and the first coding block being coded in palette mode and the second coding block having a coding mode different from the palette mode; and

generating a bitstream that is based on the encoding.

2. The method according to claim 1 , wherein the boundary filter strength is set to 0 in response to both the first coding block and the second coding block of the two neighboring coding blocks are coded in a block based delta pulse code modulation (BDPCM) mode.

3. The method according to claim 1 , wherein the boundary filter strength is set to 1 in response to both the first coding block and the second coding block are coded in an intra block copy (IBC) mode and an absolute difference between a horizontal component or a vertical component of block vectors used for the first coding block and the second coding block is greater than or equal to 8 in unit of 1/16 luma samples.

4. The method according to claim 1 , wherein the boundary filter strength is set to 1 in response to a first reference picture used for the first coding block is different from a second reference picture used for the second coding block.

5. The method according to claim 1 , wherein the boundary filter strength is set to 1 in response to a first number of motion vector used for the first coding block is different from a second number of motion vector used for the second coding block.

6. The method according to claim 1 , wherein the boundary filter strength is set to 1 in response to an absolute difference between a horizontal component or a vertical component of a first motion vector used for the first coding block and a second motion vector used for the second coding block is greater than or equal to 8 in units of 1/16 luma samples.

7. A method for determining a boundary filter strength for an edge, comprising:

receiving a bitstream; and

decoding, using coded information of the bitstream, one or more frames, wherein the decoding comprises:

decoding two or more coding units for a frame, wherein each coding unit of the two or more coding units have one or more coding blocks;

determining whether at least one of a first coding block of two neighboring coding blocks and a second coding block of the two neighboring coding blocks is coded in an intra prediction mode; and

setting a boundary filter strength based on the first coding block or the second coding block, wherein:

the boundary filter strength is set to 2 in response to one of the first coding block and the second coding block being coded in the intra prediction mode;

the boundary filter strength is set to 2 in response to the first coding block and the second coding block being not coded in the intra prediction mode and one of the first coding block and the second coding block is coded in a CIIP (combined inter and intra prediction) mode; and

the boundary filter strength is set to 1 in response to the first coding block and the second coding block being not coded in the CIIP mode and the first coding block being coded in palette mode and the second coding block having a coding mode different from the palette mode.

8. The method according to claim 7 , wherein the boundary filter strength is set to 0 in response to both the first coding block and the second coding block of the two neighboring coding blocks are coded in a block based delta pulse code modulation (BDPCM) mode.

9. The method according to claim 7 , wherein the boundary filter strength is set to 1 in response to both the first coding block and the second coding block are coded in an intra block copy (IBC) mode and an absolute difference between a horizontal component or a vertical component of block vectors used for the first coding block and the second coding block is greater than or equal to 8 in unit of 1/16 luma samples.

10. The method according to claim 7 , wherein the boundary filter strength is set to 1 in response to a first reference picture used for the first coding block is different from a second reference picture used for the second coding block.

11. The method according to claim 7 , wherein the boundary filter strength is set to 1 in response to a first number of motion vector used for the first coding block is different from a second number of motion vector used for the second coding block.

12. The method according to claim 7 , wherein the boundary filter strength is set to 1 in response to an absolute difference between a horizontal component or a vertical component of a first motion vector used for the first coding block and a second motion vector used for the second coding block is greater than or equal to 8 in units of 1/16 luma samples.

13. An apparatus for determining a boundary filter strength for an edge, the apparatus comprising:

a memory figured to store instructions; and

one or more processors configured to execute the instructions to cause the apparatus to perform operations comprising:

receiving a video frame for processing;

encoding the frame by;

generating two or more coding units for the video frame, wherein each coding unit of the two or more coding units have one or more coding blocks;

determining whether at least one of a first coding block of two neighboring coding blocks and a second coding block of the two neighboring coding blocks is coded in an intra prediction mode; and

setting a boundary filter strength based on the first coding block or the second coding block, wherein:

the boundary filter strength is set to 2 in response to one of the first coding block and the second coding block being coded in the intra prediction mode;

the boundary filter strength is set to 2 in response to the first coding block and the second coding block being not coded in the intra prediction mode and one of the first coding block and the second coding block is coded in a CIIP (combined inter and intra prediction) mode; and

the boundary filter strength is set to 1 in response to the first coding block and the second coding block being not coded in the CIIP mode and the first coding block being coded in palette mode and the second coding block having a coding mode different from the palette mode.

14. The apparatus according to claim 13 , wherein the boundary filter strength is set to 0 in response to both the first coding block and the second coding block of the two neighboring coding blocks are coded in a block based delta pulse code modulation (BDPCM) mode.

15. The apparatus according to claim 13 , wherein the boundary filter strength is set to 1 in response to both the first coding block and the second coding block are coded in an intra block copy (IBC) mode and an absolute difference between a horizontal component or a vertical component of block vectors used for the first coding block and the second coding block is greater than or equal to 8 in unit of 1/16 luma samples.

16. The apparatus according to claim 13 , wherein the boundary filter strength is set to 1 in response to a first reference picture used for the first coding block is different from a second reference picture used for the second coding block.

17. The apparatus according to claim 13 , wherein the boundary filter strength is set to 1 in response to a first number of motion vector used for the first coding block is different from a second number of motion vector used for the second coding block.

18. The apparatus according to claim 13 , wherein the boundary filter strength is set to 1 in response to an absolute difference between a horizontal component or a vertical component of a first motion vector used for the first coding block and a second motion vector used for the second coding block is greater than or equal to 8 in units of 1/16 luma samples.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 4, 2026
From: ALIBABA INNOVATION PRIVATE LIMITED
To: HFI INNOVATION INC.
Reel/Frame 075499/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2026
From: ALIBABA GROUP HOLDING LIMITED
To: ALIBABA INNOVATION PRIVATE LIMITED
Reel/Frame 074832/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2024
From: LIAO, RU-LING; SARWER, MOHAMMED GOLAM; YE, YAN; HUANG, XUAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 066997/0486 →
Continuity (4)
Continuation 17218655 · Mar 31, 2021
Provisional Application 63005305 · Apr 4, 2020
Provisional Application 63002594 · Mar 31, 2020
Related Publication 20240275962A1 · Aug 15, 2024
References Cited (47)
US 20130003829A1 · Misra et al. · 2013 [cited by applicant]
US 20140072237A1 · Tanizawa et al. · 2014 [cited by applicant]
US 20140294078A1 · Seregin et al. · 2014 [cited by applicant]
US 20150365671A1 · Pu et al. · 2015 [cited by applicant]
US 20150365695A1 · Pu et al. · 2015 [cited by applicant]
US 20160309172A1 · Laroche et al. · 2016 [cited by applicant]
US 20170078683A1 · Seregin et al. · 2017 [cited by applicant]
US 20170195676A1 · Chuang et al. · 2017 [cited by applicant]
US 20170264909A1 · Koyama et al. · 2017 [cited by applicant]
US 20180014034A1 · Lai et al. · 2018 [cited by applicant]
US 20180109798A1 · Lee et al. · 2018 [cited by applicant]
US 20200092546A1 · Ye et al. · 2020 [cited by applicant]
US 20200314423A1 · Hu et al. · 2020 [cited by applicant]
US 20200404258A1 · Wang · 2020 [cited by examiner]
US 20210051336A1 · Chao et al. · 2021 [cited by applicant]
US 20210092393A1 · Chao et al. · 2021 [cited by applicant]
US 20210306627A1 · Liao · 2021 [cited by examiner]
US 20210321141A1 · Jang et al. · 2021 [cited by applicant]
US 20210337211A1 · Wang · 2021 [cited by examiner]
US 20220078410A1 · Zhu et al. · 2022 [cited by applicant]
US 20220159241A1 · Zhu et al. · 2022 [cited by applicant]
US 20220182636A1 · Zhu et al. · 2022 [cited by applicant]
US 20220224886A1 · Tsai · 2022 [cited by examiner]
CN 107211160A · 2017 [cited by applicant]
JP 2017519460A · 2017 [cited by applicant]
JP 2017522804A · 2017 [cited by applicant]
JP 2017168879A · 2017 [cited by applicant]
JP 2022538668A · 2022 [cited by applicant]
WO WO2015179898A1 · 2015 [cited by applicant]
WO WO2021202667A1 · 2021 [cited by applicant]
First Office Action issued in corresponding Chinese Application No. 202180026652.0 on Nov. 4, 2024, (13 pages). [cited by applicant]
High Efficiency Video Coding, Rec. ITU-T H.265 and ISO/IEC 23008-2, Jan. 2013, 692 pages. [cited by applicant]
G.J. Sullivan, J.R. Ohm, W.J. Han, T. Wiegand, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, No. 12, pp. 1649-1668, Dec. 2012. [cited by applicant]
JEM, https://jvet.hhi.fraunhofer.de/svn/svn_HMJEMSoftware. [cited by applicant]
J. Chen, E. Alshina, G. J. Sullivan, J.-R. Ohm, J. Boyce, “Algorithm description of Joint Exploration Test Model 7 (JEM7)”, JVET-G1001, Jul. 2017, 50 pages. [cited by applicant]
A. Segall, V. Baroncini, J. Boyce, J. Chen, and T. Suzuki, “Joint Call for Proposals on Video Compression with Capability beyond HEVC,” JVET-H1002 (v6), Oct. 2017, 27 pages. [cited by applicant]
J. Chen, Y. Ye, S. H. Kim, “Algorithm description for Versatile Video Coding and Test Model 8 (VTM 8)” JVET-Q2002, Jan. 2020, 91 pages. [cited by applicant]
B. Bross, J. Chen, S. Liu, Y.-K. Wang, “Versatile Video Coding (Draft 8)”, JVET-Q2001, Jan. 2020, 509 pages. [cited by applicant]
Y.-H. Chao, C.-H. Hung, W.-J. Chien, T. Hsieh, M. Karczewicz, “CE8-1.3: Line-based CG Palette Mode”, JVET-P0077, Geneva, Oct. 2019, 6 pages. [cited by applicant]
PCT International Search Report and Written Opinion mailed Aug. 10, 2021, issued in corresponding International Application No. PCT/US2021/025092 (10 pgs.). [cited by applicant]
European Patent Office Communication issued for Application No. 21780078.8 the Supplementary European Search Report (Art. 153(7) EPC) and the European search opinion dated Mar. 14, 2024, 11 pages. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 8),” JVET-Q2001-vE, 17 [cited by applicant]
Chao et al., “Non-CE8: Simplification of palette predictor update for small CUs,” JVET-P0475, 16 [cited by applicant]
Liao et al., “AHG11: Fixed No. of reuse flags for palette mode,” JVET-R0229, 18 [cited by applicant]
Liao et al., “AHG11: Bugfix to deblocking filter boundary strength setting for palette,” JVET-R0228, 18 [cited by applicant]
Japanese Office Action issued in corresponding Japanese Application No. 2022-554887 on Jan. 21, 2025 (6 pages). [cited by applicant]
Japanese Search Report issued in corresponding Japanese Application No. 2022-554887 on Jan. 15, 2025 (41 pages). [cited by applicant]