IP Library Granted Patent US 12,348,708
Granted Patent B2
US 12,348,708 · App. 18/334,120 · Granted Jul 1, 2025

Mode determination for palette mode coding

Inventors: Weijia Zhu (San Diego, CA); Li Zhang (San Diego, CA); Jizheng Xu (San Diego, CA); Kai Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/132H04N19/139H04N19/159H04N19/176H04N19/186
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,348,708
App. No.
18/334,120
Granted
Jul 1, 2025
Kind
B2
Abstract

Devices, systems and methods for video processing are described. An exemplary method for video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, that a neighboring block of the current block that is coded in a palette mode is processed as an intra-coded block having a default mode during a construction of a list of most probable modes (MPM) candidates of the current block in case the neighboring block is located above or left of the current block. The method also includes performing the conversion based on the determining.

Claims (52)

1. A method of processing video data, comprising:

constructing, for a first conversion between a first video block of a video and a bitstream of the video, a mode candidate list for the first video block based on prediction modes of at least one spatial neighboring video block,

deriving a first prediction mode for the first video block based on the mode candidate list;

performing the first conversion at least based on the first prediction mode,

wherein when the spatial neighboring video block is coded with a predetermined coding mode, the spatial neighboring video block is treated as having a first default intra mode to derive the mode candidate list,

wherein, in the predetermined coding mode, reconstructed samples of the spatial neighboring video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a first indication indicates whether to enable the predetermined coding mode for the spatial neighboring video block,

wherein in case that the spatial neighboring video block has a first size and a first color format, the first indication is conditionally included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a first tree type, and is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a second tree type different from the first tree type, and

wherein the first indication is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a size of 16.

2. The method of claim 1 , wherein the first default intra mode is a planar intra prediction mode.

3. The method of claim 1 , wherein the predetermined coding mode is not an intra coding mode.

4. The method of claim 1 , wherein a first flag indicating whether to use the predetermined coding mode for the spatial neighboring video block is omitted in the bitstream in response to a variable indicating a prediction mode of the spatial neighboring video block being not equal to MODE_INTRA.

5. The method of claim 1 , wherein the first indication is included in the bitstream when a second indication indicating that the predetermined coding mode is enabled is included in the bitstream.

6. The method of claim 1 , wherein the at least one spatial neighboring video block is above or left neighboring block of the first video block.

7. The method of claim 1 , wherein the first conversion includes encoding the first video block into the bitstream.

8. The method of claim 1 , wherein the first conversion includes decoding the first video block from the bitstream.

9. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

construct, for a first conversion between a first video block of a video and a bitstream of the video, a mode candidate list for the first video block based on prediction modes of at least one spatial neighboring video block,

derive a first prediction mode for the first video block based on the mode candidate list;

perform the first conversion at least based on the first prediction mode,

wherein when the spatial neighboring video block is coded with a predetermined coding mode, the spatial neighboring video block is treated as having a first default intra mode to derive the mode candidate list,

wherein, in the predetermined coding mode, reconstructed samples of the spatial neighboring video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a first indication indicates whether to enable the predetermined coding mode for the spatial neighboring video block,

wherein in case that the spatial neighboring video block has a first size and a first color format, the first indication is conditionally included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a first tree type, and is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a second tree type different from the first tree type, and

wherein the first indication is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a size of 16.

10. The apparatus of claim 9 , wherein the first default intra mode is a planar mode.

11. The apparatus of claim 9 , wherein the predetermined coding mode is not an intra coding mode.

12. The apparatus of claim 9 , wherein a first flag indicating whether to use the predetermined coding mode for the spatial neighboring video block is omitted in the bitstream in response to a variable indicating a prediction mode of the spatial neighboring video block being not equal to MODE_INTRA.

13. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

construct, for a first conversion between a first video block of a video and a bitstream of the video, a mode candidate list for the first video block based on prediction modes of at least one spatial neighboring video block,

derive a first prediction mode for the first video block based on the mode candidate list;

perform the first conversion at least based on the first prediction mode,

wherein when the spatial neighboring video block is coded with a predetermined coding mode, the spatial neighboring video block is treated as having a first default intra mode to derive the mode candidate list,

wherein, in the predetermined coding mode, reconstructed samples of the spatial neighboring video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a first indication indicates whether to enable the predetermined coding mode for the spatial neighboring video block,

wherein in case that the spatial neighboring video block has a first size and a first color format, the first indication is conditionally included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a first tree type, and is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a second tree type different from the first tree type, and

wherein the first indication is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a size of 16.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the first default intra mode is a planar intra prediction mode.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the predetermined coding mode is not an intra coding mode.

16. The non-transitory computer-readable storage medium of claim 13 , wherein a first flag indicating whether to use the predetermined coding mode for the spatial neighboring video block is omitted in the bitstream in response to a variable indicating a prediction mode of the spatial neighboring video block being not equal to MODE_INTRA.

17. A non-transitory computer-readable recording medium storing a bitstream which is generated by a method performed by a video processing apparatus, wherein the method comprises:

constructing, for a first video block of a video, a mode candidate list for the first video block based on prediction modes of at least one spatial neighboring video block,

deriving a first prediction mode for the first video block based on the mode candidate list;

generating the bitstream from the first video block at least based on the first prediction mode,

wherein when the spatial neighboring video block is coded with a predetermined coding mode, the spatial neighboring video block is treated as having a first default intra mode to derive the mode candidate list,

wherein, in the predetermined coding mode, reconstructed samples of the spatial neighboring video block are represented by a set of representative color values, and the set of representative color values comprises at least one of 1) palette predictors, 2) escaped samples, or 3) palette information included in the bitstream,

wherein a first indication indicates whether to enable the predetermined coding mode for the spatial neighboring video block,

wherein in case that the spatial neighboring video block has a first size and a first color format, the first indication is conditionally included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a first tree type, and is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a second tree type different from the first tree type, and

wherein the first indication is not included in the bitstream for the spatial neighboring video block when the spatial neighboring video block has a size of 16.

18. The non-transitory computer-readable recording medium of claim 17 , wherein the first default intra mode is a planar intra prediction mode.

19. The non-transitory computer-readable recording medium of claim 17 , wherein the predetermined coding mode is not an intra coding mode.

20. The non-transitory computer-readable recording medium of claim 17 , wherein a first flag indicating whether to use the predetermined coding mode for the spatial neighboring video block is omitted in the bitstream in response to a variable indicating a prediction mode of the spatial neighboring video block being not equal to MODE_INTRA.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2023
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 063950/0534 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2023
From: ZHU, WEIJIA; ZHANG, LI; XU, JIZHENG; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 063950/0673 →
Priority Claims (1)
WO PCT/CN2019/097288 · Jul 23, 2019 · international
Continuity (3)
Continuation 17580314 · Jan 20, 2022
Continuation PCTCN2020102968 · Jul 20, 2020
Related Publication 20230328234A1 · Oct 12, 2023
References Cited (320)
US 9374578B1 · Mukherjee · 2016 [cited by applicant]
US 9900617B2 · Karczewicz · 2018 [cited by applicant]
US 10148981B2 · Zhu · 2018 [cited by applicant]
US 10212434B2 · Rapaka · 2019 [cited by applicant]
US 10277910B2 · Xiu · 2019 [cited by applicant]
US 10484686B2 · Xiu · 2019 [cited by applicant]
US 10659783B2 · Li · 2020 [cited by applicant]
US 10681383B2 · Ye · 2020 [cited by applicant]
US 10735764B2 · Tsai · 2020 [cited by applicant]
US 10812817B2 · Li · 2020 [cited by applicant]
US 11611753B2 · Zhu · 2023 [cited by applicant]
US 11677953B2 · Zhu · 2023 [cited by applicant]
US 12132884B2 · Zhu et al. · 2024 [cited by applicant]
US 20080192824A1 · Lim · 2008 [cited by applicant]
US 20120257678A1 · Zhou · 2012 [cited by applicant]
US 20130272413A1 · Seregin · 2013 [cited by applicant]
US 20150264354A1 · Zhang · 2015 [cited by applicant]
US 20150264365A1 · Tsai · 2015 [cited by applicant]
US 20150312573A1 · Bugdayci · 2015 [cited by applicant]
US 20150341635A1 · Seregin · 2015 [cited by applicant]
US 20150341673A1 · Joshi · 2015 [cited by applicant]
US 20150358631A1 · Zhang · 2015 [cited by applicant]
US 20150373325A1 · Karczewicz · 2015 [cited by applicant]
US 20150373327A1 · Zhang · 2015 [cited by applicant]
US 20150382011A1 · Lin · 2015 [cited by applicant]
US 20160057430A1 · Kolesnikov · 2016 [cited by applicant]
US 20160100171A1 · Karczewicz · 2016 [cited by examiner]
US 20160100179A1 · He · 2016 [cited by applicant]
US 20160100184A1 · Liu · 2016 [cited by applicant]
US 20160100189A1 · Pang · 2016 [cited by applicant]
US 20160105670A1 · Pang · 2016 [cited by applicant]
US 20160105676A1 · Pu · 2016 [cited by applicant]
US 20160212438A1 · Andersson · 2016 [cited by applicant]
US 20160227211A1 · Gisquet · 2016 [cited by applicant]
US 20160227221A1 · Lai · 2016 [cited by applicant]
US 20160227225A1 · Zou · 2016 [cited by applicant]
US 20160227226A1 · Rapaka · 2016 [cited by applicant]
US 20160227231A1 · Xiu · 2016 [cited by applicant]
US 20160234498A1 · Misra · 2016 [cited by applicant]
US 20160241852A1 · Gamei · 2016 [cited by applicant]
US 20160316214A1 · Gisquet · 2016 [cited by applicant]
US 20160323600A1 · Ma · 2016 [cited by applicant]
US 20160345030A1 · Karczewicz · 2016 [cited by applicant]
US 20160366442A1 · Liu · 2016 [cited by applicant]
US 20160381388A1 · Kazui · 2016 [cited by applicant]
US 20170006309A1 · Liu · 2017 [cited by applicant]
US 20170054988A1 · Lin · 2017 [cited by applicant]
US 20170078683A1 · Seregin · 2017 [cited by applicant]
US 20170085891A1 · Seregin · 2017 [cited by applicant]
US 20170099490A1 · Seregin · 2017 [cited by applicant]
US 20170127058A1 · Misra · 2017 [cited by applicant]
US 20170127090A1 · Rosewarne · 2017 [cited by applicant]
US 20170195676A1 · Chuang · 2017 [cited by applicant]
US 20170374384A1 · Xiu · 2017 [cited by applicant]
US 20180041757A1 · Liu · 2018 [cited by applicant]
US 20180041774A1 · Zhu · 2018 [cited by applicant]
US 20180098092A1 · Ye · 2018 [cited by applicant]
US 20180160129A1 · Kalevo · 2018 [cited by applicant]
US 20180262763A1 · Seregin · 2018 [cited by applicant]
US 20180288415A1 · Li · 2018 [cited by applicant]
US 20180332288A1 · Hsiang · 2018 [cited by applicant]
US 20180376149A1 · Zhang · 2018 [cited by applicant]
US 20190104322A1 · Tsukuba · 2019 [cited by applicant]
US 20190158854A1 · He · 2019 [cited by applicant]
US 20190174145A1 · Zhang · 2019 [cited by applicant]
US 20190215521A1 · Chuang · 2019 [cited by applicant]
US 20190215524A1 · Lee · 2019 [cited by applicant]
US 20190222839A1 · Jang · 2019 [cited by applicant]
US 20190246118A1 · Ye · 2019 [cited by applicant]
US 20190246122A1 · Zhang · 2019 [cited by applicant]
US 20190281311A1 · Ye · 2019 [cited by applicant]
US 20200020134A1 · Tsukuba · 2020 [cited by applicant]
US 20200092546A1 · Ye · 2020 [cited by applicant]
US 20200169745A1 · Han · 2020 [cited by applicant]
US 20200213591A1 · Sun · 2020 [cited by applicant]
US 20200244962A1 · Li · 2020 [cited by applicant]
US 20200252621A1 · Xu · 2020 [cited by applicant]
US 20200280742A1 · Ramasubramonian · 2020 [cited by applicant]
US 20200288145A1 · Chuang · 2020 [cited by applicant]
US 20200288175A1 · Chang · 2020 [cited by applicant]
US 20200296423A1 · Chao · 2020 [cited by applicant]
US 20200322630A1 · Tsai · 2020 [cited by applicant]
US 20200329257A1 · Zhao · 2020 [cited by applicant]
US 20200336735A1 · Chang · 2020 [cited by applicant]
US 20200374545A1 · Lai · 2020 [cited by applicant]
US 20200389667A1 · Zhao · 2020 [cited by applicant]
US 20200404253A1 · Chen · 2020 [cited by applicant]
US 20200413071A1 · Huang · 2020 [cited by applicant]
US 20210006794A1 · Karczewicz · 2021 [cited by applicant]
US 20210136405A1 · Chen · 2021 [cited by applicant]
US 20210235072A1 · Ko · 2021 [cited by applicant]
US 20210297657A1 · Lee · 2021 [cited by applicant]
US 20210306638A1 · Kang · 2021 [cited by applicant]
US 20210368180A1 · Park · 2021 [cited by applicant]
US 20210409686A1 · Xu · 2021 [cited by applicant]
US 20210409745A1 · Ikai · 2021 [cited by applicant]
US 20220007010A1 · Van der Auwera · 2022 [cited by applicant]
US 20220007021A1 · Jang · 2022 [cited by applicant]
US 20220070487A1 · Park · 2022 [cited by applicant]
US 20220078433A1 · Yoo · 2022 [cited by applicant]
US 20220086449A1 · Koo · 2022 [cited by applicant]
US 20220103858A1 · Jang · 2022 [cited by applicant]
US 20220159241A1 · Zhu · 2022 [cited by applicant]
US 20220174274A1 · Jang · 2022 [cited by examiner]
US 20220182636A1 · Zhu · 2022 [cited by applicant]
US 20220182655A1 · Zhu · 2022 [cited by applicant]
US 20220232205A1 · Chiang · 2022 [cited by applicant]
US 20220377341A1 · Zhu · 2022 [cited by applicant]
US 20230007271A1 · Zhu · 2023 [cited by applicant]
BR 112022001079B1 · 2025 [cited by applicant]
CN 102804776A · 2012 [cited by applicant]
CN 104685874A · 2015 [cited by applicant]
CN 104853211A · 2015 [cited by applicant]
CN 105704491A · 2016 [cited by applicant]
CN 105791824A · 2016 [cited by applicant]
CN 105981385A · 2016 [cited by applicant]
CN 106063270A · 2016 [cited by applicant]
CN 106105202A · 2016 [cited by applicant]
CN 106105203A · 2016 [cited by applicant]
CN 106105205A · 2016 [cited by applicant]
CN 106105207A · 2016 [cited by applicant]
CN 106170979A · 2016 [cited by applicant]
CN 106416249A · 2017 [cited by applicant]
CN 106464875A · 2017 [cited by applicant]
CN 106464885A · 2017 [cited by applicant]
CN 106471809A · 2017 [cited by applicant]
CN 106534846A · 2017 [cited by applicant]
CN 106664405A · 2017 [cited by applicant]
CN 106664429A · 2017 [cited by applicant]
CN 106716999A · 2017 [cited by applicant]
CN 106797469A · 2017 [cited by applicant]
CN 106797475A · 2017 [cited by applicant]
CN 106797478A · 2017 [cited by applicant]
CN 107005717A · 2017 [cited by applicant]
CN 107113436A · 2017 [cited by applicant]
CN 107211134A · 2017 [cited by applicant]
CN 107211160A · 2017 [cited by applicant]
CN 107409215A · 2017 [cited by applicant]
CN 107409225A · 2017 [cited by applicant]
CN 107409227A · 2017 [cited by applicant]
CN 107637080A · 2018 [cited by applicant]
CN 107646195A · 2018 [cited by applicant]
CN 107710760A · 2018 [cited by applicant]
CN 107852497A · 2018 [cited by applicant]
CN 107925759A · 2018 [cited by applicant]
CN 107925769A · 2018 [cited by applicant]
CN 108495135A · 2018 [cited by applicant]
CN 109076210A · 2018 [cited by applicant]
CN 109479137A · 2019 [cited by applicant]
CN 109547790A · 2019 [cited by applicant]
CN 109661819A · 2019 [cited by applicant]
CN 109891883A · 2019 [cited by applicant]
CN 113475077B · 2023 [cited by applicant]
CN 113678448B · 2024 [cited by applicant]
CN 113615188B · 2024 [cited by applicant]
EP 2075845A1 · 2009 [cited by applicant]
EP 3211900A1 · 2017 [cited by applicant]
EP 3251358A1 · 2017 [cited by applicant]
EP 3301914A1 · 2018 [cited by applicant]
EP 3422717A1 · 2019 [cited by applicant]
EP 3912351A1 · 2021 [cited by applicant]
EP 3915258A4 · 2022 [cited by applicant]
EP 3987791A4 · 2022 [cited by applicant]
GB 201509936 · 2015 [cited by applicant]
HK 40062419B · 2024 [cited by applicant]
ID P00094482 · 2024 [cited by applicant]
JP 2017521920A · 2017 [cited by applicant]
JP 2017522839A · 2017 [cited by applicant]
JP 7197720B2 · 2022 [cited by applicant]
RU 2483467C2 · 2013 [cited by applicant]
RU 2678490C2 · 2019 [cited by applicant]
SG 11202108938T · 2024 [cited by applicant]
WO 2014003254A1 · 2014 [cited by applicant]
WO 2014205561A1 · 2014 [cited by applicant]
WO 2015074047A1 · 2015 [cited by applicant]
WO 2015091879A2 · 2015 [cited by applicant]
WO 2015096647A1 · 2015 [cited by applicant]
WO 2015096808A1 · 2015 [cited by applicant]
WO 2015192800A1 · 2015 [cited by applicant]
WO 2015196117A1 · 2015 [cited by applicant]
WO 2015196126A1 · 2015 [cited by applicant]
WO 2016004086A1 · 2016 [cited by applicant]
WO 2016048834A1 · 2016 [cited by applicant]
WO 2016074627A1 · 2016 [cited by applicant]
WO 2016082699A1 · 2016 [cited by applicant]
WO 2016100424A1 · 2016 [cited by applicant]
WO 2016115343A2 · 2016 [cited by applicant]
WO 2016115728A1 · 2016 [cited by applicant]
WO 2016123492A1 · 2016 [cited by applicant]
WO 2016123513A1 · 2016 [cited by applicant]
WO 2016125685A1 · 2016 [cited by applicant]
WO 2016192677A1 · 2016 [cited by applicant]
WO 2016197314A1 · 2016 [cited by applicant]
WO 2016201032A1 · 2016 [cited by applicant]
WO 2017008255A1 · 2017 [cited by applicant]
WO 2017049119A1 · 2017 [cited by applicant]
WO 2017143963A1 · 2017 [cited by applicant]
WO 2017196957A1 · 2017 [cited by applicant]
WO 2018012808A1 · 2018 [cited by applicant]
WO 2018062788A1 · 2018 [cited by applicant]
WO 2018064956A1 · 2018 [cited by applicant]
WO 2018190523A1 · 2018 [cited by applicant]
WO 2018202558A1 · 2018 [cited by applicant]
WO 2019009540A1 · 2019 [cited by applicant]
WO 2019069950A1 · 2019 [cited by applicant]
WO 2019074273A1 · 2019 [cited by applicant]
WO 2020169103A1 · 2020 [cited by applicant]
WO 2020169104A1 · 2020 [cited by applicant]
WO WO2020228578A1 · 2020 [cited by examiner]
WO 2020249762A1 · 2020 [cited by applicant]
WO 2021013120A1 · 2021 [cited by applicant]
Sun, Y., et al., “CE8: Proposed WD for palette mode and intra mode combination (Test8.2.2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting: Marrakech, MA, Jan. 9-18, 201… [cited by examiner]
Document No. JVET-O0600-WD, Jhu, H., et al., “CE8-related: Palette mode excluding small blocks,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, 3012 Jul. … [cited by examiner]
Document: JVET-N0472-v2, Xu, J., et al., “Non-CE8: On IBC reference buffer design,” Joint Video Experts Team (JVET) of Itu-T Sg 16 WP 3 and Iso/Iec Jtc 1/SC 29/WG 11 14th Meeting: Geneva, CH, Mar. 19-27, 2019, 6 pages. [cited by applicant]
Office Action from Canadian Application No. 3,130,472 dated Nov. 1, 2023, 6 pages. [cited by applicant]
Office Action from Canadian Application No. 3,130,472 dated Oct. 23, 2023, 7 pages. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/384,137 dated Nov. 7, 2023, 26 pages. [cited by applicant]
Ma et al. “Restriction of CU Sizes for Intra Block Copy,” Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting, Sapporo, JP, Jun. 30-Jul. 9, 2014, document JC… [cited by applicant]
Chen et al. “Description of Screen Content Coding Technology Proposal by NCTU and ITRI International,” Joint Collaborative Team on Video Coding {JCT-VC) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC29/WG 11, 17th Meeting, Val… [cited by applicant]
Joshi et al. “High Efficiency Video Coding (HEVC) Screen Content Coding: Draft 1,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 18th Meeting, Sapporo, JP, Jun. 9, … [cited by applicant]
Chao et al. “CE15-2: Palette Mode of HEVC SCC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/ IEC JTC 1/SC 29/WG 11, 12th Meeting, Macao, CN, Oct. 3-12, 2018, document JVET-L0336, 2018. [cited by applicant]
Chao et al. “Proposed WD for CE15-2: Palette Mode of HEVC SCC,” Joint Video Experts Team (JVET) of ITU-T SG 6 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting, Macao, CN, Oct. 3-12, 2018, document JVET-L0336-Wd, 2018. [cited by applicant]
Fang et al. “CE3-Related: MPM List Modification for Zero Reference Line,” Joint Video Experts Team {JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, documentJVET-O0… [cited by applicant]
Wang et al. “CE3-Related: A Unified MPM List for Intra Mode Coding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Geneva, CH, Mar. 19-27, 2019, document JVET-N0185, 20… [cited by applicant]
Rath et al. “CE3-Related: Further Simplifications of the Unified MPM List for Intra Mode Coding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-1… [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1SO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, document JVET-O2001, 2019. [cited by applicant]
Zhu et al. “CE8-Related: Compound Palette Mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Geneva, CH, Mar. 19-27, 2019, document JVET-N0259, 2019. [cited by applicant]
Chao et al. “CE8-2.1: Palette Mode in HEVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, document JVET-00119, 2019. [cited by applicant]
Zhu et al. “CE8-Related: Palette Mode with 8 Bits Entries,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, document JVET-O0259, 2019. [cited by applicant]
Chao et al. “CE8: Palette Mode in Hevc (CE8-2.1),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and SO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Geneva, CH, Mar. 19-27, 2019, document JVET-N0344, 2019. [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 4),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1SO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, Jan. 9-18, 2019, document JVET-M1001, 2019. [cited by applicant]
https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/tags/VTM-4.0, Mar. 24, 2022. [cited by applicant]
“Information Technology—High Efficiency Coding and Media Delivery in Heterogeneous Environments—Part 2: High Efficiency Video Coding” Apr. 20, 2018, ISO/DIS 23008, 4th Edition. [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 3),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1SO/IEC JTC 1/SC 29/WG 11, 12th Meeting, Macao, CN, Oct. 3-12, 2018, document JVET-L1001, 2018. [cited by applicant]
Ikeda et al. “CE11.1.6, CE11.1.7 and CE11.1.8: Joint Proposals for Long Deblocking from Sony, Qualcomm, Sharp, Ericsson,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, … [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 5),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1S0/IEC JTC 1/SC 29/WG 11, 14th Meeting, Geneva, CH, Mar. 19-27, 2019, document JVET-N1001, 2019. [cited by applicant]
Document: JVET-O2001-v9, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 434 pages. [cited by applicant]
Galpin et al. “Non-CE4: Affine and Sub-Block Modes Coding Clean-Up,” Joint Video Experts Team {JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, document JVET-O0500,… [cited by applicant]
Said et al. “CE5: Per-Context CABAG Initialization with Single Window (Test 5.1.4),” Joint Video Experts Team (JVET of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 13th Meeting, Marrakech, MA, Jan. 9-18, 2019, docume… [cited by applicant]
http://phenix.it-sudparis.eu/jvet/doc_end_user/current_document.phpid=5755, Mar. 24, 2022. [cited by applicant]
“High Efficiency Video Coding” Series H: Audiovisual and Multimedia Systems: Infrastructure of Audiovisual Services—Coding of Moving Video, ITU-T, H.265, Nov. 2019. [cited by applicant]
Zhu et al. “CE8-Related: Palette Mode Coding,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP3 and 1SO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Geneva, CH, Mar. 19-27, 2019, documentJVET-N0258, 2019. [cited by applicant]
Joshi et al. “High Efficiency Video Coding (HEVC) Screen Content Coding: Draft 6,” Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC San Diego, USA, Feb. 19-26, 2016, document JC… [cited by applicant]
“Advanced Video Coding for Generic Audiovisual Services,” ITU-T Telecommunication Standardization Sector of ITU, Series H: Audiovisual and Multimedia Systems, Infrastructure of Audiovisual Services—Coding of Moving Vide… [cited by applicant]
Bross et al. “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, document JVET-O2001 Ve, 2019. [cited by applicant]
Cha et al. “An Efficient Combined Inter and Intra Prediction Scheme for Video Coding,” APSIPA ASC 2011. [cited by applicant]
Chen et al. “CE8: Separate Palette Coding for Luma and Chroma (Test 8.2.5),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 13th Meeting, Marrakech, MA Jan. 9-18, 2019, document JVET-M… [cited by applicant]
Chen et al. “ Algorithm Description for Versatile Video Coding and Test Model 6 (VTM 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, … [cited by applicant]
Chernyak et al. “CE15-Related: Separate Palette Coding for Luma and Chroma Components,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 12th Meeting, Macao, CN, Oct. 3-12, 2018, documen… [cited by applicant]
Jhu et al. “CE8-Related: Palette Mode Excluding Small Blocks,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, document JVET-O0600, 2019. [cited by applicant]
Karczewicz et al. “Non-CE8: Minimum QP for Transform Skip Mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, documents JVET-O0919, 201… [cited by applicant]
Duanmu et al. “Fast Screen Content Coding and Two Tier 360 Degree Video Streaming,” Dissertation for Doctor of Philosophy (Electrical Engineering) at the New York University Tandon School of Engineering[online], May 201… [cited by applicant]
Jhu et al. “Non-CE8: Quantization Unification for Palette Escape and Transform Skip,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting, Geneva, CH Oct. 1-11, 2019, document … [cited by applicant]
Jhu et al. “Non-CE8: QP Dependent Binarization for Palette Escape,” Joint Video Experts Team (JVET) of ITU-T SG16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 16th Meeting, Geneva, CH Oct. 1-11, 2019, document JVET-P0529-v2, 2019. [cited by applicant]
Jin et al. “Combined Inter-Intra Prediction for High Definition Video Coding,” Procedures Picture Coding Symposium, Feb. 2007, pp. 1-4. [cited by applicant]
Pu et al. “Palette Mode Coding in HEVC Screen Content Coding Extension,” IEEE Journal of Emerging and Selected Topics in Circuits and Systems, Nov. 18, 2016, 6(4):420-432. [cited by applicant]
JVET-O2001-v8, Bross, B., et al., “Versatile Video Coding (Draft 6)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 434 pages. [cited by applicant]
Document: JVET-O0186, Ikonin, S., et al., “AHG15: Signalling of chroma Qp mapping table,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, … [cited by applicant]
Chao et al. “CE8-2.1: Palette Mode in HEVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 15th Meeting, Gothenburg, SE, Jul. 3-12, 2019, document JVET-O0119, 2019. [cited by applicant]
Document: JVET-O0285-v1, Lin, Y., et al., “CE4-related: On merging candidate list construction,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12,… [cited by applicant]
Extended European Search Report from European Patent Application No. 20846718.3 dated Jul. 21, 2022 (12 pages). [cited by applicant]
Extended European Search Report from European Patent Application No. 20760048.7 dated Aug. 3, 2022 (12 pages). [cited by applicant]
Extended European Search Report from European Patent Application No. 20844841.5 dated Jul. 25, 2022 (8 pages). [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/580,446 dated Aug. 23, 2022. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/585,704 dated Aug. 31, 2022. [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/103694 dated Oct. 28, 2020 (12 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/105403 dated Oct. 29, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/105405 dated Sep. 9, 2020 (10 pages). [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/330,792 dated Aug. 5, 2021. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/330,792 dated Nov. 17, 2021. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/384,137 dated Nov. 19, 2021. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/384, 37 dated Mar. 7, 2022. [cited by applicant]
Office Action from Australian Patent Application No. 2020316506 dated Jun. 6, 2023 (3 pages). [cited by applicant]
Office Action from Canadian Patent Application No. 3, 147,923 dated Jun. 19, 2023 (4 pages). [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/384,137 dated Jul. 6, 2023. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/580,314 dated Apr. 11, 2022. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/578,703 dated Sep. 14, 2022. [cited by applicant]
Extended European Search Report from European Patent Application No. 20758451.7 dated Jun. 3, 2022 (11 pages). [cited by applicant]
Extended European Search Report from European Patent Application No. 20758940.9 dated May 23, 2022 (10 pages). [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/572,810 dated Apr. 1, 2022. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/585,704 dated Apr. 20, 2022. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/578,703 dated May 11, 2022. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/580,446 dated May 11, 2022. [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/076367 dated May 28, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/076368 dated Apr. 29, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/076369 dated May 14, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/076370 dated May 14, 2020 (10 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/083887 dated Jun. 29, 2020 (9 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/102968 dated Oct. 21, 2020 (12 pages). [cited by applicant]
International Search Report and Written Opinion from International Patent Application No. PCT/CN2020/102970 dated Aug. 27, 2020 (9 pages). [cited by applicant]
Final Office Action from U.S. Appl. No. 17/384,137 dated Mar. 7, 2022. [cited by applicant]
Office Action from Canadian Patent Application No. 2020102970 dated Jun. 19, 2023 (4 pages). [cited by applicant]
Final Office Action from U.S. Appl. No. 17/580,314 dated Jul. 26, 2022. [cited by applicant]
Office Action from Canadian Application No. 3,132,071 dated Oct. 23, 2023, 7 pages. [cited by applicant]
Document: JVET-O0405-v1, Nguyen, T., et al., “Non-CE8: Minimum Allowed QP for Transform Skip Mode”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-… [cited by applicant]
He T. et al., “Evaluation of No Reference Bitstream-based Video Quality Assessment Methods,” APSIPA ASC, URL: https://arxiv.org/abs/1706.10143, Jun. 30, 2017, 8 pages. [cited by applicant]
Document: JVET-O2001-vC, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 436 pages. [cited by applicant]
Singapore Office Action from Singapore Patent Application No. 11202200568V dated Aug. 22, 2024, 10 pages. [cited by applicant]
Japanese Office Action from Japanese Patent Application No. 2023-201864 dated Aug. 27, 2024, 14 pages. [cited by applicant]
Indian Hearing for Indian Patent Application No. 202127037093 dated Sep. 4, 2024, 2 pages. [cited by applicant]
Hearing Notice for Indian Patent Application No. 202227005254 mailed Jan. 2, 2025, 3 pages. [cited by applicant]
Invitation to Respond to Written Opinion for Singaporean Application No. 11202109482P dated Nov. 21, 2024, 7 pages. [cited by applicant]
Substantive Examination Adverse Report for Malaysian Application No. PI2021004973 mailed on Dec. 26, 2024, 5 pages. [cited by applicant]
Technical Examination Report for Brazilian Application No. 112022001079-6, mailed Oct. 29, 2024, 14 pages. [cited by applicant]
Document: JVET-O0119, Chao, Y-H., et al., “CE8-2.1: Palette mode in HEVC,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 9 pages. [cited by applicant]
Indonesian Office Action from Indonesian Patent Application No. P00202106364 dated Dec. 18, 2024, 5 pages. [cited by applicant]
Chinese Notice of Allowance from Chinese Patent Application No. 202080055003.9 dated Nov. 29, 2024, 10 pages. [cited by applicant]
Chinese Office Action from Chinese Patent Application No. 202080016396.2 dated Jan. 17, 2025, 13 pages. [cited by applicant]
Notice of Reasons for Refusal for Japanese Application No. 2023-166048, mailed Oct. 22, 2024, 10 pages. [cited by applicant]
Sun, Y-C., et al., “Improvements of HEVC SCC Palette Mode and Intra Block Copy,” IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 6, No. 4, Dec. 2016, 13 pages. [cited by applicant]
Cha, R., et al., “Improved Combined Inter-Intra Prediction Using Spatial-Variant Weighted Coefficient,” 978-1-61284-350-6/11/$26.00 AO2011 IEEE, 2011, 5 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/585,704 dated May 22, 2024, 27 pages. [cited by applicant]
Document: JVET-O0919-v2, Karczewicz, M., et al., “Non-CE8: Minimum QP for Transform Skip Mode,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, … [cited by applicant]
Document: JVET-O2001-v6, Bross, B., et al., “Versatile Video Coding (Draft 6),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 2019, 426 pages. [cited by applicant]
Document: JVET-O0600-WD, Jhu, H., et al., “CE8-related: Palette mode excluding small blocks,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 15th Meeting: Gothenburg, SE, Jul. 3-12, 20… [cited by applicant]
Zhu, W., et al., “Compound Palette Mode for Screen Content Coding” IEEE (Year: 2019), 5 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/994,095 dated Jan. 29, 2024, 10 pages. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/994,095 dated Apr. 11, 2024, 14 pages. [cited by applicant]
Extended Office Action from European Application No. 20760048.7 dated Mar. 14, 2024, 11 pages. [cited by applicant]
Extended Office Action from European Application No. 20844841.5 dated Feb. 28, 2024, 6 pages. [cited by applicant]