IP Library › Granted Patent US 12,537,940
Granted Patent B2
US 12,537,940 · App. 18/741,032 · Granted Jan 27, 2026

Definition of zero unit

Inventors: Kai Zhang (San Diego, CA); Li Zhang (San Diego, CA); Hongbin Liu (Beijing, CN); Hsiao Chiang Chuang (San Diego, CA); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/119H04N19/159H04N19/176H04N19/96
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,537,940
App. No.
18/741,032
Granted
Jan 27, 2026
Kind
B2
Abstract

Devices, systems and methods for using zero-units in video and image coding are described. In a representative aspect, a method for processing video, including: determining, for a conversion between a block of the video and a bitstream of the video, that the block is a zero-unit (ZU) block based on one or more dimensions of the block being a non-power-of-two number, wherein no transform and inverse-transform operations are performed on the block; and performing the conversion based on the determination.

Claims (31)

1 . A method for processing video, comprising:

determining, for a conversion between a block of the video and a bitstream of the video, that the block is a zero-unit (ZU) block based on one or more dimensions of the block being a non-power-of-two number, wherein no transform and inverse-transform operations are performed on the block;

performing the conversion based on the determining,

wherein the ZU block is a coding unit (CU) split in an asymmetric binary-tree (ABT) partitioning.

2 . The method of claim 1 , wherein, in response to determining that the block is a ZU block, setting all residuals of the ZU block to zero.

3 . The method of claim 1 , wherein any one of the dimensions of the block is an even number of a form 2 N.

4 . The method of claim 1 , wherein any one of the dimensions of the block is of a form 2 KN where K is an integer.

5 . The method of claim 1 , wherein a transform operation or an inverse-transform operation is not performed on the ZU block.

6 . The method of claim 1 , further comprising signaling an encoded ZU block in the bitstream, wherein the signaling excludes any syntax element indicating a prediction mode.

7 . The method of claim 1 , wherein motion information of the ZU block is inherited from motion information of a neighboring block.

8 . The method of claim 1 , wherein signaling does not include a cbf_flag and a cbf flag of the ZU block is inferred to be zero.

9 . The method of claim 6 , wherein the signaling excludes a transform skip flag.

10 . The method of claim 1 , wherein the ZU block is a block at a border of a picture, slice or tile.

11 . The method of claim 1 , wherein each coding unit at a border of a picture, slice, or tile is a ZU block.

12 . The method of claim 1 , wherein the ZU block may only be an inter-coded block.

13 . The method of claim 1 , wherein the determining further includes determining that the block is the ZU block due to a total number of samples of the block being greater than or equal to a threshold number T.

14 . The method of claim 1 , wherein the determining further includes determining that the block is the ZU block due to the dimensions further being greater than a first threshold for width or a second threshold for height of the block of the video.

15 . The method of claim 1 , wherein the conversion includes decoding the block from the bitstream.

16 . The method of claim 1 , wherein the conversion includes encoding the block into the bitstream.

17 . An apparatus for processing video comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a block of a video and a bitstream of the video, that the block is a zero-unit (ZU) block based on one or more dimensions of the block being a non-power-of-two number, wherein no transform and inverse-transform operations are performed on the block;

perform the conversion based on the determination,

wherein the ZU block is a coding unit (CU) split in an asymmetric binary-tree (ABT) partitioning.

18 . A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a block of video and a bitstream of the video, that the block is a zero-unit (ZU) block based on one or more dimensions of the block being a non-power-of-two number, wherein no transform and inverse-transform operations are performed on the block;

perform the conversion based on the determination,

wherein the ZU block is a coding unit (CU) split in an asymmetric binary-tree (ABT) partitioning.

19 . A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a block of the video, that the block is a zero-unit (ZU) block based on one or more dimensions of the block being a non-power-of-two number, wherein no transform and inverse-transform operations are performed on the block;

generating the bitstream from the block based on the determining,

wherein the ZU block is a coding unit (CU) split in an asymmetric binary-tree (ABT) partitioning.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2024
From: ZHANG, KAI; ZHANG, LI; CHUANG, HSIAO CHIANG
To: BYTEDANCE INC.
Reel/Frame 068283/0805 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2024
From: LIU, HONGBIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 068284/0296 →
Continuity (4)
Continuation 17134082 · Dec 24, 2020
Continuation PCTIB2019055562 · Jul 1, 2019
Provisional Application 62693415 · Jul 2, 2018
Related Publication 20240333917A1 · Oct 3, 2024
References Cited (71)
US 11122296B2 · Leleannec · 2021 [cited by examiner]
US 12034911B2 · Zhang · 2024 [cited by applicant]
US 20030081850A1 · Karczewicz · 2003 [cited by examiner]
US 20120230411A1 · Liu · 2012 [cited by examiner]
US 20130114730A1 · Joshi · 2013 [cited by examiner]
US 20130294524A1 · Van Der Auwera · 2013 [cited by examiner]
US 20140046670A1 · Moon · 2014 [cited by examiner]
US 20140192862A1 · Flynn · 2014 [cited by examiner]
US 20150016506A1 · Fu · 2015 [cited by examiner]
US 20150078443A1 · Kolesnikov · 2015 [cited by examiner]
US 20150249828A1 · Rosewarne · 2015 [cited by examiner]
US 20180084284A1 · Rosewarne · 2018 [cited by examiner]
US 20180109812A1 · Tsai · 2018 [cited by examiner]
US 20180278958A1 · Hsiang · 2018 [cited by examiner]
US 20190215516A1 · Lim · 2019 [cited by examiner]
US 20190349602A1 · Li · 2019 [cited by examiner]
US 20200007893A1 · Leleannec · 2020 [cited by examiner]
US 20200029072A1 · Xu · 2020 [cited by examiner]
US 20200304816A1 · Zhao · 2020 [cited by examiner]
US 20210037237A1 · Hsiang · 2021 [cited by examiner]
US 20210084319A1 · Zhao · 2021 [cited by examiner]
US 20210321130A1 · Li · 2021 [cited by examiner]
CA 3019490A1 · 2017 [cited by applicant]
CN 101449476A · 2009 [cited by applicant]
CN 103004192 · 2013 [cited by applicant]
CN 103718556A · 2014 [cited by applicant]
CN 104202599A · 2014 [cited by applicant]
CN 104685872A · 2015 [cited by applicant]
CN 105103549A · 2015 [cited by applicant]
CN 103004192B · 2016 [cited by applicant]
CN 105721867A · 2016 [cited by applicant]
CN 107211154A · 2017 [cited by applicant]
CN 107925773A · 2018 [cited by applicant]
CN 108134935A · 2018 [cited by applicant]
CN 108174211A · 2018 [cited by applicant]
CN 110662035 · 2020 [cited by applicant]
CN 110662038 · 2020 [cited by applicant]
CN 110662050 · 2020 [cited by applicant]
EP 3310054A1 · 2018 [cited by applicant]
TW 201820882A · 2018 [cited by applicant]
WO 2012005521A2 · 2012 [cited by applicant]
WO 2018088805A1 · 2018 [cited by applicant]
Sullivan et al. “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEEE Transactions on Circuits and Systems for Video Technology, Dec. 2012, 22(12):1649-1668. [cited by applicant]
Luthra et al. Overview of the H.264/AVC Video Coding Standard, Proc. SPIE, 5203, Applications of Digital Image Processing, Nov. 19, 2003, Optical Science and Technology, SPIE 48th annutal Meeting, San Diego, CA, US, 200… [cited by applicant]
Chen et al. “Algorithm Description of Joint Exploration Test Model 7 (JEM 7),” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 7th Meeting: Torino, IT, Jul. 13-21, 2017, document J… [cited by applicant]
Retrieved from the internet: https://jvet.hhi.fraunhofer.de/svn/svn_HMJEMSoftware/tags/ HM-16.6-JEM-7.0, JEM-7.0, Jun. 12, 2024. [cited by applicant]
H.265/HEVC, Retrieved from the internet: https://www.itu.int/rec/T-REC-H.265, Jun. 12, 2024. [cited by applicant]
Escoda, et al., “Geometry-Adaptive Block Partitioning for Video Coding,” IEEE International Conference on Acoustic, Speech, and Signal Processing, Honolulu, Hawaii, USA 2007, pp. 657-660. [cited by applicant]
Zhang et al. “CE1-Related: Zero-Unit for Picture Boundary Handling,” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and 1SO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, document JVET-K0320,… [cited by applicant]
Won et al. “Transform Skip Based on Minimum TU Size,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Vienna, AT, Jul. 25 to Aug. 2, 2013, document JCTV… [cited by applicant]
Xiu et al. “Rext HLS: On Lossless Coding,” Joint Collaborative Team on Video Coding (JCT-VG) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Valencia, ES, Mar. 27 to Apr. 4, 2014, document JCTVC-Q0106, … [cited by applicant]
Rosewarne et al. “CE1: Test 3—Square Transforms for Range Extensions,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting, Geneva, CH, Jan. 16-23, 2013, doc… [cited by applicant]
Ma et al. “Description of Core Experiment 1 (CE1): Partitioning,” Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and 1SO/IEC JTC 1/SC 29/WG 11, 10th Meeting, San Diego, US, Apr. 10-20, 2018, document JVET-J1021… [cited by applicant]
International Search Report and Written Opinion from PCT/IB2019/055433 dated Nov. 15, 2019 (14 pages). [cited by applicant]
International Search Report and Written Opinion from PCT/IB2019/055553 dated Jan. 8, 2020 (18 pages). [cited by applicant]
International Search Report and Written Opinion from PCT/IB2019/055562 dated Jan. 8, 2020 (20 pages). [cited by applicant]
Taiwanese Office Action from Taiwanese Application No. 108123153 dated May 13, 2020, 21 pages. [cited by applicant]
Chinese Notice of Allowance from Chinese Application No. 201910586408.4 dated Nov. 2, 2021, 6 pages. [cited by applicant]
Chinese Office Action from Chinese Application No. 201910586408.4 dated May 7, 2021, 77 pages. [cited by applicant]
Taiwanese Office Action from Taiwanese Application No. 108122735 dated Mar. 27, 2020, 26 pages. [cited by applicant]
Chinese Office Action from Chinese Application No. 201910584189.6 dated Apr. 26, 2021, 16 pages. [cited by applicant]
Chinese Office Action from Chinese Application No. 201910584189.6 dated Dec. 23, 2021, 9 pages. [cited by applicant]
Taiwanese Office Action from Taiwanese Application No. 108123121 dated Aug. 4, 2020, 14 pages. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/134,082 dated Apr. 5, 2023, 15 pages. [cited by applicant]
Final Office Action from U.S. Appl. No. 17/134,082 dated Feb. 15, 2022, 17 pages. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/134,082 dated Aug. 3, 2023, 16 pages. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/134,082 dated Jul. 22, 2021, 21 pages. [cited by applicant]
Non Final Office Action from U.S. Appl. No. 17/134,082 dated Sep. 1, 2022, 15 pages. [cited by applicant]
JEM-7.0: “svn_HMJEMSoftware—Revision 603: /tags/HM-16.6-JEM-7.0,” Apache Subversion Version 1.9.7 (r1800392), 1 Page, Retrieved from URL: https://jvet.hhi.fraunhofer.de/svn/svn_HMJEMSoftware/tags/HM-16.6-JEM-7.0. [cited by applicant]
Rosewarne C., et al., “CE1: Test 3—Square Transforms for Range Extensions,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Geneva, CH, Jan. 16-23, 2013… [cited by applicant]
Won K., et al., “Transform Skip Based on Minimum TU Size,” Joint Collaborative Team on Video Coding (JCT-VC) of ITU SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 14th Meeting, Vienna, AT, Jul. 25, 2013-Aug. 2, 2013, Documen… [cited by applicant]