IP Library › Granted Patent US 12,627,495
Granted Patent B2
US 12,627,495 · App. 18/191,972 · Granted May 12, 2026

Picture partitioning in video coding

Inventors: Jizheng Xu (San Diego, CA); Ye-kui Wang (San Diego, CA); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA)
Assignee: Bytedance Inc.
H04L9/30H04L9/0643H04N21/2347
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,627,495
App. No.
18/191,972
Granted
May 12, 2026
Kind
B2
Abstract

Methods, systems, and devices for media processing are described. One example method of processing digital media includes performing a conversion between a media segment and a bitstream of the media segment, the conversion conforming to a format rule and an encryption rule, and the format rule specifying that an indication of an integrity of a portion of the media segment is signaled in the bitstream. In an example, the media segment is a video segment, an audio segment, or an image.

Claims (35)

1 . A method of processing video data, comprising:

performing a conversion between a media segment and a bitstream of the media segment,

wherein the conversion conforms to a format rule and an encryption rule,

wherein the format rule specifies an indication of an integrity of a portion of the media segment is signaled in the bitstream,

wherein the encryption rule specifies applying at least one of message digest algorithm 5 (MD5), secure hash algorithm 0 (SHA-0), or secure hash algorithm 1 (SHA-1) to the portion of the media segment, and

wherein the format rule further specifies that a region of the media segment is subject to a constraint, and wherein the format rule further specifies that the region is measured, based on a color format of the media segment, using a chroma unit or a luma unit.

2 . The method of claim 1 , wherein the region of measured using the luma unit due to the color format of the media segment being 4:0:0.

3 . The method of claim 1 , wherein the region of measured using the chroma unit due to the color format of the media segment being different from 4:0:0.

4 . The method of claim 1 , wherein the encryption rule specifies applying a post-quantum cryptography method to the portion of the media segment.

5 . The method of claim 4 , wherein the post-quantum cryptography method is an eXtended Merkle Signature Scheme (XMSS) or a Leighton-Micali Signature (LMS).

6 . The method of claim 4 , wherein the post-quantum cryptography method comprises code-based cryptography, and

wherein the code-based cryptography comprises a McEliece public key encryption system or a Niederreiter encryption algorithm.

7 . The method of claim 1 , wherein the bitstream further comprises a public key fingerprint or a shorter term public key fingerprint.

8 . The method of claim 7 , wherein the public key fingerprint comprises a 128-bit message digest algorithm 5 (MD5) fingerprint or a 12-bit secure hash algorithm 1 (SHA-1) fingerprint, or

the public key fingerprint comprises a 160-bit message digest algorithm 5 (MD5) fingerprint or a 12-bit secure hash algorithm 1 (SHA-1) fingerprint.

9 . The method of claim 7 , wherein information associated with the public key fingerprint comprises user authentication information.

10 . The method of claim 1 , wherein the bitstream further comprises a public key or a shorter term public key.

11 . The method of claim 10 , wherein the public key is distributed using one or more trusted servers.

12 . The method of claim 10 , wherein the public key is sent in a supplemental enhancement information (SEI) message, and wherein an indication of a color component, the color format, a monochrome picture, or a usage of the SEI message is signaled in the SEI message.

13 . The method of claim 12 , wherein the indication is a 1-bit indication.

14 . The method of claim 12 , wherein the indication is equal to (ChromaFormatIdc==0) or (sps_chroma_format_idc==0).

15 . The method of claim 1 , wherein the conversion comprises decoding the media segment from the bitstream.

16 . The method of claim 1 , wherein the conversion comprises encoding the media segment into the bitstream.

17 . An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor cause the processor to:

perform a conversion between a media segment and a bitstream of the media segment,

wherein the conversion conforms to a format rule and an encryption rule,

wherein the format rule specifies an indication of an integrity of a portion of the media segment is signaled in the bitstream,

wherein the encryption rule specifies applying at least one of message digest algorithm 5 (MD5), secure hash algorithm 0 (SHA-0), or secure hash algorithm 1 (SHA-1) to the portion of the media segment, and

wherein the format rule further specifies that a region of the media segment is subject to a constraint, and wherein the format rule further specifies that the region is measured, based on a color format of the media segment, using a chroma unit or a luma unit.

18 . A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

generating the bitstream of a media segment,

wherein the generating conforms to a format rule and an encryption rule,

wherein the format rule specifies an indication of an integrity of a portion of the media segment is signaled in the bitstream,

wherein the encryption rule specifies applying at least one of message digest algorithm 5 (MD5), secure hash algorithm 0 (SHA-0), or secure hash algorithm 1 (SHA-1) to the portion of the media segment, and

wherein the format rule further specifies that a region of the media segment is subject to a constraint, and wherein the format rule further specifies that the region is measured, based on a color format of the media segment, using a chroma unit or a luma unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2023
From: XU, JIZHENG; WANG, YE-KUI; ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 063870/0012 →
Continuity (3)
Continuation PCTUS2021053008 · Sep 30, 2021
Provisional Application 63085906 · Sep 30, 2020
Related Publication 20230246834A1 · Aug 3, 2023
References Cited (56)
US 6959384B1 · Serret-Avila · 2005 [cited by applicant]
US 11190498B1 · Coleridge · 2021 [cited by examiner]
US 20050251682A1 · Collins · 2005 [cited by applicant]
US 20080222420A1 · Serret-Avila · 2008 [cited by applicant]
US 20080313264A1 · Pestoni · 2008 [cited by applicant]
US 20090168892A1 · McFarland · 2009 [cited by applicant]
US 20100131412A1 · Bradley · 2010 [cited by applicant]
US 20100177891A1 · Keidar · 2010 [cited by applicant]
US 20120233345A1 · Hannuksela · 2012 [cited by applicant]
US 20120317305A1 · Einarsson · 2012 [cited by applicant]
US 20130283035A1 · Tomlinson · 2013 [cited by applicant]
US 20140304515A1 · Feuerman · 2014 [cited by applicant]
US 20140376405A1 · Erickson · 2014 [cited by applicant]
US 20150103926A1 · Hannuksela · 2015 [cited by applicant]
US 20150325243A1 · Grant · 2015 [cited by applicant]
US 20150381362A1 · Thota · 2015 [cited by applicant]
US 20160103911A1 · Logue · 2016 [cited by applicant]
US 20160373735A1 · Binti Abdul Hamid · 2016 [cited by examiner]
US 20170034523A1 · Ebrahimi · 2017 [cited by examiner]
US 20170132272A1 · Khadiwala · 2017 [cited by applicant]
US 20170208361A1 · Dogui · 2017 [cited by examiner]
US 20170214701A1 · Hasan · 2017 [cited by applicant]
US 20180088927A1 · Zhao · 2018 [cited by applicant]
US 20190354697A1 · Aghdam · 2019 [cited by examiner]
US 20210281432A1 · Cambou · 2021 [cited by examiner]
US 20240007667A1 · Li · 2024 [cited by applicant]
US 20240406431A1 · Sanchez De La Fuente · 2024 [cited by applicant]
CN 103493502A · 2014 [cited by applicant]
CN 104581431A · 2015 [cited by applicant]
CN 105704545A · 2016 [cited by applicant]
CN 106612172A · 2017 [cited by applicant]
CN 109600620A · 2019 [cited by applicant]
CN 110012260A · 2019 [cited by applicant]
CN 110602570A · 2019 [cited by applicant]
CN 115280791B · 2024 [cited by applicant]
JP 4875075B2 · 2012 [cited by applicant]
Document: JVET-Q2001-vC, Bross, B., et al., “Versatile Video Coding (Draft 8),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Brussels, BE, Jan. 7-17, 2020, 508 pages. [cited by applicant]
https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/-/archive/VTM-8.0/VVCSoftware_VTM-VTM-8.0.zip, ZIP file, Jun. 15, 2023, 1 page. [cited by applicant]
Document: JVET-Q2007-v5, Boyce, J., et al., “Supplemental enhancement information for coded video bitstreams (Draft 3),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 17th Meeting: Br… [cited by applicant]
Retrieved from the internet: https://en.wikipedia.org/wiki/Deepfake, Wikipedia, Deepfake, Jun. 15, 2023, 34 pages. [cited by applicant]
Document: JVET-Q2014-v5, Nguyen, T., et al., “JVET common test conditions and software reference configurations for lossless, near lossless, and mixed lossy/lossless coding,” Joint Video Experts Team (JVET) of ITU-T SG … [cited by applicant]
Document: JVET-R2001-v2, Boyce, J., et al., “Supplemental enhancement information for coded video bitstreams (Draft 4),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 18th Meeting: by… [cited by applicant]
FIPS Pub 186-4, “Digital Signature Standard,” http://dx.doi.org/10.6028/NIST.FIPS. 186-4, Federal Information Processing Standards Publication, Jul. 2013, 130 pages. [cited by applicant]
FIPS Pub 180-4, “Secure Hash Standard,” http://dx.doi.org/10.6028/NIST.FIPS.180-4, Federal Information Processing Standards Publication, Aug. 2015, 36 pages. [cited by applicant]
FIPS Pub 202, “SHA-3 Standard: Permutation-Based Hash and Extendable-Output Functions,” http://dx.doi.prg/10.6028/NIST.FIPS.202, Federal Information Processing Standards Publication, Aug. 2015, 37 pages. [cited by applicant]
Retrieved from the internet: https://en.wikipedia.org/wiki/Post-quantum_cryptography, Wikipedia, Post-quantum cryptography, Jun. 15, 2023, 14 pages. [cited by applicant]
Harran, M., et al., “A method for verifying integrity & authenticating digital media,” Applied Computing and Informatics 14 145-158, 2018, 14 pages. [cited by applicant]
Lederer, S., et al., “Distributed Dash Dataset,” MMSys'13, Feb. 26-Mar. 1, 2013, 5 pages. [cited by applicant]
Foreign Communication From a Related Counterpart Application, PCT Application No. PCT/US2021/021706, International Search Report dated Jun. 25, 2021, 9 pages. [cited by applicant]
Foreign Communication From a Related Counterpart Application, PCT Application No. PCT/US2021/053008, International Search Report dated Dec. 28, 2021, 8 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 17/942,921 dated Feb. 18, 2025, 33 pages. [cited by applicant]
Boyce J., et al., “Supplemental Enhancement Information for Coded Video Bitstreams (Draft 3),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JVET-Q2007-v6, 17th Meeting: Br… [cited by applicant]
Bross B., et al., “Versatile Video Coding (Draft 8),” Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 17th Meeting: Brussels, BE, Jan. 7-17, 2020, Document: JVET-Q2001-vE, pp. 47-50, 5… [cited by applicant]
Suehring K., “VTM Reference Software for VVC,” Dec. 6, 2022, 03 Pages, Retrieved From URL: https://vcgit.hhi.fraunhofer.de/jvet/VVCSoftware_VTM/-/archive/VTM-8.0/VVCSoftware_VTM-VTM-8.0.zip. [cited by applicant]
Notice of Allowance from U.S. Appl. No. 17/942,921 dated Jun. 4, 2025, 11 pages. [cited by applicant]
Chinese Office Action from Chinese Patent Application No. 202180067097.6 dated Mar. 13, 2026, 27 pages. [cited by applicant]