IP Library › Granted Patent US 12,659,471
Granted Patent B2
US 12,659,471 · App. 18/288,015 · Granted Jun 16, 2026

Method, device, and medium for video processing

Inventors: Kai Zhang (Los Angeles, CA); Li Zhang (Los Angeles, CA)
Assignee: BYTEDANCE INC.
H04N19/117H04N19/159H04N19/82H04N19/86
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,659,471
App. No.
18/288,015
Granted
Jun 16, 2026
Kind
B2
Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: reordering a plurality of samples in a region of a video during a conversion between the region and a bitstream of the video; and performing the conversion based on the reordered plurality of samples. Compared with the conventional solution, the proposed method can advantageously improve the coding efficiency.

Claims (66)

1 . A method of video processing, comprising:

reordering a plurality of samples in a region of a video during a conversion between the region and a bitstream of the video, wherein reordering the plurality of samples comprises changing an original position of a sample in the plurality of samples to a reordered position in the region based on a plurality of different functions for determining the reordered position using the original position; and

performing the conversion based on the reordered plurality of samples.

2 . The method of claim 1 , wherein the plurality of samples comprise at least one type of samples, the at least one type of samples comprising:

a plurality of original samples before encoding,

a plurality of prediction samples,

a plurality of reconstruction samples,

a plurality of transformed samples,

a plurality of samples before inverse-transform,

a plurality of samples before deblocking filtering,

a plurality of samples after deblocking filtering,

a plurality of samples before sample adaptive offset (SAO) processing,

a plurality of samples after SAO processing,

a plurality of samples before adaptive loop-filter (ALF) processing,

a plurality of samples after ALF processing,

a plurality of samples before post processing, and/or

a plurality of samples after post processing.

3 . The method of claim 1 ,

wherein the plurality of samples are reordered at more than one stage; or

wherein the plurality of samples comprises at least two types of samples, and the at least two types of samples are reordered in different reordering schemes, or are reordered in the same reordering scheme.

4 . The method of claim 1 , wherein at least one respective reordered position of at least one sample of the plurality of samples is different from at least one respective original position of the at least one sample of the plurality of samples.

5 . The method of claim 1 , wherein at least one respective reordered position of at least one sample of the plurality of samples is the same as at least one respective original position of at least one sample of the plurality of samples.

6 . The method of claim 1 , wherein the plurality of samples are reordering in at least one reordering scheme, the at least one reordering scheme comprising a horizontal flip, a vertical flip, a horizontal-vertical flip, a shift and/or a rotation.

7 . The method of claim 1 , wherein

at least one sample of the plurality of samples is processed by at least one auxiliary procedure before and/or after the reordering.

8 . The method of claim 7 , wherein the at least one auxiliary procedure comprises at least one of:

adding at least one offset to the at least one sample,

multiplying the at least one sample by at least one factor,

clipping the at least one sample,

filtering the at least one sample, or

modifying the at least one sample based on T (X), wherein X represents a sample of the at least one sample and T represents a function.

9 . The method of claim 1 , wherein at least one of a first indication of whether to apply the reordering or a second indication of a reordering scheme for the reordering is included in the bitstream.

10 . The method of claim 9 , wherein the first indication or the second indication is coded with context coding.

11 . The method of claim 9 , wherein the at least one of the first and second indications is derived from coding information associated with the region.

12 . The method of claim 11 , wherein the coding information comprises at least one of:

dimensions of the region,

at least one coding mode of the region,

at least one motion information associated with the region,

at least one intra-prediction mode associated with the region,

at least one inter-prediction mode associated with the region,

at least one quantization parameter (QP) associated with the region,

coding tree splitting information associated with the region, or

at least one color format and/or color component associated with the region.

13 . The method of claim 9 , wherein

at least one of a parsing scheme or a decoding scheme for the region depends on:

whether the reordering is applied, and/or

the reordering scheme for the reordering.

14 . The method of claim 13 , wherein the bitstream further includes a third indication whether the reordering is applied.

15 . The method of claim 13 , wherein the at least one of the parsing scheme or the decoding scheme comprises a scanning order and/or a filtering scheme.

16 . The method of claim 9 , wherein

the region comprises a block coded with an Intra-Block Copy (IBC) mode, and

the bitstream further comprises:

a fourth indication whether the plurality of samples comprise a plurality of reconstruction samples, and/or

a fifth indication of at least one reordering scheme for reconstruction samples.

17 . The method of claim 16 , wherein the fourth indication or the fifth indication is coded with context coding.

18 . The method of claim 17 , wherein the fifth indication is included in the bitstream if the plurality of samples comprise the plurality of reconstruction samples.

19 . An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

reorder a plurality of samples in a region of a video during a conversion between the region and a bitstream of the video, wherein reordering the plurality of samples comprises changing an original position of a sample in the plurality of samples to a reordered position in the region based on a plurality of different functions for determining the reordered position using the original position; and

perform the conversion based on the reordered plurality of samples.

20 . A non-transitory computer-readable storage medium storing instructions that cause a processor to:

reorder a plurality of samples in a region of a video during a conversion between the region and a bitstream of the video, wherein reordering the plurality of samples comprises changing an original position of a sample in the plurality of samples to a reordered position in the region based on a plurality of different functions for determining the reordered position using the original position; and

perform the conversion based on the reordered plurality of samples.

21 . The method of claim 1 , wherein the conversion comprises encoding the region into the bitstream, and/or

wherein the conversion comprises decoding the region from the bitstream.

22 . The method of claim 1 , further comprising:

storing the bitstream in a non-transitory computer-readable recording medium.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2025
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 069989/0972 →
Continuity (2)
Provisional Application 63178875 · Apr 23, 2021
Related Publication 20240205394A1 · Jun 20, 2024
References Cited (9)
US 20090046941A1 · Mietens et al. · 2009 [cited by applicant]
US 20130101034A1 · Wahadaniah · 2013 [cited by examiner]
US 20130182755A1 · Chen et al. · 2013 [cited by applicant]
US 20150201212A1 · Zhang · 2015 [cited by examiner]
US 20150222821A1 · Shaburova · 2015 [cited by applicant]
US 20160191931A1 · Hannuksela · 2016 [cited by examiner]
International Search Report in PCT/US2022/071847, mailed Jul. 28, 2022, 4 pages. [cited by applicant]
Adluru et al. “Reordering for improved constrained reconstruction from undersampled k-space data”, International Journal of Biomedical Imaging, vol. 2008, Dec. 11, 2008, 12 pages. [cited by applicant]
Kastrinaki et al. “A survey of video processing techniques for traffic applications”, Image and Vision Computing, vol. 21, Issue 4, Apr. 1, 2003, 25 pages. [cited by applicant]