IP Library Granted Patent US 12,445,604
Granted Patent B2
US 12,445,604 · App. 18/732,427 · Granted Oct 14, 2025

Method, apparatus, and medium for video processing

Inventors: Yang Wang (Beijing, CN); Kai Zhang (Los Angeles, CA); Na Zhang (Beijing, CN); Li Zhang (Los Angeles, CA); Hongbin Liu (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.; BYTEDANCE INC.
H04N19/105H04N19/139H04N19/176
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,445,604
App. No.
18/732,427
Granted
Oct 14, 2025
Kind
B2
Abstract

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, during a conversion between a target block of a video and a bitstream of the target block, a processing procedure to at least one motion candidate in a motion candidate list; reordering the motion candidate list by applying a first reordering process to the motion candidate list after the processing procedure; and performing the conversion based on the reordered motion candidate list.

Claims (30)

1. A method of video processing, comprising: applying, during a conversion between a target block of a video and a bitstream of the target block, a processing procedure to at least one motion candidate in a motion candidate list; reordering the motion candidate list by applying a first reordering process to the motion candidate list after the processing procedure; and performing the conversion based on the reordered motion candidate list, wherein if the at least one motion candidate in the motion candidate list is modified by a motion refinement process for the target block, the motion candidate list is reordered using refined motion information, or wherein the motion candidate list is not reordered before the first reordering process is applied.

2. The method of claim 1 , wherein the processing procedure comprises at least one of:

a modification process,

a motion refinement process, or

a second reordering process.

3. The method of claim 2 , wherein the second reordering process is applied to the motion candidate list before the first reordering process.

4. The method of claim 3 , wherein the motion candidate list is reordered using original motion information, during a construction of the motion candidate list in the second reordering process.

5. The method of claim 2 , wherein the motion refinement process comprises at least one of:

a template matching based motion refinement, or

a bilateral matching based motion refinement.

6. The method of claim 2 , wherein a simplified version of the motion refinement process is applied.

7. The method of claim 6 , wherein if a template matching is used as the motion refinement process, a template size is set to 1 or 2.

8. The method of claim 1 , wherein the processing procedure is a motion refinement process, and

wherein refined motion information used in the first reordering process is final motion information of the motion refinement process.

9. The method of claim 8 , wherein if the motion refinement process comprises a plurality of steps, motion information after a last step in the motion refinement process is used in the first reordering process.

10. The method of claim 9 , wherein the plurality of steps refine motion information at different resolutions of motion vector.

11. The method of claim 10 , wherein an integer resolution motion vector is refined to be a fractional resolution motion vector, or

wherein a fractional resolution motion vector is refined to be a fractional resolution motion vector, or

wherein the different resolutions comprise at least one of: 16-pel, 8-pel, 4-pel, 2-pel, 1-pel, ½-pel, ¼-pel, ⅛-pel, 1/16-pel, 1/32-pel, or 1/64-pel.

12. The method of claim 9 , wherein the plurality of steps comprises different searching shapes to refine the motion vector in a template matching.

13. The method of claim 12 , wherein motion information after a step of diamond searching shape of the template matching is used in the first reordering process.

14. The method of claim 9 , wherein a resolution of motion vector to be used is dependent on a syntax element indicating the resolution of motion vector of a motion candidate, or

wherein if early termination is used in the motion refinement process, motion information output related to the early termination is used in the first reordering process.

15. The method of claim 1 , wherein a plurality of motion refinement processes are applied to the target block, and the plurality of motion refinement processes are applied in order, and

wherein motion information derived after a last motion refinement process is used in the first reordering process.

16. The method of claim 1 , wherein the conversion includes encoding the target block into the bitstream, or

wherein the conversion includes decoding the target block from the bitstream.

17. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to perform acts comprising: applying, during a conversion between a target block of a video and a bitstream of the target block, a processing procedure to at least one motion candidate in a motion candidate list; reordering the motion candidate list by applying a first reordering process to the motion candidate list after the processing procedure; and performing the conversion based on the reordered motion candidate list, wherein if the at least one motion candidate in the motion candidate list is modified by a motion refinement process for the target block, the motion candidate list is reordered using refined motion information, or wherein the motion candidate list is not reordered before the first reordering process is applied.

18. A non-transitory computer-readable storage medium storing instructions that cause a processor to perform acts comprising: applying, during a conversion between a target block of a video and a bitstream of the target block, a processing procedure to at least one motion candidate in a motion candidate list; reordering the motion candidate list by applying a first reordering process to the motion candidate list after the processing procedure; and performing the conversion based on the reordered motion candidate list, wherein if the at least one motion candidate in the motion candidate list is modified by a motion refinement process for the target block, the motion candidate list is reordered using refined motion information, or wherein the motion candidate list is not reordered before the first reordering process is applied.

19. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises: applying a processing procedure to at least one motion candidate in a motion candidate list for the target block; reordering the motion candidate list by applying a first reordering process to the motion candidate list after the processing procedure; and generating a bitstream of the target block based on the reordered motion candidate list, wherein if the at least one motion candidate in the motion candidate list is modified by a motion refinement process for the target block, the motion candidate list is reordered using refined motion information, or wherein the motion candidate list is not reordered before the first reordering process is applied.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2025
From: WANG, YANG
To: BEIJING OCEAN ENGINE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 072299/0755 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2025
From: ZHANG, KAI; ZHANG, LI
To: BYTEDANCE INC.
Reel/Frame 072299/0797 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2025
From: ZHANG, NA; LIU, HONGBIN
To: BEIJING ZITIAO NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 072299/0850 →
Priority Claims (1)
WO PCT/CN2021/135449 · Dec 3, 2021 · international
Continuity (2)
Continuation PCTCN2022136321 · Dec 2, 2022
Related Publication 20240323352A1 · Sep 26, 2024
References Cited (31)
US 11606566B2 · Lee · 2023 [cited by examiner]
US 11706409B2 · Zhang · 2023 [cited by examiner]
US 11800090B2 · Zhang · 2023 [cited by examiner]
US 11895321B2 · Zhang · 2024 [cited by examiner]
US 11936899B2 · Zhang · 2024 [cited by examiner]
US 12015762B2 · Sethuraman · 2024 [cited by examiner]
US 12069289B2 · Chuang · 2024 [cited by examiner]
US 20190342557A1 · Robert et al. · 2019 [cited by applicant]
US 20200068218A1 · Chen · 2020 [cited by examiner]
US 20200296414A1 · Park et al. · 2020 [cited by applicant]
US 20210014522A1 · Jung · 2021 [cited by examiner]
US 20210037238A1 · Park · 2021 [cited by examiner]
US 20210120262A1 · Chen · 2021 [cited by examiner]
US 20240364904A1 · Kang · 2024 [cited by examiner]
CN 110313180A · 2019 [cited by applicant]
CN 110662030A · 2020 [cited by applicant]
CN 113273186A · 2021 [cited by applicant]
CN 113330739A · 2021 [cited by applicant]
CN 114175656A · 2022 [cited by applicant]
GB 2611367A · 2023 [cited by applicant]
WO 2019066602A1 · 2019 [cited by applicant]
WO 2019244669A1 · 2019 [cited by applicant]
Chen et al., “Algorithm Description of Joint Exploration Test Model 7 (JEM 7)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 7th Meeting: Torino, IT, Jul. 2017, pp. 1-50. [cited by applicant]
Esenlik et al., “CE9: DMVR with Bilateral Matching (Test2.9)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 11th Meeting: Ljubljana, SI, Jul. 2018, pp. 1-5. [cited by applicant]
International Search Report for PCT/CN2023/084741, mailed Jul. 7, 2023, 4 pages. [cited by applicant]
International Search Report for PCT/CN2023/087694, mailed May 22, 2023, 4 pages. [cited by applicant]
Park et al., “CE9: Template matching based reordering and refining (CE9-3.7, CE9-3.8 and CE9-4.1)”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WVG 11 11th Meeting: Ljubljana, SL, Jul… [cited by applicant]
Zhang et al., “AHG12: Adaptive Reordering of Merge Candidates with Template Matching”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29 22nd Meeting, by teleconference, Apr. 2021, pp. 1-4. [cited by applicant]
Zhang, Na., “CE9.4.3: Template Matching based Adaptive Merge Candidate Reorder”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 11th Meeting: Ljubljana, SI, Jul. 2018, pp. 1-4. [cited by applicant]
International Search Report for PCT/CN2022/136321, mailed Feb. 16, 2023, 5 pages. [cited by applicant]
Office Action for Japanese Patent Application No. 2024-533129, mailed on Aug. 5, 2025, 8 pages. [cited by applicant]