IP Library › Granted Patent US 11,792,406
Granted Patent B2
US 11,792,406 · App. 17/729,404 · Granted Oct 17, 2023

Symmetric motion vector difference coding

Inventors: Hongbin Liu (Beijing, CN); Li Zhang (San Diego, CA); Kai Zhang (San Diego, CA); Zhipin Deng (Beijing, CN); Yue Wang (Beijing, CN)
Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD; BYTEDANCE INC.
H04N19/137H04N19/105H04N19/176H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,792,406
App. No.
17/729,404
Granted
Oct 17, 2023
Kind
B2
Abstract

Symmetric motion vector difference coding is described. One example video processing method includes determining, for a conversion between a block of a current picture of video and a bitstream representation of the block, whether a symmetric motion vector difference (SMVD) mode is allowable for the block, wherein whether the SMVD mode is allowable depends on a derivation process of two target reference pictures of the current picture, which includes a first step for searching a forward target reference picture in the reference picture list 0 and searching a backward target reference picture in the reference picture list 1, and a second step for searching a backward target reference picture in the reference picture list 0 and searching a forward target reference picture in the reference picture list 1, outputs of the first step and the second step being independent of each other; and performing the conversion based on the determination.

Claims (52)

1. A method of processing video data, comprising:

determining, for a conversion between a block of a current picture of a video and a bitstream of the video, that a first coding mode is applied to the block based on a derivation process of two target reference pictures of the current picture, wherein the derivation process includes:

performing a first step for searching a forward target reference picture in a reference picture list 0 and searching a backward target reference picture in a reference picture list 1, wherein target reference picture indices in both the reference picture list 0 and the reference picture list 1 are initialized to be unavailable;

keeping a target reference picture index in one of the reference picture list 0 and the reference picture list 1 unavailable due to the forward target reference picture or the backward target reference picture not being found in the one of the reference picture list 0 and the reference picture list 1 in the first step;

resetting a target reference picture index in another of the reference picture list 0 and the reference picture list 1 available due to the forward target reference picture or the backward target reference picture being found in the another of the reference picture list 0 and the reference picture list 1 in the first step;

resetting both the target reference picture indices to be unavailable before a second step is invoked due to the target reference picture index in the one of the reference picture list 0 and the reference picture list 1 being unavailable; and

performing the second step for searching a backward target reference picture in the reference picture list 0 and searching a forward target reference picture in the reference picture list 1; and

performing the conversion based on the determination,

wherein in the first coding mode, a syntax structure indicating a motion vector difference of a reference picture list X is not present in the bitstream, and the motion vector difference of the reference picture list X is derived based on a motion vector difference of a reference picture list (1-X), wherein X is equal to 0 or 1.

2. The method of claim 1 , wherein resetting both the target reference picture indices to be unavailable comprises resetting both RefIdxSymL0 and RefIdxSymL1 to −1, wherein RefIdxSymL0 indicates the target reference picture index in the reference picture list 0 and RefIdxSymL1 indicates the target reference picture index in the reference picture list 1.

3. The method of claim 1 , wherein whether the first coding mode is allowable depends on whether both the target reference pictures are found in one step of the first step and the second step.

4. The method of claim 3 , wherein when both the target reference pictures are found in the first step, the first coding mode is allowed.

5. The method of claim 3 , wherein when both the target reference pictures are found in the second step, the first coding mode is allowed.

6. The method of claim 3 , wherein when at least one of the two target reference pictures are not found in the first step and at least one of the two target reference pictures are not found in the second step, the first coding mode is disallowed.

7. The method of claim 1 , wherein a picture order of the forward target reference picture is smaller than a picture order of the current picture and a picture order of the backward target reference picture is larger than the picture order of the current picture.

8. The method of claim 1 , wherein the conversion includes decoding the block of video from the bitstream.

9. The method of claim 1 , wherein the conversion includes encoding the block of video into the bitstream.

10. An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

determine, for a conversion between a block of a current picture of a video and a bitstream of the video, that a first coding mode is applied to the block based on a derivation process of two target reference pictures of the current picture, wherein the derivation process includes:

performing a first step for searching a forward target reference picture in a reference picture list 0 and searching a backward target reference picture in a reference picture list 1, wherein target reference picture indices in both the reference picture list 0 and the reference picture list 1 are initialized to be unavailable;

keeping a target reference picture index in one of the reference picture list 0 and the reference picture list 1 unavailable due to the forward target reference picture or the backward target reference picture not being found in the one of the reference picture list 0 and the reference picture list 1 in the first step;

resetting a target reference picture index in another of the reference picture list 0 and the reference picture list 1 available due to the forward target reference picture or the backward target reference picture being found in the another of the reference picture list 0 and the reference picture list 1 in the first step;

resetting both the target reference picture indices to be unavailable before a second step is invoked due to the target reference picture index in the one of the reference picture list 0 and the reference picture list 1 being unavailable; and

performing the second step for searching a backward target reference picture in the reference picture list 0 and searching a forward target reference picture in the reference picture list 1; and

perform the conversion based on the determination,

wherein in the first coding mode, a syntax structure indicating a motion vector difference of a reference picture list X is not present in the bitstream, and the motion vector difference of the reference picture list X is derived based on a motion vector difference of a reference picture list (1-X), wherein X is equal to 0 or 1.

11. The apparatus of claim 10 , wherein resetting both the target reference picture indices to be unavailable comprises resetting both RefIdxSymL0 and RefIdxSymL1 to −1, wherein RefIdxSymL0 indicates the target reference picture index in the reference picture list 0 and RefIdxSymL1 indicates the target reference picture index in the reference picture list 1.

12. The apparatus of claim 10 , wherein whether the first coding mode is allowable depends on whether both the target reference pictures are found in one step of the first step and the second step.

13. The apparatus of claim 12 , wherein when both the target reference pictures are found in the first step, the first coding mode is allowed.

14. The apparatus of claim 12 , wherein when both the target reference pictures are found in the second step, the first coding mode is allowed.

15. The apparatus of claim 12 , wherein when at least one of the two target reference pictures are not found in the first step and at least one of the two target reference pictures are not found in the second step, the first coding mode is disallowed.

16. The apparatus of claim 10 , wherein a picture order of the forward target reference picture is smaller than a picture order of the current picture and a picture order of the backward target reference picture is larger than the picture order of the current picture.

17. A non-transitory computer-readable storage medium storing instructions that cause a processor to:

determine, for a conversion between a block of a current picture of a video and a bitstream of the video, that a first coding mode is applied to the block based on a derivation process of two target reference pictures of the current picture, wherein the derivation process includes:

performing a first step for searching a forward target reference picture in a reference picture list 0 and searching a backward target reference picture in a reference picture list 1, wherein target reference picture indices in both the reference picture list 0 and the reference picture list 1 are initialized to be unavailable;

keeping a target reference picture index in one of the reference picture list 0 and the reference picture list 1 unavailable due to the forward target reference picture or the backward target reference picture not being found in the one of the reference picture list 0 and the reference picture list 1 in the first step;

resetting a target reference picture index in another of the reference picture list 0 and the reference picture list 1 available due to the forward target reference picture or the backward target reference picture being found in the another of the reference picture list 0 and the reference picture list 1 in the first step;

resetting both the target reference picture indices to be unavailable before a second step is invoked due to the target reference picture index in the one of the reference picture list 0 and the reference picture list 1 being unavailable; and

performing the second step for searching a backward target reference picture in the reference picture list 0 and searching a forward target reference picture in the reference picture list 1; and

perform the conversion based on the determination,

wherein in the first coding mode, a syntax structure indicating a motion vector difference of a reference picture list X is not present in the bitstream, and the motion vector difference of the reference picture list X is derived based on a motion vector difference of a reference picture list (1-X), wherein X is equal to 0 or 1.

18. The non-transitory computer-readable storage medium of claim 17 , wherein resetting both the target reference picture indices to be unavailable comprises resetting both RefIdxSymL0 and RefIdxSymL1 to −1, wherein RefIdxSymL0 indicates the target reference picture index in the reference picture list 0 and RefIdxSymL1 indicates the target reference picture index in the reference picture list 1.

19. The non-transitory computer-readable storage medium of claim 17 , wherein a picture order of the forward target reference picture is smaller than a picture order of the current picture and a picture order of the backward target reference picture is larger than the picture order of the current picture.

20. A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

determining, for a block of a current picture of the video, that a first coding mode is applied to the block based on a derivation process of two target reference pictures of the current picture, wherein the derivation process includes:

performing a first step for searching a forward target reference picture in a reference picture list 0 and searching a backward target reference picture in a reference picture list 1, wherein target reference picture indices in both the reference picture list 0 and the reference picture list 1 are initialized to be unavailable;

keeping a target reference picture index in one of the reference picture list 0 and the reference picture list 1 unavailable due to the forward target reference picture or the backward target reference picture not being found in the one of the reference picture list 0 and the reference picture list 1 in the first step;

resetting a target reference picture index in another of the reference picture list 0 and the reference picture list 1 available due to the forward target reference picture or the backward target reference picture being found in the another of the reference picture list 0 and the reference picture list 1 in the first step;

resetting both the target reference picture indices to be unavailable before a second step is invoked due to the target reference picture index in the one of the reference picture list 0 and the reference picture list 1 being unavailable; and

performing the second step for searching a backward target reference picture in the reference picture list 0 and searching a forward target reference picture in the reference picture list 1; and

generating the bitstream based on the determination,

wherein in the first coding mode, a syntax structure indicating a motion vector difference of a reference picture list X is not present in the bitstream, and the motion vector difference of the reference picture list X is derived based on a motion vector difference of a reference picture list (1-X), wherein X is equal to 0 or 1.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2022
From: ZHANG, LI; ZHANG, KAI
To: BYTEDANCE INC.
Reel/Frame 059751/0906 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2022
From: LIU, HONGBIN; DENG, ZHIPIN; WANG, YUE
To: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD.
Reel/Frame 059751/0953 →
Priority Claims (3)
WO PCT/CN2019/084768 · Apr 28, 2019 · international
WO PCT/CN2019/087201 · May 16, 2019 · international
WO PCT/CN2019/094954 · Jul 5, 2019 · international
Continuity (3)
Continuation 17411204 · Aug 25, 2021
Continuation PCTCN2020087551 · Apr 28, 2020
Related Publication 20220272354A1 · Aug 25, 2022