IP Library › Granted Patent US 11,206,422
Granted Patent B2
US 11,206,422 · App. 17/060,011 · Granted Dec 21, 2021

Video image processing method and device

Inventors: Xiaozhen Zheng (Shenzhen, CN); Suhong Wang (Beijing, CN); Shanshe Wang (Beijing, CN); Siwei Ma (Beijing, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
H04N19/513H04N19/12H04N19/136H04N19/176H04N19/587
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,206,422
App. No.
17/060,011
Granted
Dec 21, 2021
Kind
B2
Abstract

A video image processing method includes determining a current image block and, in response to a size of the current image block meeting a preset condition, determining a temporal candidate motion vector of the current image block according to at least one of a temporal motion vector prediction (TMVP) operation or an advanced/alternative temporal motion vector prediction (ATMVP) operation.

Claims (66)

1. A video image processing method comprising:

determining a current image block;

constructing a motion information candidate list for the current image block, the motion information candidate list being of a first type of mode or a second type of mode; and

determining a predicted image block of the current image block, including:

in response to the motion information candidate list being of the first type of mode, determining the predicted image block according to selected motion information from the motion information candidate list of the first type of mode; and

in response to the motion information candidate list being of the second type of mode:

searching for revised motion information by using selected motion information from the motion information candidate list of the second type of mode as a search starting point; and

determining the predicted image block according to the revised motion information;

wherein during a process of constructing the motion information candidate list, temporal motion vector prediction (TMVP) operation is turned off in response to a number of pixels of the current image block being smaller than or equal to 32, the TMVP operation including:

determining a relevant block of the current image block in a temporal neighboring image; and

determining a temporal candidate motion vector of the current image block according to a motion vector of the relevant block.

2. The video image processing method of claim 1 , wherein:

the temporal neighboring image includes a co-located frame of the current image block; and

the relevant block of the current image block includes a co-located block of the current image block.

3. The video image processing method of claim 1 , wherein the temporal neighboring image is a specified reference image of the current image block in a slice header.

4. The video image processing method of claim 1 , wherein determining the relevant block of the current image block in the temporal neighboring image in the TMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position in a current image containing the current image block to be the relevant block of the current image block.

5. The video image processing method of claim 4 , wherein the specified position includes a position at an upper left, an upper right, a lower left, or a lower right of the current image block.

6. The video image processing method of claim 1 , wherein determining the relevant block of the current image block in the temporal neighboring image in the TMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position spatially neighboring to the current image block to be the relevant block of the current image block.

7. The video image processing method of claim 6 , wherein the specified position spatially neighboring to the current image block includes a specified position in a current image containing the current image block and outside the current image block.

8. An encoder comprising:

a memory storing program instructions; and

a processor configured to execute the program instructions to:

determine a current image block;

construct a motion information candidate list for the current image block, the motion information candidate list being of a first type of mode or a second type of mode; and

determine a predicted image block of the current image block, including:

in response to the motion information candidate list being of the first type of mode, determining the predicted image block according to selected motion information from the motion information candidate list of the first type of mode; and

in response to the motion information candidate list being of the second type of mode:

searching for revised motion information by using selected motion information from the motion information candidate list of the second type of mode as a search starting point; and

determining the predicted image block according to the revised motion information;

wherein during a process of constructing the motion information candidate list, temporal motion vector prediction (TMVP) operation is turned off in response to a number of pixels of the current image block being smaller than or equal to 32, the TMVP operation including:

determining a relevant block of the current image block in a temporal neighboring image; and

determining a temporal candidate motion vector of the current image block according to a motion vector of the relevant block.

9. The encoder of claim 8 , wherein:

the temporal neighboring image includes a co-located frame of the current image block; and

the relevant block of the current image block includes a co-located block of the current image block.

10. The encoder of claim 8 , wherein determining the relevant block of the current image block in the temporal neighboring image in the TMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position in a current image containing the current image block to be the relevant block of the current image block.

11. The encoder of claim 10 , wherein the specified position includes a position at an upper left, an upper right, a lower left, or a lower right of the current image block.

12. The encoder of claim 8 , wherein determining the relevant block of the current image block in the temporal neighboring image in the TMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position spatially neighboring to the current image block to be the relevant block of the current image block.

13. The encoder of claim 12 , wherein the specified position spatially neighboring to the current image block includes a specified position in a current image containing the current image block and outside the current image block.

14. A decoder comprising:

a memory storing program instructions; and

a processor configured to execute the program instructions to:

determine a current image block;

construct a motion information candidate list for the current image block, the motion information candidate list being of a first type of mode or a second type of mode; and

determine a predicted image block of the current image block, including:

in response to the motion information candidate list being of the first type of mode, determining the predicted image block according to selected motion information from the motion information candidate list of the first type of mode; and

in response to the motion information candidate list being of the second type of mode:

searching for revised motion information by using selected motion information from the motion information candidate list of the second type of mode as a search starting point; and

determining the predicted image block according to the revised motion information;

wherein during a process of constructing the motion information candidate list, temporal motion vector prediction (TMVP) operation is turned off in response to a number of pixels of the current image block being smaller than or equal to 32, the TMVP operation including:

determining a relevant block of the current image block in a temporal neighboring image; and

determining a temporal candidate motion vector of the current image block according to a motion vector of the relevant block.

15. The decoder of claim 14 , wherein:

the temporal neighboring image includes a co-located frame of the current image block; and

the relevant block of the current image block includes a co-located block of the current image block.

16. The decoder of claim 14 , wherein the temporal neighboring image is a specified reference image of the current image block in a slice header.

17. The decoder of claim 14 , wherein determining the relevant block of the current image block in the temporal neighboring image in the TMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position in a current image containing the current image block to be the relevant block of the current image block.

18. The decoder of claim 17 , wherein the specified position in the current image block includes a position at an upper left, an upper right, a lower left, or a lower right of the current image block.

19. The decoder of claim 14 , wherein determining the relevant block of the current image block in the temporal neighboring image in the TMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position spatially neighboring to the current image block to be the relevant block of the current image block.

20. The decoder of claim 19 , wherein the specified position spatially neighboring to the current image block includes a specified position in a current image containing the current image block and outside the current image block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2020
From: ZHENG, XIAOZHEN; WANG, SUHONG; WANG, SHANSHE; MA, SIWEI
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 053941/0054 →
Priority Claims (1)
WO PCT/CN2019/070315 · Jan 3, 2019 · international
Continuity (2)
Continuation PCTCN2019077893 · Mar 12, 2019
Related Publication 20210021858A1 · Jan 21, 2021
Cited By (1)
US 12,695,899