IP Library › Granted Patent US 11,178,420
Granted Patent B2
US 11,178,420 · App. 17/060,001 · Granted Nov 16, 2021

Video image processing method and device

Inventors: Suhong Wang (Beijing, CN); Xiaozhen Zheng (Shenzhen, CN); Shanshe Wang (Beijing, CN); Siwei Ma (Beijing, CN)
Assignee: SZ DJI TECHNOLOGY CO., LTD.
H04N19/513H04N19/12H04N19/136H04N19/176H04N19/587
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,178,420
App. No.
17/060,001
Granted
Nov 16, 2021
Kind
B2
Abstract

A video image processing method includes determining a current image block and, in response to a size of the current image block meeting a preset condition, determining a temporal candidate motion vector of the current image block according to at least one of a temporal motion vector prediction (TMVP) operation or an advanced/alternative temporal motion vector prediction (ATMVP) operation.

Claims (70)

1. A video image processing method comprising:

determining a current image block; and

during a process of determining a temporal candidate motion vector of the current image block:

turning off temporal motion vector prediction (TMVP) operation in response to a number of pixels of the current image block being smaller than or equal to 32; and

turning off advanced/alternative temporal motion vector prediction (ATMVP) operation in response to a width of the current image block being smaller than 8 pixels or a height of the current image block being smaller than 8 pixels;

wherein the TMVP operation includes:

determining a relevant block of the current image block in a temporal neighboring image; and

determining the temporal candidate motion vector of the current image block according to a motion vector of the relevant block; and

wherein the ATMVP operation includes:

determining the relevant block of the current image block in the temporal neighboring image;

dividing the current image block into a plurality of sub-blocks, a size of each of the sub-blocks being 8 pixels×8 pixels;

for each of the sub-blocks, determining a corresponding relevant sub-block in the relevant block, a size of each of the relevant sub-blocks being 8 pixels×8 pixels; and

determining temporal candidate motion vectors of the sub-blocks of the current image block according to motion vectors of the relevant sub-blocks corresponding to the sub-blocks.

2. The video image processing method of claim 1 , wherein:

the temporal neighboring image includes a co-located frame of the current image block; and

the relevant block of the current image block includes a co-located block of the current image block.

3. The video image processing method of claim 1 , wherein determining the relevant block of the current image block in the temporal neighboring image in at least one of the TMVP operation or the ATMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position in a current image containing the current image block to be the relevant block of the current image block.

4. The video image processing method of claim 3 , wherein the specified position includes a position at an upper left, an upper right, a lower left, or a lower right of the current image block.

5. The video image processing method of claim 1 , wherein determining the relevant block of the current image block in the temporal neighboring image in at least one of the TMVP operation or the ATMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position spatially neighboring to the current image block to be the relevant block of the current image block.

6. The video image processing method of claim 5 , wherein the specified position spatially neighboring to the current image block includes a specified position in a current image containing the current image block and outside the current image block.

7. An encoder comprising:

a memory storing program instructions; and

a processor configured to execute the program instructions to:

determine a current image block; and

during a process of determining a temporal candidate motion vector of the current image block:

turn off temporal motion vector prediction (TMVP) operation in response to a number of pixels of the current image block being smaller than or equal to 32; and

turn off advanced/alternative temporal motion vector prediction (ATMVP) operation in response to a width of the current image block being smaller than 8 pixels or a height of the current image block being smaller than 8 pixels;

wherein the TMVP operation includes:

determining a relevant block of the current image block in a temporal neighboring image; and

determining the temporal candidate motion vector of the current image block according to a motion vector of the relevant block; and

wherein the ATMVP operation includes:

determining the relevant block of the current image block in the temporal neighboring image;

dividing the current image block into a plurality of sub-blocks, a size of each of the sub-blocks being 8 pixels×8 pixels;

for each of the sub-blocks, determining a corresponding relevant sub-block in the relevant block, a size of each of the relevant sub-blocks being 8 pixels×8 pixels; and

determining temporal candidate motion vectors of the sub-blocks of the current image block according to motion vectors of the relevant sub-blocks corresponding to the sub-blocks.

8. The encoder of claim 7 , wherein:

the temporal neighboring image includes a co-located frame of the current image block; and

the relevant block of the current image block includes a co-located block of the current image block.

9. The encoder of claim 7 , wherein determining the relevant block of the current image block in the temporal neighboring image in at least one of the TMVP operation or the ATMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position in a current image containing the current image block to be the relevant block of the current image block.

10. The encoder of claim 9 , wherein the specified position includes a position at an upper left, an upper right, a lower left, or a lower right of the current image block.

11. The encoder of claim 7 , wherein determining the relevant block of the current image block in the temporal neighboring image in at least one of the TMVP operation or the ATMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position spatially neighboring to the current image block to be the relevant block of the current image block.

12. The encoder of claim 11 , wherein the specified position spatially neighboring to the current image block includes a specified position in a current image containing the current image block and outside the current image block.

13. A decoder comprising:

a memory storing program instructions; and

a processor configured to execute the program instructions to:

determine a current image block; and

during a process of determining a temporal candidate motion vector of the current image block:

turn off temporal motion vector prediction (TMVP) operation in response to a number of pixels of the current image block being smaller than or equal to 32; and

turn off advanced/alternative temporal motion vector prediction (ATMVP) operation in response to a width of the current image block being smaller than 8 pixels or a height of the current image block being smaller than 8 pixels;

wherein the TMVP operation includes:

determining a relevant block of the current image block in a temporal neighboring image; and

determining the temporal candidate motion vector of the current image block according to a motion vector of the relevant block; and

wherein the ATMVP operation includes:

determining the relevant block of the current image block in the temporal neighboring image;

dividing the current image block into a plurality of sub-blocks, a size of each of the sub-blocks being 8 pixels×8 pixels;

for each of the sub-blocks, determining a corresponding relevant sub-block in the relevant block, a size of each of the relevant sub-blocks being 8 pixels×8 pixels; and

determining temporal candidate motion vectors of the sub-blocks of the current image block according to motion vectors of the relevant sub-blocks corresponding to the sub-blocks.

14. The decoder of claim 13 , wherein:

the temporal neighboring image includes a co-located frame of the current image block; and

the relevant block of the current image block includes a co-located block of the current image block.

15. The decoder of claim 13 , wherein determining the relevant block of the current image block in the temporal neighboring image in at least one of the TMVP operation or the ATMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position in a current image containing the current image block to be the relevant block of the current image block.

16. The decoder of claim 15 , wherein the specified position in the current image block includes a position at an upper left, an upper right, a lower left, or a lower right of the current image block.

17. The decoder of claim 13 , wherein determining the relevant block of the current image block in the temporal neighboring image in at least one of the TMVP operation or the ATMVP operation includes:

determining an image block at a same position in the temporal neighboring image as a specified position spatially neighboring to the current image block to be the relevant block of the current image block.

18. The decoder of claim 17 , wherein the specified position spatially neighboring to the current image block includes a specified position in a current image containing the current image block and outside the current image block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 30, 2020
From: WANG, SUHONG; ZHENG, XIAOZHEN; WANG, SHANSHE; MA, SIWEI
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 053940/0991 →
Continuity (2)
Continuation PCTCN2019070315 · Jan 3, 2019
Related Publication 20210021857A1 · Jan 21, 2021
Cited By (1)
US 12,695,899