Methods and systems for motion vector filtering
Systems and methods are herein provided for motion vector filtering to reduce hole size. In one example, a method comprises determining presence of one or more holes in an outputted image, wherein the outputted image was generated based on one or more motion vector (MV) fields and depth fields; determining a local foreground MV field and depth field for each pixel of the outputted image; defining a hole MV field based on the local foreground MV field; filter the hole MV field along its motion trajectory to reduce size of the one or more holes; and outputting a filtered image with one or more smaller holes.
1 . A method, comprising:
determining presence of one or more holes in an outputted image, wherein the outputted image was generated based on one or more motion vector (MV) fields and depth fields;
determining a local foreground MV field and depth field for each pixel of the outputted image;
defining a hole MV field based on the local foreground MV field;
filter the hole MV field along its motion trajectory to reduce size of the one or more holes; and
outputting a filtered image with one or more smaller holes.
2 . The method of claim 1 , further comprising performing an inpainting algorithm on the filtered image to fill the one or more smaller holes.
3 . The method of claim 1 , wherein filtering the hole MV field along its motion trajectory comprises determining an MV at a projected position for each step along the motion trajectory.
4 . The method of claim 3 , wherein filtering the hole MV field further comprises comparing an MV of a given pixel and the MV at the projected position of that pixel in the outputted image to determine which MVs to filter.
5 . The method of claim 4 , further comprising determining foreground and background relationship between the MV of the given pixel and the MV at the projected position.
6 . The method of claim 1 , wherein filtering the hole MV field along its motion trajectory comprises accumulating MVs within a specified range to determine a filtered MV field.
7 . The method of claim 6 , wherein the filtered MV field comprises the one or more smaller holes.
8 . The method of claim 6 , further comprising performing foreground MV dilation on the filtered MV field.