System and method for adaptive pixel filtering
View Patent ↗Various embodiments provide an optimized image filter. The optimized image and video obtains an input image and selects a target pixel for modification. Difference values are then determined between the selected target pixel and each reference pixel of a search area. Subsequently, a weighting function is used to determine weight values for each of the reference pixels of the search area based on their respective difference value. The selected target pixel is then modified by the optimized image filter using the determined weight values. A new target pixel in an apply patch is then selected for modification. The new target pixel is modified using the previously determined weight values reassigned to a new set of reference pixels. The previously determined weight values are reassigned to the new set of reference pixels based on each of the new set of reference pixels' position relative to the new target pixel.
1. A device, comprising:
an image sensor that in operation:
captures an image having a plurality of pixels; and
a processor coupled to the image sensor to filter the image, the processor in operation:
selects an apply patch of the image, the apply patch including first and second pixels of the plurality of pixels;
selects a search area of the image, the search area including at least a third pixel of the plurality of pixels;
determines a difference value between the first pixel and the third pixel based on the pixels surrounding the first pixel and the third pixel;
determines a weight value based on the difference value;
assigns the weight value to the third pixel;
modifies the first pixel with the weight value assigned to the third pixel;
selects a fourth pixel, the fourth pixel being adjacent to the third pixel;
assigns the weight value to the fourth pixel; and
modifies the second pixel with the weight value assigned to the fourth pixel.
2. The device of claim 1 wherein the processor in operation selects the second pixel to be immediately adjacent to the first pixel.
3. The device of claim 1 wherein the processor in operation selects the fourth pixel such that a position of the fourth pixel in the image relative to the third pixel is the same as a position of the second pixel in the image relative to the first pixel.
4. The device of claim 1 wherein the processor includes a finite impulse response filter that determines the weight value.
5. A method, comprising:
filtering an image having a plurality of pixels, the filtering including:
selecting a first target pixel in a first target area, the first target area including a first number of pixels of the plurality of pixels;
selecting a first reference pixel in a first reference area, the first reference area including the first number of pixels of the plurality of pixels;
determining difference values for each pixel in the first reference area with respect to the first target area;
determining weight values for each pixel in the first reference area based on the difference values;
modifying the first target pixel with the weight values from each pixel in the first reference area; and
modifying a second target pixel in the first target area with the weight values.
6. The method of claim 5 wherein the filtering includes modifying a third target pixel and a fourth target pixel in the first target area with the weight values.
7. The method of claim 6 wherein the first and second target pixels are adjacent to each other and the third and fourth target pixels being adjacent to each other and the second and third target pixels are adjacent to each other.
8. The method of claim 5 wherein the first target area overlaps and shares some pixels with the first reference area.
9. A method, comprising:
filtering an image by:
selecting an apply patch of the image, the apply patch including first and second pixels of the plurality of pixels, the second pixel being adjacent to the first pixel;
selecting a search area of the image, the search area including at least a third pixel of the plurality of pixels;
determining a difference value between the first pixel and the third pixel based on the pixels surrounding the first pixel and the third pixel;
determining a weight value based on the difference value;
modifying the first pixel with the weight value; and
modifying the second pixel with the weight value.
10. The method of claim 9 wherein filtering the image includes modifying a fourth pixel and a fifth pixel in the apply patch with the weight value.
11. The method of claim 10 wherein the fourth pixel and fifth pixels are adjacent to each other and adjacent to the first and second pixels.
12. The method of claim 9 wherein the determining of the weight value includes setting the weight value to a value that is inversely related to the difference value.
13. The method of claim 9 , further comprising selecting a target patch that includes the apply patch, selecting a reference patch that includes the third pixel, and determining the difference value from the pixels in the target patch and the reference patch.
14. The method of claim 9 wherein determining the difference value includes using a sum of absolute differences or a sum of squared differences.