Method and apparatus for estimating noise in a video signal
View Patent ↗A method and system for detecting and estimating noise in a video signal. For example, detail edges may be identified in a plurality of pixels, wherein each detail edge has an edge magnitude value. The detail edges in the plurality of pixels may be identified by: determining one or more directionality values for the plurality of pixels by passing the input video signal through at least one directional filter, and identifying the detail edges by assigning edge magnitude values based on whether the one or more directionality values exceed predetermined threshold levels. An edge map of the detail edges may be created, where the edge map is configured to indicate areas of the plurality of pixels to be considered or ignored in estimating the noise in the input video signal. The noise in the input video signal may then be estimated based on the indicated areas of the edge map.
1. A method for estimating noise in an input video signal, the method comprising:
receiving an input video signal, wherein the input video signal comprises a plurality of pixels;
identifying one or more detail edges in the plurality of pixels, wherein identifying the one or more detail edges in the plurality of pixels comprises
determining one or more directional output values for the plurality of pixels by passing the input video signal through at least one directional filter, and
comparing the one or more directional output values with one or more of a first threshold and a second threshold to determine which pixels of the plurality of pixels are part of the one or more detail edges, and
assigning a value to each pixel determined to be a part of the one or more detail edges;
creating an edge map based on the pixels of the plurality of pixels determined to be a part of the one or more detail edges
comparing the values of the pixels in the edge map to a third threshold;
creating a binary map based on the comparison of the values of the pixels in the edge map to the third threshold, wherein the binary map indicates which pixels of the pixels are valuable for estimating the noise in the input video signal; and
estimating the noise in the input video signal based on the pixels indicated in the binary map as being valuable for estimating the noise in the input video signal.
2. The method of claim 1 , wherein the pixels indicated in the binary map as being valuable for estimating the noise in the input video signal are in homogenous areas in the input video signal.
3. The method of claim 1 , wherein the pixels indicated in the binary map as being valuable for estimating the noise in the input video signal are indicated by a value of 1 in the binary map.
4. The method of claim 1 , wherein the at least one directional filter comprises a horizontal directional filter, a vertical directional filter, and a diagonal direction filter.
5. The method of claim 4 , wherein:
the horizontal directional filter, the vertical directional filter, and the diagonal directional filter are configured to respectively generate outputs h1, h2, and h3; and
the one or more directional output values comprise
i) a difference value for a given pixel calculated according to
max( h 1 ,h 2 ,h 3)−min( h 1 ,h 2 ,h 3),
where max(h1, h2, h3) is a maximum magnitude of the outputs h1, h2, and h3 for the given pixel and min(h1, h2, h3) is a minimum magnitude of the outputs h1, h2, and h3 for the given pixel, and
ii) a variance calculated according to
Σ(max( h 1 ,h 2 ,h 3)−min( h 1 ,h 2 ,h 3)).
6. The method of claim 5 , wherein:
the predetermined threshold levels comprise a variance threshold level and a difference threshold level; and
i) if the variance exceeds the variance threshold level or the difference value exceeds the difference threshold level, a high magnitude value is assigned to a detail edge,
ii) otherwise, the detail edge is assigned a low magnitude value, wherein the low magnitude value is lower than the high magnitude value.
7. The method of claim 6 , wherein the high magnitude value is max(h1, h2, h3), and wherein the low magnitude value is min(h1, h2, h3).
8. The method of claim 4 , wherein each of the horizontal directional filter, the vertical directional filter, and the diagonal directional filter is a high-pass filter.
9. The method of claim 1 , further comprising:
expanding the detail edges in the edge map, including
for an identified detailed edge in the edge map, selecting additional pixels surrounding the identified detail edge to be included as part of the identified detail edge.
10. A system for estimating noise in an input video signal, the system comprising:
at least one directional filter configured to receive the input video signal and to produce an output indicating a directionality of the input video signal;
a low activity region detector configured to perform operations including
receiving an input video signal, wherein the input video signal comprises a plurality of pixels,
identifying one or more detail edges in the plurality of pixels, wherein identifying the one or more detail edges in the plurality of pixels comprises
determining one or more directional output values for the plurality of pixels by passing the input video signal through at least one directional filter, and
comparing the one or more directional output values with one or more of a first threshold and a second threshold to determine which pixels of the plurality of pixels are part of the one or more detail edges, and
assigning a value to each pixel determined to be a part of the one or more detail edges;
creating an edge map based on the pixels of the plurality of pixels determined to be a part of the one or more detail edge
comparing the values of the pixels in the edge map to a third threshold;
creating a binary map based on the comparison of the values of the pixels in the edge map to the third threshold, wherein the binary map indicates which pixels of the pixels are valuable for estimating the noise in the input video signal; and
a noise estimating module configured to estimate the noise in the input video signal based on the pixels indicated in the binary map as being valuable for estimating the noise in the input video signal.
11. The system of claim 10 , wherein the pixels indicated in the binary map as being valuable for estimating the noise in the input video signal are in homogenous areas in the input video signal.
12. The system of claim 10 , wherein the pixels indicated in the binary map as being valuable for estimating the noise in the input video signal are indicated by a value of 1 in the binary map.
13. The system of claim 10 , wherein the at least one directional filter comprises a horizontal directional filter, a vertical directional filter, and a diagonal directional filter.
14. The system of claim 13 , wherein:
the horizontal directional filter, the vertical directional filter, and the diagonal directional filter are respectively configured to generate outputs h1, h2, and h3; and
the one or more directional output values comprise
i) a difference value for a given pixel calculated according to
max( h 1 ,h 2 ,h 3)−min( h 1 ,h 2 ,h 3),
where max(h1, h2, h3) is a maximum magnitude of the outputs h1, h2, and h3 for the given pixel and min(h1, h2, h3) is a minimum magnitude of the outputs h1, h2, and h3 for the given pixel, and
ii) a variance calculated according to
Σ(max( h 1 ,h 2 ,h 3)−min( h 1 ,h 2 ,h 3)) 2 .
15. The system of claim 14 , wherein:
the predetermined threshold levels comprise a variance threshold level and a difference threshold level; and
i) if the variance exceeds the variance threshold level or the difference value exceeds the difference threshold level, a high magnitude value is assigned to a detail edge,
ii) otherwise, the detail edge is assigned a low magnitude value, wherein the low magnitude value is lower than the high magnitude value.
16. The system of claim 15 , wherein the high magnitude value is max(h1, h2, h3), and wherein the low magnitude value is min(h1, h2, h3).
17. The system of claim 13 , wherein each of the horizontal directional filter, the vertical directional filter, and the diagonal directional filter is a high-pass filter.
18. The system of claim 10 , wherein the low activity region detector is further configured to perform operations including:
expanding the detail edges in the edge map, including
for an identified detailed edge in the edge map, selecting additional pixels surrounding the identified detail edge to be included as part of the identified detail edge.