Method, Apparatus, and Circuitry of Noise Reduction
A method of noise reduction is discloses. The method comprises identifying a plurality of candidate matching blocks in a reference frame for a current patch; obtaining at least one filtering result based on the plurality of candidate matching blocks; determining at least one reference block from a plurality of candidate motion vectors; and generating a de-noised patch for the current patch according to the at least one filtering result and the at least one reference block.
1 . A method of noise reduction, comprising:
identifying a plurality of candidate matching blocks in a reference frame for a current patch;
obtaining at least one filtering result based on a plurality of pixels of the plurality of candidate matching blocks;
determining at least one reference block from a plurality of candidate motion vectors; and
generating a de-noised patch for the current patch according to the at least one filtering result, a spatial noise reduction patch and a temporal noise reduction patch;
wherein the spatial noise reduction patch is with a spatial noise reduction score and the temporal noise reduction patch is with a temporal noise reduction score.
2 . The method of claim 1 , wherein the plurality of candidate matching blocks comprise a plurality of patch costs and the plurality of candidate motion vectors respectively corresponding to the plurality of candidate matching blocks.
3 . The method of claim 2 , wherein the patch cost is determined by at least one of a matching cost, a mean absolute difference (MAD), a sum of square difference (SSD) and a sum of absolute difference (SAD).
4 . The method of claim 2 , wherein the plurality of candidate motion vectors are determined by a reference patch in a search region of the reference frame and the current patch.
5 . The method of claim 4 , wherein each filtering result is generated based on the at least one candidate matching block and at least one current matching block, wherein the at least one current matching block is generated based on the plurality of patch costs and the plurality of candidate motion vectors.
6 . The method of claim 4 , wherein a size or a shape of the search region is arbitrary.
7 . The method of claim 4 , wherein each filtering result is generated based on the at least one candidate matching block, the plurality of patch costs and the plurality of candidate motion vectors.
8 . The method of claim 4 , wherein the reference patch is in a reference matching block and the current patch is in a current matching block, a size of the reference matching block is equal to or greater than the reference patch, and a size of the current matching block is equal to or greater than the current patch.
9 . The method of claim 8 , wherein the reference matching block and the current matching block are utilized for determining the plurality of candidate motion vectors.
10 . The method of claim 1 , wherein the reference frame is a current frame relative to the current patch and the current patch is generated by an identical capturing device or in an identical video sequence.
11 . The method of claim 1 , wherein the reference frame is a current frame relative to the current patch and the current patch is generated by different capturing device or in different video sequence.
12 . An apparatus for noise reduction, comprising:
a motion estimation unit, for identifying a plurality of candidate matching blocks in a reference frame for a current patch;
a filtering unit, for obtaining at least one filtering result based on a plurality of pixels of the plurality of candidate matching blocks;
a compensation unit, for determining at least one reference block from a plurality of candidate motion vectors; and
a noise reduction unit, for generating a de-noised patch for the current patch according to the at least one filtering result, a spatial noise reduction patch and a temporal noise reduction patch;
wherein the spatial noise reduction patch is with a spatial noise reduction score and the temporal noise reduction patch is with a temporal noise reduction score.
13 . The apparatus of claim 12 , wherein the plurality of candidate matching blocks comprise a plurality of patch costs and the plurality of candidate motion vectors respectively corresponding to the plurality of candidate matching blocks.
14 . The apparatus of claim 13 , wherein the patch cost is determined by at least one of a matching cost, a mean absolute difference (MAD), a sum of square difference (SSD) and a sum of absolute difference (SAD).
15 . The apparatus of claim 13 , wherein the plurality of candidate motion vectors are determined by a reference patch in a search region of the reference frame and the current patch.
16 . The apparatus of claim 15 , wherein each filtering result is generated based on the at least one candidate matching block and at least one current matching block, wherein the at least one current matching block is generated based on the plurality of patch costs and the plurality of candidate motion vectors.
17 . The apparatus of claim 15 , wherein a size or a shape of the search region is arbitrary.
18 . The apparatus of claim 15 , wherein each filtering result is generated based on the at least one candidate matching block, the plurality of patch costs and the plurality of candidate motion vectors.
19 . The apparatus of claim 15 , wherein the reference patch is in a reference matching block and the current patch is in a current matching block, a size of the reference matching block is equal to or greater than the reference patch, and a size of the current matching block is equal to or greater than the current patch.
20 . The apparatus of claim 19 , wherein the reference matching block and the current matching block are utilized for determining the plurality of candidate motion vectors.
21 . The apparatus of claim 12 , wherein the reference frame is a current frame relative to the current patch and the current patch is generated by an identical capturing device or in an identical video sequence.
22 . The apparatus of claim 12 , wherein the reference frame is a current frame relative to the current patch and the current patch is generated by different capturing device or in different video sequence.
23 . A circuitry for noise reduction, comprising:
a motion estimation circuit, for identifying a plurality of candidate matching blocks in a reference frame for a current patch;
a filter circuit, coupled to the motion estimation circuit, for obtaining at least one filtering result based on a plurality of pixels of the plurality of candidate matching blocks;
a motion compensation circuit, coupled to the motion estimation circuit, for determining at least one reference block from a plurality of candidate motion vectors; and
a noise reduction circuit, coupled to the motion estimation circuit and the motion compensation circuit, for generating a de-noised patch for the current patch according to the at least one filtering result, a spatial noise reduction patch and a temporal noise reduction patch;
wherein the spatial noise reduction patch is with a spatial noise reduction score and the temporal noise reduction patch is with a temporal noise reduction score.
24 . The circuitry of claim 23 , wherein the plurality of candidate matching blocks comprise a plurality of patch costs and the plurality of candidate motion vectors respectively corresponding to the plurality of candidate matching blocks.
25 . The circuitry of claim 24 , wherein the patch cost is determined by at least one of a matching cost, a mean absolute difference (MAD), a sum of square difference (SSD) and a sum of absolute difference (SAD).
26 . The circuitry of claim 24 , wherein the plurality of candidate motion vectors are determined by a reference patch in a search region of the reference frame and the current patch.
27 . The circuitry of claim 26 , wherein each filtering result is generated based on the at least one candidate matching block and at least one current matching block, wherein the at least one current matching block is generated based on the plurality of patch costs and the plurality of candidate motion vectors.
28 . The circuitry of claim 26 , wherein a size or a shape of the search region is arbitrary.
29 . The circuitry of claim 26 , wherein each filtering result is generated based on the at least one candidate matching block, the plurality of patch costs and the plurality of candidate motion vectors.
30 . The circuitry of claim 26 , wherein the reference patch is in a reference matching block and the current patch is in a current matching block, a size of the reference matching block is equal to or greater than the reference patch, and a size of the current matching block is equal to or greater than the current patch.
31 . The circuitry of claim 30 , wherein the reference matching block and the current matching block are utilized for determining the plurality of candidate motion vectors.
32 . The circuitry of claim 23 , wherein the reference frame is a current frame relative to the current patch and the current patch is generated by an identical capturing device or in an identical video sequence.
33 . The circuitry of claim 23 , wherein the reference frame is a current frame relative to the current patch and the current patch is generated by different capturing device or in different video sequence.