System for reducing noise in video processing
A system includes a data storage configured to store a model human visual system, an input module configured to receive an original picture in a video sequence and to receive a reference picture, and a processor. The processor is configured to create a pixel map of the original picture using the model human visual system. A first layer is determined from the pixel map. A weighting map is determined from a motion compensated difference between the original picture and the reference picture. A processed picture is then determined from the original picture using the weighting map and the first layer.
1. A system for reducing noise in video processing, the system comprising:
a data storage configured to store a model human visual system;
an input module configured to receive an original picture in a video sequence and to receive a reference picture in the video sequence;
a processor configured to:
create a pixel map of the original picture using the model human visual system;
determine a first layer from the pixel map using the model human visual system;
determine a motion compensated difference between the original picture and the reference picture,
determine a weighting map from the motion compensated difference between the original picture and the reference picture, wherein the weighting map includes a value for each pixel based on a model of human temporal perceptibility; and
determine a processed picture from the original picture by recombining the first layer with the weighting map,
wherein the first layer goes beyond a noise layer that includes additive noise and is made up of a spatial detail layer including a value for each pixel based on a model of human spatial perceptibility.
2. The system of claim 1 , wherein
the processor is configured to determine the processed picture by cleaning the original picture using the weighting map and the noise layer, wherein the cleaned picture has a reduced amount of noise compared to the original picture.
3. The system of claim 2 , wherein the processor is configured to clean the original picture by
forming a modified layer using the noise layer and the motion compensated weighting map, wherein the modified layer includes a value for each pixel in the modified layer based on the model of human spatial perceptibility, and each value in the modified layer indicates a level of difficulty for compressing and perceiving the pixel; and
determining the cleaned picture by subtracting pixels in the modified layer from pixels in the original picture to eliminate data that is difficult-to-compress and difficult-to-perceive.
4. The system of claim 1 , wherein the weighting map is determined using the original picture, the processed version of the original picture, the reference picture, and a processed version of the reference picture.
5. The system of claim 4 , wherein the weighting map is determined using a reference weighting map.
6. The system of claim 4 , wherein the weighting map is determined using a second processed version of the original picture and a second processed version of the original picture.
7. The system of claim 6 , wherein the weighting map is determined using a reference weighting map.
8. The system of claim 1 , wherein when the first layer comprises a spatial detail layer
the processor is configured to determine the processed picture by modifying the original picture using the weighting map and the spatial detail layer, wherein the modified picture includes reduced amounts of adapted details.
9. The system of claim 8 , wherein the processor is configured to modify the original picture by
forming a modified detail layer using the spatial detail layer and the weighting map, wherein the modified detail layer includes a value for each pixel in the modified detail layer based on a model of human perceptibility, and each value in the modified detail layer indicates a level of difficulty for compressing and perceiving the pixel; and
determine the modified picture by subtracting pixels in the modified detail layer from pixels in the original picture to eliminate data that is difficult-to-compress and difficult-to-perceive.
10. The system of claim 9 , wherein the weighting map is configured to preserve predetermined details and to selectively attenuate targeted details, wherein the targeted details are simultaneously difficult-to-perceive and difficult-to-compress; and
wherein values in the modified detail layer indicate the targeted details.
11. A method for improving human visual perception in video processing:
receiving an original picture in a video sequence;
creating a pixel map of the original picture using a model human visual system;
determining a first layer from the pixel map;
receiving a reference picture in the video sequence;
determining a motion compensated difference between the original picture and the reference picture,
determining a weighting map from the motion compensated difference between the original picture and the reference picture, wherein the weighting map includes a value for each pixel based on a model of human temporal perceptibility; and
determining a processed picture from the original picture by recombining the first layer with the weighting motion compensated map,
wherein the first layer goes beyond a noise layer that includes additive noise and is made up of a spatial detail layer including a value for each pixel based on a model of human spatial perceptibility.
12. The method of claim 11 , wherein
determining the processed picture comprises cleaning the original picture using the weighting map and the noise layer, wherein the cleaned picture has a reduced amount of noise compared to the original picture.
13. The method of claim 12 , wherein cleaning the original picture comprises:
forming a modified noise layer using the noise layer and the motion compensated weighting map, wherein the modified noise layer includes a value for each pixel in the modified noise layer based on the model of human spatial perceptibility, and each value in the modified noise layer indicates a level of difficulty for compressing and perceiving the pixel; and
determining the cleaned picture by subtracting pixels in the modified noise layer from pixels in the original picture to eliminate data that is difficult-to-compress and difficult-to-perceive.
14. The method of claim 11 , wherein
determining the processed picture comprises modifying the original picture using the weighting map and the spatial detail layer, wherein the modified picture includes reduced amounts of adapted details.
15. The method of claim 14 , wherein modifying the original picture comprises:
forming a modified detail layer using the spatial detail layer and the motion compensated weighting map, wherein the modified detail layer includes a value for each pixel in the modified detail layer based on a model of human perceptibility, and each value in the modified detail layer indicates a level of difficulty for compressing and perceiving the pixel; and
determining the modified picture by subtracting pixels in the modified detail layer from pixels in the original picture to eliminate data that is difficult-to-compress and difficult-to-perceive.
16. The method of claim 11 , wherein determining the motion compensated weighting map comprises:
determining for each pixel the level of perceptibility, wherein the level of perceptibility is in a range from low perceptibility to high perceptibility; and
determining values for the pixels based on the level of perceptibility.