Image processing device, image processing method and storage medium

1. An image processing device comprising:

image input unit that inputs picture signals comprising a plurality of frame images from outside;

processed frame storage unit that stores a processed frame image on which image processing has already been completed;

a processor which functions as:

processing pixel group determination unit that determines a to-be-processed pixel group from the plurality of frame images of the picture signals input from the image input unit based on a first predetermined rule and that determines a processed pixel group from the processed frame image stored in the processed frame storage unit based on a second predetermined rule;

frequency component processing unit that extracts at least a temporal frequency component from the to-be-processed pixel group and the processed pixel group determined by the processing pixel group determination unit, that executes predetermined coefficient processing on a temporal high-frequency component of the extracted temporal frequency component and that acquires the executed to-be-processed pixel group on which the predetermined coefficient processing has been executed; and

processing completion frame generation unit that generates a processing completion frame image from the executed to-be-processed pixel group acquired by the frequency component processing unit; and

image output unit that outputs to the outside the processing completion frame image generated by the processing completion frame generation unit and that stores, as the processed frame image, the processing completion frame image in the processed frame storage unit,

wherein the frequency component processing unit prevents the predetermined coefficient processing from being executed on a component having low sensitivity in visual characteristic included in the temporal high-frequency component,

wherein the predetermined coefficient processing is processing in which an absolute value of the frequency component and a predetermined threshold value are compared, and when the absolute value of the frequency component is more than the threshold value, the frequency component is maintained and when the absolute value of the frequency component is not more than the threshold value, a predetermined value is substituted for the frequency component.

2. An image processing device comprising:

image input unit that inputs picture signals comprising a plurality of frame images from outside;

processed frame storage unit that stores a processed frame image on which image processing has already been completed;

a processor which functions as:

processing pixel group determination unit that determines a to-be-processed pixel group from the plurality of frame images of the picture signals input from the image input unit based on a first predetermined rule and that determines a processed pixel group from the processed frame image stored in the processed frame storage unit based on a second predetermined rule;

frequency component processing unit that extracts a spatial frequency component and a temporal frequency component from the to-be-processed pixel group and the processed pixel group determined by the processing pixel group determination unit, that executes predetermined coefficient processing on a spatial low-frequency component and a spatial high-frequency component included in a temporal high-frequency component of the extracted temporal frequency component and that acquires the executed to-be-processed pixel group on which the predetermined coefficient processing has been executed; and

processing completion frame generation unit that generates a processing completion frame image from the executed to-be-processed pixel group acquired by the frequency component processing unit; and

image output unit that outputs to the outside the processing completion frame image generated by the processing completion frame generation unit and that stores, as the processed frame image, the processing completion frame image in the processed frame storage unit,

wherein the predetermined coefficient processing is processing in which an absolute value of the frequency component and a predetermined threshold value are compared, and when the absolute value of the frequency component is more than the threshold value, the frequency component is maintained and when the absolute value of the frequency component is not more than the threshold value, a predetermined value is substituted for the frequency component.

3. The image processing device of claim 2 ,

wherein the frequency component processing unit executes spatial frequency transformation on the to-be-processed pixel group and the processed pixel group to extract the spatial frequency component, and executes temporal frequency transformation on the extracted spatial frequency component to extract the temporal frequency component.

4. The image processing device of claim 1 ,

wherein the processing completion frame generation unit generates the processing completion frame image by combining a plurality of executed to-be-processed pixel groups such that, in plurality of executed to-be-processed pixel groups acquired by the frequency component processing unit, at least one or more pixels are superimposed on each other.

5. The image processing device of claim 2 ,

wherein the processing completion frame generation unit generates the processing completion frame image by combining a plurality of executed to-be-processed pixel groups such that, in plurality of executed to-be-processed pixel groups acquired by the frequency component processing unit, at least one or more pixels are superimposed on each other.

6. The image processing device of claim 3 ,

wherein the processing completion frame generation unit generates the processing completion frame image by combining a plurality of executed to-be-processed pixel groups such that, in plurality of executed to-be-processed pixel groups acquired by the frequency component processing unit, at least one or more pixels are superimposed on each other.

7. The image processing device of claim 1 ,

wherein the predetermined value substituted for the frequency component is zero.

8. An image processing method executed by an image processing device including processed frame storage unit that stores a processed frame image on which image processing has already been completed, the image processing method comprising:

an image input step of inputting picture signals comprising a plurality of frame images from outside;

a processing pixel group determination step of determining a to-be-processed pixel group from the plurality of frame images of the picture signals input from the image input unit based on a first predetermined rule and of determining a processed pixel group from the processed frame image stored in the processed frame storage unit based on a second predetermined rule;

a frequency component processing step of extracting at least a temporal frequency component from the to-be-processed pixel group and the processed pixel group determined by the processing pixel group determination step, of executing predetermined coefficient processing on a temporal high-frequency component of the extracted temporal frequency component and of acquiring the executed to-be-processed pixel group on which the predetermined coefficient processing has been executed;

a processing completion frame generation step of generating a processing completion frame image from the executed to-be-processed pixel group acquired by the frequency component processing step; and

an image output step of outputting to the outside the processing completion frame image generated by the processing completion frame generation step and of storing, as the processed frame image, the processing completion frame image in the processed frame storage unit,

wherein the frequency component processing step prevents the predetermined coefficient processing from being executed on a component having low sensitivity in visual characteristic included in the temporal high-frequency component,

wherein the predetermined coefficient processing is processing in which an absolute value of the frequency component and a predetermined threshold value are compared, and when the absolute value of the frequency component is more than the threshold value, the frequency component is maintained and when the absolute value of the frequency component is not more than the threshold value, a predetermined value is substituted for the frequency component.

9. An image processing method executed by an image processing device including processed frame storage unit that stores a processed frame image on which image processing has already been completed, the image processing method comprising:

an image input step of inputting picture signals comprising a plurality of frame images from outside;

a processing pixel group determination step of determining a to-be-processed pixel group from the plurality of frame images of the picture signals input from the image input unit based on a first predetermined rule and of determining a processed pixel group from the processed frame image stored in the processed frame storage unit based on a second predetermined rule;

a frequency component processing step of extracting a spatial frequency component and a temporal frequency component from the to-be-processed pixel group and the processed pixel group determined by the processing pixel group determination step, of executing predetermined coefficient processing on a spatial low-frequency component and a spatial high-frequency component included in a temporal high-frequency component of the extracted temporal frequency component and of acquiring the executed to-be-processed pixel group on which the predetermined coefficient processing has been executed;

a processing completion frame generation step of generating a processing completion frame image from the executed to-be-processed pixel group acquired by the frequency component processing step; and

an image output step of outputting to the outside the processing completion frame image generated by the processing completion frame generation step and of storing, as the processed frame image, the processing completion frame image in the processed frame storage unit,

wherein the predetermined coefficient processing is processing in which an absolute value of the frequency component and a predetermined threshold value are compared, and when the absolute value of the frequency component is more than the threshold value, the frequency component is maintained and when the absolute value of the frequency component is not more than the threshold value, a predetermined value is substituted for the frequency component.

10. A non-transitory computer-readable storage medium for storing an image processing program instructing a computer to function as:

image input unit that inputs picture signals comprising a plurality of frame images from outside;

processed frame storage unit that stores a processed frame image on which image processing has already been completed;

processing pixel group determination unit that determines a to-be-processed pixel group from the plurality of frame images of the picture signals input from the image input unit based on a first predetermined rule and that determines a processed pixel group from the processed frame image stored in the processed frame storage unit based on a second predetermined rule;

frequency component processing unit that extracts at least a temporal frequency component from the to-be-processed pixel group and the processed pixel group determined by the processing pixel group determination unit, that executes predetermined coefficient processing on a temporal high-frequency component of the extracted temporal frequency component and that acquires the executed to-be-processed pixel group on which the predetermined coefficient processing has been executed;

processing completion frame generation unit that generates a processing completion frame image from the executed to-be-processed pixel group acquired by the frequency component processing unit; and

image output unit that outputs to the outside the processing completion frame image generated by the processing completion frame generation unit and that stores, as the processed frame image, the processing completion frame image in the processed frame storage unit,

wherein the frequency component processing unit prevents the predetermined coefficient processing from being executed on a component having low sensitivity in visual characteristic included in the temporal high-frequency component,

wherein the predetermined coefficient processing is processing in which an absolute value of the frequency component and a predetermined threshold value are compared, and when the absolute value of the frequency component is more than the threshold value, the frequency component is maintained and when the absolute value of the frequency component is not more than the threshold value, a predetermined value is substituted for the frequency component.

11. A non-transitory computer-readable storage medium for storing an image processing program instructing a computer to function as:

image input unit that inputs picture signals comprising a plurality of frame images from outside;

processed frame storage unit that stores a processed frame image on which image processing has already been completed;

processing pixel group determination unit that determines a to-be-processed pixel group from the plurality of frame images of the picture signals input from the image input unit based on a first predetermined rule and that determines a processed pixel group from the processed frame image stored in the processed frame storage unit based on a second predetermined rule;

frequency component processing unit that extracts a spatial frequency component and a temporal frequency component from the to-be-processed pixel group and the processed pixel group determined by the processing pixel group determination unit, that executes predetermined coefficient processing on a spatial low-frequency component and a spatial high-frequency component included in a temporal high-frequency component of the extracted temporal frequency component and that acquires the executed to-be-processed pixel group on which the predetermined coefficient processing has been executed;

processing completion frame generation unit that generates a processing completion frame image from the executed to-be-processed pixel group acquired by the frequency component processing unit; and

image output unit that outputs to the outside the processing completion frame image generated by the processing completion frame generation unit and that stores, as the processed frame image, the processing completion frame image in the processed frame storage unit,

wherein the predetermined coefficient processing is processing in which an absolute value of the frequency component and a predetermined threshold value are compared, and when the absolute value of the frequency component is more than the threshold value, the frequency component is maintained and when the absolute value of the frequency component is not more than the threshold value, a predetermined value is substituted for the frequency component.