Image processing apparatus and image processing method

1. An image enlarging apparatus comprising:

a luminance data calculation unit configured to set a reference frame from a video image which has a plurality of pixels, and to calculate first luminance data for a high resolution video image, the high resolution video image obtained by interpolating supplementary luminance data into the reference frame having second luminance data, the number of pixels of the high resolution video image being larger than the video image;

a position calculation unit configured to set target pixels in at least one of frames included in the video image except the reference frame, and to calculate corresponding positions to the target pixels in the reference frame with decimal accuracy;

a correction amount calculation unit configured to calculate correction amounts of the first luminance data for the corresponding positions based on the first luminance data, third luminance data of the target pixels, and the corresponding positions, the correction amounts being parallelly calculated for the respective corresponding positions;

an addition unit configured to calculate sum of correction amounts from the correction amounts; and

a luminance data correction unit configured to correct the first luminance data based on the sum of the correction amounts.

2. The apparatus according to claim 1 , wherein the additional unit calculates the sum of the correction amounts in the entire of the reference frame.

3. The apparatus according to claim 1 , wherein the additional unit calculates the sum of the correction amounts in a partial area that is obtained by dividing the reference frame.

4. The apparatus according to claim 1 , wherein the luminance data calculation unit selects an image data as the reference frame.

5. The apparatus according to claim 1 , further comprising a filtering unit configured to calculate filtered sum of the correction amounts by removing a predetermined component from the sum of the correction amounts,

wherein the luminance data correction unit corrects the first luminance data based on the filtered sum of the correction amounts.

6. The apparatus according to claim 5 , wherein the filtering unit calculates the filtered sum of the correction amounts by removing a component of impulse signal from the sum of the correction amounts.

7. An image enlarging method comprising:

setting a reference frame from a video image which has a plurality of pixels;

calculating first luminance data for a high resolution video image by interpolating supplementary luminance data based on second luminance data of the reference frame, the number of pixels of the high resolution video image being larger than the video image;

setting target pixels in at least one of frames included in the video image except the reference frame;

calculating corresponding positions to the target pixels in the reference frame with decimal accuracy;

parallelly calculating correction amounts of the first luminance data for the corresponding positions based on the first luminance data, third luminance data of the target pixels, and the corresponding positions;

calculating sum of correction amounts from the correction amounts; and

correcting the first luminance data based on the sum of the correction amounts.

8. The method according to claim 7 , wherein the step of calculating the sum of the correction amounts includes calculating the sum of the correction amounts based on the correction amounts in the entire of the reference frame.

9. The method according to claim 7 , wherein the step of calculating the sum of the correction amounts includes calculating the sum of the correction amounts based on the correction amounts in a partial area that is obtained by dividing the reference frame.

10. The method according to claim 7 , wherein the step of calculating the first luminance data includes selecting an image data as the reference frame.

11. The method according to claim 7 , further comprising calculating filtered sum of the correction amounts by removing a predetermined component from the sum of the correction amounts,

wherein the step of correcting the first luminance data includes using the filtered sum of the correction amounts as the sum of the correction amounts.

12. The method according to claim 11 , wherein the step of calculating the filtered sum of the correction amounts includes removing a component of impulse signal from the sum of the correction amounts as the predetermined component.

13. The apparatus according to claim 5 , wherein the filtering unit calculates the filtered sum of the correction amounts by removing a component at predetermined area of the first luminance data from the sum of the correction amounts.