Image recording apparatus and image processing method
An image processing apparatus having: an image acquisition unit that acquires a plurality of viewpoint images; a disparity map generation unit that generates a disparity map representing a disparity distribution; a multi-viewpoint image generation unit that generates a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map; an image processing unit that performs image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switches an amount of image processing for the subject image depending on the disparity; and an output unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, and sequentially outputs the viewpoint images.
1. An image processing apparatus comprising:
an image acquisition unit that acquires a plurality of viewpoint images generated by imaging a subject at a plurality of viewpoints;
a disparity map generation unit that generates a disparity map representing a disparity distribution based on the plurality of viewpoint images;
a multi-viewpoint image generation unit that generates a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map;
an image processing unit that performs image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switches an amount of image processing for the subject image depending on the disparity; and
an output unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, and sequentially outputs the viewpoint images;
wherein the image processing unit makes an amount of blur of pixels, between which there is a larger disparity, in the multi-viewpoint image larger;
wherein the image processing unit makes amounts of blur of the viewpoint images at viewpoint positions at both ends out of the plurality of viewpoint images included in the multi-viewpoint image larger than an amount of blur of a viewpoint image at a viewpoint position at the center.
2. The image processing apparatus according to claim 1 , further comprising a display control unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displays the viewpoint images in two dimensions on a display device serving as the output unit.
3. The image processing apparatus according to claim 2 , further comprising a moving image file generation unit that generates a moving image file for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displaying the viewpoint images in two dimensions on the display device serving as the output unit.
4. The image processing apparatus according to claim 1 further comprising a moving image file generation unit that generates a moving image file for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displaying the viewpoint images in two dimensions on the display device serving as the output unit.
5. The image processing apparatus according to claim 1 , wherein the image processing unit refers to the disparity map, uses pixels between which there is no disparity as a reference, to determine whether a subject image within each of the viewpoint images is a back-side area or a front-side area, and performs image processing for reducing the subject image in the back-side area and enlarging the subject image in the front-side area.
6. An image processing apparatus comprising:
an image acquisition unit that acquires a plurality of viewpoint images generated by imaging a subject at a plurality of viewpoints;
a disparity map generation unit that generates a disparity map representing a disparity distribution based on the plurality of viewpoint images;
a multi-viewpoint image generation unit that generates a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map;
an image processing unit that performs image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switches an amount of image processing for the subject image depending on the disparity; and
an output unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, and sequentially outputs the viewpoint images;
wherein the image processing unit makes an amount of decrease in at least one of saturation, contrast, and sharpness of pixels, between which there is a larger disparity, in the multi-viewpoint image larger;
wherein the image processing unit makes the amounts of decrease of the viewpoint images at the viewpoint positions at both ends out of the plurality of viewpoint images included in the multi-viewpoint image larger than the amount of decrease of the viewpoint image at the viewpoint position at the center.
7. The image processing apparatus according to claim 6 , further comprising a display control unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displays the viewpoint images in two dimensions on a display device serving as the output unit.
8. The image processing apparatus according to claim 7 , further comprising a moving image file generation unit that generates a moving image file for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displaying the viewpoint images in two dimensions on the display device serving as the output unit.
9. The image processing apparatus according to claim 6 , further comprising a moving image file generation unit that generates a moving image file for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displaying the viewpoint images in two dimensions on the display device serving as the output unit.
10. An image processing apparatus comprising:
an image acquisition unit that acquires a plurality of viewpoint images generated by imaging a subject at a plurality of viewpoints;
a disparity map generation unit that generates a disparity map representing a disparity distribution based on the plurality of viewpoint images;
a multi-viewpoint image generation unit that generates a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map;
an image processing unit that performs image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switches an amount of image processing for the subject image depending on the disparity; and
an output unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, and sequentially outputs the viewpoint images;
wherein the output unit makes output times of the viewpoint images at the viewpoint positions at both ends out of the plurality of viewpoint images included in the multi-viewpoint image shorter than an output time of the viewpoint image at the viewpoint position at the center.
11. The image processing apparatus according to claim 10 , further comprising a display control unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displays the viewpoint images in two dimensions on a display device serving as the output unit.
12. The image processing apparatus according to claim 11 , further comprising a moving image file generation unit that generates a moving image file for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displaying the viewpoint images in two dimensions on the display device serving as the output unit.
13. The image processing apparatus according to claim 10 , further comprising a moving image file generation unit that generates a moving image file for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, in the order of their viewpoints and displaying the viewpoint images in two dimensions on the display device serving as the output unit.
14. An image processing method comprising:
an image acquisition step for acquiring a plurality of viewpoint images generated by imaging a subject at a plurality of viewpoints;
a disparity map generation step for generating a disparity map representing a disparity distribution based on the plurality of viewpoint images;
a multi-viewpoint image generation step for generating a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map;
an image processing step for performing image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switching an amount of image processing for the subject image depending on the disparity; and
an output step for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing in the image processing step, in the order of their viewpoints and sequentially outputting the viewpoint images;
wherein the image processing unit makes an amount of blur of pixels, between which there is a larger disparity, in the multi-viewpoint image larger;
wherein the image processing unit makes amounts of blur of the viewpoint images at viewpoint positions at both ends out of the plurality of viewpoint images included in the multi-viewpoint image larger than an amount of blur of a viewpoint image at a viewpoint position at the center.
15. An image processing method comprising:
an image acquisition step for acquiring a plurality of viewpoint images generated by imaging a subject at a plurality of viewpoints;
a disparity map generation step for generating a disparity map representing a disparity distribution based on the plurality of viewpoint images;
a multi-viewpoint image generation step for generating a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map;
an image processing step for performing image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switching an amount of image processing for the subject image depending on the disparity; and
an output step for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing in the image processing step, in the order of their viewpoints and sequentially outputting the viewpoint images;
wherein the image processing unit makes an amount of decrease in at least one of saturation, contrast, and sharpness of pixels, between which there is a larger disparity, in the multi-viewpoint image larger;
wherein the image processing unit makes the amounts of decrease of the viewpoint images at the viewpoint positions at both ends out of the plurality of viewpoint images included in the multi-viewpoint image larger than the amount of decrease of the viewpoint image at the viewpoint position at the center.
16. An image processing method comprising:
an image acquisition step for acquiring a plurality of viewpoint images generated by imaging a subject at a plurality of viewpoints;
a disparity map generation step for generating a disparity map representing a disparity distribution based on the plurality of viewpoint images;
a multi-viewpoint image generation step for generating a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map;
an image processing step for performing image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switching an amount of image processing for the subject image depending on the disparity; and
an output step for switching the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing in the image processing step, in the order of their viewpoints and sequentially outputting the viewpoint images; wherein the output unit makes output times of the viewpoint images at the viewpoint positions at both ends out of the plurality of viewpoint images included in the multi-viewpoint image shorter than an output time of the viewpoint image at the viewpoint position at the center.