Image processing apparatus and method

1. An image processing apparatus comprising:

an image generation unit which generates, using profile information, an image based on a plurality of captured images with mutually different viewpoints,

wherein the profile information includes lens parameters, each of which virtually simulates a respective physical lens of an image sensor that reproduces a respective optical effect,

wherein the profile information is specified by a user from a plurality of pieces of profile information, the specified profile information including a diaphragm shape,

wherein the lens parameters of the plurality of pieces of profile information are different from each other, and

wherein the image generation unit is implemented via at least one processor.

2. The image processing apparatus according to claim 1 ,

wherein the profile information is information which simulates a virtual lens of the virtual optical system.

3. The image processing apparatus according to claim 1 ,

wherein the generated image is a virtual image captured from the same position as the position captured by a reference camera among a plurality of cameras used to capture the plurality of captured images.

4. The image processing apparatus according to claim 1 ,

wherein the plurality of captured images are captured by simulating a virtual image sensor of each virtual optical system obtaining an optical ray vector after permeating the one or more lenses specified by the user for the virtual optical system.

5. The image processing apparatus according to claim 1 ,

wherein the image generation unit generates interpolation images specified in number by the profile information based on the plurality of captured images, and generates the virtual captured image by using the plurality of captured images and the interpolation images.

6. The image processing apparatus according to claim 5 ,

wherein the image generation unit generates the interpolation images in accordance with sequence information showing a relative position relationship of each viewpoint of the plurality of captured images, eye number information showing a number of viewpoints of the plurality of captured images, and depth data.

7. The image processing apparatus according to claim 6 ,

wherein the sequence information includes information showing a distance from a viewpoint serving as a reference to each different viewpoint, and information showing an orientation of each different viewpoint from the viewpoint serving as the reference.

8. The image processing apparatus according to claim 7 ,

wherein the image generation unit determines the image serving as the reference, a matching axis, and an interpolation method based on the sequence information, and the eye number information.

9. The image processing apparatus according to claim 1 ,

wherein the specified profile information further includes PSF data corresponding to a distance to a point light source for each color of a plurality of colors.

10. An image processing method comprising:

generating, by using profile information, an image based on a plurality of captured images with mutually different viewpoints,

wherein the profile information includes lens parameters, each of which virtually simulates a respective physical lens of an image sensor that reproduces a respective optical effect,

wherein the profile information is specified by a user from a plurality of pieces of profile information, the specified profile information including a diaphragm shape, and

wherein the lens parameters of the plurality of pieces of profile information are different from each other.

11. An image processing apparatus comprising:

a display unit configured to display a captured image and a plurality of icons corresponding to a plurality of lens units, each lens unit being defined by parameters related to lens information of one or more lenses and virtually simulating a respective physical lens of an image sensor that reproduces a respective optical effect,

wherein the parameters defining the plurality of lens units are different from each other,

wherein the display unit is further configured to display a modified image, based on the captured image, the modified image being generated using the parameters related to the lens information corresponding to one of the icons selected by a user and at least one different image of a plurality of captured images with mutually different viewpoints,

wherein the parameters defining each lens unit include a diaphragm shape, and

wherein the display unit is implemented via at least one processor.

12. The image processing apparatus according to claim 11 ,

wherein the plurality of icons corresponding to the plurality of lens units reproduce an optical effect corresponding to a virtual optical system when selected.

13. The image processing apparatus according to claim 12 ,

wherein the plurality of captured images are captured by simulating a virtual image sensor of each virtual optical system obtaining an optical ray vector after permeating one or more lenses specified by the user for the selected virtual optical system.

14. An image processing method comprising:

displaying a captured image and a plurality of icons corresponding to a plurality of lens units, each lens unit being defined by parameters related to lens information of one or more lenses and virtually simulating a respective physical lens of an image sensor that reproduces a respective optical effect; and

displaying a modified image, based on the captured image, the modified image being generated using the parameters related to the lens information corresponding to one of the icons selected by a user and at least one different image of a plurality of captured images with mutually different viewpoints,

wherein the parameters defining the plurality of lens units are different from each other, and

wherein the parameters defining each lens unit include a diaphragm shape.

15. An image processing system comprising:

a transmitting unit configured to transmit at least one of profile information which is defined by lens parameters, each of which virtually simulates a respective physical lens of an image sensor that reproduces a respective optical effect, or image data generated using the profile information and a plurality of captured images with mutually different viewpoints; and

a receiving unit configured to receive the at least one of the profile information or the image data,

wherein the receiving unit is further configured to generate image data using the at least one of the profile information or the image data and the plurality of captured images with mutually different viewpoints,

wherein the lens parameters defining the plurality of lens units are different from each other,

wherein the lens parameters defining each lens unit include a diaphragm shape, and

wherein the transmitting unit and the receiving unit are each implemented via at least one processor.

16. An image processing method comprising:

transmitting at least one of profile information which is defined by lens parameters, each of which virtually simulates a respective physical lens of an image sensor that reproduces a respective optical effect or image data generated using the profile information and a plurality of captured images with mutually different viewpoints;

receiving the at least one of the profile information or the image data; and

generating image data using the at least one of the profile information or the image data and the plurality of captured images with mutually different viewpoints when the profile information is received,

wherein the lens parameters defining the plurality of lens units are different from each other, and

wherein the lens parameters defining each lens unit include a diaphragm shape.