Processing apparatus, image pickup apparatus, image pickup system, and processing method

1. A processing apparatus configured to generate a combined image by stacking a plurality of images based on a plurality of object images formed on an imaging plane of an image sensor by a plurality of lens units, the processing apparatus comprising:

at least one processor or circuit configured to execute a plurality of tasks including:

an acquisition task configured to acquire conversion information for converting a first coordinate system in the imaging plane into a second coordinate system in the combined image, the conversion information being generated based on information on a center position of each of the plurality of object images on the imaging plane, information on a correspondence relationship between the center positions and layer positions of the plurality of images in the combined image, and a correction function for correcting the plurality of object images; and

a processing task configured to generate the combined image using the conversion information.

2. The processing apparatus according to claim 1 , wherein the acquisition task acquires correction information for correcting an in-plane luminance distribution of an image corresponding to each of the plurality of object images, and

wherein the processing task corrects an image corresponding to each of the plurality of object images using the correction information.

3. The processing apparatus according to claim 1 , further comprising a memory configured to store the conversion information.

4. An image pickup apparatus comprising:

the processing apparatus according to claim 1 ; and

an image sensor configured to generate the plurality of images.

5. The image pickup system comprising:

the image pickup apparatus according to claim 4 ; and

an optical system that includes a plurality of lens units.

6. The image pickup system according to claim 5 , wherein the optical system includes a plurality of filters disposed on optical axes of the plurality of lens units and having transmission characteristics different from each other.

7. The image pickup system according to claim 6 , wherein the correction function includes a function including a deformation component caused by a lateral chromatic aberration of each of the plurality of object images, and a function including a distortion component of each of the plurality of object images at a reference wavelength.

8. The image pickup system according to claim 5 , wherein the optical system includes a main optical system on an object side of the plurality of lens units.

9. The image pickup system according to claim 8 , wherein the correction function includes a function including an angle of view component of each of the plurality of object images, and a function including a component of a shift amount between an optical axis of the main optical system and an optical axis of each of the plurality of lens units.

10. A processing method for a processing apparatus configured to generate a combined image by stacking a plurality of images based on a plurality of object images formed on an imaging plane of an image sensor by a plurality of lens units, the processing method comprising the steps of:

acquiring conversion information for converting a first coordinate system in the imaging plane into a second coordinate system in the combined image, the conversion information being generated based on information on a center position of each of the plurality of object images on the imaging plane, information on a correspondence relationship between the center positions and layer positions of the plurality of images in the combined image, and a correction function for correcting the plurality of object images; and

generating the combined image using the conversion information.