Image processing device, ranging device, and method

1. An image processing device comprising:

first storage configured to store a statistical model generated by learning of bokeh that occurs in a first image affected by aberration of a first optical system and varies non-linearly in accordance with a distance to a subject in the first image; and

a processor configured to:

acquire a second image affected by aberration of a second optical system; and

input the acquired second image into the statistical model corresponding to a lens used in the second optical system and acquire distance information indicating a distance to a subject in the second image.

2. The image processing apparatus according to claim 1 , wherein

the bokeh that varies non-linearly in accordance with the distance to the subject in the first image further varies in accordance with position in the first image.

3. The image processing apparatus according to claim 1 , wherein the processor is configured to:

select a region for acquisition of the distance information in the second image; and

acquire the distance information indicating the distance to the subject in the selected region.

4. The image processing apparatus according to claim 3 , wherein

the processor is configured to select the region, based on an operation of a user.

5. The image processing apparatus according to claim 3 , wherein

the processor is configured to select a region including a specific subject in the second image.

6. The image processing apparatus according to claim 1 , wherein

the first storage is configured to store the statistical model every lens for use in the first optical system.

7. The image processing apparatus according to claim 1 , wherein

the processor is configured to:

acquire lens information regarding the lens used in the second optical system;

select the statistical model corresponding to the lens specified based on the lens information, from the first storage; and

input the second image into the specified statistical model and acquire the distance information indicating the distance to the subject in the second image.

8. The image processing apparatus according to claim 1 , further comprising:

a second storage configured to store, for the statistical model corresponding to each of the lenses for use in the first optical system, a first aberration map indicating a distribution of bokeh that occurs in a third image affected by the aberration of the first optical system with the lens and depends on a distance to a subject in the third image and position in the third image, wherein

the processor is configured to:

specify a first aberration map stored in the second storage, based on bokeh occurring in a fourth image affected by the aberration of the second optical system; and

input the second image into the statistical model corresponding to the specified first aberration map and acquire the distance information indicating the distance to the subject in the second image.

9. The image processing apparatus according to claim 8 , wherein

the fourth image includes an image acquired by capturing of a predetermined text pattern, and

the processor is configured to collate a second aberration map estimated based on the bokeh occurring in the fourth image, with each of the first aberration maps stored in the second storage, and specify a first aberration map similar to the second aberration map.

10. The image processing apparatus according to claim 8 , wherein

the processor is configured to compare the fourth image with a sixth image generated by convolution of each of the first aberration maps stored in the second storage to a fifth image less affected by the aberration of the second optical system than the fourth image, and specify the first aberration map convolved in the sixth image similar to the fourth image.

11. The image processing apparatus according to claim 8 , wherein

the processor is configured to specify a first aberration map, based on bokeh occurring in an entirety of the fourth image or bokeh occurring in a partial region of the fourth image.

12. The image processing apparatus according to claim 11 , wherein

the bokeh occurring in the partial region of the fourth image includes bokeh occurring in a region near an end portion of the fourth image.

13. The image processing apparatus according to claim 1 , wherein

the processor is configured to:

display the second image;

select a region in the displayed second image, in accordance with an operation of a user; and

input information regarding the selected region, into the statistical model corresponding to the lens used in the second optical system, and acquire the distance information indicating the distance to the subject in the region.

14. A ranging device comprising:

a capture device configured to capture an image;

a first storage configured to store a statistical model generated by learning of bokeh that occurs in a first image affected by aberration of a first optical system of the image capturing module and varies non-linearly in accordance with a distance to a subject in the first image; and

the processor configured to:

acquire a second image affected by aberration of a second optical system of the capture device; and

input the acquired second image into the statistical model corresponding to a lens used in the second optical system and acquire distance information indicating a distance to a subject in the second image.

15. A method to be performed by an image processing device including storage configured to store a statistical model generated by learning of bokeh that occurs in a first image affected by aberration of a first optical system and varies non-linearly in accordance with a distance to a subject in the first image, the method comprising:

acquiring a second image affected by aberration of a second optical system; and

inputting the acquired second image into the statistical model corresponding to a lens used in the second optical system and acquiring distance information indicating a distance to a subject in the second image.