Imaging apparatus, image processing apparatus, image processing method, and medium
There is provided with an imaging apparatus. An imaging unit captures an image with use of a fisheye lens. An image conversion unit converts an input image obtained from the imaging unit into a panoramic image, by performing geometrical conversion on the input image such that a region of the input image in which a distance from a point on an optical axis is smaller than a set distance becomes a perspective projection, and such that a region in which the distance is larger than the set distance becomes a stereographic projection. The set distance is determined based on an accuracy of fisheye lens distortion correction with respect to the fisheye lens.
1. An imaging apparatus comprising:
an imaging unit configured to capture an image with use of a fisheye lens; and
an image conversion unit configured to convert an input image obtained from the imaging unit into a panoramic image, by performing geometrical conversion on the input image such that a region of the input image in which a distance from a point on an optical axis is smaller than a set distance becomes a perspective projection, and such that a region in which the distance is larger than the set distance becomes a stereographic projection,
wherein the set distance is determined based on an accuracy of fisheye lens distortion correction with respect to the fisheye lens.
2. The imaging apparatus according to claim 1 ,
wherein the fisheye lens is a stereographic projection lens.
3. The imaging apparatus according to claim 1 ,
wherein the image conversion unit is further configured to perform the geometrical conversion in accordance with a combined conversion function in which a conversion function for conversion of an image to a stereographic projection is combined with a conversion function for conversion to a perspective projection.
4. The imaging apparatus according to claim 3 ,
wherein the combined conversion function is expressed by H(r) shown below
H
(
r
)
=
1
1
+
e
-
β
(
r
-
r
th
)
Z
(
r
)
+
1
1
+
e
β
(
r
-
r
th
)
K
(
r
)
(
5
)
where r is a distance between a processing target point in the input image and a point corresponding to the optical axis, Z(r) is the conversion function for conversion to a perspective projection, K(r) is the conversion function for conversion to a stereographic projection, r th is the set distance, and β is a parameter for determining weights of the conversion function for conversion to a stereographic projection and the conversion function for conversion to a perspective projection.
5. The imaging apparatus according to claim 1 ,
further comprising an accuracy detection unit configured to determine the accuracy of fisheye lens distortion correction.
6. The imaging apparatus according to claim 5 ,
wherein the accuracy detection unit is further configured to determine a visibility circle diameter in the input image, and
the image conversion unit is further configured to determine the set distance with use of a ratio of the visibility circle diameter and a design value of the visibility circle diameter.
7. The imaging apparatus according to claim 5 ,
wherein the image conversion unit is further configured to set the set distance such that, in a case of an object located at the set distance from the point on the optical axis in the input image, an error in fisheye lens distortion correction in the perspective projection does not exceed a maximum error in fisheye lens distortion correction in the stereographic projection.
8. The imaging apparatus according to claim 1 ,
wherein the set distance is different between when performing visible light image capturing and when performing IR image capturing.
9. The imaging apparatus according to claim 8 ,
wherein the set distance when performing IR image capturing is less than or equal to an IR emission radius.
10. The imaging apparatus according to claim 1 ,
wherein the accuracy of fisheye lens distortion correction is expressed by a difference between a fisheye lens distortion ratio that is approximated by a polynomial expression and a measured value of the fisheye lens distortion ratio.
11. The imaging apparatus according to claim 1 ,
wherein the image conversion unit is further configured to perform the geometrical conversion with reference to a look up table.
12. An image processing apparatus comprising:
an image conversion unit configured to obtain an input image that was captured with use of a fisheye lens, and perform correction on the input image such that a shape of an image of an object is brought closer to a shape that is homothetic to the object,
wherein an intensity of the correction is weaker in a peripheral portion of the input image than in a central portion of the input image.
13. An image processing method comprising:
obtaining an input image which is captured with use of a fisheye lens; and
converting the input image into a panoramic image, by performing geometrical conversion on the input image such that a region of the input image in which a distance from a point on an optical axis is smaller than a set distance becomes a perspective projection, and such that a region in which the distance is larger than the set distance becomes a stereographic projection,
wherein the set distance is determined based on an accuracy of fisheye lens distortion correction with respect to the fisheye lens.
14. A non-transitory computer-readable medium storing a program which, when executed by a computer comprising a processor and a memory, causes the computer to:
obtain an input image which is captured with use of a fisheye lens; and
convert the input image into a panoramic image, by performing geometrical conversion on the input image such that a region of the input image in which a distance from a point on an optical axis is smaller than a set distance becomes a perspective projection, and such that a region in which the distance is larger than the set distance becomes a stereographic projection,
wherein the set distance is determined based on an accuracy of fisheye lens distortion correction with respect to the fisheye lens.