Image processing system, image processing method, and storage medium
An image processing system, which estimates a position and a pose of a camera and performs three-dimensional reconstruction processing of an object having a cylindrical shape by using a photographed image acquired by photographing an inside of the object with the camera, includes a processor. The processor estimates a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image. In addition, the processor performs bundle adjustment for correcting the position and the pose of the camera and the coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.
1. An image processing system that estimates a position and a pose of a camera and performs three-dimensional reconstruction processing of an object having a cylindrical shape, by using a photographed image acquired by photographing an inside of the object with the camera, the image processing system comprising a processor,
the processor being configured to:
estimate a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image; and
perform bundle adjustment for correcting the position and the pose of the camera and coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.
2. The image processing system according to claim 1 , wherein the processor is further configured to:
extract, from the group of three-dimensional points, a three-dimensional point whose distance from the first center axis has a difference from the radius, the difference being within a predetermined range, or a three dimensional point whose distance from the first center axis has a difference, the difference being out of the predetermined range; and
determine whether to estimate a second center axis different from the first axis based on at least one of a number of the extracted three-dimensional points or a ratio of the extracted three-dimensional points to the group of three-dimensional points.
3. The image processing system according to claim 1 , wherein the processor detects a conic shape from the group of three-dimensional points, and detects the first center axis from the detected conic shape.
4. The image processing system according to claim 1 , wherein the radius has a value set in advance based on an actual measurement value of the object.
5. The image processing system according to claim 1 , wherein the radius has a value estimated by the processor.
6. An image processing method for estimating a position and a pose of a camera and performing three-dimensional reconstruction processing of an object having a cylindrical shape, by using a photographed image acquired by photographing an inside of the object with the camera, the image processing method comprising:
estimating a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image; and
correcting the position and the pose of the camera and coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.
7. A non-transitory computer-readable storage medium that stores an image processing program for estimating a position and a pose of a camera and performing three-dimensional reconstruction processing of an object having a cylindrical shape, by using a photographed image acquired by photographing an inside of the object with the camera,
the image processing program causing a computer to execute:
estimating a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image; and
correcting the position and the pose of the camera and coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.