Imaging system, image processing apparatus, imaging device, and recording medium
An imaging system includes a plurality of imaging devices facing different directions and an output unit configured to output an output image generated based on the captured images. The plurality of imaging devices is configured to capture images. The output image having been generated based on the captured images covers a range of 360 degrees in at least a first direction. In the output image, an area where a subject is reflected in the captured images is placed at a predetermined position so as to prevent the area from being cut off at the edges of the output image.
1. An imaging system, comprising:
a plurality of imagers facing different directions, the plurality of imagers configured to capture images;
inclination detection circuitry configured to detect an inclination of the plurality of imagers;
recognition circuitry configured to recognize a subject reflected in the images captured by the plurality of imagers,
rotation-amount determination circuitry configured to:
determine a first amount of rotation in roll and pitch directions based on the inclination detected by the inclination detection circuitry; and
determine a second amount of rotation in a yaw direction based on a recognition result of the recognition circuitry; and
processing circuitry configured to
perform image rotation, based on the first amount of rotation and the second amount of rotation, on the images captured by the plurality of imagers to change a position of an area in a horizontal direction where the subject is reflected to a predetermined position,
synthesize the images corrected by the image rotation to generate an output image which covers a range of 360 degrees in at least a first direction, and
output the output image, wherein
the position of the area is changed to the predetermined position so as to prevent the area from being cut off at edges of the output image, and
the predetermined position is substantially at a center of the output image in the horizontal direction so that the area where the subject is reflected is not divided at the edges of the output image.
2. The imaging system according to claim 1 , wherein
the output image covers a range of 360 degrees in a second direction orthogonal to the first direction, and
when the position of the area where the subject is reflected satisfies a prescribed degree, the processing circuitry performs an additional image rotation on the images on which the image rotation has been performed, so as to place the area where the subject is reflected at substantially the center of the output image in the second direction.
3. The imaging system according to claim 2 , wherein
based on the inclination detected by the inclination detection circuitry, the processing circuitry performs zenith correction through the image rotation,
the prescribed degree is satisfied such that the area where the subject is reflected is positioned closer to either one of the edges of the output image, and
in a case that the prescribed degree is satisfied, the zenith correction is modified so as to prevent the area from being cut off at edges of the output image.
4. The imaging system according to claim 1 , wherein
the subject includes a plurality of subjects, and
a center of gravity of the area where the plurality of subjects is included together or a center of gravity of any one of the plurality of subjects is placed at the predetermined position.
5. The imaging system according to claim 1 , wherein another area other than the area the subject is reflected is positioned at the edges of the output image.
6. The imaging system according to claim 1 , wherein a scaled-down image, in which the area where the subject is reflected is not cut off at the edges of the scaled-down image, is generated based on the output image.
7. The imaging system according to claim 1 , wherein the subject is at least one of a face of a person, a face of an animal, a whole body of an animal, a part of an object, and a whole of an object.
8. The imaging system according to claim 1 , wherein
the images captured by the plurality of imagers include a plurality of partial images captured by a plurality of imaging optical systems,
the recognition circuitry recognizes the subject in the plurality of partial images or a synthesized image of the plurality of partial images, and
the output image is the synthesized image.
9. The imaging system according to claim 8 , wherein
the plurality of imaging optical systems includes a plurality of fish-eye lenses or wide-angle lenses,
the plurality of partial images is a plurality of fisheye images or wide-angle images, and
each of the output image and the synthesized image is a spherical image in a spherical coordinate system obtained by performing distortion correction and synthesis processing on the plurality of partial images.
10. An image processing apparatus, comprising:
image acquisition circuitry configured to acquire, as an input image, a plurality of partial images each having a different captured range or a synthesis image of the plurality of partial images;
inclination detection circuitry configured to detect an inclination of the plurality of imagers;
recognition circuitry configured to recognize a subject reflected in the input image acquired by the image acquisition circuitry;
rotation-amount determination circuitry configured to:
determine a first amount of rotation in roll and pitch directions based on the inclination detected by the inclination detection circuitry; and
determine a second amount of rotation in a yaw direction based on a recognition result of the recognition circuitry;
image rotation circuitry configured to perform image rotation, based on the first amount of rotation and the second amount of rotation, on the input image to change a position of an area in a horizontal direction where the subject is reflected to a predetermined position; and
generation circuitry configured to generate an output image based on the input image corrected by the image rotation which covers a range of 360 degrees in at least a first direction, and the position of the area is located at the predetermined position to prevent the area of the subject from being cut off at edges of the image, wherein
the predetermined position is substantially at a center of the output image in the horizontal direction so that the area where the subject is reflected is not divided at the edges of the output image.
11. An imaging device, comprising:
the image processing apparatus according to claim 10 ; and
a plurality of imagers configured to capture the plurality of partial images.
12. An image processing method, comprising:
acquiring, as an input image, a plurality of partial images captured by a plurality of imagers, wherein each partial image of the plurality of partial images has a different captured range;
detecting an inclination of the plurality of partial imagers;
recognizing a subject reflected in the input image;
determining a first amount of rotation in roll and pitch directions based on the inclination detected by the detecting;
determining a second amount of rotation in a yaw direction based on a recognition result of the recognizing;
performing image rotation, based on the first amount of rotation and the second amount of rotation, on the input image to change a position of an area in a horizontal direction where the subject is reflected to a predetermined position; and
generating an output image based on the input image corrected by the image rotation, wherein
the output image covers a range of 360 degrees at least a first direction,
the position of the area is located at the predetermined position to prevent the area of the subject from being cut off at the edges of the output image, and
the predetermined position is substantially at a center of the output image in the horizontal direction so that the area where the subject is reflected is not divided at the edges of the output image.
13. A non-transitory recording medium storing a computer-readable code for controlling a computer system to carry out the method according to claim 12 .