Image processing apparatus, image processing method, and image processing system
Provision of a sense of distance by motion parallax and provision of various visual fields are satisfactorily realized. A display image is generated by superimposing a vehicle interior image on a captured image obtained by capturing an image on a rear side from a vehicle. The display image is generated on the basis of reference visual field setting information set by a setting unit. For example, the reference visual field setting includes a display position setting, a display size setting, a compression setting in all or part of a horizontal direction, a compression setting in all or part of a vertical direction, and the like. For example, the image showing the vehicle is a computer graphics image. For example, a change is made in a superimposed positional relationship between the captured image and the image showing the vehicle in accordance with motion of a viewpoint of a driver.
1. An image processing apparatus comprising:
circuitry configured to
generate a display image by superimposing a vehicle interior image on a captured image obtained by capturing an image on a rear side from a vehicle,
wherein the circuitry generates the display image on a basis of setting information regarding a reference visual field;
set the reference visual field;
arrange the captured image and the vehicle interior image in a three-dimensional space;
arrange the captured image at an arrangement position on a rear side from the vehicle;
obtain a virtual viewpoint position that changes in accordance with motion of a viewpoint of a driver; and
convert the captured image and the vehicle interior image into a projected coordinate system with a visual field determined by the virtual viewpoint position, to obtain the display image,
wherein the arrangement position is a position of a predetermined object existing on a rear side from the vehicle.
2. The image processing apparatus according to claim 1 , wherein
as the reference visual field setting, a display position setting is included.
3. The image processing apparatus according to claim 1 , wherein
as the reference visual field setting, a display size setting is included.
4. The image processing apparatus according to claim 1 , wherein
as the reference visual field setting, a compression setting of all or part of the display image in a horizontal direction is included.
5. The image processing apparatus according to claim 1 , wherein
as the reference visual field setting, a compression setting of all or part of the display image in a vertical direction is included.
6. The image processing apparatus according to claim 1 , wherein
the circuitry is further configured to
use, as a captured image obtained by capturing an image on a rear side from the vehicle, a captured image captured by an image capturing device attached to a rear part of the vehicle and a captured image captured by an image capturing device attached to a side part of the vehicle.
7. The image processing apparatus according to claim 1 , wherein
the circuitry is further configured to
select any reference visual field setting from a plurality of the reference visual field settings; and
generate the display image on a basis of the selected reference visual field setting.
8. The image processing apparatus according to claim 1 , wherein
the vehicle interior image includes a computer graphics image.
9. The image processing apparatus according to claim 1 , wherein
the circuitry is further configured to
change a superimposed positional relationship between the captured image and the vehicle interior image in accordance with motion of a viewpoint of a driver.
10. The image processing apparatus according to claim 1 , wherein the predetermined object includes an object closest to the vehicle.
11. The image processing apparatus according to claim 1 , wherein the predetermined object includes an object being seen by the driver.
12. The image processing apparatus according to claim 1 , wherein
the circuitry is further configured to
superimpose the vehicle interior image on the captured image to allow the captured image to be seen through.
13. An image processing method comprising:
generating a display image by superimposing a vehicle interior image on a captured image obtained by capturing an image on a rear side from a vehicle, wherein
in the procedure for generating the display image, the display image is generated on a basis of setting information regarding a reference visual field, and
the image processing method further comprises:
setting the reference visual field is further provided;
arranging the captured image and the vehicle interior image in a three-dimensional space;
arranging the captured image at an arrangement position on a rear side from the vehicle;
obtaining a virtual viewpoint position that changes in accordance with motion of a viewpoint of a driver; and
converting the captured image and the vehicle interior image into a projected coordinate system with a visual field determined by the virtual viewpoint position, to obtain the display image,
wherein the arrangement position is a position of a predetermined object existing on a rear side from the vehicle.
14. An image processing system comprising:
image capturing circuitry configured to capture an image on a rear side from a vehicle; and
processing circuitry configured to generate a display image by superimposing a vehicle interior image on a captured image obtained by capturing an image on a rear side from the vehicle, wherein
the processing circuitry generates the display image on a basis of setting information regarding a reference visual field, and
the image processing system further comprises:
setting circuitry configured to set the reference visual field; and
display circuitry configured to display a display image generated by the processing circuitry; wherein
the processing circuitry is further configured to
arrange the captured image and the vehicle interior image in a three-dimensional space;
arrange the captured image at an arrangement position on a rear side from the vehicle;
obtain a virtual viewpoint position that changes in accordance with motion of a viewpoint of a driver; and
convert the captured image and the vehicle interior image into a projected coordinate system with a visual field determined by the virtual viewpoint position, to obtain the display image,
wherein the arrangement predetermined position is a position of a predetermined object existing on a rear side from the vehicle.