Autonomous vehicle system testing simulator
To provide evaluation by using a virtual video image generated by performing an optical image processing for lightness and distortion required by an evaluation object. An evaluation apparatus for a camera system including a camera for capturing a video image of outside view includes: a video generation unit for generating a simulation video image simulating the video image of outside view captured by the camera; an optical filter unit which performs an optical image processing on the simulation video image in order to simulate the video image outputted from the camera; and a camera image processing unit which generates a vehicle control signal by performing a recognition processing by using the processed video image.
1. An evaluation apparatus for a camera system including a camera for capturing a video image of outside view, comprising:
a video generation unit for generating a simulation video image simulating the video image of outside view captured by the camera;
an optical filter unit which performs an optical image processing on the simulation video image in order to simulate the video image outputted from the camera;
a camera image processing unit which generates a shutter signal and a vehicle control signal by performing a recognition processing by using the processed video image;
a simulator for simulating a behavior of a vehicle equipped with the camera and an ambient environment thereof; and
a conversion unit for converting a format of the video, wherein
the video generation unit generates the simulation video image based on an output from the simulator,
the conversion unit converts the processed video image to a video image in a format compatible with the camera image processing unit, and
after the image processing, the camera image processing unit performs the recognition processing by using the video converted in the format, thus generating the vehicle control signal, wherein
the simulator calculates the behavior of the vehicle, camera coordinates and attitude of the vehicle present in the ambient environment, at the timing of the shutter signal.
2. The evaluation apparatus according to claim 1 , wherein
the optical filter unit is disposed at the video generation unit.
3. The evaluation apparatus according to claim 1 , wherein
the camera is a compound eye camera capturing at least a left viewpoint video image and a right viewpoint video image,
the video generation unit generates a left viewpoint simulation video image and a right viewpoint simulation video image based on the output from the simulator;
the optical filter unit performs the optical image processing on each of the left viewpoint simulation video image and the right viewpoint simulation video image based on the output from the camera image processing unit, and outputs the optically processed left viewpoint simulation video image and right viewpoint simulation video image according to a timing signal from the camera image processing unit;
the conversion unit converts the processed left viewpoint simulation video image and right viewpoint simulation video image to video images in a format compatible with the camera image processing unit; and
the camera image processing unit performs the recognition processing using the video images converted in format after the image processing, thus generating the vehicle control signal.
4. The evaluation apparatus according to claim 3 , wherein the optical filter unit is disposed at the video generation unit.
5. The evaluation apparatus according to claim 1 , wherein
the optical filter unit performs at least one of a gain adjustment processing, an airbrushing processing, a noise processing and a distortion processing.
6. The evaluation apparatus according to claim 1 , wherein
the camera image processing unit is an electronic control unit implemented in the camera system.
7. The evaluation apparatus according to claim 1 , wherein the camera image processing unit is a camera function simulator implemented by software.
8. A method wherein an arithmetic device provides an evaluation of a camera system including a camera for capturing a video image of outside view, comprising:
a video generation step where the arithmetic device generates a simulation video image of outside view captured by the camera;
an optical filter step where the arithmetic device performs an optical image processing on the simulation video image in order to simulate the video image outputted from the camera;
a camera image processing step where the arithmetic device generates a shutter signal and a vehicle control signal by performing a recognition step by using the processed video image;
a step simulating a behavior of a vehicle equipped with the camera and an ambient environment thereof;
a step converting a format of the video,
a step generating the simulation video image based on the simulated behavior of the vehicle,
a step converting the processed video image to a video image in a format compatible with the camera image processing unit, and
after the image processing, a step performing the recognition processing by using the video converted in the format, thus generating the vehicle control signal, wherein
the simulating the behavior of the vehicle is based on the shutter signal, and includes calculating camera coordinates and attitude of the vehicle present in the ambient environment.
9. The evaluation apparatus according to claim 1 , wherein
the optical filter unit changes the order of a gain adjustment processing, an airbrushing processing, a noise processing and a distortion processing.
10. The evaluation apparatus according to claim 1 , wherein
the video generation unit generates video data based on brightness information outputted from the camera image processing unit.
11. The evaluation apparatus according to claim 5 , wherein
the video data generated by the video generation unit is converted to video data simulating an optical sensor.