External environment recognition device and external environment recognition method
An EXTERNAL ENVIRONMENT RECOGNITION DEVICE that reduces an influence on a ranging error caused by a temporal change of an optical system/imaging system is provided by focusing on characteristics (individual difference) of the optical system/imaging system of an in-vehicle stereo camera device. Thus, the EXTERNAL ENVIRONMENT RECOGNITION DEVICE includes a parallax calculation unit that calculates parallax by images captured by an in-vehicle camera device including a plurality of cameras, a ranging unit that obtains a distance to an object outside a vehicle by the parallax, a storage unit in which response characteristics and luminance characteristics of each lens of the plurality of cameras are recorded, a ranging correction necessity determination unit that determines whether the distance to the object is necessary to be corrected using the response characteristics and the luminance characteristics of the lens; and a ranging correction unit that corrects the distance to the object based on the response characteristics and the luminance characteristics of the lens when it is determined that the correction is necessary.
1 . An external environment recognition device comprising:
a computer processing unit (CPU) configured to:
calculate parallax from images captured by an in-vehicle camera device including a plurality of cameras;
obtain from the parallax a distance to an object outside a vehicle;
record response characteristics and luminance characteristics of each lens of the plurality of cameras, wherein the response characteristics of the lens further includes data depending on a temperature;
determine whether the distance to the object is necessary to be corrected using the temperature dependence in addition to the response characteristics of the lens, and the luminance characteristics of the lens; and
correct the distance to the object based on the temperature dependence in addition to the response characteristics of the lens, and the luminance characteristics of the lens when it is determined that the correction is necessary,
wherein the CPU is further configured to:
inspect the response characteristics and the luminance characteristics of the lens at the time of manufacturing the in-vehicle camera device, and
record the response characteristics and the luminance characteristics of the lens.
2 . An external environment recognition device comprising
a computer processing unit (CPU) configured to:
calculate parallax from images captured by an in-vehicle camera device including a plurality of cameras;
obtain from the parallax a distance to an object outside a vehicle;
record response characteristics and luminance characteristics of each lens of the plurality of cameras, wherein the response characteristics of the lens further includes data depending on a temperature;
determine whether the distance to the object is necessary to be corrected using the temperature dependence in addition to the response characteristics of the lens, and the luminance characteristics of the lens; and
correct the distance to the object based on the temperature dependence in addition to the response characteristics of the lens, and the luminance characteristics of the lens when it is determined that the correction is necessary,
wherein the CPU is further configured to determine that the distance to the object is necessary to be corrected when brightness of the object is a predetermined value or more.
3 . The external environment recognition device according to claim 1 , wherein
the CPU is further configured to determine that the distance to the object is necessary to be corrected when an exposure time is less than a predetermined value.
4 . The external environment recognition device according to claim 1 , wherein
the CPU is further configured to determine that the distance to the object is necessary to be corrected when the temperature of the imaging environment is a predetermined value or more.
5 . A method for monitoring an external environment comprising:
performing parallax calculation of calculating parallax from an image captured by an in-vehicle camera device including a plurality of cameras;
performing ranging of obtaining from the parallax a distance to an object outside a vehicle;
recording response characteristics and luminance characteristics of each lens of the plurality of cameras, wherein the response characteristics of the lens further include data depending on a temperature;
performing ranging correction necessity determination of determining whether the distance to the object is necessary to be corrected based on the temperature dependence in addition to the response characteristics of the lens, and luminance characteristics of each lens of the plurality of cameras; and
performing ranging correction of correcting the distance to the object based on the temperature dependence in addition to the response characteristics of the lens, and the luminance characteristics of the lens when it is determined that the correction is necessary,
wherein the method further comprises:
inspecting the response characteristics and the luminance characteristics of the lens at the time of manufacturing the in-vehicle camera device, and
recording the response characteristics and the luminance characteristics of the lens.