Periphery recognition device
Provided is a periphery recognition device that makes it possible to: minimize the load from object recognition processing for recognizing an object moving between one region covered by a long-distance sensor and/or a wide-angle short-distance sensor to another such region; the periphery recognition device being able to reduce the proportion of non-recognition or erroneous recognition of objects moving from a region covered by the long-distance sensor or the wide-angle short-distance sensor to a boundary region. There is provided a first sensor 11 a , a second sensor 11 b , a long-distance object recognition unit 13 for recognizing an object present in a long-distance area on the basis of three-dimensional long-distance data calculated on the basis of situation data acquired using the first sensor 11 a , a short-distance object recognition unit 14 for recognizing an object present in a wide-angle and short-distance area on the basis of three-dimensional wide-angle short-distance data calculated on the basis of situation data acquired using the second sensor 11 b , and a feedback unit 15 for transferring information relating to the objects between the long-distance object recognition unit 13 and the short-distance object recognition unit 14.
1. A periphery recognition device comprising:
a first sensor that is configured to acquire situation data of a long-distance area;
a second sensor that has a detection region having a wider angle than the first sensor and is configured to acquire situation data of a short-distance area in the detection region;
a long-distance object recognition unit configured to recognize an object present in the long-distance area based on three-dimensional long-distance data calculated based on the situation data acquired by the first sensor, wherein recognizing the object includes determining a type of the object;
a short-distance object recognition unit configured to recognize the object present in the short-distance area based on three-dimensional wide-angle short-distance data calculated based on the situation data acquired by the second sensor, wherein recognizing the object includes determining a type of the object; and
an information linkage unit configured to transfer information indicating the type of the object between the long-distance object recognition unit and the short-distance object recognition unit,
wherein at least one of the long-distance object recognition unit and the short-distance object recognition unit is configured to use the transferred information to estimate an object type of an object detected in an area outside of the long-distance area and outside of the short-distance area.
2. The periphery recognition device according to claim 1 , wherein
the information linkage unit comprises a solid object map that is configured to record object recognition information created by the long-distance object recognition unit and the short-distance object recognition unit and indicates at least a type of a solid object, and a current position and speed in real environment of a three-dimensional object.
3. The periphery recognition device according to claim 1 , wherein
the information linkage unit is configured to transfer the information indicating the type of the object from the long-distance object recognition unit to the short-distance object recognition unit.
4. The periphery recognition device according to claim 1 , wherein
the first sensor and the second sensor in the periphery recognition device are constituted by a stereo camera device including a pair of cameras suitable for detection in a long distance and detection in a wide angle and a short distance, and
the periphery recognition device further comprises a three-dimensional distance image generation unit that performs stereo matching using an image signal received from the stereo camera device and creates a three-dimensional distance image for the long distance and a three-dimensional distance image for the wide angle and short distance.
5. The periphery recognition device according to claim 1 , wherein
the first sensor and the second sensor are mounted on a vehicle.
6. The periphery recognition device according to claim 1 , further comprising
a control application processing unit configured to determine a control operation to be executed by the vehicle on which the first sensor and the second sensor are mounted.
7. The periphery recognition device according to claim 1 ,
wherein the transferred information corresponds to an earlier time, and the at least one of the long-distance object recognition unit and the short-distance object recognition unit is configured to use the transferred information to determine object information including at least one of the object type, the object position, and the object speed.