Object detection device and vehicle using same
View Patent ↗Provided is an object detection device that makes it possible to more accurately detect a road surface even when an area that is not the road surface occupies the majority of an image and the gradient of the road surface is large, and to detect an obstacle on a road surface with greater accuracy than in the prior art. The object detection device includes: a parallax calculation unit that generates a parallax image on the basis of a plurality of images; a parallax gradient calculation unit that, for each pixel in the parallax image, calculates a parallax gradient for each pixel on the basis of the parallax of a predetermined pixel and a pixel that is adjacent to the predetermined pixel; a detection candidate determination unit that determines whether a detection candidate is present on the basis of the parallax gradient of each pixel; a voting unit that carries out a histogram vote using each of the pixels that are determined to be detection candidates and generates a histogram frequency for each of the pixels when the detection candidate is determined to be present; and an object detection unit that detects presence of an object and a position of the object on the basis of the histogram frequency.
1. An object detection device comprising:
a parallax calculation unit that generates a parallax image based on a plurality of images;
a parallax gradient calculation unit that, for each pixel in the parallax image, calculates a parallax gradient for each pixel based on the parallax of a predetermined pixel and a pixel that is adjacent to the predetermined pixel;
a detection candidate determination unit that determines whether a detection candidate is present based on the parallax gradient of each pixel;
a voting unit that carries out a histogram vote using each of the pixels that are determined to be detection candidates and generates a histogram frequency for each of the pixels when the detection candidate is determined to be present; and
an object detection unit that detects presence of an object and a position of the object based on the histogram frequency;
wherein the detection candidate determination unit compares the parallax gradient of the pixel and a parallax gradient threshold corresponding to the acquired parallax of the pixel for each pixel in the parallax image, and determines whether the detection candidate is present from each of the pixels;
wherein the parallax gradient calculation unit calculates and outputs the parallax gradient αi=ΔDisparity/ΔV, where V is an image ordinate; and
wherein the parallax gradient threshold is determined based on a maximum gradient of the road surface.
2. The object detection device according to claim 1 , wherein
the object to be detected by the object detection unit is a road surface or an obstacle.
3. The object detection device according to claim 1 , wherein
the detection candidate of the detection candidate determination unit is a road surface candidate, and
the parallax gradient threshold is a threshold to determine whether the road surface is present for each parallax in a certain fixed range, and is stored in a parallax gradient threshold table in advance.
4. The object detection device according to claim 1 , wherein the detection candidate determination unit determines whether a data point of each of the pixels, indicating a point on a three-dimensional space which is represented by an image coordinate of the pixel and the parallax stored in the pixel, is a road surface candidate.
5. The object detection device according to claim 1 , wherein a V-disparity image is a two-dimensional image having an image coordinate in the vertical direction and parallax disparity as its axes, and the histogram vote counts up the histogram frequency of the pixel with which the spatial position of the data point is projected onto the V-disparity image, one by one, for each data point of target pixels.
6. The object detection device according to claim 1 , wherein the parallax gradient calculation unit executes processing at a timing delayed by one line plus one pixel after the parallax calculation unit generates the parallax image.
7. The object detection device according to claim 1 , wherein the application to determine whether a data point of the pixel is an object candidate in air including a traffic light or a road sign and detect an object in the air using the object detection unit on a subsequent stage is made by adjusting ΔYup and ΔYdown, where Y represents a height of the data point having a position of a camera as an origin point.
8. A vehicle comprising:
the object detection device according to claim 1 which is provided with a traveling control unit that generates an instruction to control a braking force or a driving force based on the presence of the object and the position of the object which are detected by the object detection unit.