Vehicle control device
A vehicle control device recognizes a border of a traveling area of a vehicle based on image data acquired when a camera photographs a forward view of the vehicle, and performs at least one of a departure alarm and a departure control when the vehicle is predicted to depart from a reference line set based on the border or when the vehicle has departed from the border. Furthermore, the vehicle control device determines whether a particular registered three-dimensional object that is previously registered exists, based on the image data, and makes it easier to recognize the border in a predetermined easing area set based on the position of the registered three-dimensional object on the image data, than in a normal area on the image data other than the easing area, when it is determined that the registered three-dimensional object exists.
1 . A vehicle control device comprising:
a camera that photographs a forward view of a vehicle and that acquires image data; and
a control unit that is configured to:
extract feature points in the image data;
perform fitting of the feature points to approximate lines expressed by multidimensional functions;
acquire a vote value based on numbers of the feature points on each of the approximate lines;
specify one or more of the approximate lines for each of which the vote value is equal to or more than a recognition threshold, as border candidates of a traveling area for the vehicle;
recognize a border of the traveling area for the vehicle from the border candidates;
determine, based on the image data, whether a starting point three-dimensional object provided at only a starting point of a median strip on the border exists;
set an easing area based on a position of the starting point three-dimensional object on the image data and based on setting at least one of a first threshold, for the easing area as the recognition threshold which is smaller than a second threshold for a normal area, and a weight of the vote value in the easing area to a larger value than the weight of the vote value in the normal area, the starting point three-dimensional object exists in the normal area, and the normal area being an area that is on the image data and that is other than the easing area;
determine whether the vehicle is predicted to depart from a reference line that is set based on at least one of the border and whether the vehicle has departed from the reference line; and
perform at least one of a departure alarm and a departure control based on determining that the vehicle is predicted to depart from the reference line that is set based on the at least one of the border and whether the vehicle has departed from the reference line, the departure alarm indicating a departure of the vehicle from the reference line, the departure control comprising controlling the vehicle to avoid departing from the reference line.
2 . The vehicle control device according to claim 1 , wherein the control unit is configured to cause an execution condition to be satisfied and execute any of the departure alarm and the departure control, when there is a possibility that the vehicle collides with a registered three-dimensional object.
3 . The vehicle control device according to claim 1 , wherein the control unit is configured to select, based on the image data, a kind of the border from among kinds comprising a white line, a guardrail, a curbstone, and a wall.
4 . The vehicle control device according to claim 1 , further comprising
a millimeter wave radar that sends a millimeter wave in a forward direction of the vehicle, receives a reflected wave from a physical object, and acquires radar physical object information based on the received reflected wave,
wherein the control unit is configured to specify a position of stationary physical object based on the radar physical object information, and determine whether a registered three-dimensional object exists in the stationary physical objects on the image data.
5 . The vehicle control device according to claim 2 , further comprising
a millimeter wave radar that sends a millimeter wave in a forward direction of the vehicle, receives a reflected wave from a physical object, and acquires radar physical object information based on the received reflected wave,
wherein the control unit is configured to specify positions of stationary physical objects based on the radar physical object information, and determine whether the starting point three-dimensional object and the registered three-dimensional object exist in the stationary physical objects on the image data.
6 . The vehicle control device according to claim 1 , wherein the control unit is configured to perform the departure alarm, and the departure alarm comprises controlling a speaker of the vehicle to emit a sound.
7 . The vehicle control device according to claim 1 , wherein the control unit is configured to perform the departure control, and the departure control comprises controlling a steering motor of the vehicle to change a steering angle of the vehicle.
8 . A vehicle control system comprising:
a camera that photographs a forward view of a vehicle and that acquires image data;
a millimeter wave radar that that sends a millimeter wave in a forward direction of the vehicle, receives a reflected wave from a physical object, and acquires radar physical object information based on the received reflected wave; and
a control unit that is configured to:
extract feature points in the image data, the feature points representing at least part of any of a white line, a guardrail, a curbstone, and a wall;
perform fitting of the feature points to approximate lines expressed by multidimensional functions;
acquire a vote value based on numbers of the feature points on each of the approximate lines and a number of pixels in at least part of the image data;
specify one or more of the approximate lines for each of which the vote value is equal to or more than a recognition threshold, as border candidates of a traveling area for the vehicle;
recognize a border of the traveling area for the vehicle from the border candidates and, based on recognizing the border, set a reference line to a preset distance away from at least part of the border, the border being at least one of a right border and a left border relative to the forward direction of the vehicle;
determine a distance from the vehicle to a traffic light;
determine, based on the image data and the distance from the vehicle to the traffic light, whether a starting point three-dimensional object provided at only a starting point of a median strip on the border exists;
specify a position of stationary physical object based on the radar physical object information, and determine whether a registered three-dimensional object exists in the stationary physical objects on the image data
set an easing area based on a position of the starting point three-dimensional object on the image data and based on setting at least one of a first threshold, for the easing area as the recognition threshold which is smaller than a second threshold for a normal area, and a weight of the vote value in the easing area to a larger value than the weight of the vote value in the normal area, the starting point three-dimensional object exists in the normal area, and the normal area being an area that is on the image data and that is other than the easing area;
determine whether the vehicle is predicted to depart from a reference line that is set based on at least one of the border and whether the vehicle has departed from the reference line; and
perform at least one of a departure alarm and a departure control based on determining that the vehicle is predicted to depart from the reference line that is set based on the at least one of the border and whether the vehicle has departed from the reference line, the departure alarm indicating a departure of the vehicle from the reference line, the departure control comprising controlling the vehicle to avoid departing from the reference line.