Correct driving direction from lane marked arrows
The invention covers a method performed by a computing device configured to detect a lane direction in a parking zone being navigated by a vehicle. The method uses an image capture device to obtain an image of an environment surrounding the vehicle that includes an arrow marking on a ground surface of the parking zone. The method then generates a top-down image, including the arrow marking, of the environment surrounding the vehicle, performs an image analysis of the top-down image to determine an arrow direction of the arrow marking. The method then detects the lane direction of a lane occupied by the vehicle based on the determined arrow direction from the image analysis results, generates and provides an output indicating the lane direction of the lane occupied by the vehicle, and moves the vehicle in that direction.
1 . A method performed by a computing device configured to detect a lane direction in a parking zone being navigated by a vehicle, the method comprising:
capturing, using an image capture device, at least one image of an environment surrounding the vehicle, wherein the at least one image includes an arrow marking on a ground surface of the parking zone;
generating a top-down image of the environment surrounding the vehicle based on the captured at least one image, wherein the top-down image includes the arrow marking;
performing an image analysis of the top-down image to determine an arrow direction of the arrow marking;
detecting, based on results of the image analysis, the lane direction of a lane occupied by the vehicle based on the determined arrow direction;
generating and providing an output indicating the lane direction of the lane occupied by the vehicle; and
providing, to an autonomous driving system of the vehicle, an instruction to correct a driving direction of the vehicle and for the vehicle to move in that direction,
which includes at least one of, responsive to the detected lane direction:
providing, to at least one of a driver of the vehicle and the autonomous driving system of the vehicle, a notification of the detected lane direction; and
providing, to at least one of the driver of the vehicle and the autonomous driving system of the vehicle, a notification that a driving direction of the vehicle is incorrect.
2 . The method of claim 1 , wherein the generating of the top-down image includes performing inverse perspective projection (IPP) processing on the captured at least one image to generate the top-down image.
3 . The method of claim 2 , wherein the captured at least one image includes a plurality of captured images, and the performing of the IPP processing includes generating the top-down image using the plurality of captured images.
4 . The method of claim 3 , wherein the plurality of captured images includes at least four of the captured images corresponding to a front view, a rear view, and left and right views of the environment surrounding the vehicle.
5 . The method of claim 1 , wherein the performing of the image analysis of the top-down image includes performing segmentation of the top-down image to generate a segmented image that identifies the arrow marking.
6 . The method of claim 5 , wherein the performing of the image analysis further includes performing a point density analysis of the arrow marking.
7 . The method of claim 6 , wherein the performing of the point density analysis includes generating an overlay of points on the arrow marking in the segmented image and measuring concentrations of the points in respective portions of the arrow marking.
8 . The method of claim 7 , wherein determining the arrow direction includes determining the arrow direction based on the measured concentrations of the points.
9 . The method of claim 7 , wherein determining the lane direction includes determining the lane direction based on a portion of the arrow marking having a greatest concentration of the points.
10 . A system configured to detect a lane direction in a parking zone being navigated by a vehicle, the system comprising:
at least one image capture device configured to capture at least one image of an environment surrounding the vehicle, wherein the at least one image includes an arrow marking on a ground surface of the parking zone; and
a computing system configured to
generate a top-down image of the environment surrounding the vehicle based on the captured at least one image, wherein the top-down image includes the arrow marking,
perform an image analysis of the top-down image to determine an arrow direction of the arrow marking,
detect, based on results of the image analysis, the lane direction of a lane occupied by the vehicle based on the determined arrow direction,
generate and provide an output indicating the lane direction of the lane occupied by the vehicle, and
provide, to an autonomous driving system of the vehicle, an instruction to correct a driving direction of the vehicle and for the vehicle to move in that direction,
which includes at least one of, responsive to the detected lane direction:
providing, to at least one of a driver of the vehicle and the autonomous driving system of the vehicle, a notification of the detected lane direction; and
providing, to at least one of the driver of the vehicle and the autonomous driving system of the vehicle, a notification that a driving direction of the vehicle is incorrect.
11 . The system of claim 10 , wherein the generating of the top-down image includes performing inverse perspective projection (IPP) processing on the captured at least one image to generate the top-down image.
12 . The system of claim 11 , wherein the captured at least one image includes a plurality of captured images, and the performing of the IPP processing includes generating the top-down image using the plurality of captured images.
13 . The system of claim 12 , wherein the plurality of captured images includes at least four of the captured images corresponding to a front view, a rear view, and left and right views of the environment surrounding the vehicle.
14 . The system of claim 10 , wherein the performing of the image analysis of the top-down image includes performing segmentation of the top-down image to generate a segmented image that identifies the arrow marking.
15 . The system of claim 14 , wherein the performing of the image analysis further includes performing a point density analysis of the arrow marking.
16 . The system of claim 15 , wherein the performing of the point density analysis includes generating an overlay of points on the arrow marking in the segmented image and measuring concentrations of the points in respective portions of the arrow marking.
17 . The system of claim 16 , wherein determining the arrow direction includes determining the arrow direction based on the measured concentrations of the points.
18 . A processor configured to execute instructions stored on a non-transitory computer-readable medium, wherein executing the instructions causes the processor to:
capture at least one image of an environment surrounding a vehicle navigating a parking zone, wherein the at least one image includes an arrow marking on a ground surface of the parking zone;
generate a top-down image of the environment surrounding the vehicle based on the captured at least one image, wherein the top-down image includes the arrow marking;
perform an image analysis of the top-down image to determine an arrow direction of the arrow marking;
detect, based on results of the image analysis, a lane direction of a lane occupied by the vehicle based on the determined arrow direction;
generate and provide an output indicating the lane direction of the lane occupied by the vehicle; and
provide, to an autonomous driving system of the vehicle, an instruction to correct a driving direction of the vehicle and for the vehicle to move in that direction,
which includes at least one of, responsive to the detected lane direction:
providing, to at least one of a driver of the vehicle and the autonomous driving system of the vehicle, a notification of the detected lane direction; and
providing, to at least one of the driver of the vehicle and the autonomous driving system of the vehicle, a notification that a driving direction of the vehicle is incorrect.