Granted Patent B2

US 8,487,991 · App. 12/581,659 · Granted Jul 16, 2013

Inventors: Wende Zhang (Shelby Township, MI); Qi Wu (Pittsburgh, PA); Tsuhan Chen (Ithaca, NY)

Assignees: GM Global Technology Operations LLC; Carnegie Mellon University

Abstract

Claims (54)

1. A method for estimating a vanishing point in a roadway using a current image generated by a camera on a vehicle, the method comprising:

defining an exemplary vanishing point for each of a plurality of sample images;

identifying features within each of the plurality of sample images;

monitoring the current image generated by the camera;

identifying features within the current image;

matching the current image to at least one of the sample images based upon the identified features within the current image and the identified features within the plurality of sample images;

determining the vanishing point based upon the matching and the exemplary vanishing point for each of the plurality of sample images that have been matched with the current image;

determining a horizon line on the current image based upon the exemplary vanishing points comprising:

identifying a greatest number of the exemplary vanishing points along a horizontal row over the plurality of sample images as the horizon line, the current image is a separate and distinct image from each of the plurality of sample images; and

utilizing the vanishing point and the horizon line to navigate the vehicle.

2. The method of claim 1 , further comprising:

utilizing the vanishing point and the horizon line to determine a clear path of travel for the vehicle; and

wherein utilizing the vanishing point and the horizon line to navigate the vehicle comprises utilizing the clear path of travel to navigate the vehicle.

3. The method of claim 2 , wherein the horizontal line is identified utilizing a two-dimensional histogram; and

wherein utilizing the vanishing point and the horizon line to determine the clear path of travel for the vehicle comprises determining the clear path of travel based upon an image area below the horizon line.

4. The method of claim 2 , further comprising:

filtering a plurality of image areas on the current image using a plurality of linear filters to obtain a filter response;

determining a dominant orientation of the filter response for each of the image areas;

determining an orientation ray based upon the dominant orientation for each of the image areas; and

determining a quantity of intersections among the image areas and the orientation rays for each of the image areas.

5. The method of claim 4 , further comprising:

determining clear path image areas based upon the quantity of intersections among the image areas and the orientation rays.

6. A method for estimating a vanishing point in a roadway using a current image generated by a camera on a vehicle, the method comprising:

defining an exemplary vanishing point for each of a plurality of sample images;

identifying features within each of the plurality of sample images;

monitoring the current image generated by the camera;

identifying features within the current image, comprising:

filtering a plurality of image areas on the current image using a plurality of linear filters to obtain a filter response;

determining a dominant orientation of the filter response for each of the image areas;

determining an orientation ray based upon the dominant orientation for each of the image areas;

determining a quantity of intersections among image areas and the orientation rays for each of the image areas;

determining clear path image areas based upon the quantity of intersections; and

utilizing a clear path detection analysis to identify the image areas on the current image corresponding to said clear path image areas, wherein image areas surrounded by said clear path image areas correspond to lane markers, and

wherein image areas neighboring said clear path image areas on a first side and not clear path image areas on an opposite side correspond to lane boundaries;

matching the current image to at least one of the plurality of sample images based upon the identified features within the current image and the identified features within the plurality of sample images;

determining the vanishing point based upon the matching and the exemplary vanishing point for each of the plurality of sample images that have been matched to the current image;

utilizing the vanishing point to determine a clear path of travel for the vehicle; and

utilizing the clear path of travel to navigate the vehicle.

7. The method of claim 6 , wherein image areas intersected by less than a predetermined threshold of orientation rays correspond to the clear path of travel for the vehicle.

8. The method of claim 6 , wherein image areas intersected by greater than a predetermined threshold of the orientation rays correspond to the features within the current image.

9. A method for estimating a vanishing point in a roadway using a current image generated by a camera on a vehicle, the method comprising:

defining an exemplary vanishing point for each of a plurality of sample images;

identifying features within each of the plurality of sample images;

monitoring the current image generated by the camera;

identifying features within the current image;

matching the current image to at least one of the plurality of sample images based upon the identified features within the current image and the identified features within the plurality of sample images;

determining the vanishing point based upon the matching and the exemplary vanishing point for each of the plurality of sample images that have been matched to the current image, comprising:

initializing positions of the exemplary vanishing points in a feature space;

for each of the exemplary vanishing points, estimating a probability that the exemplary vanishing point corresponds to the vanishing point in the current image;

converging the exemplary vanishing points based upon the estimated probability; and

merging vanishing points based upon distance between exemplary vanishing points; and

utilizing the vanishing point to navigate the vehicle.

10. The method of claim 9 , further comprising:

removing the exemplary vanishing points residing a predetermined threshold distance.

Assignments (9)

Continuity (4)