Granted Patent B2

US 8,605,947 · App. 12/581,838 · Granted Dec 10, 2013

Inventors: Wende Zhang (Shelby Township, MI); Sanjeev M. Naik (Troy, MI)

Assignee: GM Global Technology Operations LLC

Abstract

Claims (67)

1. Method for detecting a clear path of travel for a host vehicle including fusion of clear path detection by image analysis and detection of an object within an operating environment of the host vehicle, the method comprising:

monitoring an image from a camera device;

analyzing the image through clear path detection analysis to determine a clear path of travel within the image;

monitoring two sets of sensor data describing the object, each set of sensor data comprising a range, a time-rate of change of range, and an azimuth angle of the object;

fusing, over a series of discrete time events, the two sets of sensor data to determine a tracked position and velocity of the object;

analyzing the tracked position and velocity of the object to determine an impact of the object to the clear path, comprising:

extracting a defined area of interest in the image corresponding to the tracked position and velocity of the object,

analyzing the defined area of interest to extract features indicative of the object, and

classifying the extracted features to determine the impact of the object to the clear path;

utilizing the determined impact of the object to describe an enhanced clear path of travel;

when the velocity of the object indicates the object is in motion, identifying a clear path image area, comprising:

determining a previously traversed path travelled by the object based on the tracked position and velocity of the object, and

identifying the clear path image area based on the previously traversed path, the clear path image area being devoid of other objects; and

utilizing the enhanced clear path of travel and the identified clear path image area to navigate the host vehicle.

2. The method of claim 1 , wherein monitoring two sets of sensor data describing the object comprises monitoring two sets of sensor data wherein each set describes a range, a time-rate of change of range, and an azimuth angle of another vehicle.

3. The method of claim 2 , wherein utilizing the determined impact of the object to describe the enhanced clear path of travel comprises removing from the clear path of travel a position of the other vehicle.

4. The method of claim 2 , wherein utilizing the determined impact of the object to describe the enhanced clear path of travel comprises removing from the clear path of travel a projected future position of the other vehicle.

5. The method of claim 2 , wherein utilizing the determined impact of the object to describe the enhanced clear path of travel comprises affecting a clear path confidence likelihood for different regions of the image based upon the two sets of sensor data wherein each set describes the range, the time-rate of change of range, and the azimuth angle of another vehicle.

6. The method of claim 1 , further comprising:

monitoring sensor data describing a construction area including structures within the construction area.

7. The method of claim 6 , wherein utilizing the determined impact of the object to describe the enhanced clear path of travel comprises removing from the clear path of travel the structures within the construction area.

8. The method of claim 6 , further comprising:

defining a construction area boundary based upon the sensor data describing the construction area.

9. The method of claim 6 , wherein monitoring sensor data describing the construction area comprises utilizing pattern recognition to determine lane instructions; and

determining a lane geometry restriction based upon the lane instructions.

10. The method of claim 6 , wherein utilizing the determined impact of the object to describe the enhanced clear path of travel comprises affecting a clear path confidence likelihood for different regions of the image based upon the sensor data describing the construction area.

11. The method of claim 6 , wherein analyzing the tracked position and velocity of the object comprises analyzing the tracked position and velocity of another vehicle; and

wherein analyzing the tracked position and velocity of the object to determine the impact of the object to the clear path comprises utilizing the tracked position and velocity of the other vehicle to augment a clear path defined within the construction area.

12. The method of claim 1 , wherein monitoring the two sets of sensor data describing the object comprises monitoring data from a camera system.

13. The method of claim 1 , wherein monitoring the two sets of sensor data describing the object comprises monitoring data from a system selected from the group consisting of a radar system, a LIDAR system, a vehicle-to-vehicle communications system, a vehicle-to-infrastructure communications system, and an ultrasonic detection system.

14. The method of claim 1 , further comprising monitoring sensor data describing a lane geometry; and

wherein analyzing the tracked position and velocity of the object to determine the impact of the object to the clear path is further based upon the lane geometry.

15. The method of claim 1 , further comprising utilizing the enhanced clear path of travel to augment subsequent monitoring of sensor data describing the object.

16. The method of claim 1 , further comprising utilizing the clear path detection analysis to describe an enhanced location of the object.

17. The method of claim 16 , wherein utilizing the clear path detection analysis to describe the enhanced location of the object comprises describing an enhanced location of another vehicle proximate to the host vehicle.

18. The method of claim 16 , wherein utilizing the clear path detection analysis to describe the enhanced location of the object comprises describing an enhanced location of a construction area object.

19. Method for detecting a clear path of travel for a host vehicle including fusion of clear path detection by image analysis and detection of an object within an operating environment of the host vehicle, the method comprising:

monitoring an image from a camera device;

analyzing the image through segmentation-based clear path detection analysis to determine a clear path of travel within the image;

monitoring two sets of sensor data describing the object wherein each set of sensor data comprises a range, a time-rate of change of range, and an azimuth angle of the object;

fusing, over a series of discrete time events, the two sets of sensor data to determine a tracked position and velocity of the object;

analyzing the tracked position and velocity of the object to determine an impact of the object to the clear path, comprising:

extracting a defined area of interest in the image corresponding to the tracked position and velocity of the object,

analyzing the defined area of interest to extract features indicative of the object, and

classifying the extracted features to determine the impact of the object to the clear path;

utilizing the determined impact of the object to describe an enhanced clear path of travel;

when the velocity of the object indicates the object is in motion, identifying a clear path image area, comprising:

determining a previously traversed path travelled by the object based on the tracked position and velocity of the object, and

identifying the clear path image area based on the previously traversed path; and

utilizing the enhanced clear path of travel and the identified clear path image area to navigate the vehicle.

20. System for detecting a clear path of travel for a host vehicle including fusion of clear path detection by image analysis and detection of an object within an operating environment of the host vehicle, the system comprising:

a camera device monitoring a view in front of the vehicle; and

a processing module comprising a general-purpose digital computer configured to execute the steps comprising:

monitoring an image from the camera device,

analyzing the image through clear path detection analysis to determine a clear path of travel within the image,

monitoring two sets of sensor data describing the object, each set of sensor data comprising a range, a time-rate of change of range, and an azimuth angle of the object,

analyzing the tracked position and velocity of the object to determine an impact of the object to the clear path, comprising

extracting a defined area of interest in the image corresponding to the tracked position and velocity of the object,

analyzing the defined area of interest to extract features indicative of the object,

classifying the extracted features to determine the impact of the object to the clear path,

utilizing the determined impact of the object to describe an enhanced clear path of travel,

when the velocity of the object indicates the object is in motion, identifying a clear path image area, comprising:

determining a previously traversed path travelled by the object based on the tracked position and velocity of the object, and

identifying the clear path image area based on the previously traversed path;

utilizing the enhanced clear path of travel and the identified clear path image area to navigate the vehicle.

21. The system of claim 20 , further comprising a radar imaging system; and

wherein the two sets of sensor data describing the object comprises two sets of data from the radar imaging system describing the object.

Assignments (8)

Continuity (5)