IP Library › Granted Patent US 8,428,305
Granted Patent B2
US 8,428,305 · App. 12/581,846 · Granted Apr 23, 2013

Method for detecting a clear path through topographical variation analysis

Inventors: Wende Zhang (Shelby Township, MI); Sanjeev M. Naik (Troy, MI)
Assignee: GM Global Technology Operations LLC
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,428,305
App. No.
12/581,846
Granted
Apr 23, 2013
Kind
B2
Abstract

A method for detecting a clear path of travel for a vehicle wherein the detecting includes a fusion of a plurality of analyses including monitoring an image from a camera device includes analyzing the image through clear path detection analysis to determine a clear path of travel within the image, analyzing an area in front of the vehicle utilizing a topographical variation analysis to determine a flat surface upon which the vehicle can travel, combining the clear path of travel and the determined flat surface to describe an enhanced clear path of travel, and utilizing the enhanced clear path of travel to navigate the vehicle.

Claims (50)

1. Method for detecting a clear path of travel for a vehicle, the detecting comprising a fusion of a plurality of analyses, the method comprising:

monitoring an image from a camera device;

analyzing the image through clear path detection analysis to determine a clear path of travel within the image;

analyzing an area in front of the vehicle utilizing a topographical variation analysis to determine a flat surface upon which the vehicle can travel, the topographical variation analysis comprising at least one of:

utilizing a ground plane estimation analysis to compile a map that describes height variation on a surface in the area in front of the vehicle to determine an elevation contour of a ground plane in front of the vehicle, and

utilizing a snow elevation change analysis estimating a transition in height of snow in front of the vehicle;

combining the clear path of travel and the determined flat surface to describe an enhanced clear path of travel; and

utilizing the enhanced clear path of travel to navigate the vehicle.

2. The method of claim 1 , wherein analyzing the area in front of the vehicle comprises only utilizing the ground plane estimation analysis.

3. The method of claim 2 , wherein utilizing ground plane estimation analysis comprises utilizing a plurality of images to estimate heights of visible features in front of the vehicle based upon relative movement of features between the plurality of images.

4. The method of claim 2 , wherein utilizing ground plane estimation analysis comprises utilizing a LIDAR device to determine a ground plane estimate in front of the vehicle.

5. The method of claim 1 , wherein analyzing the image through clear path detection analysis comprises utilizing an analysis selected from the group consisting of a patch-based analysis, a pixel-based analysis, a segmentation-based analysis, and an example-based analysis.

6. The method of claim 1 , wherein analyzing the image through clear path detection analysis comprises utilizing a fusion of analyses selected from the group consisting of a patch-based analysis, a pixel-based analysis, a segmentation-based analysis, and an example-based analysis.

7. The method of claim 1 , further comprising iteratively analyzing the area in front of the vehicle utilizing the topographical variation analysis to build confidence in the flat surface.

8. The method of claim 1 , wherein combining the clear path of travel and the determined flat surface to describe the enhanced clear path of travel comprises utilizing as the enhanced clear path only an area contained by both the clear path of travel and the determined flat surface.

9. The method of claim 1 , wherein combining the clear path of travel and the determined flat surface further describes an enhanced topographical variation analysis; and

utilizing the enhanced topographical variation analysis to navigate the vehicle.

10. Method for detecting a clear path of travel for a vehicle, the detecting comprising a fusion of a plurality of analyses, the method comprising:

monitoring an image from a camera device;

analyzing the image through clear path detection analysis to determine a clear path of travel within the image;

analyzing an area in front of the vehicle utilizing snow elevation change analysis to determine a flat surface upon which the vehicle can travel;

combining the clear path of travel and the determined flat surface to describe an enhanced clear path of travel; and

utilizing the enhanced clear path of travel to navigate the vehicle.

11. The method of claim 10 , wherein the snow elevation change analysis comprises analyzing an image based upon a frequency of pixel change to estimate the flat surface.

12. The method of claim 11 , wherein analyzing the image based upon the frequency of pixel change to estimate the flat surface comprises analyzing a change in pixel intensity.

13. The method of claim 11 , wherein analyzing the image based upon the frequency of pixel change to estimate the flat surface comprises analyzing a change in pixel color.

14. The method of claim 11 , wherein analyzing the image based upon the frequency of pixel change to estimate the flat surface comprises identifying a boundary to the flat surface based upon identifying an area of large pixel change in excess of a threshold.

15. The method of claim 14 , wherein analyzing the image based upon the frequency of pixel change to estimate the flat surface further comprises identifying the flat surface based upon identifying an area adjacent to the boundary of moderate pixel change less than the threshold and greater than a lower threshold.

16. The method of claim 11 , wherein analyzing the image based upon the frequency of pixel change to estimate the flat surface comprises identifying boundaries upon both sides of the flat surface based upon identifying areas of large pixel change in excess of a threshold.

17. The method of claim 16 , wherein analyzing the image based upon the frequency of pixel change to estimate the flat surface further comprises identifying the flat surface based upon identifying an area between the boundaries of moderate pixel change less than the threshold and greater than a lower threshold.

18. Method for detecting a clear path of travel for a vehicle, the detecting comprising a fusion of a plurality of analyses, the method comprising:

monitoring an image from a camera device;

analyzing the image through clear path detection analysis to determine a clear path of travel within the image;

analyzing an area in front of the vehicle utilizing a topographical variation analysis to determine a flat surface upon which the vehicle can travel, wherein the topographical variation analysis comprises ground plane estimation and snow elevation detection;

combining the clear path of travel and the determined flat surface to describe an enhanced clear path of travel; and

utilizing the enhanced clear path of travel to navigate the vehicle.

19. A system for detecting a clear path of travel for a vehicle, the detecting comprising a fusion of a plurality of analyses, the system comprising:

a camera device; and

a processing module

monitor images from the camera device, and

analyzing the images comprising

determining a clear path of travel from other portions of the image that do not indicate a clear path of travel, and

monitoring data describing topography in front of the vehicle,

analyzing the data describing the topography in front of the vehicle comprising at least one of:

utilizing a ground plane estimation analysis to compile a map that describes height variation on a surface in the area in front of the vehicle to determine an elevation contour of a ground plane in front of the vehicle, and

utilizing a snow elevation change analysis estimating a transition in height of snow in front of the vehicle,

analyzing the clear path and the analysis of the data describing the topography in front of the vehicle,

enhancing the clear path based upon the analysis of the clear path and the analysis of the data describing the topography in front of the vehicle, and

aiding navigation of the vehicle based upon the modified clear path.

20. The system of claim 19 , further comprising an autonomous steering system, wherein the autonomous steering system utilizes the navigation aid from the processing module.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2014
From: WILMINGTON TRUST COMPANY
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 034287/0001 →
CHANGE OF NAME Recorded Feb 10, 2011
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 025781/0299 →
SECURITY AGREEMENT Recorded Nov 8, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: WILMINGTON TRUST COMPANY
Reel/Frame 025324/0555 →
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2010
From: UAW RETIREE MEDICAL BENEFITS TRUST
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025315/0136 →
RELEASE OF SECURITY INTEREST Recorded Nov 4, 2010
From: UNITED STATES DEPARTMENT OF THE TREASURY
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 025246/0234 →
SECURITY AGREEMENT Recorded Feb 25, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UNITED STATES DEPARTMENT OF THE TREASURY
Reel/Frame 023989/0155 →
SECURITY AGREEMENT Recorded Feb 25, 2010
From: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
To: UAW RETIREE MEDICAL BENEFITS TRUST
Reel/Frame 023990/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 6, 2010
From: ZHANG, WENDE; NAIK, SANJEEV M.
To: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
Reel/Frame 023738/0182 →
Continuity (5)
Continuation In Part 12581659 · Oct 19, 2009
Continuation In Part 12474594 · May 29, 2009
Continuation In Part 12108581 · Apr 24, 2008
Provisional Application 61215745 · May 8, 2009
Related Publication 20100098290A1 · Apr 22, 2010