IP Library › Granted Patent US 10,372,128
Granted Patent B2
US 10,372,128 · App. 15/357,980 · Granted Aug 6, 2019

Sinkhole detection systems and methods

Inventors: Scott Vincent Myers (Camarillo, CA); Ashley Elizabeth Micks (Mountain View, CA); Alexandru Mihai Gurghian (Palo Alto, CA); Harpreetsingh Banvait (Sunnyvale, CA); Parsa Mahmoudieh (Vallejo, CA)
Assignee: FORD GLOBAL TECHNOLOGIES, LLC
G05D1/0088B60W30/00G06K9/00791G06K9/6288G08G1/0967G08G1/09626G08G1/096791G08G1/162G08G1/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,372,128
App. No.
15/357,980
Granted
Aug 6, 2019
Kind
B2
Abstract

Example sinkhole detection systems and methods are described. In one implementation, a method receives data from multiple sensors mounted to a vehicle and analyzes the received data to identify a sinkhole in a roadway ahead of the vehicle. If a sinkhole is identified, the method adjusts vehicle operations and reports the sinkhole to a shared database and/or another vehicle.

Claims (48)

1. A method comprising:

receiving data from a plurality of sensors mounted to a vehicle;

analyzing, using one or more processors, the received data to identify a sinkhole in a roadway ahead of the vehicle; and

responsive to identification of a sinkhole in the roadway:

adjusting vehicle operations; and

reporting the sinkhole to at least one of a shared database and another vehicle;

wherein analyzing the received data to identify a sinkhole in the roadway includes:

receiving drive history data describing the roadway ahead of the vehicle, the drive history data including a road elevation for the roadway ahead of the vehicle;

determining an actual elevation of a second vehicle on the roadway ahead of the vehicle; and

detecting a difference between the actual elevation and the road elevation;

in response to detecting a difference between the actual elevation and the road elevation, identifying the sinkhole in the roadway ahead of the vehicle.

2. The method of claim 1 , wherein the plurality of sensors include one or more of a Lidar sensor, a radar sensor, and a camera.

3. The method of claim 1 , further comprising fusing the data received from the plurality of vehicle sensors.

4. The method of claim 1 , wherein analyzing the received data to identify a sinkhole in the roadway includes detecting an area in the roadway that does not return Lidar ground plane points.

5. The method of claim 1 , wherein analyzing the received data to identify a sinkhole in the roadway includes detecting an area in data from a camera that does not indicate a roadway surface.

6. The method of claim 1 , wherein analyzing the received data to identify a sinkhole in the roadway includes detecting a descent of another vehicle with respect to the roadway.

7. The method of claim 1 , wherein analyzing the received data to identify a sinkhole in the roadway includes detecting a rise of a back of another vehicle with respect to the roadway.

8. The method of claim 1 , wherein reporting the sinkhole to another vehicle includes communicating with the another vehicle using vehicle-to-vehicle communications.

9. The method of claim 1 , wherein adjusting vehicle operations includes stopping the vehicle or maneuvering around the sinkhole.

10. The method of claim 1 , wherein the vehicle is an autonomous vehicle.

11. A method comprising:

receiving data from a plurality of sensors mounted to a first vehicle;

analyzing, using one or more processors, the received data to identify movement of a second vehicle in a roadway ahead of the first vehicle; and

responsive to identification of movement of the second vehicle:

determining the existence of a sinkhole in the roadway ahead of the first vehicle;

adjusting operation of the first vehicle; and

reporting the sinkhole to at least one of a shared database and another vehicle;

wherein determining the existence of the sinkhole in the roadway ahead of the first vehicle comprises:

receiving drive history data describing the roadway ahead of the vehicle, the drive history data including a road elevation for the roadway ahead of the vehicle;

determine an actual elevation of a second vehicle on the roadway ahead of the vehicle according to the received data from the plurality of sensors; and

detecting a difference between the actual elevation and the road elevation for the roadway ahead of the vehicle; and

in response to detecting the difference is detected between the actual elevation and the road surface height, determining that the sinkhole is in the roadway ahead of the vehicle.

12. The method of claim 11 , wherein the plurality of sensors include one or more of a Lidar sensor, a radar sensor, and a camera.

13. The method of claim 11 , wherein identifying the movement of the second vehicle includes identifying a descent of the second vehicle with respect to the roadway surface.

14. The method of claim 11 , wherein identifying the movement of the second vehicle includes a rise of the back of the second vehicle with respect to the roadway surface.

15. The method of claim 11 , wherein reporting the sinkhole to another vehicle includes communicating with the another vehicle using vehicle-to-vehicle communications.

16. The method of claim 11 , wherein adjusting operation of the first vehicle includes stopping the first vehicle or maneuvering the first vehicle around the sinkhole.

17. An apparatus comprising:

a plurality of sensors mounted to a vehicle and configured to capture sensor data;

a plurality of vehicle control actuators configured to adjust operation of the vehicle; and

a sinkhole detection system coupled to the plurality of sensors and the plurality of vehicle control actuators, the sinkhole detection system configured to receive and analyze the sensor data to identify a sinkhole in a roadway ahead of the vehicle, the sinkhole detection further configured, responsive to identification of a sinkhole in the roadway, to:

adjust vehicle operations using the plurality of vehicle control actuators; and

report the sinkhole to at least one of a shared database and another vehicle;

wherein the sinkhole detection system is programmed to:

receive drive history data describing the roadway ahead of the vehicle, the drive history data including a road elevation for the roadway ahead of the vehicle;

determine an actual elevation of the roadway ahead of the vehicle according to the sensor data; and

if a difference is detected between the actual elevation and the road elevation, identify the sinkhole in the roadway ahead of the vehicle.

18. The apparatus of claim 17 , wherein the plurality of sensors include one or more of a Lidar sensor, a radar sensor, and a camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: MYERS, SCOTT VINCENT; MICKS, ASHLEY ELIZABETH; GURGHIAN, ALEXANDRU MIHAI; BANVAIT, HARPREETSINGH; MAHMOUDIEH, PARSA
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 040661/0774 →
Continuity (1)
Related Publication 20180143631A1 · May 24, 2018
Cited By (1)
US 12,286,120