IP Library › Granted Patent US 10,369,994
Granted Patent B2
US 10,369,994 · App. 15/215,368 · Granted Aug 6, 2019

Rear camera stub detection

Inventors: Scott Vincent Myers (Camarillo, CA); Alexandru Mihai Gurghian (Palo Alto, CA); Ashley Elizabeth Micks (Mountain View, CA); Alexandro Walsh (Mountain View, CA)
Assignee: FORD GLOBAL TECHNOLOGIES, LLC
B60W30/12B60W30/0956B60W40/072B60W50/00G01S13/867G01S13/89G01S15/025G01S15/89G01S17/023G01S17/89G06K9/00201G06K9/00798G06K9/4628G06K9/627G06K9/66G08G1/0962G08G1/165G08G1/167B60W2050/0014B60W2420/40B60W2420/42B60W2420/52B60W2420/54B60W2550/143
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,369,994
App. No.
15/215,368
Granted
Aug 6, 2019
Kind
B2
Abstract

A method for detecting stubs or intersecting roadways includes receiving perception data from at least two sensors. The at least two sensors include a rear facing camera of a vehicle and another sensor. The perception data includes information for a current roadway on which the vehicle is located. The method includes detecting, based on the perception data, an intersecting roadway connecting with the current roadway. The method also includes storing an indication of a location and a direction of the intersecting roadway with respect to the current roadway.

Claims (45)

1. A method comprising:

receiving perception data from at least two sensors of a vehicle that generate different data types, the at least two sensors comprising a rear facing camera and at least one of a light detection and ranging (LIDAR) system or a radar system, wherein the perception data comprises information for a current roadway on which the vehicle is located;

generating fused data based on the perception data using weighted averages for the different data types;

detecting, based on the fused data, an intersecting roadway connecting with the current roadway; and

providing an indication of a location and a direction of the intersecting roadway with respect to the current roadway to an automated driving system or driver assistance system, whereby the automated driving system or driver assistance system actuates one or more vehicle controllers based on the indication.

2. The method of claim 1 , wherein detecting the intersecting roadway comprises detecting one or more of: a gap in roadway markings, a break in a shoulder for the current roadway, or a variation or break in curb or barrier height.

3. The method of claim 1 , wherein detecting the intersecting roadway comprises detecting using a deep neural network, and wherein generating the fused data further comprises modifying raw perception data to match a data format expected by the deep neural network.

4. The method of claim 1 , wherein the at least two sensors comprise the rear facing camera, the LIDAR system, the radar system, an ultrasound sensing system, and an infrared camera system.

5. The method of claim 1 , wherein the direction indicates a side of the current roadway on which the intersecting roadway is located.

6. The method of claim 1 , further comprising storing the indication of the location and the direction of the intersecting roadway by uploading the indication to a remote storage location accessible over a network.

7. The method of claim 6 , further comprising:

determining a current location of the vehicle;

retrieving drive history data from the remote storage location for the current location, wherein the drive history data indicates a location or direction of intersecting roadways near the current location; and

broadcasting the location or direction of intersecting roadways near the current location to one or more vehicle controllers of an automated driving system or driving assistance system.

8. The method of claim 7 , further comprising processing the location or direction of intersecting roadways to determine a route for the vehicle or detect a point of interest for the vehicle or a passenger.

9. A system comprising:

two or more sensors of a vehicle that generate different data types, the two or more sensors comprising a rear facing camera and at least one of a light detection and ranging (LIDAR) system or a radar system;

a computing system comprising a processor configured to perform the following:

receive perception data from the two or more sensors, wherein the perception data comprises information for a region behind the vehicle on a current roadway on which the vehicle is located;

generate fused data based on the perception data using weighted averages for the different data types;

detect, based on the fused data, an intersecting roadway connecting with the current roadway;

determine a driving maneuver for the vehicle based on an indication of a location and a direction of the intersecting roadway with respect to the current roadway; and

actuate one or more controllers of the vehicle to execute the driving maneuver.

10. The system of claim 9 , wherein the computing system comprising the processor is configured to detect the intersecting roadway by detecting one or more of: a gap in roadway markings, a break in a shoulder for the current roadway, or a variation or break in curb or barrier height.

11. The system of claim 9 , wherein the computing system comprising the processor is configured to detect the intersecting roadway by detecting using a deep neural network to process at least a portion of the perception data.

12. The system of claim 9 , wherein the two or more sensors comprise the rear facing camera, the LIDAR system, the radar system, an ultrasound sensing system, and an infrared camera system.

13. The system of claim 9 , wherein the computing system comprising the processor is configured to detect the direction, wherein the direction indicates a side of the current roadway on which the intersecting roadway is located.

14. The system of claim 9 , wherein the computing system comprising the processor is configured to detect an intersecting roadway by detecting a driving surface that connects the current roadway to one or more of a driveway, parking lot, or a cross street.

15. The system of claim 9 , wherein the computing system comprising the processor is configured to store the indication of the location and the direction of the intersecting roadway by uploading the indication to a remote storage location accessible over a network.

16. The system of claim 15 , wherein the computing system comprising the processor is further configured to:

determine a current location of the vehicle; and

retrieve drive history data from the remote storage location for the current location, wherein the drive history data indicates a location or direction of intersecting roadways near the current location; and

broadcast the location or direction of intersecting roadways near the current location to one or more vehicle controllers of an automated driving system or driving assistance system.

17. The system of claim 16 , wherein the computing system comprising the processor is further configured to process the location or direction of the intersecting roadway to detect a point of interest for the vehicle or a passenger.

18. Non-transitory computer readable storage media storing instructions that, when executed by one or more processors, cause the one or more processors to:

receive perception data from at least two sensors of a vehicle that generate different data types, the at least two sensors comprising a rear facing camera and at least one of a light detection and ranging (LIDAR) system or a radar system, wherein the perception data comprises information for a region behind the vehicle on a current roadway on which the vehicle is located;

generate fused data based on the perception data using weighted averages for the different data types;

detect, based on the fused data, an intersecting roadway connecting with the current roadway; and

provide an indication of a location and a direction of the intersecting roadway with respect to the current roadway to an automated driving system or driver assistance system, whereby the automated driving system or driver assistance system actuates one or more vehicle controllers based on the indication.

19. The non-transitory computer readable storage media of claim 18 , wherein the instructions cause the one or more processors to detect the intersecting roadway by detecting one or more of: a gap in roadway markings, a break in a shoulder for the current roadway, or a variation or break in curb or barrier height.

20. The non-transitory computer readable storage media of claim 18 , wherein the instructions further cause the one or more processors to:

store the indication of the location and direction by uploading to a remote storage location accessible over a network,

determine a current location of the vehicle;

retrieve drive history data from the remote storage location for the current location, wherein the drive history data indicates a location or direction of intersecting roadways near the current location; and

broadcast the location or direction of intersecting roadways near the current location to one or more vehicle controllers of an automated driving system or driving assistance system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2016
From: MYERS, SCOTT VINCENT; GURGHIAN, ALEXANDRU MIHAI; MICKS, ASHLEY ELIZABETH; WALSH, ALEXANDRO
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 039418/0471 →
Continuity (1)
Related Publication 20180022347A1 · Jan 25, 2018