IP Library › Granted Patent US 10,629,072
Granted Patent B2
US 10,629,072 · App. 15/298,389 · Granted Apr 21, 2020

LIDAR and vision vehicle sensing

Inventor: Rodrigo Felix (Atizapan de Zaragoza/Estado de Mexico, MX)
Assignee: FORD GLOBAL TECHNOLOGIES, LLC
G08G1/015B60W50/00G01S7/4802G01S17/86G01S17/89G01S17/931G05D1/0088G05D1/0238G05D1/0242G06K9/00805G08G1/04G08G1/052G08G1/056B60W2420/40B60W2420/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,629,072
App. No.
15/298,389
Granted
Apr 21, 2020
Kind
B2
Abstract

A computer is programmed to identify a vehicle in an infrared image, determine a body type of the vehicle based on the infrared image, and predict coordinates of one or more vehicle elements based at least on the determined body type. The computer is further programmed to then perform a plurality of LIDAR sensor sweeps and, based on the LIDAR sensor sweeps, determine whether the vehicle elements are at the predicted coordinates.

Claims (62)

1. A computer, comprising a processor and a memory, the memory storing instructions such that the computer is programmed to:

determine a body type of a first vehicle based on an infrared image received from an infrared sensor;

predict coordinates of one or more first vehicle elements based at least on the determined body type;

actuate a LIDAR sensor to sweep the one or more first vehicle elements; and

based on LIDAR sensor sweeps received from the LIDAR sensor, operate a second vehicle by actuating an actuator of the second vehicle upon determining that the one or more first vehicle elements are at the predicted coordinates.

2. The computer of claim 1 , further programmed to determine the body type of the first vehicle based at least in part on a shape of the first vehicle determined from the infrared image, wherein the shape includes at least one of a first vehicle height, a first vehicle length, a first vehicle width, and a distance between the one or more first vehicle elements.

3. The computer of claim 1 , wherein the body type of the first vehicle is one of convertible, compact, mid-size sedan, full-size sedan, sport utility, minivan, van, and pickup truck.

4. The computer of claim 1 , wherein the one or more first vehicle elements include a front windshield, a front light, a window, a rear light, a pillar, a wheel well, and a wheel.

5. The computer of claim 1 , further programmed to:

receive two or more infrared images;

identify a direction of movement of the first vehicle based at least in part on the received two or more infrared images; and

predict coordinates of the one or more first vehicle elements further based on the identified direction of movement.

6. The computer of claim 1 , further programmed to:

project a size of the first vehicle based on the infrared image; and

predict coordinates of the one or more first vehicle elements further based on the projected size and a size associated with the determined body type.

7. The computer of claim 1 , further programmed to:

predict a size of one of the one or more first vehicle elements; and

based on the LIDAR sensor sweeps, determine whether each one or more first vehicle elements has a size matching its predicted size.

8. The computer of claim 1 , further programmed to:

predict a distance between two first vehicle elements based at least in part on the determined body type; and

based on the LIDAR sensor sweeps, further determine whether the two first vehicle elements are at the predicted distance from one another.

9. The computer of claim 1 , further programmed to:

predict an orientation of the first vehicle with respect to a second vehicle based on the infrared image; and

predict coordinates of the one or more first vehicle elements of the first vehicle further based on the predicted orientation of the first vehicle with respect to the second vehicle.

10. The computer of claim 1 , further programmed to:

determine a sweep area based at least in part on the predicted coordinates of the one or more first vehicle elements of the first vehicle; and

receive LIDAR sweep data from the LIDAR sensor by:

transmitting LIDAR beams to the determined sweep area; and

receiving reflections of the transmitted LIDAR beams.

11. The computer of claim 10 , wherein the computer is further programmed to receive reflections of the transmitted LIDAR beams at least by:

receiving a first reflection from a transparent vehicle element of the one or more first vehicle elements; and

receiving a second reflection from an opaque vehicle element of the one or more first vehicle elements.

12. The computer of claim 11 , further programmed to determine whether the one or more first vehicle elements are at the predicted coordinates by detecting dimensions of the transparent vehicle element based at least in part on the first reflection and the second reflection.

13. A method, comprising:

determining a body type of a first vehicle based on an infrared image;

predicting coordinates of one or more first vehicle elements based at least on the determined body type;

actuating a LIDAR sensor to sweep the one or more first vehicle elements; and

based on LIDAR sensor sweeps received from the LIDAR sensor, operating a second vehicle by actuating an actuator of the second vehicle upon determining that the one or more first vehicle elements are at the predicted coordinates.

14. The method of claim 13 , wherein determining the body type of the first vehicle is based at least in part on a shape of the first vehicle determined from the infrared image.

15. The method of claim 13 , further comprising:

determining a sweep area based at least in part on the predicted coordinates of the one or more first vehicle elements of the first vehicle; and

performing the plurality of LIDAR sensor sweeps by at least:

transmitting LIDAR beams to the determined sweep area; and

receiving reflections of the transmitted LIDAR beams.

16. The method of claim 15 , wherein the sweep area includes at least the one or more first vehicle elements of the first vehicle.

17. The method of claim 13 , further comprising:

receiving two or more infrared images;

identifying a direction of movement of the first vehicle based at least in part on the received two or more infrared images; and

predicting coordinates of the one or more first vehicle elements further based on the identified direction of movement.

18. The method of claim 13 , further comprising:

projecting a size of the first vehicle based on the infrared image; and

predicting coordinates of the one or more first vehicle elements further based on the projected size and a size associated with the determined body type.

19. The method of claim 13 , further comprising:

predicting a distance between two first vehicle elements based at least in part on the determined body type; and

based on the LIDAR sensor sweeps, further determining whether the two first vehicle elements are at the predicted distance from one another.

20. A computer, programmed to:

identify a vehicle in an infrared image;

determine a body type of the vehicle based on the infrared image;

predict coordinates of one or more vehicle elements based at least on the determined body type;

receive LIDAR sweep data from a LIDAR sensor;

receive reflections of the transmitted LIDAR beams at least by receiving a first reflection from a transparent vehicle element of the one or more vehicle elements, receiving a second reflection from an opaque vehicle element of the one or more first vehicle elements; and

based on the LIDAR sensor sweeps, determine whether the one or more first vehicle elements are at the predicted coordinates by detecting dimensions of the transparent vehicle element based at least in part on the first reflection and the second reflection.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2016
From: FELIX, RODRIGO
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 040073/0065 →
Continuity (1)
Related Publication 20180114436A1 · Apr 26, 2018
Cited By (3)
US 12,399,278 US 12,399,279 US 12,736,642