IP Library Granted Patent US 9,862,318
Granted Patent B2
US 9,862,318 · App. 14/953,848 · Granted Jan 9, 2018

Method to determine distance of an object from an automated vehicle with a monocular device

Inventors: Stephanie Lessmann (Wuppertal, DE); Mirko Meuter (Erkath, DE); Dennis Mueller (Moers, DE)
Assignee: DELPHI TECHNOLOGIES, INC.
B60R1/00G06K9/00805G06K9/3241G06K9/6278G06T7/246G06T7/73H04N5/225B60R2300/804B60R2300/8033
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,862,318
App. No.
14/953,848
Granted
Jan 9, 2018
Kind
B2
Abstract

A method of determining the distance of an object from an automated vehicle based on images taken by a monocular image acquiring device. The object is recognized with an object-class by means of an image processing system. Respective position data are determined from the images using a pinhole camera model based on the object-class. Position data indicating in world coordinates the position of a reference point of the object with respect to the plane of the road is used with a scaling factor of the pinhole camera model estimated by means of a Bayes estimator using the position data as observations and under the assumption that the reference point of the object is located on the plane of the road with a predefined probability. The distance of the object from the automated vehicle is calculated from the estimated scaling factor using the pinhole camera model.

Claims (18)

1. A method of determining the distance of an object from an automated vehicle, said method comprising:

equipping an automated vehicle with a monocular image acquiring device, said device located on the automated vehicle at a predefined height above a plane of a road on which the automated vehicle travels;

capturing images of an environment proximate to the vehicle, wherein the images of the environment are taken at time intervals by the device;

classifying, by an image processing system, an object in the images;

associating, by the image processing system, the object with an object-class;

determining, by the image processing system, respective position data from the images using a pinhole camera model and based on the object-class, said position data indicative of a position of a reference point of the object with respect to the plane of the road in world coordinates;

estimating a scaling factor of the pinhole camera model using a Bayes estimator on the position data as observations and under the assumption that the reference point of the object is located on the plane of the road with a predefined probability; and

calculating a distance of the object from the automated vehicle based on the scaling factor using the pinhole camera model, wherein an angle of inclination is used as the position indication that a view ray adopts with respect to the plane of the road, said view ray leading from a center of the automated vehicle and projected perpendicular onto the plane of the road and from a fixed point arranged at a known distance therefrom to the reference point of the object.

2. A method in accordance with claim 1 , wherein a further assumption is used as the basis for the Bayes estimator in that a width of the object is associated with the object-class and adopts a standard value associated with of the object-class with a predefined probability.

3. A method in accordance with claim 2 , wherein the assumption that the reference point of the object is located on the plane of the road with a predefined probability is modeled by a continuous a priori distribution, whereas the assumption that the width of the object adopts a standard value with a predefined probability is modeled by a discrete a priori distribution.

4. A method in accordance with claim 1 , wherein results of a time filtering of the position data are used as observations for the Bayes estimator, wherein mean time values over a respective plurality of successively taken images are formed for the position data.

5. A method in accordance with claim 1 , wherein the scaling factor (p) of the pinhole camera is estimated by determining a modal value of a posteriori distribution of the observations.

6. A method in accordance with claim 1 , wherein a normal distribution can be fixed around the value zero as an a priori distribution of the angle of inclination.

7. A method in accordance with claim 1 , wherein movement of the object is tracked by a tracking process that uses a recursive state switch characterized by a Kalman filter, and that the estimated scaling factor is used as an input for the recursive state switch.

8. A method in accordance with claim 1 , wherein the object is associated with one of a plurality of object-classes by a classifier, wherein a separate width range and a separate set of discrete width values are defined for each object-class for fixing the a priori distribution of the width of the object.

9. A method in accordance with claim 8 , wherein the object is associated with one of the object-classes “four-wheeled vehicle” and “two-wheeled vehicle” by the classifier, wherein, an object associated with the object-class “four-wheeled vehicle” is associated with one of the subclasses “passenger vehicle”, “van” and “truck”.

10. A method in accordance with claim 8 , wherein a basic truth of the classifier is used for solving the equations of the Bayes estimator.

11. A method in accordance with claim 1 , wherein a smallest enclosing rectangle is determined for the object with a base located at the lower margin of the smallest enclosing rectangle being selected as the reference point of the object.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2024
From: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
To: APTIV TECHNOLOGIES AG
Reel/Frame 066551/0219 →
MERGER Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES (2) S.À R.L.
To: APTIV MANUFACTURING MANAGEMENT SERVICES S.À R.L.
Reel/Frame 066566/0173 →
ENTITY CONVERSION Recorded Feb 11, 2024
From: APTIV TECHNOLOGIES LIMITED
To: APTIV TECHNOLOGIES (2) S.À R.L.
Reel/Frame 066746/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2018
From: DELPHI TECHNOLOGIES INC.
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 047143/0874 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2015
From: LESSMANN, STEPHANIE; MEUTER, MIRKO; MUELLER, DENNIS
To: DELPHI TECHNOLOGIES, INC.
Reel/Frame 037348/0597 →
Priority Claims (1)
EP 14199767 · Dec 22, 2014 · regional
Continuity (1)
Related Publication 20160180531A1 · Jun 23, 2016