IP Library Granted Patent US 10,885,640
Granted Patent B2
US 10,885,640 · App. 16/325,470 · Granted Jan 5, 2021

Enhanced object detection and motion estimation for a vehicle environment detection system

Inventor: Dominik Kellner (Dachau, DE)
Assignee: VEONEER SWEDEN AB
G06T7/246G01S13/589G01S13/931G06K9/00805G06T7/277G06T7/285G06T7/593G06T7/70G06T7/73G01S2013/9323G01S2013/9324G06T2207/10021G06T2207/10044G06T2207/20164G06T2207/30252G06T2207/30261G08G1/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,885,640
App. No.
16/325,470
Granted
Jan 5, 2021
Kind
B2
Abstract

A vehicle environment detection system ( 2 ) that includes a detection device and a processing unit ( 5 ), arranged to detect at least two feature points at objects ( 11 ) outside a vehicle ( 1 ). Each feature point constitutes a retrievable point that has a fixed position (x 1 , y 1 ; x 2 , y 2 ) on the object ( 11 ). The processing unit ( 5 ) is arranged to determine the positions (x 1 , y 1 ; x 2 , y 2 ) and the resulting velocities (v r1 , v r2 ) for each one of the feature points for multiple frames by use of a feature point tracker; and determine a reference position (x 0 , y 0 ), a corresponding reference velocity (v r0 ) and reference angular velocity (ω), constituting a common motion state for the object ( 11 ), by use of the results from the feature point tracker. A feature point tracker is constituted by a tracking algorithm which is arranged to track multiple features and which includes temporal filtering.

Claims (198)

1. A vehicle environment detection system that comprises, at least one detection device and at least one processing unit, where the vehicle environment detection system is arranged to detect at least two feature points at objects outside a vehicle, where each of the at least two feature points constitutes a retrievable point that has a position (x 1 , y 1 ; x 2 , y 2 ) on the object, the processing unit is arranged to:

determine the positions (x 1 , y 1 ; x 2 , y 2 ) and resulting velocities (v r1 , v r2 ) for each one of the at least two feature points for multiple frames by use of a feature point tracker; and

determine a reference position (x 0 , y 0 ), a corresponding reference velocity (v r0 ) and a reference angular velocity (ω), constituting a common motion state for the object, by use of results from the feature point tracker;

where the feature point tracker is constituted by a tracking algorithm which is arranged to track multiple of the feature points and which comprises temporal filtering;

wherein the vehicle environment detection system is arranged to calculate the common motion state by solving a linear equation system:

[

v

x

1

v

y

1

v

x

2

v

y

2

v

xN

v

yN

]

=

[

-

y

1

+

y

0

1

0

x

1

-

x

0

0

1

-

y

2

+

y

0

1

0

x

2

-

x

0

0

1

-

y

N

+

y

0

1

0

x

N

-

x

0

0

1

]

[

ω

v

x

0

v

y

0

]

where v x1 . . . v xN are determined velocity x-components for each of the at least two feature points, v y1 . . . v yN are determined velocity y-components for each of the at least two feature points, x 1 . . . x N is an x-coordinate for each of the feature point positions, y 1 . . . y N is a y-coordinate for each feature of the at least two point positions, v x0 is a velocity x-component for a reference velocity vector (v r0 ), v y0 is a velocity y-component for the reference velocity vector (v r0 ), x 0 is a reference position x-coordinate and y 0 is a reference position y-coordinate, where all the coordinates are determined relative a coordinate system having an x-axis and a y-axis.

2. The vehicle environment detection system according to claim 1 , wherein the feature point tracker comprises a Kalman filter.

3. The vehicle environment detection system according to claim 1 , further comprising, the processing unit is arranged to transform the reference velocity vector (v r0 ) to desired positions.

4. The vehicle environment detection system according to claim 3 , further comprising, the processing unit is arranged to transform the reference velocity vector (v r0 ) to the positions of the feature points, and to correct the resulting velocities (v r1 , v r2 ) of the feature points.

5. The vehicle environment detection system according to claim 1 , wherein the vehicle environment detection system comprises a radar sensor arrangement that is arranged to provide radial detected Doppler velocity components (v D1 , v D2 ) and corresponding azimuth detection angles (θ 1 , θ 2 ), where the processing unit is arranged to calculate a velocity vector (v Sr ) of the object at the radar sensor arrangement position (x S , y S ) by use of the detected Doppler velocity components (v D1 , v D2 ) and corresponding azimuth detection angles (θ 1 , θ 2 ), where the processing unit is arranged to apply the velocity vector (v Sr ) to the linear equation system such that the calculation accuracy of the velocity vector (v r0 ) and yaw rate (ω) is improved.

6. A method for determining a common motion state for at least one object outside a vehicle, where the method comprises the steps of:

detecting at least two feature points at objects outside a vehicle, where each of the at least two feature point constitutes a retrievable point that has a fixed position (x 1 , y 1 ; x 2 , y 2 ) on the object;

determining the positions (x 1 , y 1 ; x 2 , y 2 ) and resulting velocities (v r1 , v r2 ) for each one of the at least two feature points for multiple frames by using a feature point tracker; and

determining a reference position (x 0 , y 0 ), a corresponding reference velocity (v r0 ) and reference angular velocity (ω), constituting the common motion state for the object, using the results from the feature point tracker;

where the feature point tracker is constituted by a tracking algorithm which is arranged to track multiple features and which comprises temporal filtering;

calculating the common motion state by solving a linear equation system:

[

v

x

1

v

y

1

v

x

2

v

y

2

v

xN

v

yN

]

=

[

-

y

1

+

y

0

1

0

x

1

-

x

0

0

1

-

y

2

+

y

0

1

0

x

2

-

x

0

0

1

-

y

N

+

y

0

1

0

x

N

-

x

0

0

1

]

[

ω

v

x

0

v

y

0

]

where v x1 . . . v xN are determined velocity x-components for each of the at least two feature points, v y1 . . . v yN are determined velocity y-components for each of the at least two feature points, x 1 . . . x N is an x-coordinate for each of the feature point positions, y 1 . . . y N is a y-coordinate for each feature of the at least two point positions, v x0 is a velocity x-component for a reference velocity vector (v r0 ), v y0 is a velocity y-component for the reference velocity vector (v r0 ), x 0 is a reference position x-coordinate and y 0 is a reference position y-coordinate, where all the coordinates are determined relative a coordinate system having an x-axis and a y-axis.

7. The method according to claim 6 , wherein the method further comprises transforming the reference velocity vector (v r0 ) to desired positions.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2024
From: ARRIVER SOFTWARE AB
To: QUALCOMM AUTO LTD.
Reel/Frame 069171/0233 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2022
From: VEONEER SWEDEN AB
To: ARRIVER SOFTWARE AB
Reel/Frame 060097/0807 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2019
From: KELLNER, DOMINIK
To: VEONEER SWEDEN AB
Reel/Frame 048378/0988 →
Priority Claims (1)
EP 16184839 · Aug 19, 2016 · regional
Continuity (1)
Related Publication 20190180451A1 · Jun 13, 2019
Cited By (1)
US 12,316,992