IP Library Granted Patent US 10,093,233
Granted Patent B2
US 10,093,233 · App. 15/021,529 · Granted Oct 9, 2018

Method and apparatus for displaying the surroundings of a vehicle, and driver assistance system

Inventors: Dieter Krökel (Eriskirch, DE); Christian Exner (Lindau, DE); Herbert Meier (Regensburg, DE); Stefan Lüke (Rosbach vor der Höhe, DE); Sebastian Houben (Bonn, DE); Jan Salmen (Bochum, DE)
Assignees: Conti Temic microelectronic GmbH; Continental Automotive GmbH; Continental Teves AG & Co. oHG
B60R1/00G06T5/006G06T7/60G06T7/75H04N5/23293H04N5/247G06T2200/04G06T2207/10016G06T2207/30241G06T2207/30252G06T2207/30261
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,093,233
App. No.
15/021,529
Granted
Oct 9, 2018
Kind
B2
Abstract

A method and an apparatus for displaying the surroundings of a vehicle and to a driver assistance system having such an apparatus having at least one sensor for producing sensor data for the surroundings of a vehicle. In this case, the sensor data are conditioned to produce raw image data, if need be using a grid model of the surroundings of the vehicle, if need be the raw image data are processed to produce object information using a grid model of the surroundings of the vehicle, and the object information obtained is used to condition raw image data to produce image object data, and finally the image object data are displayed.

Claims (30)

1. A method for displaying surroundings of a vehicle the method comprising:

detecting of the surroundings of the vehicle with at least one sensor and producing sensor data for the surroundings of the vehicle,

conditioning the sensor data to produce raw image data,

processing the raw image data to produce object information using a grid model of the surroundings of the vehicle, wherein a 3D grid model is used as a grid model, wherein cells of the grid model enclosing the vehicle are defined, and wherein identified object heights, extent, position and speed can be assigned to the cells of the grid model, to condition the raw image data to produce image object data, wherein the raw image data is projected onto the 3D grid model using a projection algorithm, and

displaying the image object data.

2. The method according to claim 1 , wherein

the conditioning of the sensor data to produce raw image data is performed by an image conditioning device and the processing of the raw image data to produce object information is performed by an image processing device, wherein

the image processing device receives the raw image data from the image conditioning device via a first data link, and

the conditioning of the raw image data to produce image object data based on the object information, is performed by the image conditioning device, wherein

the image conditioning device receives the object information from the image processing device via a second data link.

3. The method according to claim 1 , wherein, within a framework of the processing of the raw image data, historical and/or predicted object information is additionally used.

4. The method according to claim 1 , wherein the grid model of the surroundings comprises cells, wherein partial object information is assigned to these cells and object information is produced from partial object information in an object identification step.

5. The method according to claim 1 , wherein the cells of the grid model comprise at least one of a size, a form and an orientation dependent on the position of the cell in the grid.

6. The method according to claim 1 , wherein a 3D grid model is used as a grid model and raw image data is projected onto the 3D grid model using a projection algorithm.

7. The method according to claim 6 , wherein the grid model of the surroundings of the vehicle constitutes a model of a curved surface, wherein a radius of curvature increases as a distance increases from the vehicle.

8. The method according to claim 1 , wherein cell-related partial object information is assigned to the cells of the grid model and object information regarding identified objects is transmitted together with object information regarding object heights to an image conditioning device.

9. An apparatus for displaying surroundings of a vehicle, comprising:

at least one sensor for detecting the surroundings of the vehicle and for producing sensor data for the surroundings of the vehicle,

an image conditioning device having image data conditioning areas which are set up to condition the sensor data to produce raw image data and to condition the raw image data using object information and/or a grid model to produce image object data, wherein the raw image data is projected onto the 3D grid model using a projection algorithm, and

an image processing device which comprises a data link to the image conditioning device and which is set up to process raw image data to produce object information using a grid model of the surroundings of the vehicle, wherein a 3D grid model is used as a grid model, wherein cells of the grid model enclosing the vehicle are defined, and wherein identified object heights, extent, position and speed can be assigned to the cells of the grid model to condition the raw image data to produce image object data, wherein the raw image data is projected onto the 3D grid model using a projection algorithm, and

a display apparatus for displaying the image object data.

10. The apparatus according to claim 9 , wherein

the image conditioning device is connected via a first data link to the image processing device, wherein the image processing device receives the conditioned raw image data from the image conditioning device via the first data link, and

the image processing device is connected via an additional data link to the image conditioning device, wherein the image conditioning device receives the object information obtained by the image processing device from the raw image data via the additional data link.

11. The apparatus according to claim 10 , wherein the image conditioning device is connected to the display apparatus for displaying image object data obtained from the raw image data and the object data.

12. The apparatus according to claim 9 , further comprising additional sensors which have a data link to the image processing device, wherein the image processing device is set up to verify and/or stabilize the object information by comparison with data from the additional sensors.

13. The apparatus according to claim 9 , further comprising a data storage device for storing historical and/or predicted object information, wherein the image processing device is set up to use historical and/or predicted object information within a framework of processing the raw image data.

14. The apparatus according to claim 9 , further comprising a data storage device for storing a grid model of the surroundings of the vehicle, wherein the image processing device is set up to identify objects on the basis of partial object information, which is assigned to cells of the grid model and/or the image conditioning device is set up to condition raw image data on the basis of the grid model.

15. A driver assistance system having an apparatus according to claim 9 .

16. The method according to claim 1 , wherein the object information is verified and/or stabilized by comparison with data from additional sensors.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2025
From: CONTINENTAL AUTOMOTIVE GMBH
To: CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
Reel/Frame 073225/0515 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2025
From: CONTI TEMIC MICROELECTRONIC GMBH; CONTI TEMIC MICROELECTRONIC GMBH
To: CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
Reel/Frame 073202/0113 →
MERGER AND CHANGE OF NAME Recorded Dec 12, 2025
From: CONTINENTAL TEVES AG & CO. OHG; CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH
To: CONTINENTAL AUTOMOTIVE TECHNOLOGIES GMBH
Reel/Frame 073202/0976 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2016
From: KRÖKEL, DIETER; EXNER, CHRISTIAN; MEIER, HERBERT; LÜKE, STEFAN; HOUBEN, SEBASTIAN; SALMEN, JAN
To: CONTI TEMIC MICROELECTRONIC GMBH; CONTINENTAL AUTOMOTIVE GMBH; CONTINENTAL TEVES AG & CO. OHG
Reel/Frame 038973/0264 →
Priority Claims (1)
DE 10 2013 220 005 · Oct 2, 2013 · national
Continuity (1)
Related Publication 20160221503A1 · Aug 4, 2016