IP Library Granted Patent US 12,437,468
Granted Patent B2
US 12,437,468 · App. 17/754,904 · Granted Oct 7, 2025

Method and device for providing a visualization of a vehicle, and vehicle

Inventors: Andreas Panakos (Neu-Ulm, DE); Moritz Meyers (Ulm, DE); Markus Friebe (Gefrees, DE)
Assignee: Continental Autonomous Mobility Germany GmbH
G06T15/205G06T3/02G06T7/70B60W2050/146B60W2420/403B60W2510/22G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,437,468
App. No.
17/754,904
Granted
Oct 7, 2025
Kind
B2
Abstract

The present disclosure provides a method for providing a visualization of a vehicle, the method having the steps: receiving, for each vehicle camera of a plurality of vehicle cameras of the vehicle, current values of camera extrinsic parameters of said vehicle camera; receiving vehicle suspension data relating to a suspension of wheels of the vehicle; and visualizing the vehicle using a predefined model of the vehicle, wherein the vehicle is visualized on a ground surface; wherein the ground surface is modelled to contact the wheels of the vehicle, based on the current values of the camera extrinsic parameters of the vehicle cameras and based on the suspension data.

Claims (38)

1. A method for providing a visualization of a vehicle, the method comprising:

receiving, for each vehicle camera of a plurality of vehicle cameras of the vehicle, current values of camera extrinsic parameters of the vehicle camera;

receiving vehicle suspension data relating to a suspension of wheels of the vehicle; and

visualizing the vehicle using a predefined model of the vehicle, wherein the vehicle is visualized on a ground surface;

wherein the ground surface is modelled to contact the wheels of the vehicle based on the current values of the camera extrinsic parameters of the vehicle cameras and based on the suspension data; and

computing, for each wheel, a displacement based on the vehicle suspension data, wherein the ground surface is modelled based on the computed displacements of the wheels of the vehicle;

wherein the vehicle suspension data comprises, for each wheel, information regarding a current suspension height; and

wherein, for each wheel, the displacement is computed based on a difference between the current suspension height and a predefined initial suspension height.

2. The method according to claim 1 , further comprising:

computing, for each vehicle camera, a difference between the current values of the camera extrinsic parameters of the vehicle camera and predefined initial values of the camera extrinsic parameters of the vehicle camera; and

computing a current three-dimensional posture of the vehicle based on the computed differences between the current values of the camera extrinsic parameters of the vehicle cameras and the predefined initial values of the camera extrinsic parameters of the vehicle cameras;

wherein the ground surface is modelled based on the computed current three-dimensional posture of the vehicle.

3. The method according to claim 2 , wherein the three-dimensional posture of the vehicle is computed in homogeneous coordinates, using affine transformations, and wherein the affine transformations comprise rotations related to a rotation of the vehicle and translations related to a translation of the vehicle.

4. The method according to claim 3 , wherein the three-dimensional posture of the vehicle is computed by applying multivariate interpolations to the current values of the camera extrinsic parameters.

5. The method according to claim 4 , wherein the multivariate interpolations comprise at least one of a bilinear interpolation and a bicubic interpolation.

6. The method according to claim 1 , wherein a position of each wheel of the vehicle is computed based on the three-dimensional posture of the vehicle and/or based on the computed displacement of the wheel of the vehicle.

7. The method according to claim 6 , wherein the ground surface is modelled using a multivariate interpolation using the computed positions of the wheels.

8. The method according to claim 7 , wherein the multivariate interpolations using the computed positions of the wheels comprise at least one of a bilinear interpolation and a bicubic interpolation.

9. A device for providing a visualization of a vehicle, comprising:

an interface receiving, for each vehicle camera of a plurality of vehicle cameras of the vehicle, current values of camera extrinsic parameters of the vehicle camera, and receiving vehicle suspension data relating to a suspension of wheels of the vehicle; and

a computation unit comprising a processor circuit configured to compute a visualization of the vehicle using a predefined model of the vehicle, wherein the vehicle is visualized on a ground surface;

wherein the computation unit processor circuit is configured to model the ground surface so as to contact the wheels of the vehicle, based on the current values of the camera extrinsic parameters of the vehicle cameras and based on the suspension data,

wherein the computation unit processor circuit is further configured to compute, for each wheel, a displacement based on the vehicle suspension data, wherein the ground surface is modelled based on the computed displacements of the wheels of the vehicle, and

wherein the vehicle suspension data comprises, for each wheel, information regarding a current suspension height, wherein, for each wheel, the displacement is computed based on a difference between the current suspension height and a predefined initial suspension height.

10. The device according to claim 9 , further comprising a display for outputting the computed visualization of the vehicle.

11. A vehicle comprising

a plurality of vehicle cameras; and

a device according to claim 10 .

12. The vehicle according to claim 11 , further comprising at least one sensor configured to

measure the current camera extrinsic parameters of the vehicle cameras and the suspension data, and

provide the measured current camera extrinsic parameters of the vehicle cameras and the suspension data to the device.

13. The vehicle according to claim 11 , comprising at least four vehicle cameras arranged around the vehicle.

14. The device according to claim 9 , wherein the computation unit processor circuit is further configured to

compute, for each vehicle camera, a difference between the current values of the camera extrinsic parameters of the vehicle camera and predefined initial values of the camera extrinsic parameters of the vehicle camera; and

compute a current three-dimensional posture of the vehicle based on the computed differences between the current values of the camera extrinsic parameters of the vehicle cameras and the predefined initial values of the camera extrinsic parameters of the vehicle cameras;

wherein the ground surface is modelled based on the computed current three-dimensional posture of the vehicle, and

wherein the three-dimensional posture of the vehicle is computed by applying multivariate interpolations to the current values of the camera extrinsic parameters.

15. The device according to claim 14 , wherein the multivariate interpolations comprise at least one of a bilinear interpolation and a bicubic interpolation.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2025
From: CONTINENTAL AUTOMOTIVE GMBH
To: CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
Reel/Frame 070438/0643 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2022
From: PANAKOS, ANDREAS; MEYERS, MORITZ; FRIEBE, MARKUS, DR
To: CONTINENTAL AUTOMOTIVE GMBH
Reel/Frame 059649/0986 →
Priority Claims (1)
EP 19203132 · Oct 15, 2019 · regional
Continuity (1)
Related Publication 20240312120A1 · Sep 19, 2024
References Cited (32)
US 20100034426A1 · Takiguchi · 2010 [cited by examiner]
US 20170010618A1 · Shashua · 2017 [cited by examiner]
US 20180066941A1 · Kubota et al. · 2018 [cited by applicant]
US 20180210442A1 · Guo · 2018 [cited by applicant]
US 20200074738A1 · Hare · 2020 [cited by examiner]
US 20200218249A1 · Sannodo · 2020 [cited by examiner]
US 20210094376A1 · Smith · 2021 [cited by examiner]
CN 106574880A · 2017 [cited by applicant]
CN 107878327A · 2018 [cited by applicant]
CN 109725645A · 2019 [cited by examiner]
DE 102014221990A1 · 2016 [cited by applicant]
EP 2620917A1 · 2013 [cited by applicant]
EP 2853916A1 · 2015 [cited by applicant]
JP 2005295495A · 2005 [cited by examiner]
JP 2008042235A · 2008 [cited by applicant]
JP 2009253571A · 2009 [cited by applicant]
JP 4587601B2 · 2010 [cited by examiner]
JP 2018042148A · 2018 [cited by applicant]
JP 2018160848A · 2018 [cited by applicant]
WO 2016162226A1 · 2016 [cited by applicant]
WO 2018204656A1 · 2018 [cited by applicant]
English translation of CN 109725645 A (Year: 2019). [cited by examiner]
English translation of JP 2005295495 A (Year: 2005). [cited by examiner]
English translation of JP 4587601 B2 (Year: 2010). [cited by examiner]
European Search Report dated Feb. 27, 2020 for the counterpart European Patent Application No. 19203132.6. [cited by applicant]
Notification of Reasons for Refusal mailed on May 10, 2023 for the counterpart Japanese Patent Application 2022-519326 and DeepL translation of same. [cited by applicant]
European Examination Report dated Jul. 31, 2023 for the counterpart European Patent Application No. 19 203 132.6. [cited by applicant]
Japanese Decision to Grant issued on Oct. 13, 2023 for the counterpart Japanese Patent Application 2022-519326. [cited by applicant]
Chinese Office Action dated Nov. 25, 2024 for the counterpart Chinese Patent Application No. 202080071375.0 and machine translation of same. [cited by applicant]
Summons to attend oral proceedings pursuant to Rule 115(1) EPC dated Mar. 28, 2025 for the European Patent Application No. 19 203 132.6. [cited by applicant]
Decision to Grant a Patent drafted Oct. 13, 2023 for the counterpart Japanese Patent Application No. 2022-519326 and machine translation of same. [cited by applicant]
Chinese Second Office Action dated Apr. 25, 2025 for the counterpart Chinese Patent Application No. 202080071375.0 and machine translation of same. [cited by applicant]