IP Library › Granted Patent US 12,726,581
Granted Patent B2
US 12,726,581 · App. 17/595,909 · Granted Sep 1, 2026

Method for representing a harmonized obscured area of an environment of a mobile platform

Inventors: Markus Friebe (Gefrees, DE); Chetan Gotur (Bangalore, IN); Pavan Nag Prabhakar (Bangalore, IN); Abhishek Ranjan (Bangalore, IN)
Assignee: Continental Automotive GmbH
H04N5/265B60R1/27G06T7/74G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,726,581
App. No.
17/595,909
Filed
Nov 29, 2021
Granted
Sep 1, 2026
Kind
B2
Examiner
LIU, XIAO
Art Unit
2664
USPC
382/104
Abstract

A method is disclosed for representing an obscured area of a mobile platform environment relative to an object area of a first and second imaging devices of the mobile platform, including determining a delta-area, being the difference of a second obscured area of the environment which is obscured in respect to the object area at a second time step, and a first obscured area of the environment which is obscured in respect to the object area at a first time step. First and second overlap-images, being an overlap of an image of the first imaging device respectively of an image of the second imaging device with the delta-area, are determined, wherein both images are taken at the first time step. A difference of an optical property of the images is determined, and the difference of the optical property is harmonized within at least one of the overlap-images.

Claims (22)

1 . A method for representing an obscured area of an environment of a mobile platform in respect to an object area of a first and a second imaging device of the mobile platform, the method comprising:

determining a delta-area, being a difference of a second obscured area of the environment, which is obscured in respect to the object area of the first and second imaging device at a second time step, and a first obscured area of the environment which is obscured in respect to the object area of the first and second imaging device at a first time step;

determining a first overlap-image and a second overlap-image, being an overlap of an image of the first imaging device respectively of an image of the second imaging device with the delta-area;

determining a difference of an optical property of the images of the first and the second imaging device; and

harmonizing the difference of the optical property within at least one of the overlap-images,

wherein at least one of the first overlap image or the second overlap-image is harmonized in respect to an optical propert gradient defined by the difference of the optical property and a portion of a length of the first obscured area, and

wherein the harmonization of the at least one of the first overlap-image or the second overlap-image includes adjusting an optical property value of each pixel of the first or second overlap-image corresponding to the optical property value and a direction of the optical property gradient.

2 . The method according to claim 1 , wherein the difference of the optical property is determined by comparing an optical property of at least one first reference area within the image of the first imaging device and at least one second reference area within the image of the second imaging device.

3 . The method according to claim 2 , wherein the at least one first reference area and the at least one second reference area are areas of the environment were the object areas of both imaging devices overlap.

4 . The method according to claim 1 , wherein the optical property value is at least one of a brightness value or a color value.

5 . The method according to claim 1 , wherein the delta-area is determined using motion data of the mobile platform.

6 . The method according to claim 1 , wherein the first imaging device points into a front direction of the mobile platform and the second imaging device at least partially points into a direction of the motion of the mobile platform.

7 . The method according to claim 1 , wherein the second obscured area is represented by the harmonized second overlap-image, the first overlap-image and a section of a representation of the first obscured area.

8 . The method according to claim 7 , wherein the representation of the second obscured area is stored in between power cycles of the vehicle.

9 . The method according to claim 7 , wherein the representation of the second obscured area is shown on a screen of the mobile platform.

10 . A surround-view-system, arranged to perform the method according to claim 1 .

11 . A mobile platform, preferably a vehicle, including a screen for visualizing a representation of the obscured area, and a surround-view-system according to claim 10 .

12 . A computer program stored on a non-transitory computer-readable medium and comprising instructions, which, when executed by a computer, cause the computer to carry out the method according to claim 1 .

13 . The method according to claim 1 , wherein the first overlap-image comprises the overlap of the image of the first imaging device with the delta-area, and the second overlap-image comprises the overlap of the image of the second imaging device with the delta-area.

14 . The method according to claim 13 , wherein the first overlap-image and the second overlap-image are taken at the first time step.

15 . The method according to claim 13 , wherein the first overlap-image and the second overlap-image are taken at the same time step.

16 . The method according to claim 1 , further comprising composing the first overlap-image and the second overlap-image based upon the harmonization, and initiating a display of the first overlap-image and the second overlap-image on a display screen associated with the mobile platform.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2025
From: CONTINENTAL AUTOMOTIVE GMBH
To: CONTINENTAL AUTONOMOUS MOBILITY GERMANY GMBH
Reel/Frame 070438/0643 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2022
From: FRIEBE, MARKUS; GOTUR, CHETAN; PRABHAKAR, PAVAN NAG; RANJAN, ABHISHEK
To: CONTINENTAL AUTOMOTIVE GMBH
Reel/Frame 059027/0928 →
Priority Claims (1)
EP 19177339 · May 29, 2019 · regional
Continuity (1)
Related Publication 20220321836A1 · Oct 6, 2022
References Cited (27)
US 6813391B1 · Uyttendaele et al. · 2004 [cited by applicant]
US 7346212B2 · Cheatle · 2008 [cited by examiner]
US 10694102B2 · Roulet · 2020 [cited by examiner]
US 20020196340A1 · Kato et al. · 2002 [cited by applicant]
US 20170140542A1 · Hodohara · 2017 [cited by applicant]
US 20200023772A1 · Kurnaz · 2020 [cited by examiner]
US 20200086791A1 · Hardy · 2020 [cited by examiner]
CN 103501415A · 2014 [cited by applicant]
CN 104240211A · 2014 [cited by applicant]
DE 102013020949A1 · 2015 [cited by applicant]
EP 1383331A1 · 2004 [cited by applicant]
GB 2557758A · 2018 [cited by examiner]
GB 2559758A · 2018 [cited by applicant]
GB 2559760A · 2018 [cited by examiner]
JP 2002324235A · 2002 [cited by applicant]
JP 2011114536A · 2011 [cited by applicant]
JP 2013115738A · 2013 [cited by applicant]
JP 2014229100A · 2014 [cited by examiner]
JP 2015222934A · 2015 [cited by applicant]
JP 2017091284A · 2017 [cited by applicant]
Japanese Notice of Reasons for Refusal drafted on Jan. 5, 2023 for the counterpart Japanese Patent Application No. 2021-567063. [cited by applicant]
European Search Report dated Oct. 18, 2021 for the counterpart European Patent Application No. 19177339.9. [cited by applicant]
International Search Report and the Written Opinion of the International Searching Authority mailed on Jul. 14, 2021 for the counterpart PCT Application No. PCT/EP2020/064016. [cited by applicant]
Notice of Reasons for Refusal drafted Aug. 16, 2023 for the counterpart Japanese Patent Application No. 2021-567063 and Global Dossier translation of same. [cited by applicant]
European Examination Report dated Mar. 21, 2022 for the counterpart European Patent Application No. 19177339.9. [cited by applicant]
Notice of First Office Action dated Nov. 13, 2023 for the counterpart Chinese Patent Application No. 202080039342.8 and machine translation of same. [cited by applicant]
Notice of Second Office Action dated Apr. 27, 2023 for the counterpart Chinese Patent Application No. 202080039342.8 and machine translation of same. [cited by applicant]