IP Library › Granted Patent US 12,637,009
Granted Patent B2
US 12,637,009 · App. 18/972,783 · Granted May 26, 2026

Environment monitoring apparatus and method for operating an environment monitoring apparatus

Inventors: Thomas Dieng (Freiburg, DE); Mareike Stulz (Waldkirch, DE); Matthias Heinz (Waldkirch, DE)
Assignee: SICK AG
B60R1/23B60R1/31G06T3/047B60R2300/107B60R2300/304
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,637,009
App. No.
18/972,783
Granted
May 26, 2026
Kind
B2
Abstract

An environment monitoring apparatus for vehicles comprises a stereo camera that has two fisheye lenses, an image sensor apparatus having at least two sensor regions for detecting optical signals of the fisheye lenses in a respective one of the sensor regions and for generating and outputting image data signals based on the respective optical signals, wherein the sensor regions each have at least a first part region, which corresponds to a first aperture angle within the maximum aperture angle of the respective fisheye lens, and a second part region that corresponds to a second aperture angle within the maximum aperture angle of the respective fisheye lens, a processing unit for processing the image data signals output by the image sensor apparatus and for providing the processed image data signals, wherein the processing unit can be set in order, in particular at a respective point in time, to selectively process the image data signals corresponding to only one of the part regions, and a control unit for setting the processing unit.

Claims (48)

1 . An environment monitoring apparatus for vehicles, said environment monitoring apparatus comprising:

a stereo camera that has two fisheye lenses;

an image sensor apparatus having at least two sensor regions for detecting optical signals of the fisheye lenses in a respective one of the sensor regions and for generating and outputting image data signals based on the respective optical signals, wherein the sensor regions each have at least a first part region, which corresponds to a first aperture angle within the maximum aperture angle of the respective fisheye lens, and a second part region that corresponds to a second aperture angle within the maximum aperture angle of the respective fisheye lens;

a processing unit for processing the image data signals output by the image sensor apparatus and for providing the processed image data signals, wherein the processing unit can be set in order to selectively process the image data signals corresponding to only one of the part regions; and

a control unit for setting the processing unit.

2 . The environment monitoring apparatus according to claim 1 , wherein the vehicles are one of construction machines and agricultural machines.

3 . The environment monitoring apparatus according to claim 1 , wherein the processing unit can be set at a respective point in time to selectively process the image data signals corresponding to only one of the part regions.

4 . The environment monitoring apparatus according to claim 1 , wherein the processing unit can be set during operation of the stereo camera to selectively process the image data signals corresponding to only one of the part regions.

5 . The environment monitoring apparatus according to claim 1 , wherein a resolution of the processed image data signals is independent of the setting of the processing unit to one of the part regions.

6 . The environment monitoring apparatus according to claim 1 , wherein the processing unit is configured to rectify the image data signals during the processing.

7 . The environment monitoring apparatus according to claim 1 , wherein the image sensor apparatus can be set to selectively generate and output the image data signals corresponding to only one of the part regions.

8 . A method for operating an environment monitoring apparatus, said environment monitoring apparatus comprising:

a stereo camera having two fisheye lenses; and

an image sensor apparatus having at least two sensor regions for detecting optical signals of the fisheye lenses in a respective one of the sensor regions and for generating and outputting image data signals based on the respective optical signals, wherein the sensor regions each comprise at least a first part region, which corresponds to a first aperture angle within the maximum aperture angle of the respective fisheye lens, and a second part region that corresponds to a second aperture angle within the maximum aperture angle of the respective fisheye lens,

wherein the method comprises the following steps:

generating an application requirement based on an application currently executed by the environment monitoring apparatus wherein the application requirement defines whether image data signals with a large or a small aperture angle are required;

receiving the image data signals output by the image sensor apparatus and processing the image data signals corresponding to only one of the part regions selectively in dependence on the application requirement; and

providing the processed image data signals.

9 . The method according to claim 8 , wherein the step of receiving the image data signals output by the image sensor apparatus and processing the image data signals is carried out at a respective point in time corresponding to only one of the part regions selectively in dependence on the application requirement.

10 . The method according to claim 8 , wherein the image data signals are rectified during the processing before the provision.

11 . The method according to claim 10 , wherein the rectification of the image data signals comprises stretching the image margins and/or compressing the image center.

12 . The method according to claim 10 , wherein the rectification differs depending on the processing of the image data signals corresponding to only one of the part regions.

13 . The method according to claim 10 , wherein the rectification comprises changing a resolution of the image data signals.

14 . The method according to claim 8 , further comprising the steps of:

processing and rectification of the image data signals corresponding to only the first part region,

followed by the processing and rectification of the image data signals corresponding to only the second part region, and

the merging of the rectified image data signals corresponding to the first part region and the rectified image data signals corresponding to the second part region to form merged image data signals.

15 . An apparatus for data processing comprising a device for performing a method for operating an environment monitoring apparatus, said environment monitoring apparatus comprising:

a stereo camera having two fisheye lenses; and

an image sensor apparatus having at least two sensor regions for detecting optical signals of the fisheye lenses in a respective one of the sensor regions and for generating and outputting image data signals based on the respective optical signals, wherein the sensor regions each comprise at least a first part region, which corresponds to a first aperture angle within the maximum aperture angle of the respective fisheye lens, and a second part region that corresponds to a second aperture angle within the maximum aperture angle of the respective fisheye lens,

wherein the method comprises the following steps:

generating an application requirement based on an application currently executed by the environment monitoring apparatus wherein the application requirement defines whether image data signals with a large or a small aperture angle are required;

receiving the image data signals output by the image sensor apparatus and processing the image data signals corresponding to only one of the part regions selectively in dependence on the application requirement; and

providing the processed image data signals.

16 . A non-transitory computer readable medium comprising commands that, on the execution of the program by a computer, cause the computer to perform a method for operating an environment monitoring apparatus, said environment monitoring apparatus comprising:

a stereo camera having two fisheye lenses; and

an image sensor apparatus having at least two sensor regions for detecting optical signals of the fisheye lenses in a respective one of the sensor regions and for generating and outputting image data signals based on the respective optical signals, wherein the sensor regions each comprise at least a first part region, which corresponds to a first aperture angle within the maximum aperture angle of the respective fisheye lens, and a second part region that corresponds to a second aperture angle within the maximum aperture angle of the respective fisheye lens,

wherein the method comprises the following steps:

generating an application requirement based on an application currently executed by the environment monitoring apparatus wherein the application requirement defines whether image data signals with a large or a small aperture angle are required;

receiving the image data signals output by the image sensor apparatus and processing the image data signals corresponding to only one of the part regions selectively in dependence on the application requirement; and

providing the processed image data signals.

17 . A non-transitory computer-readable storage medium comprising commands that, on the execution by a computer, cause the computer to perform a method for operating an environment monitoring apparatus, said environment monitoring apparatus comprising:

a stereo camera having two fisheye lenses; and

an image sensor apparatus having at least two sensor regions for detecting optical signals of the fisheye lenses in a respective one of the sensor regions and for generating and outputting image data signals based on the respective optical signals, wherein the sensor regions each comprise at least a first part region, which corresponds to a first aperture angle within the maximum aperture angle of the respective fisheye lens, and a second part region that corresponds to a second aperture angle within the maximum aperture angle of the respective fisheye lens,

wherein the method comprises the following steps:

generating an application requirement based on an application currently executed by the environment monitoring apparatus wherein the application requirement defines whether image data signals with a large or a small aperture angle are required;

receiving the image data signals output by the image sensor apparatus and processing the image data signals corresponding to only one of the part regions selectively in dependence on the application requirement; and

providing the processed image data signals.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: DIENG, THOMAS; STULZ, MAREIKE; HEINZ, MATTHIAS
To: SICK AG
Reel/Frame 069820/0439 →
Priority Claims (1)
EP 23214914 · Dec 7, 2023 · regional
Continuity (1)
Related Publication 20250187542A1 · Jun 12, 2025
References Cited (17)
US 9091862B2 · Mertz · 2015 [cited by examiner]
US 11007018B2 · Breisacher · 2021 [cited by examiner]
US 11153481B2 · Rey · 2021 [cited by examiner]
US 20050265619A1 · Ozaki · 2005 [cited by applicant]
US 20160042522A1 · Wajs · 2016 [cited by examiner]
US 20160255330A1 · Wippermann · 2016 [cited by examiner]
US 20180203212A1 · Tzuang · 2018 [cited by examiner]
US 20190387149A1 · Breisacher et al. · 2019 [cited by applicant]
US 20200296281A1 · Rey · 2020 [cited by examiner]
US 20220038646A1 · Lasaruk · 2022 [cited by examiner]
US 20230206386A1 · Kobayashi · 2023 [cited by examiner]
US 20250056109A1 · Attar · 2025 [cited by examiner]
US 20250126369A1 · Nakatogawa · 2025 [cited by examiner]
US 20250147403A1 · Ishikawa · 2025 [cited by examiner]
US 20250328057A1 · Tamura · 2025 [cited by examiner]
Official Letter dated Oct. 9, 2024 issued in corresponding European Application No. 23214914.6. [cited by applicant]
Search Report dated May 16, 2024 issued in corresponding European Application No. 23214914.6. [cited by applicant]