IP Library Granted Patent US 11,321,815
Granted Patent B2
US 11,321,815 · App. 16/857,032 · Granted May 3, 2022

Method for generating digital image pairs as training data for neural networks

Inventor: Martin Meinke (Hildrizhausen, DE)
Assignee: Robert Bosch GmbH
G06T5/002G01S17/89G06N3/08G06T7/20G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,321,815
App. No.
16/857,032
Granted
May 3, 2022
Kind
B2
Abstract

A method for generating a digital image pair for training a neural network to correct noisy image components of noisy images includes determining an extent of object movements within an overlapping region of a stored first digital image and a stored second digital image of an environment of a mobile platform, and determining a respective acquired solid angle of the environment of the mobile platform of the first and second digital images. The method further includes generating the digital image pair from the first digital image and the second digital images, when the respective acquired solid angles of the environment of the first and the second digital image do not differ from one another by more than a defined difference, and the extent of the object movements within the overlapping region of the first and the second digital image is less than a defined value.

Claims (33)

1. A method for generating a digital image pair for training a neural network to correct noisy image components of noisy images, the method comprising:

determining an extent of object movements within an overlapping region of a stored first digital image and a stored second digital image of an environment of a mobile platform;

determining a respective acquired solid angle of the environment of the mobile platform of each of the stored first digital image and the stored second digital image; and

generating the digital image pair from the stored first digital image and the stored second digital image in response to (i) a difference between the respective acquired solid angles of the store first digital image and the stored second digital image being less than a defined difference, and (ii) the extent of the object movements within the overlapping region of the stored first digital image and the stored second digital image being less than a defined value.

2. The method according to claim 1 , further comprising:

determining the extent of the object movements within the overlapping region of the stored first digital image and the stored second digital image using data of an inertial navigation system of the mobile platform.

3. The method according to claim 1 , further comprising:

determining the respective acquired solid angles of the stored first digital image and the stored second digital image using data of an inertial navigation system of the mobile platform.

4. The method according to claim 1 , further comprising:

ascertaining the extent of the object movement based on at least one of (i) a signal of a radar sensor, (ii) an image analysis of an optical system, and (iii) a tracking system.

5. The method according to claim 1 , further comprising:

determining the difference between the respective acquired solid angles of the stored first digital image and the stored second digital image using data of at least one inertial sensor of the mobile platform.

6. The method according to claim 1 , further comprising:

generating the stored first digital image and the stored second digital image by a transformation of signals of a LIDAR system.

7. The method according to claim 1 , further comprising:

acquiring the stored first digital image and the stored second digital image based on image-generating systems of a plurality of at least partially automated mobile platforms.

8. A method for training a neural network to correct noisy image components of noisy images, the method comprising:

generating a digital image pair by:

determining an extent of object movements within an overlapping region of a stored first digital image and a stored second digital image of an environment of a mobile platform;

determining a respective acquired solid angle of the environment of the mobile platform of each of the stored first digital image and the stored second digital image; and

generating the digital image pair from the stored first digital image and the stored second digital image in response to (i) a difference between the respective acquired solid angles of the store first digital image and the stored second digital image being less than a defined difference, and (ii) the extent of the object movements within the overlapping region of the stored first digital image and the stored second digital image being less than a defined value; and

training the neural network to generate the stored second digital image of the digital image pair using the stored first digital image of the digital image pair as an input variable.

9. The method according to claim 8 , further comprising:

using the trained neural network for correcting noisy image components of noisy images by

transferring a noisy image as an input variable to the trained neural network, and

correcting the noisy image components in the image generated by the neural network.

10. The method according to claim 9 , further comprising:

generating a representation of the environment of the mobile platform based on images which have been acquired by image-generating systems from the environment of the mobile platform and the corrected noisy image components,

wherein the mobile platform is at least partially automated.

11. The method according to claim 10 , further comprising:

using the representation of the environment to at least one of (i) activate an at least partially automated vehicle and (ii) transmit a depiction of the representation to a vehicle occupant.

12. The method according to claim 8 , wherein a computer program product comprises commands which, upon the execution of the computer program product by a computer, causes the computer to execute the method.

13. The method according to claim 12 , wherein the computer program product is stored on a machine-readable storage medium.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2020
From: MEINKE, MARTIN
To: ROBERT BOSCH GMBH
Reel/Frame 053858/0434 →
Priority Claims (1)
DE 10 2019 205 962.7 · Apr 25, 2019 · national
Continuity (1)
Related Publication 20200342574A1 · Oct 29, 2020
Cited By (2)
US 12,438,997 US 12,506,840