IP Library › Granted Patent US 10,291,846
Granted Patent B2
US 10,291,846 · App. 15/569,656 · Granted May 14, 2019

Method for producing an overall image of surroundings of a vehicle, and corresponding device

Inventors: David Liepelt (Stuttgart, DE); Jose Domingo Esparza Garcia (Stuttgart, DE); Matthias Mayerle (Stuttgart, DE); Raphael Cano (Stuttgart, DE)
Assignee: ROBERT BOSCH GMBH
H04N5/23238B60R1/00G06T3/4038H04N5/23293H04N5/247B60R2300/105B60R2300/303
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,291,846
App. No.
15/569,656
Granted
May 14, 2019
Kind
B2
Abstract

A method for producing an overall image of surroundings of a vehicle using images that are each actively recorded by one of a plurality of cameras mounted on the vehicle. The method includes determining a position of each predefined image section that occurs in an image of the plurality of images that at least partly forms an image of a vehicle body and/or of a vehicle wheel, using an image mask associated with the respective image to mask a portion of each of the plurality of images, in which a predefined image section occurs; determining each image mask on the basis of the position determined for each predefined image section located in the associated image in such a way that it masks each predefined image section that occurs in the associated image, and producing the overall image by assembling the plurality of images.

Claims (18)

1. A method for producing an overall image of surroundings of a vehicle using a plurality of images that are each actively recorded by one of a plurality of cameras mounted on the vehicle, the overall image thereby displaying the surroundings of the vehicle and a virtual model of the vehicle from a virtual perspective, the method comprising:

determining a position of each predefined image section that occurs in an image of the plurality of images that at least partly forms an image of at least one of a vehicle body and a vehicle wheel;

using an image mask associated with the respective image to mask a portion of each of the plurality of images, in which a predefined image section occurs;

determining each image mask on the basis of the position determined for each predefined image section located in the associated image in such a way that it masks each predefined image section that occurs in the associated image;

producing the overall image by assembling the plurality of images subsequently to the masking thereof by the associated image masks; and

determining a current position of at least one vehicle wheel as a function of a current steering angle of the vehicle, and determining the position of at least one predefined image section, that occurs in one of the plurality of images and at least partly forms an image of the at least one vehicle wheel, on the basis of the current position of the at least one vehicle wheel and on the basis of current intrinsic and extrinsic calibration parameters of one of the plurality of cameras that was used to actively record the corresponding image.

2. The method as recited in claim 1 , further comprising:

determining the position of at least one predefined image section, that occurs in one of the plurality of images and at least partly forms an image of the vehicle body, on the basis of current intrinsic and extrinsic calibration parameters of one of the plurality of cameras that was used to actively record the corresponding image.

3. The method as recited in claim 1 , further comprising:

using a lookup table that includes a position of at least one predefined image section that may occur in each case in the corresponding position in an image of at least one of the plurality of cameras when the at least one camera is located in a predefined position, and taking the position of the at least one predefined image section from the lookup table when the at least one predefined image section occurs in the current image from the at least one camera.

4. The method as recited in claim 1 , further comprising:

positioning the virtual model of the vehicle in an image region of the overall image whose position in the overall image corresponds to a position of the vehicle in the surroundings thereof.

5. A device for producing an overall image of surroundings of a vehicle using a plurality of images that are each actively recorded by one of a plurality of cameras mounted on the vehicle, the overall image displaying the surroundings of the vehicle and a virtual model of the vehicle from a virtual perspective, the device being designed to:

determine a position of each predefined image section that occurs in an image of the plurality of images that at least partly forms an image of at least one of a vehicle body and a vehicle wheel;

use an image mask associated with the respective image to mask a portion of each of the plurality of images, in which a predefined image section occurs;

determine each image mask on the basis of the position determined for each predefined image section located in the associated image in such a way that it masks each predefined image section that occurs in the associated image;

produce the overall image by assembling the plurality of images subsequently to the masking thereof by the associated image masks; and

determine a current position of at least one vehicle wheel as a function of a current steering angle of the vehicle, and determine the position of at least one predefined image section, that occurs in one of the plurality of images and at least partly forms an image of the at least one vehicle wheel, on the basis of the current position of the at least one vehicle wheel and on the basis of current intrinsic and extrinsic calibration parameters of one of the plurality of cameras that was used to actively record the corresponding image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2018
From: ESPARZA GARCIA, JOSE DOMINGO
To: ROBERT BOSCH GMBH
Reel/Frame 046034/0643 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2017
From: LIEPELT, DAVID; DOMINGO, JOSE; MAYERLE, MATTHIAS; CANO, RAPHAEL
To: ROBERT BOSCH GMBH
Reel/Frame 044452/0571 →
Priority Claims (1)
DE 10 2015 208 343 · May 6, 2015 · national
Continuity (1)
Related Publication 20180115707A1 · Apr 26, 2018
Cited By (1)
US 12,536,668