IP Library › Granted Patent US 10,552,943
Granted Patent B2
US 10,552,943 · App. 15/558,903 · Granted Feb 4, 2020

Image synthesizer and a method for synthesizing an image

Inventors: Huba Nemeth (Budapest, HU); Marton Gyori (Budapest, HU)
Assignee: KNORR-BREMSE SYSTEME FUER NUTZFAHRZEUGE GMBH
G06T3/4038B60R1/00B60R2300/105B60R2300/30B60R2300/607G06T2200/32
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,552,943
App. No.
15/558,903
Granted
Feb 4, 2020
Kind
B2
Abstract

An image synthesizer for a driver assisting system includes a receiving module and a combining module. The driver assisting system includes a first camera configured to capture a first image from a first scene and a second camera configured to capture a second image from a second scene, wherein the first scene and the second scene partly overlap in an overlapping region. The receiving module configured to receive the first image from the first camera and the second image from the second camera. The combining module is configured to combine the first image and the second image in the overlapping region using a binary mask.

Claims (35)

1. An image synthesizer for a driver assisting system, comprising:

a receiving module to receive a first image from a first camera and a second image from a second camera, the driver assisting system including the first camera to capture the first image from a first scene and the second camera to capture the second image from a second scene, wherein the first scene and the second scene partly overlap in an overlapping region; and

a combining module to combine the first image and the second image in the overlapping region using a binary mask;

wherein the binary mask includes a pattern with a first plurality of first portions and a second plurality of second portions, wherein the combining module is configured to depict in the first portions respective portions of the first image and in the second portions respective portions of the second image to obtain a combined image representing alternating views of the first image and the second image in the overlapping region along at least one direction, and

wherein, when following a path in the combined image from the first scene to the second scene, a density of first portions decreases in comparison to a density of second portions.

2. The image synthesizer of claim 1 , wherein, when going from the first scene to the second scene, the decreased density depends monotonically on an angle from 0 to 90° around a corner of the vehicle or a distance from an edge of the overlapping region.

3. An image synthesizer for a driver assisting system, comprising:

a receiving module to receive a first image from a first camera and a second image from a second camera, the driver assisting system including the first camera to capture the first image from a first scene and the second camera to capture the second image from a second scene, wherein the first scene and the second scene partly overlap in an overlapping region; and

a combining module to combine the first image and the second image in the overlapping region using a binary mask;

wherein the binary mask includes a pattern with a first plurality of first portions and a second plurality of second portions, wherein the combining module is configured to depict in the first portions respective portions of the first image and in the second portions respective portions of the second image to obtain a combined image representing alternating views of the first image and the second image in the overlapping region along at least one direction, and

wherein the first scene is adjacent to a first side of a vehicle and the second scene is adjacent to a second side of the vehicle, the first side and the second side being perpendicular to each other or being the same side of the vehicle, and wherein the combining module is configured to combine the first image and the second image so as to provide a bird's eye view of the first scene and the second scene.

4. An image synthesizer for a driver assisting system, comprising:

a receiving module to receive a first image from a first camera and a second image from a second camera, the driver assisting system including the first camera to capture the first image from a first scene and the second camera to capture the second image from a second scene, wherein the first scene and the second scene partly overlap in an overlapping region; and

a combining module to combine the first image and the second image in the overlapping region using a binary mask;

wherein the binary mask includes a pattern with a first plurality of first portions and a second plurality of second portions, wherein the combining module is configured to depict in the first portions respective portions of the first image and in the second portions respective portions of the second image to obtain a combined image representing alternating views of the first image and the second image in the overlapping region along at least one direction, and

wherein the pattern includes a third plurality of mixed portions and the combining module is further configured to blend respective portions of the first image with respective portions of the second image and to depict resulting blended portions at respective mixed portions.

5. The image synthesizer of claim 4 , wherein the combining module is configured to add in the blended portions respective pixel values of the first image and pixel values of the second image in a predetermined ratio.

6. A driver assisting system, comprising:

a first camera to capture a first image from a first scene;

a second camera to capture a second image from a second scene, wherein the first scene and the second scene partly overlap over in an overlapping region;

an image synthesizer, including a receiving module to receive the first image from the first camera and the second image from the second camera, and a combining module to combine the first image and the second image in the overlapping region using a binary mask, so as to provide a combined image; and

a display and a control unit configured to receive the combined image from the image synthesizer and to create a bird's eye view by combining the first image with the second image and the combined image, wherein the display is configured to display the bird's eye view;

wherein the binary mask includes a pattern with a first plurality of first portions and a second plurality of second portions, wherein the combining module is configured to depict in the first portions respective portions of the first image and in the second portions respective portions of the second image to obtain a combined image representing alternating views of the first image and the second image in the overlapping region along at least one direction, wherein at least part of the first portions and/or the second portions in the binary mask include a size, and wherein the size or a number of the first portions and/or second portions depends on a resolution of the display, and

wherein the first camera and the second camera are arranged along one side of the vehicle or on two adjacent sides of the vehicle.

7. A method for synthesizing an image using a driver assisting system, the method comprising:

receiving a first image from a first camera and a second image from a second camera, the driver assisting system including the first camera to capture the first image from a first scene and the second camera to capture the second image from a second scene, wherein the first scene and the second scene partly overlap in an overlapping region; and

combining the first image and the second image in the overlapping region using a binary mask;

wherein the binary mask includes a pattern with a first plurality of first portions and a second plurality of second portions, wherein the combining module is configured to depict in the first portions respective portions of the first image and in the second portions respective portions of the second image to obtain a combined image representing alternating views of the first image and the second image in the overlapping region along at least one direction, and

wherein, when following a path in the combined image from the first scene to the second scene, a density of first portions decreases in comparison to a density of second portions.

8. A non-transitory computer readable medium having a computer program, which is executable by a processor, comprising:

a program code arrangement having program code for synthesizing an image using a driver assisting system, by performing the following:

receiving a first image from a first camera and a second image from a second camera, the driver assisting system including the first camera to capture the first image from a first scene and the second camera to capture the second image from a second scene, wherein the first scene and the second scene partly overlap in an overlapping region; and

combining the first image and the second image in the overlapping region using a binary mask;

wherein the binary mask includes a pattern with a first plurality of first portions and a second plurality of second portions, wherein the combining module is configured to depict in the first portions respective portions of the first image and in the second portions respective portions of the second image to obtain a combined image representing alternating views of the first image and the second image in the overlapping region along at least one direction, and

wherein, when following a path in the combined image from the first scene to the second scene, a density of first portions decreases in comparison to a density of second portions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2018
From: NEMETH, HUBA; GYORI, MARTON
To: KNORR-BREMSE SYSTEME FUER NUTZFAHRZEUGE GMBH
Reel/Frame 044588/0011 →
Priority Claims (1)
EP 15161697 · Mar 30, 2015 · regional
Continuity (1)
Related Publication 20180089801A1 · Mar 29, 2018