IP Library › Granted Patent US 11,044,421
Granted Patent B2
US 11,044,421 · App. 16/661,439 · Granted Jun 22, 2021

Image synthesis device for electronic mirror and method thereof

Inventor: Hideyuki Tsutsumitake (Yokohama, JP)
Assignee: Kabushiki Kaisha Toshiba
H04N5/2628B60R1/00G06T3/4038G06T11/001G06T11/60H04N5/2171H04N5/247H04N5/272H04N7/181B60R2300/105B60R2300/303B60R2300/306B60R2300/8046B60R2300/8066
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,044,421
App. No.
16/661,439
Granted
Jun 22, 2021
Kind
B2
Abstract

According to one embodiment, an image synthesis device for an electronic mirror includes a rear camera which obtains a first image from a first position, and a side camera which obtains a second image of the same direction with a view of the rear camera from a second position. The second image includes a view obstruction. When a part of the first image is connected as a complementary image to the view obstruction of the second image, an image processing device converts an image of the view obstruction into a translucent image, superimposes the complementary image on the translucent image, and obtains a third image which remains an outline of the complementary image.

Claims (38)

1. An image synthesis device for an electronic mirror, the device comprising:

a rear camera which obtains a first image of a first view from a first position of a vehicle, as a rear view of the vehicle, by a first field of view;

a side camera which obtains a second image from a second position on a more front side than the first position, by a second field of view including a view obstruction as a side part of the vehicle, in a direction of the first view;

a translucent image processor which converts an image of the view obstruction included in the second image into a translucent image;

an edge processor capable of adding a line to an outline of the translucent image in the second image; and

an image synthesizer which obtains a third image by synthesizing a projective transformation image, as a part of the first image, subjected to projective transformation into a view position of the side camera and corresponding to a part of the translucent image of the second image, wherein

the projective transformation image includes

a first projective transformation image obtained by subjecting an image of a viewpoint of the rear camera to projective transformation into an image of a view position of the side camera, based on a far plan position on the rear side of the vehicle, by a first image processor, and

a second projective transformation image obtained by subjecting an image of a viewpoint of the rear camera to projective transformation into an image of a viewpoint of the side camera based on a ground position closer to a capture position of the side camera than the far plan position, by a second image processor.

2. The image synthesis device of claim 1 , wherein

when a direction of a horizontal line of the rear and side cameras is a right-and-left direction, and a direction of a perpendicular line is an upper-and-lower direction,

the first image processor generates the first projective transformation image by subjecting an upper region of the projective transformation image to projective transformation based on the far plan position, and

the second image processor generates the second projective transformation image by subjecting a lower region of the projective transformation image to projective transformation based on the ground position.

3. The image synthesis device of claim 1 , further comprising:

a unit which changes any one of a thickness, a color, and concentration of the line.

4. The image synthesis device of claim 1 , wherein

the synthesizer generates an image filled with a color similar to a color of a surrounding image, as an image to be further added to the projective transformation image.

5. An image synthesis method of an electronic mirror, the method using:

in an electronic mirror mounted on a vehicle to display an image of a rear side of the vehicle,

a rear camera which obtains a first image of a first view from a first position, as a rear view of the vehicle, by a first field of view;

a side camera which obtains a second image from a second position on a more front side than the first position, by a second field of view including a view obstruction as a side part of the vehicle, in a direction of the first view; and

an image processor which proceeds the first image and the second image from the rear and side cameras,

the method comprising:

converting an image of the view obstruction included in the second image into a translucent image;

adding a line to an outline of the translucent image in the second image; and

obtaining a third image by synthesizing a projective transformation image, as a part of the first image, subjected to projective transformation into a view position of the side camera and corresponding to a part of the translucent image of the second image, wherein

when the projective transformation image is generated,

a first projective transformation image obtained by subjecting an image of a viewpoint of the rear camera to projective transformation into an image of a view position of the side camera, based on a far plan position on the rear side of the vehicle, is generated by a first image processor,

a second projective transformation image obtained by subjecting an image of a viewpoint of the side camera to projective transformation into an image of a viewpoint of the rear camera based on a ground position closer to a capture position of the side camera than the far plan position, is generated by a second image processor, and

the projective transformation image is generated by connecting the first projective transformation image and the second projective transformation image.

6. The method of claim 5 , wherein

when a direction of a horizontal line of the rear and side cameras is a right-and-left direction, and a direction of a perpendicular line is an upper-and-lower direction,

the first projective transformation image is generated by subjecting an upper region of the projective transformation image to projective transformation based on the far plan position, and

the second projective transformation image is generated by subjecting a lower region of the projective transformation image to projective transformation based on the ground position.

7. The method of claim 5 , further comprising:

changing any one of a thickness, a color, and concentration of the line.

8. The method of claim 5 , wherein

an image filled with a color similar to a color of a surrounding image, is generated as an image to be further added to the projective transformation image.

Priority Claims (1)
JP 2017-008584 · Jan 20, 2017 · national
Continuity (2)
Continuation 15659725 · Jul 26, 2017
Related Publication 20200059609A1 · Feb 20, 2020