IP Library Granted Patent US 10,611,308
Granted Patent B2
US 10,611,308 · App. 15/834,705 · Granted Apr 7, 2020

Image generation device and image generation method

Inventors: Yukiko Hatakeyama (Kobe, JP); Kouei Kiyo (Kobe, JP); Tamaki Takeuchi (Kobe, JP); Rie Habuta (Kobe, JP); Akinari Motohiro (Kobe, JP); Tomoyuki Sato (Kobe, JP); Kohei Maejima (Nisshin, JP); Atsutoshi Sakaguchi (Toyota, JP); Masahiro Takahashi (Toyota, JP)
Assignees: DENSO TEN LIMITED; TOYOTA JIDOSHA KABUSHIKI KAISHA
B60R1/002B60R1/00G06K9/209H04N5/23293H04N5/265B60R2300/303B60R2300/607B60R2300/802G06K9/00805H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,611,308
App. No.
15/834,705
Granted
Apr 7, 2020
Kind
B2
Abstract

An image generation device according to an embodiment includes a synthesis unit and a superimposition unit. The synthesis unit synthesizes an overview image for a virtual viewpoint that is provided in a manner to look in a direction of travel of a vehicle so as to include at least a portion of a side of the vehicle based on a taken image that is taken by an image-taking unit that is provided on the vehicle. The superimposition unit superimposes a plane image where a vehicle has been caused to be planar, at a position of the vehicle on a road surface, on an overview image that is synthesized by the synthesis unit.

Claims (21)

1. An image generation device for use with a vehicle having a camera, the image generation device comprising:

a processor or integrated circuit configured to:

receive a taken image that is taken by the camera that is provided on the vehicle;

detect an object that is located behind a wall that is in front of the vehicle or parallel to the vehicle based on the taken image;

synthesize an overview image for a virtual viewpoint that is provided in an inside of the vehicle that looks in a direction of a travel of the vehicle so as to include: (i) at least a portion of a side of the vehicle, and (ii) the object that is located behind the wall by making the wall transparent in the synthesized overview image, based on the taken image; and

superimpose a plane image that indicates a two-dimensional shape of the vehicle and an appearance of the vehicle where the vehicle has been caused to be planar, at a position of the vehicle on a road surface, on the synthesized overview image.

2. The image generation device according to claim 1 , wherein the processor or the integrated circuit superimposes the plane image thereon so as to be placed inside a blind-spot region of the camera in the overview image.

3. The image generation device according to claim 1 , wherein the processor or integrated circuit is further programmed to:

detect an object that exists in an environment of the vehicle, wherein

the processor or the integrated circuit superimposes a detection range image that indicates a detection range on the overview image.

4. The image generation device according to claim 2 , wherein the processor or integrated circuit is further programmed to:

detect an object that exists in an environment of the vehicle, wherein

the processor or the integrated circuit superimposes a detection range image that indicates a detection range on the overview image.

5. The image generation device according to claim 2 , wherein the processor or the integrated circuit synthesizes, in a case where an obstacle exists on a side of the vehicle, the overview image where a portion of a region where the obstacle exists therein in the overview image in the direction of travel has been caused to be transparent.

6. The image generation device according to claim 3 , wherein the processor or the integrated circuit synthesizes, in a case where an obstacle exists on a side of the vehicle, the overview image where a portion of a region where the obstacle exists therein in the overview image in the direction of travel has been caused to be transparent.

7. The image generation device according to claim 4 , wherein the processor or the integrated circuit synthesizes, in a case where an obstacle exists on a side of the vehicle, the overview image where a portion of a region where the obstacle exists therein in the overview image in the direction of travel has been caused to be transparent.

8. An image generation method for use with a vehicle having a camera, the image generation method comprising:

receiving a taken image that is taken by the camera that is provided on the vehicle;

detecting an object that is located behind a wall that is in front of the vehicle or parallel to the vehicle based on the taken image;

synthesizing an overview image for a virtual viewpoint that is provided in an inside of the vehicle that looks in a direction of a travel of the vehicle so as to include: (i) at least a portion of a side of the vehicle, and (ii) the object that is located behind the wall by making the wall transparent in the synthesized overview image, based on the taken image; and

superimposing a plane image that indicates a two-dimensional shape of the vehicle and an appearance of the vehicle where the vehicle has been caused to be planar, at a position of the vehicle on a road surface, on the synthesized overview image.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: DENSO TEN LIMITED
To: DENSO CORPORATION
Reel/Frame 060673/0937 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 7, 2017
From: HATAKEYAMA, YUKIKO; KIYO, KOUEI; TAKEUCHI, TAMAKI; HABUTA, RIE; MOTOHIRO, AKINARI; SATO, TOMOYUKI; MAEJIMA, KOHEI; SAKAGUCHI, ATSUTOSHI; TAKAHASHI, MASAHIRO
To: DENSO TEN LIMITED; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 044330/0785 →
Priority Claims (1)
JP 2016-255247 · Dec 28, 2016 · national
Continuity (1)
Related Publication 20180178724A1 · Jun 28, 2018