IP Library Granted Patent US 10,086,760
Granted Patent B2
US 10,086,760 · App. 15/091,380 · Granted Oct 2, 2018

Image processing device, image processing method, and on-vehicle apparatus

Inventors: Takayuki Ozasa (Kobe, JP); Teruhiko Kamibayashi (Kobe, JP); Kohji Ohnishi (Kobe, JP); Takeo Matsumoto (Kobe, JP); Tomoyuki Fujimoto (Kobe, JP); Daisuke Yamamoto (Kobe, JP)
Assignee: DENSO TEN Limited
B60R1/00G06T11/00B60R2300/305B60R2300/60B60R2300/605
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,086,760
App. No.
15/091,380
Granted
Oct 2, 2018
Kind
B2
Abstract

An image processing device according to an aspect of the embodiment includes an image generating unit that generates an image at a virtual viewpoint based on a captured image of an image capturing unit, and an image processing unit that generates an image in which an image for synthesis is displayed on the image at the virtual viewpoint. The image processing unit performs a process for decreasing visibility of the image for synthesis when the image at the virtual viewpoint is an image at a viewpoint location of the virtual viewpoint while the viewpoint location is moving.

Claims (30)

1. An image processing device comprising a processor, the processor programmed to:

generate an image viewed from a first viewpoint position based on a captured image of an image capturing unit including an image sensor;

synthesize the generated image and an image for synthesis corresponding to the first viewpoint position so as to generate a synthesized image;

when a virtual viewpoint moves from the first viewpoint position to a second viewpoint position, generate one or more images viewed from one or more virtual viewpoint positions between the first and second viewpoint positions;

decrease visibility of one or more images for synthesis to be synthesized with the one or more images, the one or more images for synthesis corresponding to the one or more virtual viewpoint positions; and

synthesize the one or more images and the one or more images for synthesis to generate synthesized images.

2. The image processing device according to claim 1 , wherein the processor is further programmed to output to a display the synthesized images on which the one or more images for synthesis is not displayed to zero the visibility of the one or more images for synthesis, when the virtual viewpoint moves from the first viewpoint position to the second viewpoint position.

3. An image processing device comprising a processor, the processor programmed to:

generate an image at a virtual viewpoint based on a captured image of an image capturing unit including an image sensor;

generate an image in which an image for synthesis is displayed on the image at the virtual viewpoint; and

when the image at the virtual viewpoint is an image at a viewpoint location of the virtual viewpoint while the viewpoint locating is moving, stops synthesizing the image at the virtual viewpoint and the image for synthesis so as to zero visibility of the image for synthesis, and outputs the image at the virtual viewpoint to a display.

4. The image processing device according to claim 1 , wherein

the image capturing unit is placed on a vehicle, and captures and outputs a peripheral image of the vehicle as the captured image to the image processing device, and

the processor is further programmed to synthesize as the one or more images for synthesis one or more images of a guideline that indicates a predicted running path of the vehicle on the one or more images viewed from the one or more virtual viewpoint positions.

5. An image processing method comprising:

generating an image viewed from a first viewpoint position based on a captured image of an image capturing unit including an image sensor; and

synthesizing the generated image and an image for synthesis corresponding to the first viewpoint position so as to generate a synthesized image;

when a virtual viewpoint moves from the first viewpoint position to a second viewpoint position, generating one or more images viewed from one or more virtual viewpoint positions between the first and second viewpoint positions;

decreasing visibility of one or more images for synthesis to be synthesized with the one or more images, the one or more images for synthesis corresponding to the one or more virtual viewpoint positions; and

synthesizing the one or more images and the one or more images for synthesis to generate synthesized images.

6. An on-vehicle apparatus comprising:

a display that displays an image thereon;

an image capturing unit that captures a peripheral image of a vehicle and outputs a captured image, the image capturing unit including an image sensor; and

a processor programmed to:

generate an image viewed from a first viewpoint position based on the captured image of the image capturing unit;

synthesize the generated image and an image for synthesis corresponding to the first viewpoint position so as to generate a synthesized image;

when a virtual viewpoint moves from the first viewpoint position to a second viewpoint position, generate one or more images viewed from one or more virtual viewpoint positions between the first and second viewpoint positions;

decrease visibility of one or more images for synthesis to be synthesized with the one or more images, the one or more images for synthesis corresponding to the one or more virtual viewpoint positions;

synthesize the one or more images and the one or more images for synthesis to generate synthesized images; and

output the generated synthesized images to the display.

Assignments (2)
CHANGE OF NAME Recorded Aug 8, 2018
From: FUJITSU TEN LIMITED
To: DENSO TEN LIMITED
Reel/Frame 046748/0946 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 5, 2016
From: OZASA, TAKAYUKI; KAMIBAYASHI, TERUHIKO; OHNISHI, KOHJI; MATSUMOTO, TAKEO; FUJIMOTO, TOMOYUKI; YAMAMOTO, DAISUKE
To: FUJITSU TEN LIMITED
Reel/Frame 038198/0224 →
Priority Claims (1)
JP 2015-089738 · Apr 24, 2015 · national
Continuity (1)
Related Publication 20160311372A1 · Oct 27, 2016