IP Library Granted Patent US 10,609,337
Granted Patent B2
US 10,609,337 · App. 14/836,345 · Granted Mar 31, 2020

Image processing apparatus

Inventors: Akihide Fujio (Kobe, JP); Koichi Yamamoto (Kobe, JP); Azusa Minode (Kobe, JP); Yasushi Seike (Kobe, JP); Minoru Yoshimura (Kobe, JP)
Assignee: DENSO TEN Limited
H04N7/181B60R1/00G06K9/00812B60R2300/105B60R2300/607
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,609,337
App. No.
14/836,345
Granted
Mar 31, 2020
Kind
B2
Abstract

An image processing apparatus includes an image processor configured to: acquire a plurality of captured images captured by a plurality of cameras installed on a vehicle; generate a composite image showing a vicinity of the vehicle viewed from a virtual viewpoint, using the plurality of captured images; generate a vicinity image by superimposing a distance indicator that shows at least one distance from the vehicle on the composite image, the distance indicator encompassing a periphery of the vehicle in the composite image; and output the vicinity image to a display to cause the vicinity image to be displayed on the display.

Claims (48)

1. An image processing apparatus that processes an image, the image processing apparatus comprising:

an image processor configured to:

acquire a plurality of captured images captured by a plurality of cameras installed on a vehicle;

generate a composite image showing a vicinity of the vehicle on all sides of the vehicle viewed from a virtual viewpoint, using the plurality of captured images;

acquire information relating to a traveling state of the vehicle;

generate a vicinity image by superimposing a distance indicator on the composite image, the distance indicator encompassing a periphery of the vehicle in the composite image; and

output the vicinity image to a display to cause the vicinity image to be displayed on the display, wherein

in a first mode, the vicinity image is displayed as the composite image generated using the plurality of captured images showing the vicinity of the vehicle on all sides of the vehicle from the virtual viewpoint and superimposed with the distance indicator that encompasses an entire periphery of the vehicle, and in a second mode, the vicinity image is displayed as the composite image generated using the plurality of captured images showing the vicinity of the vehicle on all sides of the vehicle from the virtual viewpoint and superimposed with the distance indicator that encompasses only a part of the periphery of the vehicle, the first mode or the second mode being selected depending on the traveling state of the vehicle, the distance indicator displayed in the first mode being different from the distance indicator displayed in the second mode, and

the distance indicator includes a plurality of distance lines showing different distances from the vehicle and intervals between the plurality of distance lines are varied by the image processor depending on the traveling state of the vehicle.

2. The image processing apparatus according to claim 1 , wherein

in a case where the traveling state of the vehicle satisfies a predetermined condition, the image processor generates the vicinity image.

3. The image processing apparatus according to claim 1 , wherein

the distance indicator includes plural areas defined by a plurality of distance lines showing different distances from the vehicle and colors of the plural areas are different from one another.

4. The image processing apparatus according to claim 1 , further comprising:

a detector that detects an object in the vicinity of the vehicle, wherein

in a case of presence of the object in the vicinity of the vehicle, the image processor generates the vicinity image.

5. The image processing apparatus according to claim 1 , wherein:

the image processor is configured to select the distance indicator, based on a determined location of the vehicle, from a plurality of available distance indicators that are different from each other.

6. The image processing apparatus according to claim 1 ,

wherein the image processor acquires information relating to a location of the vehicle and the intervals between the plurality of distance lines are also varied by the image processor depending on the location of the vehicle.

7. An image display system comprising:

an image processor configured to:

(i) acquire a plurality of captured images captured by a plurality of cameras installed on a vehicle;

(ii) generate a composite image showing a vicinity of the vehicle on all sides of the vehicle viewed from a virtual viewpoint, using the plurality of captured images;

(iii) acquire information relating to a traveling state of the vehicle; and

(iv) generate a vicinity image by superimposing a distance indicator on the composite image, the distance indicator encompassing a periphery of the vehicle in the composite image; and

a display that displays the vicinity image generated by the image processor, wherein

in a first mode, the vicinity image is displayed as the composite image generated using the plurality of captured images showing the vicinity of the vehicle on all sides of the vehicle from the virtual viewpoint and superimposed with the distance indicator that encompasses an entire periphery of the vehicle, and in a second mode, the vicinity image is displayed as the composite image generated using the plurality of captured images showing the vicinity of the vehicle on all sides of the vehicle from the virtual viewpoint and superimposed with the distance indicator that encompasses only a part of the periphery of the vehicle, the first mode or the second mode being selected depending on the traveling state of the vehicle, the distance indicator displayed in the first mode being different from the distance indicator displayed in the second mode, and

the distance indicator includes a plurality of distance lines showing different distances from the vehicle and intervals between the plurality of distance lines are varied by the image processor depending on the traveling state of the vehicle.

8. The image display system according to claim 7 ,

wherein the image processor acquires information relating to a location of the vehicle and the intervals between the plurality of distance lines are also varied by the image processor depending on the location of the vehicle.

9. An image processing method that processes an image, the image processing method comprising the steps of:

(a) acquiring, by an image processor, a plurality of captured images captured by a plurality of cameras installed on a vehicle;

(b) generating, by the image processor, a composite image showing a vicinity of the vehicle on all sides of the vehicle viewed from a virtual viewpoint, using the plurality of captured images;

(c) acquiring, by the image processor, information relating to a traveling state of the vehicle;

(d) generating, by the image processor, a vicinity image by superimposing a distance indicator on the composite image, the distance indicator encompassing a periphery of the vehicle in the composite image; and

(e) outputting, by the image processor, the vicinity image to a display to cause the vicinity image to be displayed on the display, wherein

in a first mode, the vicinity image is displayed as the composite image generated using the plurality of captured images showing the vicinity of the vehicle on all sides of the vehicle from the virtual viewpoint and superimposed with the distance indicator that encompasses an entire periphery of the vehicle, and in a second mode, the vicinity image is displayed as the composite image generated using the plurality of captured images showing the vicinity of the vehicle on all sides of the vehicle from the virtual viewpoint and superimposed with the distance indicator that encompasses only a part of the periphery of the vehicle, the first mode or the second mode being selected depending on the traveling state of the vehicle, the distance indicator displayed in the first mode being different from the distance indicator displayed in the second mode, and

the distance indicator includes a plurality of distance lines showing different distances from the vehicle and intervals between the plurality of distance lines are varied depending on the traveling state of the vehicle.

10. The image processing method according to claim 9 , wherein

in a case where the traveling state of the vehicle satisfies a predetermined condition, the step (c) generates the vicinity image.

11. The image processing method according to claim 9 , wherein

the distance indicator includes plural areas defined by a plurality of distance lines showing different distances from the vehicle and colors of the plural areas are different from one another.

12. The image processing method according to claim 9 , further comprising the step of:

(f) detecting an object in the vicinity of the vehicle, wherein

in a case of presence of the object in the vicinity of the vehicle, the step (d) generates the vicinity image.

13. The image processing method according to claim 9 ,

wherein the image processor acquires information relating to a location of the vehicle and the intervals between the plurality of distance lines are also varied by the image processor depending on the location of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2015
From: FUJIO, AKIHIDE; YAMAMOTO, KOICHI; MINODE, AZUSA; SEIKE, YASUSHI; YOSHIMURA, MINORU
To: FUJITSU TEN LIMITED
Reel/Frame 036428/0353 →
Priority Claims (1)
JP 2014-189714 · Sep 18, 2014 · national
Continuity (1)
Related Publication 20160088260A1 · Mar 24, 2016