IP Library Granted Patent US 7,728,879
Granted Patent B2
US 7,728,879 · App. 11/842,685 · Granted Jun 1, 2010

Image processor and visual field support device

Assignee: Sanyo Electric Co., Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,728,879
App. No.
11/842,685
Granted
Jun 1, 2010
Kind
B2
Abstract

Photographed images from a front camera and a side camera respectively installed at the front and left side of a vehicle are respectively converted into bird's-eye view images, and a synthetic bird's-eye view image is displayed which is obtained by synthesizing the bird's-eye view images. Based on a difference image between the front and side cameras, a difference region where a solid object is drawn is detected from a common region where the both bird's-eye view images overlap. Then, based on position of each pixel forming the difference region, it is evaluated which of the front and side cameras captures the solid object better, and an image of the common region in the synthetic bird's-eye view image is formed based on the image obtained from one of the cameras.

Claims (47)

1. An image processor comprising:

a visual point conversion section respectively converting images photographed by an n-number of photography apparatuses (where n is an integer of 2 or larger) into bird's-eye view images as viewed from a virtual visual point;

and an image synthesis section synthesizing the obtained bird's-eye view images to generate a synthetic bird's-eye view image,

the image processor generating a video signal for displaying the synthetic bird's-eye view image on a display device,

wherein the image synthesis section compares, between a plurality of the bird's-eye view images, images of a common region where the plurality of the bird's-eye view images overlap upon the synthesis to thereby specify a difference region between the plurality of the bird's-eye view images in the common region,

wherein weight values corresponding to respective pixel positions of the image in the common region are set for each of the plurality of the bird's-eye view images,

wherein part or all of the set weight values differ between the plurality of the bird's-eye view images, and

wherein the image synthesis section

sums up the weight values corresponding to pixels included in the difference region to thereby calculate a summed value for each of the plurality of the bird's-eye view images,

selects, based on the summed values, one bird's-eye view image from among the plurality of the bird's-eye view images as an image to be adopted, and

adopts, as an image of the common region in the synthetic bird's-eye view image, the image of the common region in the image to be adopted.

2. The image processor according to claim 1 ,

wherein the image synthesis section compares the summed values between the plurality of the bird's-eye view images to thereby select the image to be adopted.

3. The image processor according to claim 1 ,

wherein the n-number of photographing apparatuses are installed at a vehicle and photograph surrounding of the vehicle, and

wherein the image synthesis section, based on driving condition of the vehicle in addition to the summed values, selects the image to be adopted.

4. The image processor according to claim 1 ,

wherein the weight values are set based on installation positions of a plurality of the photographing apparatuses corresponding to the plurality of the bird's-eye view images.

5. A visual field support device comprising:

the image processor according to claim 1 ; and

at least one of the n-number of photographing apparatuses and the display device.

6. A visual support method for respectively converting images photographed by an n-number of photographing apparatuses (where n is an integer of 2 or larger) into bird's-eye view images as viewed from a virtual visual point and displaying on a display device a synthetic bird's-eye view image obtained by synthesizing the obtained bird's-eye view images,

wherein the visual support method compares, between a plurality of the bird's-eye view images, images of a common region where the plurality of the bird's-eye view images overlap upon the synthesis to thereby specify a difference region between the plurality of the bird's-eye view images in the common region,

wherein weight values corresponding to respective pixel positions of the image in the common region are set for each of the plurality of the bird's-eye view images,

wherein part or all of the set weight values differ between the plurality of the bird's-eye view images, and

wherein the visual support method

sums up the weight values corresponding to pixels included in the difference region to thereby calculate a summed value for each of the plurality of the bird's-eye view images,

selects, based on the summed values, one bird's-eye view image from among the plurality of the bird's-eye view images as an image to be adopted, and

adopts, as an image of the common region in the synthetic bird's-eye view image, the image of the common region in the image to be adopted.

7. An image processor comprising:

a visual point conversion section respectively converting images photographed by an n-number of photographing apparatuses (where n is an integer of 2 or larger) into bird's-eye view images as viewed from a virtual visual point; and

an image synthesis section synthesizing the obtained bird's-eye view images to generate a synthetic bird's-eye view image,

the image processor generating a video signal for displaying the synthetic bird's-eye view image on a display device,

wherein the image synthesis section, when a solid object having some height is present in a common visual field photographed in common by a plurality of the photographing apparatuses,

detects a solid object reflecting region corresponding to a synthetic region of regions where the solid object is drawn in a plurality of the bird's-eye view images obtained from the plurality of the photographing apparatuses,

adopts, as an image of the solid object reflecting region in the synthetic bird's-eye view image, an image of the solid object reflecting region in one of the plurality of the bird's-eye view images, and

compares, between the plurality of the bird's-eye view images, images of a common region where the plurality of the bird's-eye view images overlap upon the synthesis to thereby detect the solid object reflecting region.

8. The image processor according to claim 7 ,

wherein the image synthesis section compares, between the plurality of the bird's-eye view images, images of the common region to thereby specify a difference region between the plurality of the bird's-eye view images in the common region, and detects the difference region as the solid object reflecting region.

9. A visual field support device comprising:

the image processor according to claim 7 ; and

at least one of the n-number of photographing apparatuses and the display device.

10. A visual support method for respectively converting images photographed by an n-number of photographing apparatuses (where n is an integer of 2 or larger) into bird's-eye view images as viewed from a virtual visual point and displaying on a display device a synthetic bird's-eye view image obtained by synthesizing the obtained bird's-eye view images,

wherein the visual support method, when a solid object having some height is present in a common visual field photographed in common by a plurality of the photographing apparatuses,

detects a solid object reflecting region corresponding to a synthetic region of regions where the solid object is drawn in a plurality of the bird's-eye view images obtained from the plurality of the photographing apparatuses,

adopts, as an image of the solid object reflecting region in the synthetic bird's-eye view image, an image of the solid object reflecting region in one of the plurality of the bird's-eye view images, and

compares, between the plurality of the bird's-eye view images, images of a common region where the plurality of the bird's-eye view images overlap upon the synthesis to thereby detect the solid object reflecting region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2024
From: SANYO ELECTRIC CO., LTD.
To: PANASONIC AUTOMOTIVE SYSTEMS CO., LTD.
Reel/Frame 066595/0305 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2007
From: ISHII, YOHEI
To: SANYO ELECTRIC CO., LTD.
Reel/Frame 019726/0427 →
Priority Claims (2)
JP 2006-224002 · Aug 21, 2006 · national
JP 2006-224429 · Aug 21, 2006 · national
Continuity (1)
Related Publication 20080043113A1 · Feb 21, 2008