IP Library Granted Patent US 11,258,953
Granted Patent B2
US 11,258,953 · App. 15/992,990 · Granted Feb 22, 2022

Image processing device

Inventors: Kota Ito (Oobu, JP); Haruyuki Horie (Okazaki, JP); Miki Tsujino (Wako, JP)
Assignee: AISIN SEIKI KABUSHIKI KAISHA
H04N5/235G06T5/007G06T5/50G06T7/11G06T7/90H04N5/23238H04N5/23293H04N5/247H04N9/64G06T2207/10016G06T2207/10024G06T2207/20076G06T2207/20216G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,258,953
App. No.
15/992,990
Granted
Feb 22, 2022
Kind
B2
Abstract

According to one embodiment, the image processing device includes imagers disposed on an outer circumference of a mobile object for imaging surroundings of the mobile object to generate multiple images including mutually overlapping regions, and a processor that corrects the images on the basis of one color-value mean value and another color-value mean value to generate a peripheral image by combining the corrected images. The one color-value mean value is an average of color values of a target region set in an overlapping region of one of the images. Another color-value mean value is an average of color values of a target region set in an overlapping region of another one of the images.

Claims (27)

1. An image processing device comprising:

a plurality of imagers that are disposed on an outer circumference of a mobile object and that image surroundings of the mobile object to generate multiple images, the images each including an overlapping region that overlaps with another one of the images, the overlapping region including a target region that is set in a part of the overlapping region and a non-target region outside of the target region in the overlapping region;

a processor that corrects the images based on a first value and a second value to generate a peripheral image by combining the corrected images, the first value being an average of color values of the target region of the overlapping region of one of the images, the second value being the average of the color values of the target region of the overlapping region of another one of the images, wherein

the processor combines the corrected images such that the overlapping region between a first corrected image and a second corrected image includes the target region that is covered by at least one of the first corrected image and the second corrected image, a first region that is covered by only the first corrected image, and a second region that is covered by only the second corrected image,

the target region is provided toward the mobile object with respect to the first region and the second region, and

the processor determines whether to correct the color values of the images based on whether the average of the color values of a reference region of the images and the average of the color values of the images satisfy a predefined complementary color condition, the average of the color values of the reference region being used by each of the imagers as a reference for the correction.

2. The image processing device according to claim 1 , wherein

the imagers are disposed on a front side and a lateral side of the mobile object; and

the processor sets a third value as a reference value and corrects a fourth value to the reference value, the third value being the average of the color values of the target region set in the overlapping region of the image generated by the front-side imager, the fourth value being the average of the color values of the target region set in the overlapping region of the image generated by the lateral-side imager.

3. The image processing device according to claim 2 , wherein

at least one of the imagers is disposed on a rear side of the mobile object; and

the processor corrects a fifth value to the reference value, the fifth value being the average of the color values of the target region set in the overlapping region of the image generated by the rear-side imager.

4. The image processing device according to claim 1 , wherein

the processor determines, based on the average of the color values of the target region and a threshold, whether to correct the color values.

5. The image processing device according to claim 1 , wherein

the processor determines, based on a variation in the color values of the target region and a threshold, whether to correct the color values.

6. The image processing device according to claim 1 , wherein

the processor determines, based on a threshold and a difference in averages of the color values of multiple target regions of one of the images, whether to correct the color values.

7. The image processing device according to claim 1 , wherein

the processor determines, based on a correction value for correcting the color values and a preset upper-limit, whether to change the correction value to the upper-limit.

8. The image processing device according to claim 7 , wherein

the processor changes the correction value to the upper-limit when the correction value exceeds the upper-limit.

9. The image processing device according to claim 1 , wherein

the processor selects one of the images to be corrected, based on a comparison between a threshold and differences in the average of the color values between the one of the images and another one of the images adjacent to the one of the images.

10. The image processing device according to claim 9 , wherein

the processor corrects the color values of the one of the images when the one of the images satisfies a condition that the differences exceed the threshold, and other images different from the one of the images do not satisfy the condition.

11. The image processing device according to claim 1 , wherein the average of the color values of the images is an average of color values of the target region.

Assignments (2)
CHANGE OF NAME Recorded Dec 23, 2021
From: AISIN SEIKI KABUSHIKI KAISHA
To: AISIN CORPORATION
Reel/Frame 058575/0964 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2018
From: ITO, KOTA; HORIE, HARUYUKI; TSUJINO, MIKI
To: AISIN SEIKI KABUSHIKI KAISHA
Reel/Frame 045945/0486 →
Priority Claims (2)
JP JP2017-114468 · Jun 9, 2017 · national
JP JP2018-044493 · Mar 12, 2018 · national
Continuity (1)
Related Publication 20180359399A1 · Dec 13, 2018