IP Library Granted Patent US 11,748,920
Granted Patent B2
US 11,748,920 · App. 17/632,087 · Granted Sep 5, 2023

Image processing device, and image processing method

Inventors: Mai Okamoto (Kanagawa, JP); Hiroyuki Kikuchi (Kanagawa, JP)
Assignee: Nissan Motor Co., Ltd.
G06T11/001G06T5/002G06T11/60G06T2207/10024G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,748,920
App. No.
17/632,087
Granted
Sep 5, 2023
Kind
B2
Abstract

An image processing device includes: an information acquisition unit configured to acquire outside information including color information of outside of a vehicle; an image generation unit configured to generate, based on the outside information, a first image in which a difference in the color information with respect to the outside of the vehicle is within a predetermined range; and an output unit configured to output the first image to a display provided in a cabin of the vehicle.

Claims (46)

1. An image processing device comprising:

an information acquisition unit configured to acquire, from a captured image that is captured by an imaging device and in which a forward view from a vehicle is captured, color information of the forward view from the vehicle;

an image generation unit configured to perform processing treatment on the captured image based on the color information thereby to generate a first image blurred in the forward view such that a difference between the color information of the forward view from the vehicle and target image information regarding one or more colors of the first image is reduced to be within a predetermined range; and

an output unit configured to output the first image to a display provided in a cabin of the vehicle.

2. The image processing device according to claim 1 , wherein the first image is displayed in a first area that is a part of a display area of the display.

3. The image processing device according to claim 2 , wherein

the display is configured such that a part of the display area extends in a direction from an interior portion of the vehicle to a windshield of the vehicle, and

the first area is positioned on a windshield side.

4. The image processing device according to claim 3 , wherein the display is provided in a place in which the first area is included in a visual field of a driver of the vehicle when the driver visually recognizes the forward view through the windshield.

5. The image processing device according to claim 1 , wherein the display is provided ahead of a driver of the vehicle.

6. The image processing device according to claim 1 , wherein the processing treatment is a process of blurring the captured image based on the color information such that the difference between the color information of the forward view from the vehicle and the target image information regarding the one or more colors of the first image is within the predetermined range.

7. The image processing device according to claim 1 , wherein

the information acquisition unit sequentially acquires the color information from the captured image at a first cycle,

the image generation unit performs the processing treatment on the captured image at a second cycle to generate a plurality of candidate images, where the first image is selected from the plurality of candidate images, and

the acquisition of color information during the first cycle corresponds to a timing at which the image generation unit performs the processing treatment during the second cycle.

8. The image processing device according to claim 2 , wherein

the image generation unit generates, from images stored in a database, a second image displayed in a second area of the display area that is different from the first area, and

the output unit outputs the second image to the display.

9. The image processing device according to claim 8 , wherein

the display is configured such that a part of the display area extends in a direction from an interior portion of the vehicle to a windshield of the vehicle, and

the second area is positioned on an interior portion side as compared with the first area.

10. The image processing device according to claim 9 , wherein the display is provided in a place in which the second area is included in a visual field of a driver of the vehicle when the driver visually recognizes the forward view through the windshield.

11. The image processing device according to claim 9 , wherein the second image is an image acquired from the database that represents a surface of the interior portion.

12. The image processing device according to claim 9 , wherein

the display is a display in which the display area has a rectangular shape,

the image generation unit performs a process of applying gradation to the first image and the second image so that they gradually become a predetermined color from an end portion on the windshield side and an end portion on the interior portion side of the display area toward a boundary between the first area and the second area, and

the output unit outputs the first image and the second image subjected to the gradation process to the display.

13. The image processing device according to claim 9 , wherein the image generation unit performs the process of applying gradation to the first image and the second image so that they gradually become the predetermined color from end portions other than the end portion on the windshield side and the end portion on the interior portion side in the display area toward a boundary between the first area and the second area.

14. The image processing device according to claim 8 , wherein

the image generation unit superposes content information on the first image and the second image thereby to generate a display image to be displayed in the display area, the content information being information to be provided to a driver of the vehicle,

and the output unit outputs the display image to the display.

15. An image processing method executed by a computer, comprising:

acquiring, from a captured image that is captured by an imaging device and in which a forward view from a vehicle is captured, color information of the forward view from the vehicle;

performing processing treatment on the captured image based on the color information thereby to generate a first image blurred in the forward view such that a difference between the color information of the forward view from the vehicle and target image information regarding one or more colors of the first image is reduced to be within a predetermined range; and

outputting the first image to a display provided in a cabin of the vehicle.

16. A computer-readable medium storing a non-transitory program for causing a computer executing the program to perform as an image processing device comprising:

an information acquisition unit configured to acquire, from a captured image that is captured by an imaging device and in which a forward view from a vehicle is captured, color information of the forward view from the vehicle;

an image generation unit configured to perform processing treatment on the captured image based on the color information thereby to generate a first image blurred in the forward view such that a difference between the color information of the forward view from the vehicle and target image information regarding one or more colors of the first image is reduced to be within a predetermined range; and

an output unit configured to output the first image to a display provided in a cabin of the vehicle.

17. An image processing device comprising:

a camera that acquires a captured image in a forward view from a vehicle;

a storage device for storing programs, captured image data acquired by the camera, and target image information;

a processor that executes a program stored in the storage device to perform as:

an information acquisition unit configured to acquire, from the captured image, color information of the forward view from the vehicle;

an image generation unit configured to perform processing treatment on the captured image based on the color information thereby to generate a first image blurred in the forward view such that a difference between the color information of the forward view from the vehicle and target image information regarding one or more colors of the first image is reduced to be within a predetermined range; and

an output unit configured to output the first image to a display provided in a cabin of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 8, 2022
From: OKAMOTO, MAI; KIKUCHI, HIROYUKI
To: NISSAN MOTOR CO., LTD.
Reel/Frame 059546/0542 →
Continuity (1)
Related Publication 20220319066A1 · Oct 6, 2022