IP Library Granted Patent US 10,735,664
Granted Patent B2
US 10,735,664 · App. 16/477,612 · Granted Aug 4, 2020

Image shooting control device for vehicle, driver monitoring device, image shooting control method for vehicle, and driver monitoring method

Inventor: Kazuki Kunihiro (Tokyo, JP)
Assignee: MITSUBISHI ELECTRIC CORPORATION
H04N5/2353G06K9/00845G06K9/2027H04N5/2351
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,735,664
App. No.
16/477,612
Granted
Aug 4, 2020
Kind
B2
Abstract

A mode selecting unit ( 6 ) selects a processing mode of occupant monitoring by using vehicle information, and an area selecting unit ( 7 ) selects an area corresponding to the selected processing mode. An exposure control unit ( 8 ) then determines an exposure setting that has to be set on an image shooting unit ( 2 ) by using luminance information about the selected area.

Claims (40)

1. An image shooting control device for vehicle comprising:

a processor to execute a program; and

a memory to store the program which, when executed by the processor, performs processes of,

acquiring image information about a shot image of an inside of a vehicle, the inside including a driver's seat and a passenger seat and the image information being outputted by a camera mounted in the vehicle;

detecting luminance information about an area that is a target for monitoring, by using the image information acquired;

acquiring vehicle information;

by using the vehicle information acquired, selecting, as a processing mode of occupant monitoring, a driver state determination mode in which a state of an occupant sitting in the driver's seat is determined when the vehicle is traveling, and selecting, as the processing mode of occupant monitoring, a personal authentication mode in which an occupant sitting in the driver's seat or the passenger seat is authenticated when the vehicle is not traveling;

the driver state determination mode in which a state of an occupant sitting in the driver's seat is determined is selected, selecting an area where a face of the occupant exists from areas each of which is a target for monitoring, and, when the personal authentication mode in which an occupant sitting in the driver's seat or the passenger seat is authenticated is selected, selecting an area where a face of the occupant exists from the areas; and

determining an exposure setting to be set on the camera by using luminance information about the area selected, and outputting a control signal to instruct the camera to perform image shooting using the exposure setting determined,

wherein when multiple areas are selected, the exposure setting to be set on the camera is determined using pieces of luminance information about the respective multiple areas, and

when it is determined that there is not a deviation equal to or greater than a setting value between luminance information about a priority area that is an area having a highest priority among the multiple areas selected, and luminance information about an area other than the priority area, the exposure setting by which an average of the pieces of luminance information about the respective multiple areas selected is set to a target value is determined.

2. The image shooting control device for vehicle according to claim 1 , wherein when it is determined that there is a deviation equal to or greater than the setting value between the luminance information about the priority area and the luminance information about the area other than the priority area, the exposure setting by which the luminance information about the priority area is set to the target value is determined.

3. A driver monitoring device mounted in a vehicle, comprising:

the image shooting control device for vehicle according to claim 1 ; and

the camera,

wherein the processes further include performing a process of occupant monitoring by using the image information acquired.

4. An image shooting control method for vehicle comprising:

acquiring image information about a shot image of an inside of a vehicle, the inside including a driver's seat and a passenger seat and the image information being outputted by a camera mounted in the vehicle;

detecting luminance information about an area that is a target for monitoring, by using the image information acquired;

acquiring vehicle information;

by using the vehicle information acquired, selecting, as a processing mode of occupant monitoring, a driver state determination mode in which a state of an occupant sitting in the driver's seat is determined when the vehicle is traveling, and selecting, as the processing mode of occupant monitoring, a personal authentication mode in which an occupant sitting in the driver's seat or the passenger seat is authenticated when the vehicle is not traveling;

when the driver state determination mode in which a state of an occupant sitting in the driver's seat is determined is selected, selecting an area where a face of the occupant exists from areas each of which is a target for monitoring, and, when the personal authentication mode in which an occupant sitting in the driver's seat or the passenger seat is authenticated is selected, selecting an area where a face of the occupant exists from the areas; and

determining an exposure setting to be set on the camera by using luminance information about the area selected, and outputting a control signal to instruct the camera to perform image shooting using the exposure setting determined,

wherein when multiple areas are selected, the exposure setting to be set on the camera is determined using pieces of luminance information about the respective multiple areas, and

when it is determined that there is not a deviation equal to or greater than a setting value between luminance information about a priority area that is an area having a highest priority among the multiple areas selected, and luminance information about an area other than the priority area, the exposure setting by which an average of the pieces of luminance information about the respective multiple areas selected is set to a target value is determined.

5. An image shooting control method for vehicle comprising:

acquiring image information about a shot image of an inside of a vehicle, the inside including a driver's seat and a passenger seat and the image information being outputted by a camera mounted in the vehicle;

detecting luminance information about an area that is a target for monitoring, by using the image information acquired;

acquiring vehicle information;

by using the vehicle information acquired, selecting, as a processing mode of occupant monitoring, a driver state determination mode in which a state of an occupant sitting in the driver's seat is determined when the vehicle is traveling, and selecting, as the processing mode of occupant monitoring, a personal authentication mode in which an occupant sitting in the driver's seat or the passenger seat is authenticated when the vehicle is not traveling;

when the driver state determination mode in which a state of an occupant sitting in the driver's seat is determined is selected, selecting an area where a face of the occupant exists from areas each of which is a target for monitoring, and, when the personal authentication mode in which an occupant sitting in the driver's seat or the passenger seat is authenticated is selected, selecting an area where a face of the occupant exists from the areas; and

determining an exposure setting to be set on the camera by using luminance information about the area selected, and outputting a control signal to instruct the camera to perform image shooting using the exposure setting determined,

wherein when multiple areas are selected, the exposure setting to be set on the camera is determined using pieces of luminance information about the respective multiple areas, and

when it is determined that there is a deviation equal to or greater than a setting value between luminance information about a priority area that is an area having a highest priority among the multiple areas selected, and luminance information about an area other than the priority area, the exposure setting by which the luminance information about the priority area is set to a target value is determined.

6. A driver monitoring method comprising:

the image shooting control method according to claim 4 ; and

performing a process of occupant monitoring by using the image information acquired.

7. A driver monitoring method comprising:

the image shooting control method according to claim 5 ; and

performing a process of occupant monitoring by using the image information acquired.

Assignments (2)
COMPANY SPLIT Recorded Sep 4, 2024
From: MITSUBISHI ELECTRIC CORPORATION
To: MITSUBISHI ELECTRIC MOBILITY CORPORATION
Reel/Frame 068834/0585 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2019
From: KUNIHIRO, KAZUKI
To: MITSUBISHI ELECTRIC CORPORATION
Reel/Frame 049751/0353 →