IP Library Granted Patent US 11,539,894
Granted Patent B2
US 11,539,894 · App. 17/225,449 · Granted Dec 27, 2022

In-vehicle camera system and image processing apparatus

Inventor: Satoshi Nakayama (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
H04N5/2351B60Q9/00B60R1/00G06V20/584H04N5/235H04N5/23245H04N5/232945B60R2300/307B60R2300/8066H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,539,894
App. No.
17/225,449
Granted
Dec 27, 2022
Kind
B2
Abstract

Automatic exposure control of an in-vehicle camera is performed under dark driving environments such as at night. An in-vehicle camera system includes a vehicle camera mounted in a vehicle configured to capture surroundings of the vehicle, and control circuitry that controls an exposure level of an image captured by the vehicle camera, the control of the exposure level being based on brightness information of a detection area set within the image, the detection area being a portion of the captured image and configured to output the image having exposure control performed thereon to a display.

Claims (37)

1. An image processing apparatus, comprising:

control circuitry configured to:

receive an image of surroundings of a first vehicle, wherein the image processing apparatus is in the first vehicle;

determine an evaluation value based on a maximum value in a brightness horizontal profile and a local minimum value in the brightness horizontal profile;

detect lights of a second vehicle within a portion of the received image based on an interval between two adjacent local maximum values and an average of the two adjacent local maximum values, wherein the average is larger than the local minimum value; and

execute, based on the determined evaluation value, at least one of exposure time control or gain control, wherein

the local minimum value is between the two adjacent local maximum values in the brightness horizontal profile,

the brightness horizontal profile is based on the portion of the received image,

the second vehicle is different from the first vehicle, and

the lights of the second vehicle are displayed separately on a display screen.

2. The image processing apparatus according to claim 1 , wherein the control circuitry is further configured to:

detect the lights of the second vehicle within the portion of the received image; and

execute, based on a presence of the lights of the second vehicle within the portion of the received image, the at least one of the exposure time control or the gain control.

3. The image processing apparatus according to claim 1 , wherein the control circuitry is further configured to detect, based on the local minimum value between the two adjacent local maximum values in the brightness horizontal profile, the lights of the second vehicle within the portion of the received image.

4. The image processing apparatus according to claim 1 , wherein

the control circuitry is further configured to set the portion of the received image based on a relation of a position of a vanishing point with a reference point in the received image, and

the vanishing point is a point on a road at which ridge lines of the road cross.

5. The image processing apparatus according to claim 1 , wherein the control circuitry is further configured to execute the at least one of the exposure time control or the gain control based on a distance of peaks of two adjacent maximum values in the brightness horizontal profile.

6. The image processing apparatus according to claim 1 , wherein the control circuitry is further configured to execute the at least one of the exposure time control or the gain control based on environmental conditions associated with the surroundings of the first vehicle.

7. The image processing apparatus according to claim 1 , wherein the control circuitry is further configured to execute the at least one of the exposure time control or the gain control based on a type of a road on which the first vehicle is driven.

8. The image processing apparatus according to claim 7 , wherein the control circuitry is further configured to detect the type of the road based on position information of the first vehicle.

9. The image processing apparatus according to claim 1 , wherein the control circuitry is further configured to execute the at least one of the exposure time control or the gain control based on an average vehicle velocity on a road on which the first vehicle is driven.

10. The image processing apparatus according to claim 1 , wherein

in the exposure time control, the control circuitry is further configured to control an exposure time of an imaging sensor based on the determined evaluation value, and

in the gain control, the control circuitry is further configured to control a gain of the imaging sensor based on the determined evaluation value.

11. The image processing apparatus according to claim 1 , wherein

in the at least one of the exposure time control or the gain control, the control circuitry is further configured to notify a driver with an alarm.

12. The image processing apparatus according to claim 1 , wherein the control circuitry is further configured to execute, based on a shape of the brightness horizontal profile, the at least one of the exposure time control or the gain control.

13. An image processing method, comprising:

receiving an image of surroundings of a first vehicle;

determining an evaluation value based on a maximum value in a brightness horizontal profile and a local minimum value in the brightness horizontal profile;

detecting lights of a second vehicle within a portion of the received image based on an interval between two adjacent local maximum values and an average of the two adjacent local maximum values, wherein the average is larger than the local minimum value; and

executing, based on the determined evaluation value, at least one of exposure time control or gain control, wherein

the local minimum value is between the two adjacent local maximum values in the brightness horizontal profile,

the brightness horizontal profile is based on the portion of the received image,

the second vehicle is different from the first vehicle, and

the lights of the second vehicle are displayed separately on a display screen.

Priority Claims (2)
JP 2015-114084 · Jun 4, 2015 · national
JP 2015-250573 · Dec 22, 2015 · national
Continuity (3)
Continuation 16752935 · Jan 27, 2020
Continuation 15575572
Related Publication 20210227115A1 · Jul 22, 2021
Cited By (3)
US 12,597,345 US 12,621,573 US 12,659,603