IP Library Granted Patent US 11,089,229
Granted Patent B2
US 11,089,229 · App. 16/752,935 · Granted Aug 10, 2021

In-vehicle camera system and image processing apparatus

Inventor: Satoshi Nakayama (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
H04N5/2351B60Q9/00B60R1/00G06K9/00825H04N5/235H04N5/23245H04N5/232945B60R2300/307B60R2300/8066H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,089,229
App. No.
16/752,935
Granted
Aug 10, 2021
Kind
B2
Abstract

Automatic exposure control of an in-vehicle camera is performed under dark driving environments such as at night. An in-vehicle camera system includes a vehicle camera mounted in a vehicle configured to capture surroundings of the vehicle, and control circuitry that controls an exposure level of an image captured by the vehicle camera, the control of the exposure level being based on brightness information of a detection area set within the image, the detection area being a portion of the captured image and configured to output the image having exposure control performed thereon to a display.

Claims (60)

1. A vehicle camera system, comprising:

control circuitry; and

an imaging sensor mounted in a first vehicle, wherein

the imaging sensor is configured to:

capture an image of surroundings of the first vehicle; and

output the captured image to the control circuitry,

the control circuitry is configured to:

determine, for each horizontal line within a detection area of the captured image, a respective specific brightness value based on addition of brightness values of pixels in each horizontal line within the detection area of the captured image;

determine a corresponding weight for each horizontal line based on the respective specific brightness value;

generate a brightness horizontal profile based on addition of the corresponding weight for each horizontal line to the brightness values of the pixels in each horizontal line; and

execute an exposure control process based on the generated brightness horizontal profile,

the generated brightness horizontal profile is based on a portion of the captured image, and

the portion of the captured image corresponds to the detection area within the captured image to separately display lights of a second vehicle on a display screen.

2. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to:

set the detection area with reference to a vanishing point in the captured image; and

execute the exposure control process based on the brightness horizontal profile within the detection area.

3. The vehicle camera system according to claim 2 , wherein the control circuitry is further configured to correct the vanishing point based on a course of a vehicle driving path in an area behind the first vehicle.

4. The vehicle camera system according to claim 2 , wherein the control circuitry is further configured to set the detection area based on a relation of a position of the vanishing point with a reference point in the captured image.

5. The vehicle camera system according to claim 1 , wherein the exposure control process comprises at least one of exposure time control, gain control, or a combination thereof.

6. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to:

detect the lights of the second vehicle within the detection area; and

execute the exposure control process based on a presence of the lights of the second vehicle within the detection area, wherein the lights of the second vehicle are displayed separately on the display screen.

7. The vehicle camera system according to claim 6 , wherein the control circuitry is further configured to detect the lights of the second vehicle within the detection area based on a local minimum value between two adjacent maximum values in the brightness horizontal profile.

8. The vehicle camera system according to claim 7 , wherein

the control circuitry is further configured to determine the lights of the second vehicle within the detection area based on an interval between the two adjacent maximum values and an average of the two adjacent maximum values,

the interval is within a specific range, and

the average is a specific number of times larger than the local minimum value.

9. The vehicle camera system according to claim 7 , wherein

the control circuitry is further configured to determine the lights of the second vehicle within the detection area based on an interval between the two adjacent maximum values and an average of the adjacent maximum values,

the interval is within a specific range, and

the average is more than a specific value.

10. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to:

determine an evaluation value based on a division of an average of two adjacent maximum values by a local minimum value in the brightness horizontal profile, wherein the local minimum value is between the two adjacent maximum values; and

execute the exposure control process on the captured image based on the evaluation value.

11. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to execute the exposure control process on the captured image based on a distance of peaks of two adjacent maximum values in the brightness horizontal profile.

12. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to execute the exposure control process based on settings of the vehicle camera system.

13. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to execute the exposure control process based on environmental conditions associated with the surroundings of the first vehicle.

14. The vehicle camera system according to claim 1 , wherein the control circuitry is configured to execute the exposure control process based on a type of road on which the first vehicle is driven.

15. The vehicle camera system according to claim 1 , further comprising

an alarm, wherein

in the exposure control process, the control circuitry is further configured to notify a driver with the alarm.

16. A vehicle camera system, comprising:

control circuitry; and

an imaging sensor mounted in a first vehicle, wherein

the imaging sensor is configured to:

capture an image of surroundings of the first vehicle; and

output the captured image to the control circuitry,

the control circuitry is configured to:

determine an evaluation value based on division of a maximum value in a brightness horizontal profile by a local minimum value in the brightness horizontal profile; and

execute an exposure control process based on the determined evaluation value,

the local minimum value is between two adjacent local maximum values in the brightness horizontal profile,

the brightness horizontal profile is based on a portion of the captured image corresponding to a detection area within the captured image, and

lights of a second vehicle are displayed separately on a display screen.

17. The vehicle camera system according to claim 16 , wherein the exposure control process comprises at least one of exposure time control, gain control, or a combination thereof.

18. The vehicle camera system according to claim 17 , wherein

the control circuitry is further configured to increase at least one of an exposure time associated with the imaging sensor or a gain associated with the imaging sensor, and

the at least one of the exposure time or the gain is increased based on the evaluation value that is larger than a specific threshold.

19. The vehicle camera system according to claim 17 , wherein

the control circuitry is further configured to decrease at least one of an exposure time associated with the imaging sensor or a gain associated with the imaging sensor, and

the at least one of the exposure time or the gain is decreased based on the evaluation value that is smaller than a specific threshold.

Priority Claims (2)
JP 2015-114084 · Jun 4, 2015 · national
JP 2015-250573 · Dec 22, 2015 · national
Continuity (2)
Continuation 15575572
Related Publication 20200162652A1 · May 21, 2020
Cited By (1)
US 12,659,603