IP Library Granted Patent US 10,582,131
Granted Patent B2
US 10,582,131 · App. 15/575,572 · Granted Mar 3, 2020

In-vehicle camera system and image processing apparatus

Inventor: Satoshi Nakayama (Kanagawa, JP)
Assignee: SONY CORPORATION
H04N5/2351B60Q9/00B60R1/00G06K9/00825B60R2300/307B60R2300/8066H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,582,131
App. No.
15/575,572
Granted
Mar 3, 2020
Kind
B2
Abstract

Automatic exposure control of an in-vehicle camera is performed under dark driving environments such as at night. An in-vehicle camera system includes a vehicle camera mounted in a vehicle configured to capture surroundings of the vehicle, and control circuitry that controls an exposure level of an image captured by the vehicle camera, the control of the exposure level being based on brightness information of a detection area set within the image, the detection area being a portion of the captured image and configured to output the image having exposure control performed thereon to a display.

Claims (57)

1. A vehicle camera system, comprising:

a vehicle camera mounted in a first vehicle, wherein the vehicle camera is configured to capture an image of surroundings of the first vehicle; and

control circuitry configured to:

determine an evaluation value based on a division of an average of two adjacent maximum values in a brightness horizontal profile by a local minimum value in the brightness horizontal profile, wherein

the local minimum value is between the two adjacent maximum values,

the brightness horizontal profile is based on a detection area within the captured image, and

the detection area is a portion of the captured image;

control an exposure level of the captured image to separately display lights of a second vehicle on a display screen,

wherein the exposure level is controlled based on the evaluation value; and

output the captured image to the display screen based on the control of the exposure level.

2. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to control the exposure level based on settings of the vehicle camera system.

3. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to control the exposure level based on a type of road on which the vehicle is driven.

4. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to control the exposure level based on a type of road on which the first vehicle is driven.

5. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to:

set the detection area with reference to a vanishing point in the captured image; and

control the exposure level based on brightness information associated with the detection area.

6. The vehicle camera system according to claim 5 , wherein the control circuitry is further configured to correct the vanishing point based on a course of a vehicle driving path in an area behind the first vehicle.

7. The vehicle camera system according to claim 5 , wherein the control circuitry is further configured to set the detection area based on a relative position of the vanishing point to a reference point in the captured image.

8. The vehicle camera system according to claim 5 , wherein

the brightness information includes a result of the brightness horizontal profile, and

the control circuitry is further configured to control the exposure level of the captured image based on the result of the brightness horizontal profile.

9. The vehicle camera system according to claim 8 , wherein the control circuitry is further configured to:

add brightness values of pixels in each horizontal line within the detection area;

determine a corresponding weight for the each horizontal line based on the added brightness values; and

add the corresponding weight for the each horizontal line and the brightness values of pixels in order to produce the brightness horizontal profile.

10. The vehicle camera system according to claim 8 , wherein the control circuitry is further configured to:

detect the lights of the second vehicle within the detection area; and

control the exposure level of the captured image based on a presence of the lights of the second vehicle within the detection area.

11. The vehicle camera system according to claim 10 , wherein the control circuitry is further configured to detect the lights of the second vehicle within the detection area based on the brightness information of the local minimum value between the two adjacent maximum values.

12. The vehicle camera system according to claim 11 , wherein,

based on an interval between the two adjacent maximum values and the average of the two adjacent maximum values,

the control circuitry is further configured to determine the lights of the second vehicle within the detection area,

the interval is within a specific range, and

the average is a specific number of times larger than the local minimum value.

13. The vehicle camera system according to claim 12 , wherein, based on an interval between the two adjacent maximum values and the average of the two adjacent maximum values, the control circuitry is further configured to determine the lights of the second vehicle within the detection area, the interval is within a specific range, and the average is a specific number of times larger than the local minimum value.

14. The vehicle camera system according to claim 1 , further comprising an alarm, wherein

the control circuitry is further configured to notify a driver with the alarm at a time of the control of the exposure level.

15. The vehicle camera system according to claim 1 , wherein the control circuitry is further configured to control the exposure level of the captured image based on a distance of peaks of the two adjacent maximum values in the brightness horizontal profile.

16. An image processing apparatus, comprising:

control circuitry configured to:

receive an image captured by a vehicle camera of a first vehicle;

determine an evaluation value based on a division of an average of two adjacent maximum values in a brightness horizontal profile by a local minimum value in the brightness horizontal profile, wherein

the local minimum value is between the two adjacent maximum values,

the brightness horizontal profile is based on a detection area within the image, and

the detection area is a portion of the image;

control an exposure level of the image to separately display lights of a second vehicle on a display screen, wherein

the exposure level is controlled based on the evaluation value; and

output the image to the display screen based on the control of the exposure level.

17. An image processing method, comprising:

receiving an image captured by a vehicle camera of a first vehicle;

determining an evaluation value based on a division of an average of two adjacent maximum values in a brightness horizontal profile by a local minimum value in the brightness horizontal profile, wherein

the local minimum value is between the two adjacent maximum values,

the brightness horizontal profile is based on a detection area within the image, and

the detection area is a portion of the image;

controlling an exposure level of the image to separately display lights of a second vehicle on a display screen, wherein

the exposure level is controlled based the evaluation value; and

outputting the image to the display screen based on the control of the exposure level.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2017
From: NAKAYAMA, SATOSHI
To: SONY CORPORATION
Reel/Frame 044178/0687 →
Priority Claims (2)
JP 2015-114084 · Jun 4, 2015 · national
JP 2015-250573 · Dec 22, 2015 · national
Continuity (1)
Related Publication 20180139368A1 · May 17, 2018
Cited By (2)
US 12,581,200 US 12,659,603