Apparatus and method for calibrating driver monitoring camera

1. An apparatus for operating calibrating a driver monitoring camera, comprising:

a camera configured to capture an image, wherein the captured image comprises a face of a driver and a background showing a feature of a vehicle;

a control unit configured to receive the captured image from the camera, and detect the face to determine a face position; and

a display configured to display determination of the face position by the control unit,

wherein the control unit is further configured to:

process the captured image to obtain a line-of-sight of the driver in a vehicle coordinate system using intrinsic parameters and at least an extrinsic parameter of the camera,

analyze the line-of-sight, and

provide a warning to the driver based on analysis of the line-of-sight,

wherein the control unit is further configured to:

when the camera moves, detect the feature shown in the background of the captured image,

calibrate the extrinsic parameter of the camera based on the detected feature in the background, and

calculate the line-of-sight based on the calibrated extrinsic parameter for correcting the line-of-sight based on the calibrated extrinsic parameter in response to movement of the camera such that the warning to the driver can be based on the line-of-sight.

2. The apparatus of claim 1 , further comprising a reflecting body installed on a front surface of a lens of the camera.

3. The apparatus of claim 1 , wherein the display configured to display a vertical position depending on the face position.

4. The apparatus of claim 1 , wherein the extrinsic parameter comprises information on position and angle of the camera in the vehicle coordinate.

5. The apparatus of claim 1 , wherein the feature comprises one or more of a window frame, a roof, a B-pillar, a handle and a fixed structure of the vehicle.

6. The apparatus of claim 1 , further comprising a vehicle state input unit configured to input a vehicle state,

wherein the control unit detects the line-of-sight of the driver from the captured image when a direction indication state or a vehicle speed state is inputted from the vehicle state input unit, and calibrates the line-of-sight according to the vehicle state.

7. The apparatus of claim 6 , wherein the control unit calibrates the line-of-sight in an indication direction when the vehicle state is the direction indication state.

8. The apparatus of claim 6 , wherein the control unit calibrates the line-of-sight in a forward-looking direction when the vehicle state is the vehicle speed state equal to or more than a preset vehicle speed.

9. A method of operating a driver monitoring camera, comprising:

receiving a captured image from a camera, wherein the captured image comprises a driver's face and a background showing a feature of a vehicle;

processing the captured image to obtain a line-of-sight of a driver in a vehicle coordinate system using intrinsic parameters and at least an extrinsic parameter of the camera;

analyzing the line-of-sight;

providing a warning to the driver based on analysis of the line-of-sight;

detecting the face from the captured image;

determining a position of the detected face; and

displaying determination on a display according to the position of the detected face,

wherein the method further comprises:

when the camera moves, detecting the feature in the background of the captured image,

calibrating the extrinsic parameter of the camera based on the detected feature in the background, and

calculating the line-of-sight based on the calibrated extrinsic parameter for correcting the line-of-sight based on the calibrated extrinsic parameter in response to movement of the camera such that the warning to the driver can be based on the line-of-sight.

10. The method of claim 9 , wherein in the displaying of the determination result, a vertical position depending on the position of the face is displayed.

11. A method of operating a driver monitoring camera, comprising:

receiving a captured image from a camera, wherein the captured image comprises a driver's face and a background showing a feature of a vehicle;

processing the captured image to obtain a line-of-sight of a driver in a vehicle coordinate system using intrinsic parameters and at least an extrinsic parameter of the camera;

analyzing the line-of-sight;

providing a warning to the driver based on analysis of the line-of-sight;

when the camera moves, detecting the feature shown in the background from the captured image;

calibrating the extrinsic parameter of the camera based on the feature in the background; and

calculating the line-of-sight based on the calibrated extrinsic parameter for correcting the line-of-sight based on the calibrated extrinsic parameter in response to movement of the camera such that the warning to the driver can be based on the line-of-sight.

12. The method of claim 11 , wherein the extrinsic parameter of the camera indicates the relationship between a vehicle coordinate system and a camera coordinate system.

13. The method of claim 11 , wherein the features of the background comprise one or more of a window frame, a roof, a B-pillar, a handle and a fixed structure of the vehicle.

14. A method of operating a driver monitoring camera, comprising:

receiving a captured image from a camera, wherein the captured image comprises a driver's face and a background showing a feature of a vehicle;

processing the captured image to obtain a line-of-sight of a driver in a vehicle coordinate system using intrinsic parameters and at least an extrinsic parameter of the camera;

analyzing the line-of-sight;

providing a warning to the driver based on analysis of the line-of-sight;

when the camera moves, detecting the feature in the background of the captured image,

calibrating the extrinsic parameter of the camera based on the detected feature in the background, and

calculating the line-of-sight based on the calibrated extrinsic parameter for correcting the line-of-sight based on the calibrated extrinsic parameter in response to movement of the camera such that the warning to the driver can be based on the line-of-sight

wherein the method further comprises:

detecting a line-of-sight of a driver from the captured image for determining the line-of-sight in a predetermined direction based on the vehicle state.

15. The method of claim 14 , wherein when the vehicle state is a direction indication state, the predetermined direction is an indication direction.

16. The method of claim 14 , wherein, when the vehicle state is a vehicle speed state equal to or more than a preset vehicle speed, the predetermined direction is a forward-looking direction.