Autonomous driving control method and device

1. A method for controlling an autonomous driving in a vehicle, the method comprising:

detecting a situation in which the autonomous driving is impossible while the vehicle operates in an autonomous driving mode;

outputting a control-right handover request warning alarm and then activating a minimal risk maneuver driving mode;

determining a human driver gaze validity based on the detected situation in which the autonomous driving is impossible;

determining a human driver intervention validity when a human driver gaze is determined to be valid; and

determining a control-right handover of the vehicle based on the human driver intervention validity,

wherein the determining of the human driver gaze validity includes:

performing a human driver face recognition using a camera disposed on the vehicle;

identifying a human driver gaze point based on the human driver facial recognition;

calculating a human driver gaze quality value (Q) based on the human driver gaze point and the detected situation in which the autonomous driving is impossible; and

evaluating the human driver gaze validity based on the Q,

wherein Q is a maximum value or a minimum value or a value higher than the minimum value and below the maximum value.

2. The method of claim 1 , wherein the method comprises:

when the Q is the minimum value, maintaining the minimal risk maneuver driving mode to perform lane-keeping and deceleration driving, regardless of whether or not a human driver intervention is detected.

3. The method of claim 2 , wherein the method comprises:

when the Q is the maximum value, and the human driver is holding a steering wheel, deactivating the outputting of the warning alarm; and

transferring a full control-right from an autonomous driving system to a human driver to activate a full manual driving mode.

4. The method of claim 3 , wherein the method comprises: when the Q is the maximum value, and the human driver is performing front-rear direction movement control while the human driver is not holding the steering wheel, transferring front-rear direction movement control-right from the autonomous driving system to the human driver while left-right direction movement control-right belongs to the autonomous driving system.

5. The method of claim 3 , wherein the method comprises: when the Q is higher than the minimum value and lower than the maximum value, and when a steering wheel torque exceeds a threshold, activating the full manual driving mode; and

dynamically setting a threshold to have an inversely proportional relationship to the Q.

6. The method of claim 3 , wherein when the Q is higher than the minimum value and lower than the maximum value, and when a deceleration resulting from the human driver is greater than a deceleration corresponding to the minimal risk maneuver driving mode while the human driver is not holding the steering wheel, transferring front-rear direction movement control-right from the autonomous driving system to the human driver while left-right direction movement control-right belongs to the autonomous driving system.

7. The method of claim 6 , wherein when the Q is higher than the minimum value and lower than the maximum value, and when the deceleration resulting from the human driver is less than or equal to the deceleration corresponding to the minimal risk maneuver driving mode while the human driver is not holding the steering wheel, maintaining the minimal risk maneuver driving mode to perform lane-keeping and deceleration driving.

8. The method of claim 1 , wherein the method comprises:

when the human driver is in a front gaze state at a section termination event, or when a human driver gaze direction is valid for a curved road section in a curved road section drive event, determining that the Q is the maximum value; and

when the human driver is not in a front gaze state at the section termination event, or when a human driver gaze direction is invalid for the curved road section in the curved road section drive event, determining that the Q is the minimum value,

wherein the detected situation is an expected transition demand (TD) event including the section termination event and the curved road section drive event.

9. The method of claim 1 , wherein the method comprises:

when the detected situation is an unexpected TD event, determining the Q based on a distance between a point that has caused the unexpected TD situation and the human driver gaze point.

10. A device for controlling an autonomous driving, the device comprising:

a recognizer configured to detect a situation in which the autonomous driving is impossible in an autonomous driving mode;

a controller configured to:

output a control-right handover request warning alarm; and

activate a minimal risk maneuver driving mode when the situation is detected;

a human driver gaze validity determiner configured to determine a human driver gaze validity based on the detected situation;

a human driver intervention validity determiner configured to determine a human driver intervention validity when the human driver gaze is determined to be valid;

a control-right handover determiner configured to determine control-right handover based on the human driver intervention validity and

a human driver face recognition system configured to perform a human driver face recognition in association with an indoor camera,

wherein the human driver gaze validity determiner is configured to:

identify a human driver gaze point based on the human driver facial recognition;

calculate a human driver gaze quality value (Q) based on the human driver gaze point and the detected situation; and

evaluate the human driver gaze validity based on the Q,

wherein Q is a maximum value or a minimum value or a value higher than the minimum value and below the maximum value.

11. The device of claim 10 , wherein when the Q is the minimum value, the control-right handover determiner is configured to maintain the minimal risk maneuver driving mode to perform lane-keeping and deceleration driving, regardless of whether or not a human driver intervention is detected.

12. The device of claim 10 , wherein when the Q is the minimum value, the control-right handover determiner is configured to maintain the minimal risk maneuver driving mode to perform lane-keeping and deceleration driving, regardless of whether or not the human driver intervention is detected.

13. The device of claim 10 , wherein when the Q is the maximum value, and when the human driver is performing front-rear direction movement control while the human driver is not holding a steering wheel, the control-right handover determiner is configured to transfer front-rear direction movement control-right from an autonomous driving system to the human driver while left-right direction movement control-right belongs to the autonomous driving system.

14. The device of claim 10 , wherein when the Q is higher than the minimum value and lower than the maximum value and when a steering wheel torque exceeds a threshold, the control-right handover determiner is configured to:

activate a full manual driving mode; and

set a threshold dynamically to have an inversely proportional relationship to the Q.

15. The device of claim 10 , wherein when the Q is higher than the minimum value and lower than the maximum value and when a deceleration resulting from the human driver is greater than a deceleration corresponding to the minimal risk maneuver driving mode while the human driver is not holding a steering wheel, the control-right handover determiner is configured to transfer front-rear direction movement control-right from an autonomous driving system to the human driver while left-right direction movement control-right belongs to the autonomous driving system.

16. The device of claim 10 , wherein when the Q is higher than the minimum value and lower than the maximum value and when the deceleration resulting from the human driver is less than or equal to the deceleration corresponding to the minimal risk maneuver driving mode while the human driver is not holding a steering wheel, the control-right handover determiner is configured to maintain the minimal risk maneuver driving mode to perform lane-keeping and deceleration driving.

17. The device of claim 10 , wherein the control-right handover determiner is configured to:

determine that the Q is the maximum value when the human driver is in a front gaze state at a section termination event, or when a human driver gaze direction is valid for a curved road section in a curved road section drive event; and

determine that the Q is the minimum value when the human driver is not in a front gaze state at the section termination event, or when a human driver gaze direction is invalid for the curved road section in the curved road section drive event,

wherein the detected situation is an expected transition demand (TD) event including the section termination event and the curved road section drive event.

18. The device of claim 10 , wherein the control-right handover determiner is configured to:

determine the Q based on a distance between a point that has caused the unexpected TD situation and the human driver gaze point when the detected situation is the unexpected TD event.