IP Library › Granted Patent US 10,668,925
Granted Patent B2
US 10,668,925 · App. 15/695,885 · Granted Jun 2, 2020

Driver intention-based lane assistant system for autonomous driving vehicles

Inventors: Fan Zhu (Sunnyvale, CA); Qi Kong (Sunnyvale, CA)
Assignee: BAIDU USA LLC
B60W30/18163B60W30/12G08G1/166G08G1/167B60W2520/06B60W2540/20B60W2550/10B60W2550/14B60W2550/302B60W2720/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,668,925
App. No.
15/695,885
Granted
Jun 2, 2020
Kind
B2
Abstract

In one embodiment, a lane assistant system is configured to provide lane assistance to a driver of an autonomous driving vehicle (ADV) based on the driver's intention determined at the point in time by capturing and analyzing user actions and driving environment surrounding the ADV. By analyzing the user actions and the driving environment surrounding the vehicle, the driver's intention can be determined. The driver's intention can be utilized to interpret whether the driver indeed intends to change lane. Based on the driver's intention, the lane assistance can be provided, either allowing the vehicle change or exit the current lane, or automatically providing warning or correction of the moving direction of the vehicle.

Claims (82)

1. A computer-implemented method for operating an autonomous driving vehicle, the method comprising:

obtaining route and map data related to a route along which an autonomous driving vehicle (ADV) is to travel;

detecting, while traveling along the route, that the ADV is drifting towards an edge of a current lane of a road on which the ADV is moving by comparing a moving direction of the ADV against lane markings of the current lane;

in response to detecting that the ADV is drifting towards the edge of the current lane of the road,

determining one or more user actions performed by a driver of the ADV prior to detecting that the ADV is drifting,

determining, using one or more sensors mounted on the ADV, a driving environment surrounding the ADV, the driving environment including information describing lane configuration of the road,

examining the route and map data associated with the road on which the ADV is moving to determine whether there is another lane adjacent to the current lane on the edge to which the ADV is drifting, and

determining a user intention of possible lane changing based on the user actions, the determined driving environment, and the determination of whether there is another lane adjacent to the current lane on the edge, wherein the user intention indicates that the driver does not intend to change lanes if there is no adjacent lane on the edge to which the ADV is drifting;

allowing the ADV to continue drifting towards the edge of the road if the user intention indicates that the driver intends to change lane; and

automatically modifying the moving direction of the ADV to cause the ADV to move away from the edge and to remain within the current lane if the user intention indicates that the driver does not intend to change lane.

2. The method of claim 1 , wherein determining a user intention of possible lane changing comprises:

determining whether a turn signal conforming to a drifting direction has been turned on; and

indicating that the driver intends to change lane if the turn signal conforming to a drifting direction has been turned on.

3. The method of claim 1 , wherein determining a user intention of possible lane changing comprises:

examining routing information associated with the current road to determine whether there is a continuing path exiting from the current lane towards a side to which the ADV is drifting; and

indicating that the driver intends to change lane if there is a continuing path exiting from the current lane towards a side to which the ADV is drifting.

4. The method of claim 1 , wherein determining a user intention of possible lane changing comprises:

determining whether there is another vehicle moving at a blind spot of the ADV in an adjacent lane to which the ADV is drifting; and

indicating that the driver does not intend to change lane if there is another vehicle moving at a blind spot of the ADV in the adjacent lane to which the ADV is drifting.

5. The method of claim 1 , wherein determining a user intention of possible lane changing comprises:

determining whether there is an obstacle in front of the ADV based on perception data perceiving the driving environment; and

indicating that the driver intends to change lane if there is an obstacle in front of the ADV.

6. The method of claim 5 , wherein the obstacle is moving slower than the ADV, and wherein a different between a speed of the obstacle and a speed of the ADV is above a predetermined threshold.

7. The method of claim 1 , wherein determining a user intention of possible lane changing comprises:

determining whether there is a rough road surface of the current lane ahead of the ADV based on sensor data obtained from one or more sensors; and

indicating that the driver intends to change lane if there is a rough road surface ahead of the ADV.

8. The method of claim 1 further comprising providing a lane departure warning alert when the user intention indicates that the driver does not intend to change lanes,

wherein automatic modification of the moving direction of the ADV is in response to not receiving correction actions from the driver within a period of time since the lane departure warning alert was provided.

9. A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations, the operations comprising:

obtaining route and map data related to a route along which an autonomous driving vehicle (ADV) is to travel;

detecting, while traveling along the route, that the ADV is drifting towards an edge of a current lane of a road on which the ADV is moving by comparing a moving direction of the ADV against lane markings of the current lane;

in response to detecting that the ADV is drifting towards the edge of the current lane of the road,

determining one or more user actions performed by a driver of the ADV prior to detecting that the ADV is drifting,

determining, using one or more sensors mounted on the ADV, a driving environment surrounding the ADV, the driving environment including information describing lane configuration of the road,

examining the route and map data associated with the road on which the ADV is moving to determine whether there is another lane adjacent to the current lane on the edge to which the ADV is drifting, and

determining a user intention of possible lane changing based on the user actions, the determined driving environment, and the determination of whether there is another lane adjacent to the current lane on the edge, wherein the user intention indicates that the driver does not indent to change lanes if there is no adjacent lane on the edge to which the ADV is drifting;

allowing the ADV to continue drifting towards the edge of the road if the user intention indicates that the driver intends to change lane; and

automatically modifying the moving direction of the ADV to cause the ADV to move away from the edge and to remain within the current lane if the user intention indicates that the driver does not intend to change lane.

10. The machine-readable medium of claim 9 , wherein determining a user intention of possible lane changing comprises:

determining whether a turn signal conforming to a drifting direction has been turned on; and

indicating that the driver intends to change lane if the turn signal conforming to a drifting direction has been turned on.

11. The machine-readable medium of claim 9 , wherein determining a user intention of possible lane changing comprises:

examining routing information associated with the current road to determine whether there is a continuing path exiting from the current lane towards a side to which the ADV is drifting; and

indicating that the driver intends to change lane if there is a continuing path exiting from the current lane towards a side to which the ADV is drifting.

12. The machine-readable medium of claim 9 , wherein determining a user intention of possible lane changing comprises:

determining whether there is another vehicle moving at a blind spot of the ADV in an adjacent lane to which the ADV is drifting; and

indicating that the driver does not intend to change lane if there is another vehicle moving at a blind spot of the ADV in the adjacent lane to which the ADV is drifting.

13. The machine-readable medium of claim 9 , wherein determining a user intention of possible lane changing comprises:

determining whether there is an obstacle in front of the ADV based on perception data perceiving the driving environment; and

indicating that the driver intends to change lane if there is an obstacle in front of the ADV.

14. The machine-readable medium of claim 13 , wherein the obstacle is moving slower than the ADV, and wherein a different between a speed of the obstacle and a speed of the ADV is above a predetermined threshold.

15. The machine-readable medium of claim 9 , wherein determining a user intention of possible lane changing comprises:

determining whether there is a rough road surface of the current lane ahead of the ADV based on sensor data obtained from one or more sensors; and

indicating that the driver intends to change lane if there is a rough road surface ahead of the ADV.

16. A data processing system, comprising:

a processor; and

a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations, the operations including

obtaining route and map data related to a route along which an autonomous driving vehicle (ADV) is to travel;

detecting, while traveling along the route, that the ADV is drifting towards an edge of a current lane of a road on which the ADV is moving by comparing a moving direction of the ADV against lane markings of the current lane;

in response to detecting that the ADV is drifting towards the edge of the current lane of the road,

determining one or more user actions performed by a driver of the ADV prior to detecting that the ADV is drifting,

determining, using one or more sensors mounted on the ADV, a driving environment surrounding the ADV, the driving environment including information describing lane configuration of the road,

examining the route and map data associated with the road on which the ADV is moving to determine whether there is another lane adjacent to the current lane on the edge to which the ADV is drifting, and

determining a user intention of possible lane changing based on the user actions, the determined driving environment, and the determination of whether there is another lane adjacent to the current lane on the edge, wherein the user intention indicates that the driver does not intend to change lanes if there is no adjacent lane on the edge to which the ADV is drifting;

allowing the ADV to continue drifting towards the edge of the road if the user intention indicates that the driver intends to change lane; and

automatically modifying the moving direction of the ADV to cause the ADV to move away from the edge and to remain within the current lane if the user intention indicates that the driver does not intend to change lane.

17. The system of claim 16 , wherein determining a user intention of possible lane changing comprises:

determining whether a turn signal conforming to a drifting direction has been turned on; and

indicating that the driver intends to change lane if the turn signal conforming to a drifting direction has been turned on.

18. The system of claim 16 , wherein determining a user intention of possible lane changing comprises:

examining routing information associated with the current road to determine whether there is a continuing path exiting from the current lane towards a side to which the ADV is drifting; and

indicating that the driver intends to change lane if there is a continuing path exiting from the current lane towards a side to which the ADV is drifting.

19. The system of claim 16 , wherein determining a user intention of possible lane changing comprises:

determining whether there is another vehicle moving at a blind spot of the ADV in an adjacent lane to which the ADV is drifting; and

indicating that the driver does not intend to change lane if there is another vehicle moving at a blind spot of the ADV in the adjacent lane to which the ADV is drifting.

20. The system of claim 16 , wherein determining a user intention of possible lane changing comprises:

determining whether there is an obstacle in front of the ADV based on perception data perceiving the driving environment; and

indicating that the driver intends to change lane if there is an obstacle in front of the ADV.

21. The system of claim 20 , wherein the obstacle is moving slower than the ADV, and wherein a different between a speed of the obstacle and a speed of the ADV is above a predetermined threshold.

22. The system of claim 16 , wherein determining a user intention of possible lane changing comprises:

determining whether there is a rough road surface of the current lane ahead of the ADV based on sensor data obtained from one or more sensors; and

indicating that the driver intends to change lane if there is a rough road surface ahead of the ADV.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 5, 2017
From: ZHU, FAN; KONG, QI
To: BAIDU USA LLC
Reel/Frame 043761/0328 →
Continuity (1)
Related Publication 20190071091A1 · Mar 7, 2019
Cited By (3)
US 12,384,410 US 12,472,973 US 12,539,852