IP Library › Granted Patent US 11,093,761
Granted Patent B2
US 11,093,761 · App. 16/293,837 · Granted Aug 17, 2021

Lane position sensing and tracking in a vehicle

Inventors: Hossein Sadjadi (Markham, CA); Syed Ali Raza (Oshawa, CA); Matthew G. Adams (Oshawa, CA)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G06K9/00798G06T7/70G08G1/167G06T2207/30244G06T2207/30256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,093,761
App. No.
16/293,837
Granted
Aug 17, 2021
Kind
B2
Abstract

A system and method to perform lane position sensing and tracking in a vehicle include using a first camera with a first field of view of a first side of the vehicle and a second camera with a second field of view on a second side of the vehicle to capture images. The method includes determining if a first lane line on a first side of the vehicle and a second lane line on the second side of the vehicle are both visible, and based on the first lane line and the second lane line being visible, determining, a position of the vehicle in a lane between the first lane line and the second lane line and determining a trajectory of the first lane line and the second lane line and of the vehicle.

Claims (27)

1. A method of performing lane position sensing and tracking in a vehicle, the method comprising:

using a first camera with a first field of view of a first side of the vehicle and a second camera with a second field of view on a second side of the vehicle to capture images;

determining, using a processor, if a first lane line on a first side of the vehicle and a second lane line on the second side of the vehicle are both visible;

based on determining that the first lane line and the second lane line are both visible, determining, using the processor, a position of the vehicle in a lane between the first lane line and the second lane line and determining a trajectory of the first lane line and the second lane line and of the vehicle; and

based on determining that neither the first lane line nor the second lane line is visible, determining the trajectory of the first lane line and the second lane line and of the vehicle using additional information that does not include the first lane line and the second lane line, and determining the position of the vehicle relative to the lane using the trajectory of the first lane line and the second lane line and of the vehicle.

2. The method according to claim 1 , further comprising determining a distance between the first lane line and the second lane line as a width of the lane.

3. The method according to claim 2 , further comprising, based on determining that the first lane line and the second lane line are not both visible, determining whether only one of the first lane line and the second lane line is a visible lane line.

4. The method according to claim 3 , further comprising using the visible lane line and the width of the lane to determine if the vehicle is in the lane.

5. The method according to claim 1 , wherein, based on neither the first lane line nor the second lane line being visible, determining that an outage has occurred and tracking a duration of the outage.

6. The method according to claim 5 , further comprising, based on the duration of the outage being less than a threshold duration, determining the position of the vehicle relative to the lane using the trajectory of the first lane line and the second lane line and of the vehicle, and, based on the duration of the outage being greater than a threshold duration, declaring that the position of the vehicle relative to the lane cannot be determined.

7. The method according to claim 1 , wherein the additional information includes a high definition map, information about a location of the vehicle, wheel speed sensors, an inertial measurement unit (IMU) of the vehicle, steering angle, or velocity of the vehicle.

8. The method according to claim 7 , wherein, based on neither the first lane line nor the second lane line being visible, updating the trajectory of the first lane line and the second lane line and of the vehicle using the additional information.

9. The method according to claim 1 , further comprising reporting the position of the vehicle relative to the lane for operation of a system of the vehicle.

10. The method according to claim 9 , wherein the reporting the position of the vehicle relative to the lane is to a lane departure alerting system, or the reporting the position of the vehicle relative to the lane is to a lane positioning system.

11. A system to perform lane position sensing and tracking in a vehicle, the system comprising:

a first camera with a first field of view of a first side of the vehicle;

a second camera with a second field of view on a second side of the vehicle, wherein the first camera and the second camera are configured to capture images; and

a processor configured to determine if a first lane line on a first side of the vehicle and a second lane line on the second side of the vehicle are both visible, based on determining that the first lane line and the second lane line are both visible, to determine a position of the vehicle in a lane between the first lane line and the second lane line and to determine a trajectory of the first lane line and the second lane line and of the vehicle, based on determining that neither the first lane nor the second lane is visible, to determine the trajectory of the first lane line and the second lane line and of the vehicle using additional information that does not include the first lane line and the second lane line, and to determine the position of the vehicle relative to the lane using the trajectory of the first lane line and the second lane line and of the vehicle.

12. The system according to claim 11 , wherein the processor is further configured to determine a distance between the first lane line and the second lane line as a width of the lane.

13. The system according to claim 12 , wherein, based on determining that the first lane line and the second lane line are not both visible, the processor is further configured to determine whether only one of the first lane line and the second lane line is a visible lane line.

14. The system according to claim 13 , wherein the processor is further configured to use the visible lane line and the width of the lane to determine if the vehicle is in the lane.

15. The system according to claim 11 , wherein, based on neither the first lane line nor the second lane line being visible, the processor is further configured to determine that an outage has occurred and to track a duration of the outage.

16. The system according to claim 15 , wherein, based on the duration of the outage being less than a threshold duration, the processor is further configured to determine the position of the vehicle relative to the lane using the trajectory of the first lane line and the second lane line and of the vehicle, and, based on the duration of the outage being greater than a threshold duration, the processor is further configured to declare that the position of the vehicle relative to the lane cannot be determined.

17. The system according to claim 11 , wherein the additional information includes a high definition map, information about a location of the vehicle, wheel speed sensors, an inertial measurement unit (IMU) of the vehicle, steering angle, or velocity of the vehicle.

18. The system according to claim 17 , wherein, based on neither the first lane line nor the second lane line being visible, the processor is configured to update the trajectory of the first lane line and the second lane line and of the vehicle using the additional information.

19. The system according to claim 11 , wherein the processor is further configured to report the position of the vehicle relative to the lane for operation of a system of the vehicle.

20. The system according to claim 19 , wherein the system is a lane departure alerting system or a lane positioning system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2019
From: SADJADI, HOSSEIN; RAZA, SYED ALI; ADAMS, MATTHEW G.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 048514/0485 →
Continuity (1)
Related Publication 20200285863A1 · Sep 10, 2020