IP Library Granted Patent US 11,874,130
Granted Patent B2
US 11,874,130 · App. 18/158,974 · Granted Jan 16, 2024

Verification module system and method for motion-based lane detection with multiple sensors

Inventors: Siyuan Liu (San Diego, CA); Mingdong Wang (San Diego, CA); Xiaodi Hou (San Diego, CA)
Assignee: TUSIMPLE, INC.
G01C21/3658G06V20/588G01S17/86G01S17/89G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,874,130
App. No.
18/158,974
Granted
Jan 16, 2024
Kind
B2
Abstract

A method of lane detection for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs include instructions, which when executed by a computing device, cause the computing device to perform the following steps comprising: generating a ground truth associated with lane markings expressed in god's view; receiving features from at least one of a hit-map image and a fitted lane marking, wherein the hit-map image includes a classification of pixels that hit a lane marking, and the fitted lane marking includes pixels optimized based on the hit-map image; and training a confidence module based on the features and the ground truth, the confidence module configured to determine on-line whether a fitted lane marking is reasonable, using parameters that express a lane marking in an arc.

Claims (49)

1. A method for lane detection, comprising:

generating, based on a lane detection algorithm, a hit-map image in response to a current view, wherein the hit-map image includes a classification of pixels that hit a lane marking;

receiving a fitted lane marking associated with the current view;

extending, in a post processing module, the fitted lane marking;

generating a lane template, using a set of parameters that express the fitted lane marking in an arc, that includes features of the lane marking associated with the current view and features of an extended lane marking; and

feeding the lane template associated with the current view for detection of a next view.

2. The method according to claim 1 , wherein the extending includes: extending a fitted lane marking based on a high-definition map.

3. The method according to claim 1 , further comprising:

generating, based on a lane detection algorithm, a hit-map image in response to the current view, the hit-map image including a classification of pixels that hit a lane marking.

4. The method according to claim 3 further comprising:

generating a fitted lane marking based on the hit-map image and a lane template associated with an immediately previous view.

5. The method according to claim 4 , wherein generating a fitted lane marking includes:

optimizing, based on priors or constraints, the lane template associated with the immediately previous view to obtain a local optimal.

6. The method according to claim 4 further comprising:

determining that a confidence level of the fitted lane marking is reasonable, using the set of parameters; and

outputting the fitted lane marking to a post-processing module.

7. The method according to claim 4 further comprising: determining that a confidence level of the fitted lane marking is unreasonable, using the set of parameters; and rejecting the fitted lane marking.

8. The method according to claim 4 further comprising: removing an incorrect line from the fitted lane marking.

9. The method according to claim 6 , after extending the fitted lane marking, further comprising:

fitting, in the post-processing module, the lane marking in an arc by using the set of parameters.

10. A system for lane detection, the system comprising:

a memory;

one or more processing units; and

one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs comprising instructions to cause at least:

generating, based on a lane detection algorithm, a hit-map image in response to a current view, the hit-map image including a classification of pixels that hit a lane marking;

receiving a fitted lane marking associated with a current view;

extending, in a post processing module, the fitted lane marking;

generating a lane template, using a set of parameters that express the lane marking in an arc, the lane template including features of the lane marking associated with the current view and features of an extended lane marking; and

feeding the lane template associated with the current view for detection of a next view.

11. The system according to claim 10 , wherein the extending includes: extending a fitted lane marking based on a high-definition map.

12. The system according to claim 10 , wherein the one or more programs comprises instructions to further cause at least:

generating a fitted lane marking based on the hit-map image and a lane template associated with an immediately previous view.

13. The system according to claim 12 , wherein generating a fitted lane marking includes:

optimizing, based on priors or constraints, the lane template associated with the immediately previous view to obtain a local optimal.

14. The system according to claim 12 further comprising:

determining that a confidence level of the fitted lane marking is reasonable, using the set of parameters; and

outputting the fitted lane marking to a post-processing module.

15. The system according to claim 14 , wherein the one or more programs comprises instructions to further cause at least: determining that a confidence level of the fitted lane marking is unreasonable, using the set of parameters; and rejecting the fitted lane marking.

16. The system according to claim 14 , wherein the one or more programs comprises instructions to further cause removing an incorrect line from the fitted lane marking.

17. The system according to claim 14 , wherein the one or more programs comprises instructions to further cause at least: after extending the fitted lane marking, further comprising:

fitting, in the post-processing module, the lane marking in an arc by using the set of parameters.

18. A device for controlling a vehicle, comprising:

a processor configured to:

generate, based on a lane detection algorithm, a hit-map image in response to a current view, the hit-map image including a classification of pixels that hit a lane marking;

receive a fitted lane marking associated with a current view;

extend, in a post processing module, the fitted lane marking;

generate a lane template, using a set of parameters that express the lane marking in an arc, the lane template including features of the lane marking associated with the current view and features of an extended lane marking; and

feed the lane template associated with the current view for detection of a next view.

19. The device according to claim 18 , wherein the extending includes: extending a fitted lane marking based on a high-definition map.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2023
From: LIU, SIYUAN; WANG, MINGDONG; HOU, XIAODI
To: TUSIMPLE, INC.
Reel/Frame 062684/0474 →
Continuity (3)
Continuation 17074468 · Oct 19, 2020
Continuation 15683441 · Aug 22, 2017
Related Publication 20230160712A1 · May 25, 2023