IP Library Granted Patent US 10,482,769
Granted Patent B2
US 10,482,769 · App. 15/683,494 · Granted Nov 19, 2019

Post-processing module system and method for motioned-based lane detection with multiple sensors

Inventors: Siyuan Liu (San Diego, CA); Mingdong Wang (San Diego, CA); Xiaodi Hou (San Diego, CA)
Assignee: TUSIMPLE
G08G1/167
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,482,769
App. No.
15/683,494
Granted
Nov 19, 2019
Kind
B2
Abstract

A method of visual odometry for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs include instructions, which when executed by a computing device, cause the computing device to perform the following steps comprising: receiving a lane marking, expressed in god's view, associated with a current view; fitting, in a post-processing module, the lane marking in an arc by using a set of parameters; generating a lane template, using the set of parameters, the lane template including features of the lane marking associated with the current view and features of the arc; and feeding the lane template associated with the current view for detection of a next view.

Claims (50)

1. A method of lane detection for a non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform the following steps comprising:

generating, based on a lane detection algorithm, a hit-map image in response to a current view, the hit-map image including a classification of pixels that hit a lane marking;

receiving a lane marking, associated with the current view;

fitting, in a post-processing module, the lane marking in an arc by using a set of parameters;

generating a lane template, using the set of parameters, the lane template including features of the lane marking associated with the current view and features of the arc;

feeding the lane template associated with the current view for detection of a next view; and

generating a fitted lane marking based on the hit-map image and a lane template associated with an immediately previous view, wherein, based on priors or constraints, the lane template is associated with the immediately previous view to obtain a local optimal.

2. The method according to claim 1 further comprising:

determining that a confidence level of the fitted lane marking is reasonable, using the set of parameters; and

outputting the fitted lane marking to the post-processing module.

3. The method according to claim 1 further comprising:

determining that a confidence level of the fitted lane marking is unreasonable, using the set of parameters; and

rejecting the fitted lane marking.

4. The method according to claim 1 further comprising:

removing an incorrect line from the fitted lane marking.

5. The method according to claim 1 , after fitting the lane marking, further comprising:

extending, in the post-processing module, the fitted lane marking by increasing the number of lane marking in the lane template.

6. The method according to claim 5 , wherein the extending includes:

extending the fitted lane marking based on a high-definition map.

7. A method of lane detection for a non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform the following steps comprising:

generating, based on a lane detection algorithm, a hit-map image in response to a current view, the hit-map image including a classification of pixels that hit a lane marking;

receiving a lane marking, associated with the current view;

generating a lane template, using a set of parameters that express a lane marking in an arc, the lane template including features of the lane marking associated with the current view and features of the extended lane marking;

feeding the lane template associated with the current view for detection of a next view; and

generating a fitted lane marking based on the hit-map image and a lane template associated with an immediately previous view, wherein, based on priors or constraints, the lane template associated with the immediately previous view to obtain a local optimal.

8. The method according to claim 7 , further comprising:

extending, in a post-processing module, the lane marking by increasing the number of lane marking,

generating, based on a lane detection algorithm, a hit-map image in response to the current view, the hit-map image including a classification of pixels that hit a lane marking.

9. The method according to claim 8 further comprising:

determining that a confidence level of the fitted lane marking is reasonable, using the set of parameters; and

outputting the fitted lane marking to the post-processing module.

10. The method according to claim 8 further comprising:

determining that a confidence level of the fitted lane marking is unreasonable, using the set of parameters; and

rejecting the fitted lane marking.

11. The method according to claim 8 further comprising:

removing an incorrect line from the fitted lane marking.

12. The method according to claim 7 , after extending the fitted lane marking, further comprising:

fitting, in the post-processing module, the lane marking in an arc by using the set of parameters.

13. A system for lane detection, the system comprising:

an internet server, comprising:

an I/O port, configured to transmit and receive electrical signals to and from a client device;

a memory;

one or more processing units; and

one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs including instructions for:

generating, based on a lane detection algorithm, a hit-map image in response to the current view, the hit-map image including a classification of pixels that hit a lane marking;

receiving a lane marking, associated with the current view;

processing the lane marking in a post-processing module by at least one of fitting the lane marking in an arc by using a set of parameters and extending the lane marking by increasing the number of lane marking;

generating a lane template, using the set of parameters, the lane template including features of the lane marking associated with the current view and features of at least one of the arc and the extended lane marking;

feeding the lane template associated with the current view for detection of a next view; and

generating a fitted lane marking based on the hit-map image and a lane template associated with an immediately previous view, wherein, based on priors or constraints, the lane template associated with the immediately previous view to obtain a local optimal.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0553 →
CHANGE OF NAME Recorded Feb 20, 2020
From: TUSIMPLE
To: TUSIMPLE, INC.
Reel/Frame 051985/0697 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: LIU, SIYUAN; WANG, MINGDONG; HOU, XIAODI
To: TUSIMPLE
Reel/Frame 043359/0278 →
Continuity (1)
Related Publication 20190066512A1 · Feb 28, 2019
Cited By (1)
US 12,214,809