IP Library › Granted Patent US 12,148,219
Granted Patent B2
US 12,148,219 · App. 17/680,939 · Granted Nov 19, 2024

Method, apparatus, and computing device for lane recognition

Inventors: Donghu Li (Hangzhou, CN); Zhichang Lv (Hangzhou, CN); Yueqiang Lyu (Shanghai, CN)
Assignee: HUAWEI TECHNOLOGIES CO., LTD.
G06V20/54G06T7/70G06T2207/10016G06T2207/30236G06T2207/30241G06V2201/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,148,219
App. No.
17/680,939
Granted
Nov 19, 2024
Kind
B2
Abstract

A method for lane recognition includes, when recognizing a lane in a video, obtaining the video recorded by a monitoring device set up on a road, where the video records a plurality of vehicles running on the road; determining positions of each vehicle in a plurality of video frames of the video; determining a vehicle trajectory of each vehicle in the video based on the positions of the vehicle in the video frames of the video; and recognizing at least one lane in the video based on vehicle trajectories of the vehicles in the video.

Claims (82)

1. A method for lane recognition comprising:

obtaining, from a monitoring device on a road, a video that records a plurality of vehicles travelling on the road; and

recognizing at least one lane in the video based on first vehicle trajectories of the vehicles in the video,

wherein the first vehicle trajectories are based on positions of each of the vehicles in a plurality of video frames of the video,

wherein each trajectory of the first vehicle trajectories corresponds to a respective vehicle of the vehicles,

wherein a lane type of each of the at least one lane is based on types of the vehicles and the first vehicle trajectories,

wherein the types are based on a vehicle type detection model, and

wherein the lane type indicates a type of a vehicle that can travel on the at least one lane.

2. The method of claim 1 , wherein the road comprises an intersection, wherein the method further comprises obtaining, from the monitoring device, an extension video that is recorded in a time period after the video, wherein an attribute of each of the at least one lane is based on the first vehicle trajectories and second vehicle trajectories of the vehicles in the extension video, and wherein the attribute comprises one or more of:

a right-turn lane;

a left-turn lane;

a straight-through lane;

a right-turn and straight-through lane;

a left-turn and straight-through lane; or

an all-purpose lane.

3. The method of claim 1 , further comprising:

calculating a distance between a vehicle trajectory of a first vehicle of the vehicles and an adjacent lane in the video, wherein the adjacent lane is in the at least one lane and is nearest to the vehicle trajectory of the first vehicle;

comparing the distance and a pixel width of the first vehicle;

and

recognizing, based on the vehicle trajectory of the first vehicle, a new lane that is in the at least one lane.

4. The method of claim 1 , further comprising calculating a traffic flow on each of the at least one lane.

5. The method of claim 1 , further comprising:

identifying that a quantity of recognized lanes is not equal to a preset quantity, wherein the preset quantity is an actual quantity of detected lanes in the video; and

obtaining, in response to identifying that the quantity of recognized lanes is not equal to the preset quantity, at least one corrected lane in the video based on the preset quantity and the first vehicle trajectories.

6. The method of claim 1 , further comprising:

receiving, from the monitoring device and in real time, a video stream comprising the video; or

periodically obtaining, from the monitoring device, the video.

7. A computing device for lane recognition and comprising:

a memory configured to store computer instructions; and

a processor coupled to the memory, wherein the computer instructions cause the processor to be configured to:

obtain, from a monitoring device on a road, a video that records a plurality of vehicles travelling on the road; and

recognize at least one lane in the video based on first vehicle trajectories of the vehicles in the video,

wherein the first vehicle trajectories are based on positions of each of the vehicles in a plurality of video frames of the video,

wherein each trajectory of the first vehicle trajectories corresponds to a respective vehicle of the vehicles,

wherein a lane type of each of the at least one lane is based on types of the vehicles and the first vehicle trajectories,

wherein the types are based on a vehicle type detection model, and

wherein the lane type indicates a type of a vehicle that can travel on the at least one lane.

8. The computing device of claim 7 , wherein the road comprises an intersection, wherein the computer instructions further cause the processor to be configured to obtain, from the monitoring device, an extension video that is recorded in a time period after the video, wherein an attribute of each of the at least one lane is based on the first vehicle trajectories and second vehicle trajectories of the vehicles in the extension video, and wherein the attribute comprises one or more of:

a right-turn lane;

a left-turn lane;

a straight-through lane;

a right-turn and straight-through lane;

a left-turn and straight-through lane; or

an all-purpose lane.

9. The computing device of claim 7 , wherein the computer instructions further cause the processor to be configured to:

calculate a distance between a vehicle trajectory of a first vehicle of the vehicles and an adjacent lane in the video, wherein the adjacent lane is in the at least one lane and is nearest to the vehicle trajectory of the first vehicle;

compare the distance and a pixel width of the first vehicle;

and

recognize, based on the vehicle trajectory of the first vehicle, a new lane that is in the at least one lane.

10. The computing device of claim 7 , wherein the computer instructions further cause the processor to be configured to calculate a traffic flow on each of the at least one lane.

11. The computing device of claim 7 , wherein the computer instructions further cause the processor to be configured to:

identify that a quantity of recognized lanes is not equal to a preset quantity, wherein the preset quantity is an actual quantity of detected lanes in the video; and

obtain at least one corrected lane in the video based on the preset quantity and the first vehicle trajectories.

12. The computing device of claim 7 , wherein the computer instructions further cause the processor to be configured to:

receive, from the monitoring device and in real time, a video stream comprising the video; or

periodically obtain, from the monitoring device, the video.

13. A computer program product comprising computer-executable instructions that are stored on a non-transitory computer-readable storage medium and that, when executed by a processor, cause a computing device to:

obtain, from a monitoring device on a road, a video that records a plurality of vehicles travelling on the road; and

recognize at least one lane in the video based on the first vehicle trajectories of the vehicles in the video, wherein the first vehicle trajectories are based on positions of each of the vehicles in a plurality of video frames of the video,

wherein each trajectory of the first vehicle trajectories corresponds to a respective vehicle of the vehicles,

wherein a lane type of each of the at least one lane based on types of the vehicles and the first vehicle trajectories,

wherein the types are based on a vehicle type detection model, and

wherein the lane type indicates a type of a vehicle that can travel on the at least one lane.

14. The computer program product of claim 13 , wherein the road comprises an intersection, wherein the computer-executable instructions further cause the computing device to obtain, from the monitoring device, an extension video that is recorded in a time period after the video, wherein an attribute of each of the at least one lane is based on the first vehicle trajectories and second vehicle trajectories of the vehicles in the extension video, and wherein the attribute comprises one or more of:

a right-turn lane;

a left-turn lane;

a straight-through lane;

a right-turn and straight-through lane;

a left-turn and straight-through lane; or

an all-purpose lane.

15. The computer program product of claim 13 , wherein the computer-executable instructions further cause the computing device to:

calculate a distance between a vehicle trajectory of a first vehicle and an adjacent lane in the video, wherein the adjacent lane is in the at least one lane and is nearest to the vehicle trajectory of the first vehicle;

compare the distance and a pixel width of the first vehicle;

and

recognize, based on the vehicle trajectory of the first vehicle, a new lane that is in the at least one lane.

16. The computer program product of claim 13 , wherein the computer-executable instructions further cause the computing device to calculate a traffic flow on each of the at least one lane.

17. The computer program product of claim 13 , wherein the computer-executable instructions further cause the computing device to:

identify that a quantity of recognized lanes is not equal to a preset quantity, wherein the preset quantity is an actual quantity of detected lanes in the video; and

obtain at least one corrected lane in the video based on the preset quantity and the first vehicle trajectories.

18. The computer program product of claim 13 , wherein the computer-executable instructions further cause the computing device to receive, from the monitoring device and in real time, a video stream comprising the video.

19. The computer program product of claim 13 , wherein the computer-executable instructions further cause the computing device to periodically obtain, from the monitoring device, the video.

20. The computer program product of claim 13 , wherein the vehicle type detection model is an artificial intelligence (AI) model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2024
From: LI, DONGHU; LV, ZHICHANG; LYU, YUEQIANG
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 068706/0537 →
Priority Claims (2)
CN 201910804345.5 · Aug 28, 2019 · national
CN 201911315389.8 · Dec 18, 2019 · national
Continuity (2)
Continuation PCTCN2020081136 · Mar 25, 2020
Related Publication 20220237919A1 · Jul 28, 2022
Cited By (1)
US 12,387,505