IP Library Granted Patent US 11,867,513
Granted Patent B2
US 11,867,513 · App. 17/117,543 · Granted Jan 9, 2024

Method, apparatus, device and storage medium for determining lane where vehicle located

Inventor: Yinghui Li (Beijing, CN)
Assignee: APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECHNOLOGY CO., LTD.
G01C21/30G06F18/2321G06T7/77G06T7/80G06V20/588G06T2207/30256
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,867,513
App. No.
17/117,543
Granted
Jan 9, 2024
Kind
B2
Abstract

Embodiments of the present disclosure provide a method, apparatus, device, and storage medium for determining a lane where a vehicle is located. In the method, the image lane information of the position where the vehicle is located is determined from a lane line image; actual lane information of a position where the vehicle is located is acquired from existing lane information according to the positioning information of the vehicle; and an actual lane where the vehicle is located is determined based on the image lane information and the actual lane information.

Claims (73)

1. A method for determining a lane where a vehicle is located, comprising:

determining image lane information of a position where the vehicle is located based on a lane line image, wherein the image lane information refers to lane information of the lane at a position where the vehicle is located, determined from a lane line image, and the lane line image is acquired by an image acquisition device;

acquiring actual lane information where the vehicle is located from existing lane information according to positioning information of the vehicle, wherein the existing lane information refers to lane information that already exists, the existing lane information being acquired from a map, and the actual lane information refers to lane information of the lane at the position where the vehicle is located, obtained from the existing lane information;

determining an actual lane where the vehicle is located based on the image lane information and the actual lane information; and

correcting the actual lane information of the actual lane where the vehicle is located in the existing lane information by using the image lane information of the actual lane where the vehicle is located, said correcting including:

clustering the image lane information of the actual lane where the vehicle is located in response to determining that a number of information pieces of the image lane information of the actual lane where the vehicle is located is greater than a set number threshold;

determining target lane information from the image lane information of the actual lane where the vehicle is located based on the clustered lane information; and

correcting actual lane information of an actual lane where the vehicle is located in the existing lane information by using the target lane information.

2. The method according to claim 1 , wherein the determining image lane information of the position where the vehicle is located based on the lane line image comprises:

recognizing lane line information in the lane line image; and

determining the image lane information based on lane line information obtained through recognition.

3. The method according to claim 2 , wherein the determining the image lane information based on the lane line information obtained through recognition comprises:

determining, based on the obtained lane line information, a lane type of an image lane formed by lane lines; and

using the determined lane type as the image lane information.

4. The method according to claim 3 , wherein the determining, based on the obtained lane line information, a lane type of an image lane formed by lane lines comprises:

determining at least one of a traveling direction, or a traveling position of the image lane based on the lane line information; and

determining a lane type of the image lane based on at least one of the traveling direction, or the traveling position of the image lane.

5. The method according to claim 1 , wherein the acquiring actual lane information of the position where the vehicle is located from existing lane information according to positioning information of the vehicle comprises:

determining a road position where the vehicle is located according to a positioning longitude and latitude in the positioning information;

determining a traveling direction of the vehicle according to a heading angle in the positioning information; and

acquiring the actual lane information of the position where the vehicle is located from the existing lane information according to the road position where the vehicle is located and the traveling direction of the vehicle.

6. The method according to claim 1 , wherein the determining an actual lane where the vehicle is located based on the image lane information and the actual lane information comprises:

matching the image lane information with the actual lane information;

establishing an association relationship between an image lane associated with the lane line image and an actual lane associated with the existing lane information according to a matching result; and

determining the actual lane where the vehicle is located based on the association relationship and the image lane where the vehicle is located.

7. The method according to claim 6 , wherein before determining the actual lane where the vehicle is located based on the association relationship and the image lane where the vehicle is located, the method further comprises:

determining an image position of the vehicle based on a positional relationship between the image acquisition device of the lane line image and the vehicle, and a calibration result of the image acquisition device; and

determining the image lane where the vehicle is located based on the image position of the vehicle and an image area of the image lane.

8. The method according to claim 1 , wherein the correcting the actual lane information of the actual lane where the vehicle is located in the existing lane information by using the image lane information of the actual lane where the vehicle is located comprises:

determining a relative position relationship between the actual lane where the vehicle is located and the image acquisition device based on a calibration result of the image acquisition device of the lane line image;

determining a new position of the actual lane where the vehicle is located based on the determined relative position relationship and the actual position of the image acquisition device; and

correcting the original position of the actual lane where the vehicle is located in the existing lane information by using the determined new position.

9. The method according to claim 8 , wherein before the determining a new position of the actual lane where the vehicle is located based on the determined relative position relationship and the actual position of the image acquisition device, the method further comprises:

in response to determining that the image acquisition device is an in-vehicle image acquisition device, determining an actual position of the image acquisition device based on the position information of the vehicle.

10. An electronic device comprising:

at least one processor; and

a memory in communication with the at least one processor;

wherein, the memory stores instructions executable by the at least one processor to enable the at least one processor to perform operations, the operations comprising:

determining image lane information of a position where a vehicle is located based on a lane line image, wherein the image lane information refers to lane information of the lane at a position where the vehicle is located, determined from a lane line image, and the lane line image is acquired by an image acquisition device;

acquiring actual lane information of the position where the vehicle is located from existing lane information according to positioning information of the vehicle, wherein the existing lane information refers to lane information that already exists, the existing lane information being acquired from a map, and the actual lane information refers to lane information of the lane at the position where the vehicle is located, obtained from the existing lane information;

determining an actual lane where the vehicle is located based on the image lane information and the actual lane information;

correcting the actual lane information of the actual lane where the vehicle is located in the existing lane information by using the image lane information of the actual lane where the vehicle is located, said correcting including:

clustering the image lane information of the actual lane where the vehicle is located in response to determining that a number of information pieces of the image lane information of the actual lane where the vehicle is located is greater than a set number threshold;

determining target lane information from the image lane information of the actual lane where the vehicle is located based on the clustered lane information; and

correcting actual lane information of an actual lane where the vehicle is located in the existing lane information by using the target lane information.

11. The electronic device according to claim 10 , wherein the determining image lane information of the position where the vehicle is located based on the lane line image comprises:

recognizing lane line information in the lane line image; and

determining the image lane information based on lane line information obtained through recognition.

12. The electronic device according to claim 11 , wherein the determining the image lane information based on the lane line information obtained through recognition comprises:

determining, based on the obtained lane line information, a lane type of an image lane formed by lane lines; and

using the determined lane type as the image lane information.

13. The electronic device according to claim 12 , wherein the determining, based on the obtained lane line information, a lane type of an image lane formed by lane lines comprises:

determining at least one of a traveling direction, or a traveling position of the image lane based on the lane line information; and

determining a lane type of the image lane based on at least one of the traveling direction, or the traveling position of the image lane.

14. The electronic device according to claim 10 , wherein the acquiring actual lane information of the position where the vehicle is located from existing lane information according to positioning information of the vehicle comprises:

determining a road position where the vehicle is located according to a positioning longitude and latitude in the positioning information;

determining a traveling direction of the vehicle according to a heading angle in the positioning information; and

acquiring the actual lane information of the position where the vehicle is located from the existing lane information according to the road position where the vehicle is located and the traveling direction of the vehicle.

15. The electronic device according to claim 10 , wherein the determining an actual lane where the vehicle is located based on the image lane information and the actual lane information comprises:

matching the image lane information with the actual lane information;

establishing an association relationship between an image lane associated with the lane line image and an actual lane associated with the existing lane information according to a matching result; and

determining the actual lane where the vehicle is located based on the association relationship and the image lane where the vehicle is located.

16. The electronic device according to claim 15 , wherein before determining the actual lane where the vehicle is located based on the association relationship and the image lane where the vehicle is located, the operations further comprise:

determining an image position of the vehicle based on a positional relationship between the image acquisition device of the lane line image and the vehicle, and a calibration result of the image acquisition device; and

determining the image lane where the vehicle is located based on the image position of the vehicle and an image area of the image lane.

17. A non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform operations, the operations comprising:

determining image lane information of a position where a vehicle is located based on a lane line image, wherein the image lane information refers to lane information of the lane at a position where the vehicle is located, determined from a lane line image, and the lane line image is acquired by an image acquisition device;

acquiring actual lane information of the position where the vehicle is located from existing lane information according to positioning information of the vehicle, wherein the existing lane information refers to lane information that already exists, the existing lane information being acquired from a map, and the actual lane information refers to lane information of the lane at the position where the vehicle is located, obtained from the existing lane information;

determining an actual lane where the vehicle is located based on the image lane information and the actual lane information; and

correcting the actual lane information of the actual lane where the vehicle is located in the existing lane information by using the image lane information of the actual lane where the vehicle is located, said correcting including:

clustering the image lane information of the actual lane where the vehicle is located in response to determining that a number of information pieces of the image lane information of the actual lane where the vehicle is located is greater than a set number threshold;

determining target lane information from the image lane information of the actual lane where the vehicle is located based on the clustered lane information; and

correcting actual lane information of an actual lane where the vehicle is located in the existing lane information by using the target lane information.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057789/0357 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 14, 2021
From: LI, YINGHUI
To: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
Reel/Frame 054917/0952 →
Priority Claims (1)
CN 202010327968.0 · Apr 23, 2020 · national
Continuity (1)
Related Publication 20210334552A1 · Oct 28, 2021
Cited By (1)
US 12,567,267