IP Library Granted Patent US 11,586,218
Granted Patent B2
US 11,586,218 · App. 17/018,153 · Granted Feb 21, 2023

Method and apparatus for positioning vehicle, electronic device and storage medium

Inventors: Qi Chen (Beijing, CN); Songtao Chang (Beijing, CN); Cong Chen (Beijing, CN); Yubin Wang (Beijing, CN); Youhao Li (Beijing, CN); Wenyang Chen (Beijing, CN)
Assignee: Apollo Intelligent Driving Technology (Beijing) Co., Ltd.
G05D1/0274G05D1/0246G06N3/04G06V20/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,586,218
App. No.
17/018,153
Granted
Feb 21, 2023
Kind
B2
Abstract

A method and apparatus for positioning a vehicle. The method may include: acquiring an identification element and non-identification elements of a current vehicle. The method can further include matching the identification element of the current vehicle with position elements in a high-precision map to determine an initial position of the current vehicle. The method can further include using at least one position element in the high-precision map to perform observational constraints on the non-identification elements of the current vehicle to acquire position elements corresponding to the non-identification elements of the current vehicle. The method can further include adjusting the initial position of the current vehicle using the position elements corresponding to the non-identification elements of the current vehicle to obtain a target position of the current vehicle.

Claims (65)

1. A method for positioning a current vehicle, the method comprising:

acquiring an identification element and non-identification elements of the current vehicle, both the identification element and non-identification elements representing environmental information of the current vehicle;

matching the identification element of the current vehicle with position elements in a high-definition map to determine an initial position of the current vehicle;

using at least one position element in the high-definition map to perform observational constraints on the non-identification elements of the current vehicle to acquire position elements corresponding to the non-identification elements of the current vehicle;

adjusting the initial position of the current vehicle using the position elements corresponding to the non-identification elements of the current vehicle to obtain a target position of the current vehicle; and

moving the current vehicle based at least in part on the target position of the current vehicle;

wherein the using at least one position element in the map to perform observational constraints on the non-identification elements of the current vehicle to acquire position elements corresponding to the non-identification elements of the current vehicle, includes:

selecting a non-identification element in the non-identification elements of the current vehicle as a current non-identification element, and determining at least one position element corresponding to the current non-identification element in the map based on the current non-identification element; and

either performing point and point observational constraints on the current non-identification element and the corresponding position element, in response to that the current non-identification element is a point element and the corresponding position element is a point original element, to acquire the position element corresponding to the current non-identification element; or

performing point and line observational constraints on the current non-identification element and the corresponding position element, in response to that the current non-identification element is a line element and the corresponding position element is a point original element, or, the current non-identification element is a point element and the corresponding position element is a point and line element, to acquire the position element corresponding to the current non-identification element; and

repeatedly performing above operations until the position elements corresponding to the non-identification elements of the current vehicle are acquired.

2. The method according to claim 1 , wherein the acquiring the identification element and non-identification elements of the current vehicle, comprises:

collecting environment images of the current vehicle in four directions using four fisheye sensors provided on the current vehicle; wherein, the four fisheye sensors on the current vehicle are respectively provided in the four directions of front, rear, left, and right of the current vehicle;

stitching the environment images of the current vehicle in the four directions collected using the fisheye sensors into a surround-view fisheye image; and

inputting the surround-view fisheye image into a deep neural network, and outputting the identification element and the non-identification elements of the current vehicle through the deep neural network.

3. The method according to claim 1 , wherein the matching the identification element of the current vehicle with position elements in the high-definition map to determine the initial position of the current vehicle, comprises:

determining at least one reference initial position in the high-definition map based on the identification element of the current vehicle; and

calculating a matching degree between the identification element of the current vehicle and each of the at least one reference initial position, and determining a reference initial position having a highest matching degree as the initial position of the current vehicle.

4. The method according to claim 1 , further comprising:

collecting inertial measurement data and wheel speed data of the current vehicle using an inertial measurement unit sensor and a wheel speed sensor provided on the current vehicle; and

adjusting the target position of the current vehicle using the inertial measurement data and the wheel speed data of the current vehicle, to obtain a final position of the current vehicle.

5. An electronic device, comprising:

at least one processor; and

a memory, communicatively connected to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor, the instructions, when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

acquiring an identification element and non-identification elements of a current vehicle, both the identification element and non-identification elements representing environmental information of the current vehicle;

matching the identification element of the current vehicle with position elements in a high-definition map to determine an initial position of the current vehicle;

using at least one position element in the high-definition map to perform observational constraints on the non-identification elements of the current vehicle to acquire position elements corresponding to the non-identification elements of the current vehicle;

adjusting the initial position of the current vehicle using the position elements corresponding to the non-identification elements of the current vehicle to obtain a target position of the current vehicle; and

moving the current vehicle based at least in part on the target position of the current vehicle;

wherein the using at least one position element in the map to perform observational constraints on the non-identification elements of the current vehicle to acquire position elements corresponding to the non-identification elements of the current vehicle, includes:

selecting a non-identification element in the non-identification elements of the current vehicle as a current non-identification element, and determining at least one position element corresponding to the current non-identification element in the map based on the current non-identification element; and

performing point and point observational constraints on the current non-identification element and the corresponding position element, in response to that the current non-identification element is a point element and the corresponding position element is a point original element, to acquire the position element corresponding to the current non-identification element; or,

performing point and line observational constraints on the current non-identification element and the corresponding position element, in response to that the current non-identification element is a line element and the corresponding position element is a point original element, or, the current non-identification element is a point element and the corresponding position element is a point and line element, to acquire the position element corresponding to the current non-identification element; and

repeatedly performing above operations until the position elements corresponding to the non-identification elements of the current vehicle are acquired.

6. The electronic device according to claim 5 , wherein the acquiring the identification element and non-identification elements of the current vehicle, comprises:

collecting environment images of the current vehicle in four directions using four fisheye sensors provided on the current vehicle; wherein, the four fisheye sensors on the current vehicle are respectively provided in the four directions of front, rear, left, and right of the current vehicle;

stitching the environment images of the current vehicle in the four directions collected using the fisheye sensors into a surround-view fisheye image; and

inputting the surround-view fisheye image into a deep neural network, and outputting the identification element and the non-identification elements of the current vehicle through the deep neural network.

7. The electronic device according to claim 5 , wherein the matching the identification element of the current vehicle with position elements in the high-definition map to determine the initial position of the current vehicle, comprises:

determining at least one reference initial position in the high-definition map based on the identification element of the current vehicle; and

calculating a matching degree between the identification element of the current vehicle and each of the at least one reference initial position, and determining a reference initial position having a highest matching degree as the initial position of the current vehicle.

8. The electronic device according to claim 5 , wherein the operations further comprise:

collecting inertial measurement data and wheel speed data of the current vehicle using an inertial measurement unit sensor and a wheel speed sensor provided on the current vehicle; and

adjusting the target position of the current vehicle using the inertial measurement data and the wheel speed data of the current vehicle, to obtain a final position of the current vehicle.

9. A non-transitory computer readable storage medium, storing computer instructions, the computer instructions, when executed by a computer, cause the computer to perform operations, the operations comprising:

acquiring an identification element and non-identification elements of a current vehicle, both the identification element and non-identification elements representing environmental information of the current vehicle;

matching the identification element of the current vehicle with position elements in a high-definition map to determine an initial position of the current vehicle;

using at least one position element in the high-definition map to perform observational constraints on the non-identification elements of the current vehicle to acquire position elements corresponding to the non-identification elements of the current vehicle;

adjusting the initial position of the current vehicle using the position elements corresponding to the non-identification elements of the current vehicle to obtain a target position of the current vehicle; and

moving the current vehicle based at least in part on the target position of the current vehicle;

wherein the using at least one position element in the map to perform observational constraints on the non-identification elements of the current vehicle to acquire position elements corresponding to the non-identification elements of the current vehicle, includes:

selecting a non-identification element in the non-identification elements of the current vehicle as a current non-identification element, and determining at least one position element corresponding to the current non-identification element in the map based on the current non-identification element; and

performing point and point observational constraints on the current non-identification element and the corresponding position element, in response to that the current non-identification element is a point element and the corresponding position element is a point original element, to acquire the position element corresponding to the current non-identification element; or,

performing point and line observational constraints on the current non-identification element and the corresponding position element, in response to that the current non-identification element is a line element and the corresponding position element is a point original element, or, the current non-identification element is a point element and the corresponding position element is a point and line element, to acquire the position element corresponding to the current non-identification element and repeatedly performing above operations until the position elements corresponding to the non-identification elements of the current vehicle are acquired.

10. The non-transitory computer readable storage medium according to claim 9 , wherein the acquiring the identification element and non-identification elements of the current vehicle, comprises:

collecting environment images of the current vehicle in four directions using four fisheye sensors provided on the current vehicle; wherein, the four fisheye sensors on the current vehicle are respectively provided in the four directions of front, rear, left, and right of the current vehicle;

stitching the environment images of the current vehicle in the four directions collected using the fisheye sensors into a surround-view fisheye image; and

inputting the surround-view fisheye image into a deep neural network, and outputting the identification element and the non-identification elements of the current vehicle through the deep neural network.

11. The non-transitory computer readable storage medium according to claim 9 , wherein the matching the identification element of the current vehicle with position elements in the high-definition map to determine the initial position of the current vehicle, comprises:

determining at least one reference initial position in the high-definition map based on the identification element of the current vehicle; and

calculating a matching degree between the identification element of the current vehicle and each of the at least one reference initial position, and determining a reference initial position having a highest matching degree as the initial position of the current vehicle.

12. The non-transitory computer readable storage medium according to claim 9 , wherein the operations further comprise:

collecting inertial measurement data and wheel speed data of the current vehicle using an inertial measurement unit sensor and a wheel speed sensor provided on the current vehicle; and

adjusting the target position of the current vehicle using the inertial measurement data and the wheel speed data of the current vehicle, to obtain a final position of the current vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058241/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 11, 2020
From: CHEN, QI; CHANG, SONGTAO; CHEN, CONG; WANG, YUBIN; LI, YOUHAO; CHEN, WENYANG
To: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
Reel/Frame 053746/0699 →
Priority Claims (1)
CN 202010067385.9 · Jan 20, 2020 · national
Continuity (1)
Related Publication 20210223789A1 · Jul 22, 2021