IP Library Granted Patent US 10,402,999
Granted Patent B2
US 10,402,999 · App. 15/724,945 · Granted Sep 3, 2019

Method, apparatus and terminal device for constructing map

Inventors: Shichun Yi (Beijing, CN); Cheng Wang (Beijing, CN); Li Yu (Beijing, CN); Shiyu Song (Beijing, CN); Fangfang Dong (Beijing, CN)
Assignee: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) Co., LTD
G06T7/74G01C21/32G05D1/0274G06K9/00818G06K9/4604G06T7/248G06T17/05G05D1/0088G05D2201/0213G06T2207/10028G06T2207/20036G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,402,999
App. No.
15/724,945
Granted
Sep 3, 2019
Kind
B2
Abstract

The present disclosure discloses a method, apparatus and server for constructing a map. An embodiment of the method comprises: building a point cloud data frame sequence using point cloud data frames acquired in real time; extracting morphological data from the point cloud data frames; establishing a spatial position relation between the morphological data of two adjacent point cloud data frames in the point cloud data frame sequence; determining a reference spatial position relation corresponding to a stationary object based on the spatial position relation, and constructing a map with the reference spatial position relation. The present embodiment realizes constructing a map with the point cloud data.

Claims (50)

1. A method for constructing a map, comprising:

building a point cloud data frame sequence using point cloud data frames acquired in real time, the point cloud data frame sequence including a plurality of point cloud data frames arranged in an order of acquisition time, adjacent point cloud data frames being generated after a set time, the point cloud data frames including point cloud data arranged in a matrix, the point cloud data including three-dimensional coordinates of a spatial position for marking an object in a surrounding environment of an unmanned vehicle;

extracting morphological data from the point cloud data frames, the morphological data used for characterizing a morphological feature of a surface of the object and a morphological feature of a line of the object, including surface point cloud data corresponding to the surface of the object and/or line point cloud data corresponding to the line of the object;

establishing a spatial position relation between morphological data of two adjacent point cloud data frames in the point cloud data frame sequence, the spatial position relation being indicative of motion of the unmanned vehicle; and

determining a reference spatial position relation corresponding to a stationary object based on the spatial position relation, and constructing a map of the surrounding environment based on the reference spatial position relation.

2. The method according to claim 1 , wherein the extracting morphological data from the point cloud data frames comprises:

determining a plurality of vectors between each point cloud data and an adjacent point cloud data in the point cloud data frames; and

assigning, when a vector satisfies a distance threshold condition and an angle threshold condition, two point cloud data corresponding to the vector as the morphological data.

3. The method according to claim 1 , wherein the establishing a spatial position relation between morphological data of two adjacent point cloud data frames in the point cloud data frame sequence comprises:

determining two sets of morphological data corresponding to a given object in the two adjacent point cloud data frames; and

calculating a distance and an angle between the two sets of morphological data to obtain the spatial position relation.

4. The method according to claim 1 , wherein the determining a reference spatial position relation corresponding to a stationary object based on the spatial position relation comprises:

counting a velocity of each object in two adjacent point cloud data frames to obtain a velocity profile, the velocity being determined by the spatial position relation and the set time; and

determining an object corresponding to a velocity having a largest ratio from the velocity profile as a stationary object, and determining a spatial position relation of the stationary object as the reference spatial position relation.

5. The method according to claim 1 , wherein the constructing a map with the reference spatial position relation comprises:

plotting the stationary object in the world coordinate system based on morphological data corresponding to the reference spatial position relation to obtain a map corresponding to the point cloud data frame sequence.

6. An apparatus for constructing a map, comprising:

at least one processor; and

a memory storing instructions, which when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

building a point cloud data frame sequence using point cloud data frames acquired in real time, the point cloud data frame sequence including a plurality of point cloud data frames arranged in an order of acquisition time, adjacent point cloud data frames being generated after a set time, the point cloud data frames including point cloud data arranged in a matrix, the point cloud data including three-dimensional coordinates of a spatial position for marking an object in a surrounding environment of an unmanned vehicle;

extracting morphological data from the point cloud data frames, the morphological data used for characterizing a morphological feature of a surface of the object and a morphological feature of a line of the object, including surface point cloud data corresponding to the surface of the object and/or line point cloud data corresponding to the line of the object;

establishing a spatial position relation between morphological data of two adjacent point cloud data frames in the point cloud data frame sequence, the spatial position relation being indicative of motion of the unmanned vehicle; and

determining a reference spatial position relation corresponding to a stationary object based on the spatial position relation, and constructing a map of the surrounding environment based on the reference spatial position relation.

7. The apparatus according to claim 6 , wherein the extracting morphological data from the point cloud data frames comprises:

determining a plurality of vectors between each point cloud data and an adjacent point cloud data in the point cloud data frames; and

assigning, when a vector satisfies a distance threshold condition and an angle threshold condition, two point cloud data corresponding to the vector as the morphological data.

8. The apparatus according to claim 6 , wherein the establishing a spatial position relation between morphological data of two adjacent point cloud data frames in the point cloud data frame sequence comprises:

determining two sets of morphological data corresponding to a given object in the two adjacent point cloud data frames; and

calculating a distance and an angle between the two sets of morphological data to obtain the spatial position relation.

9. The apparatus according to claim 6 , wherein the determining a reference spatial position relation corresponding to a stationary object based on the spatial position relation comprises:

counting a velocity of each object in the two adjacent point cloud data frames to obtain a velocity profile, the velocity being determined by the spatial position relation and the set time; and

determining an object corresponding to a velocity having a largest ratio from the velocity profile as a stationary object, and determining a spatial position relation of the stationary object as the reference spatial position relation.

10. The apparatus according to claim 6 , wherein the constructing a map with the reference spatial position relation comprises:

plotting the stationary object in the world coordinate system based on morphological data corresponding to the reference spatial position relation to obtain a map corresponding to the point cloud data frame sequence.

11. A non-transitory computer readable storage medium storing a computer program, which when executed by one or more processors, causes the one or more processors to perform operations, the operations comprising:

building a point cloud data frame sequence using point cloud data frames acquired in real time, the point cloud data frame sequence including a plurality of point cloud data frames arranged in an order of acquisition time, adjacent point cloud data frames being generated after a set time, the point cloud data frames including point cloud data arranged in a matrix, the point cloud data including three-dimensional coordinates of a spatial position for marking an object in a surrounding environment of an unmanned vehicle;

extracting morphological data from the point cloud data frames, the morphological data used for characterizing a morphological feature of a surface of the object and a morphological feature of a line of the object, including surface point cloud data corresponding to the surface of the object and/or line point cloud data corresponding to the line of the object;

establishing a spatial position relation between morphological data of two adjacent point cloud data frames in the point cloud data frame sequence, the spatial position relation being indicative of motion of the unmanned vehicle; and

determining a reference spatial position relation corresponding to a stationary object based on the spatial position relation, and constructing a map of the surrounding environment based on the reference spatial position relation.

12. The non-transitory computer readable storage medium according to claim 11 , wherein the extracting morphological data from the point cloud data frames comprises:

determining a plurality of vectors between each point cloud data and an adjacent point cloud data in the point cloud data frames; and

assigning, when a vector satisfies a distance threshold condition and an angle threshold condition, two point cloud data corresponding to the vector as the morphological data.

13. The non-transitory computer readable storage medium according to claim 11 , wherein the establishing a spatial position relation between morphological data of two adjacent point cloud data frames in the point cloud data frame sequence comprises:

determining two sets of morphological data corresponding to a given object in the two adjacent point cloud data frames; and

calculating a distance and an angle between the two sets of morphological data to obtain the spatial position relation.

14. The non-transitory computer readable storage medium according to claim 11 , wherein the determining a reference spatial position relation corresponding to a stationary object based on the spatial position relation comprises:

counting a velocity of each object in two adjacent point cloud data frames to obtain a velocity profile, the velocity being determined by the spatial position relation and the set time; and

determining an object corresponding to a velocity having a largest ratio from the velocity profile as a stationary object, and determining a spatial position relation of the stationary object as the reference spatial position relation.

15. The non-transitory computer readable storage medium according to claim 11 , wherein the constructing a map with the reference spatial position relation comprises:

plotting the stationary object in the world coordinate system based on morphological data corresponding to the reference spatial position relation to obtain a map corresponding to the point cloud data frame sequence.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICANT NAME PREVIOUSLY RECORDED AT REEL: 057933 FRAME: 0812. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 28, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058594/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057933/0812 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2019
From: YI, SHICHUN; WANG, CHENG; YU, LI; SONG, SHIYU; DONG, FANGFANG
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 049745/0042 →
Priority Claims (1)
CN 2017 1 0599794 · Jul 21, 2017 · national
Continuity (1)
Related Publication 20190026920A1 · Jan 24, 2019