IP Library › Granted Patent US 12,747,951
Granted Patent B2
US 12,747,951 · App. 18/030,855 · Granted Sep 29, 2026

Information processing device, control method, program, and storage medium including acquiring point cloud map data

Inventors: Masami Suzuki (Saitama, JP); Masahiro Kato (Saitama, JP)
Assignees: PIONEER CORPORATION; PIONEER SMART SENSING INNOVATIONS CORPORATION
G01C21/28G01S17/89G01S17/931
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,747,951
App. No.
18/030,855
Granted
Sep 29, 2026
Kind
B2
Abstract

The information processing device includes a point cloud map data acquisition unit, a scan data acquisition unit, a scan data processing unit, and a matching unit. The point cloud map data acquisition unit is configured to acquire point cloud map data that is point cloud data whose reflection intensity is equal to or larger than a threshold value. The scan data acquisition unit is configured to acquire scan data that is point cloud data measured by receiving reflected light of emitted light. The scan data processing unit is configured to generate, from the scan data, high reflection intensity scan data whose reflection intensity is equal to or larger than a predetermined threshold value. The matching unit is configured to perform matching between the point cloud map data and the high reflection intensity scan data.

Claims (60)

1 . An information processing device comprising:

a processor coupled to a memory storing instructions for the processor to function as:

a point cloud map data acquisition unit configured to acquire point cloud map data which includes:

high reflection intensity map data that is point cloud data including points, on a reference plane, whose reflection intensity is equal to or larger than a first threshold value and which represents road marking paint; and

three-dimensional space map data that is point cloud data of features existing in a three-dimensional space;

a scan data acquisition unit configured to acquire scan data that is point cloud data measured by a lidar of a vehicle which receives reflected light of emitted light;

a scan data processing unit configured to:

generate, from the scan data, high reflection intensity scan data including points, on the reference plane, whose reflection intensity is equal to or larger than a second threshold value and which represents the road marking paint, wherein the scan data processing unit is configured to identify a peak reflection intensity from a histogram of the scan data and set the second threshold value based on the identified peak reflection intensity for each frame of the scan data,

generate the scan data or data obtained by filtering the scan data as three-dimensional space scan data;

a matching unit configured to perform:

a first matching between the three-dimensional space map data and the three-dimensional space scan data; and

a second matching between the high reflection intensity map data and the high reflection intensity scan data,

wherein the first threshold value is different from the second threshold value;

a position estimation unit configured to estimate a position of the vehicle based on results of the first matching and the second matching; and

a vehicle control unit configured to control the vehicle based on the estimated position.

2 . The information processing device according to claim 1 ,

wherein the matching unit is configured to perform the matching in one of the first matching and the second matching based on a Point to Point algorithm.

3 . The information processing device according to claim 1 ,

wherein the matching unit is configured to perform the first matching based on a Point to Plane algorithm and performs the second matching based on a Point to Point algorithm.

4 . The information processing device according to claim 1 ,

wherein the matching unit is configured to set weights for the first matching and the second matching based on:

a number of matched points of the three-dimensional space scan data in the first matching and

a number of matched points of the high reflection intensity scan data in the second matching.

5 . The information processing device according to claim 1 ,

wherein the reference plane includes a road surface.

6 . The information processing device according to claim 1 ,

wherein the scan data acquisition unit is configured to acquire the scan data measured by a sensor that receives the reflected light of the light emitted therefrom.

7 . The information processing device according to claim 1 ,

wherein the matching unit is configured to calculate a parameter for converting a coordinate system of the scan data into a coordinate system of the point cloud map data.

8 . The information processing device according to claim 1 ,

wherein the point cloud map data acquisition unit is configured to set the first threshold value based on a histogram of the point cloud map data in terms of the reflection intensity.

9 . The information processing device according to claim 1 ,

wherein the point cloud map data acquisition unit is configured to make a first histogram of reflection intensities of point cloud map data, which indicate a three-dimensional position and a reflection intensity for each point, and set the first threshold value based on the first histogram, and

wherein the scan data processing unit is configured to make a second histogram of the reflection intensities of the scan data, which indicate a three-dimensional position and a reflection intensity for each point, and set the second threshold value based on the second histogram.

10 . A control method executed by a computer, the control method comprising:

acquiring point cloud map data which includes:

high reflection intensity map data that is point cloud data including points, on a reference plane, whose reflection intensity is equal to or lamer than a first threshold value and which represents road marking paint; and

three-dimensional space map data that is point cloud data of features existing in a three-dimensional space,

acquiring scan data that is point cloud data measured by a lidar of a vehicle which receives reflected light of emitted light;

generating, from the scan data, high reflection intensity scan data including points, on the reference plane, whose reflection intensity is equal to or larger than a second threshold value and which represents the road marking paint, wherein the acquiring scan data includes identifying a peak reflection intensity from a histogram of the scan data and set the second threshold value based on the identified peak reflection intensity for each frame of the scan data;

generating the scan data or data obtained by filtering the scan data as three-dimensional space scan data; and

performing:

a first matching between the three-dimensional space map data and the three-dimensional space scan data; and

a second matching between the high reflection intensity map data and the high reflection intensity scan,

wherein the first threshold value is different from the second threshold value; and

estimating a position of the vehicle based on results of the first matching and the second matching; and

controlling the vehicle based on the estimated position.

11 . A non-transitory computer readable medium storing a program executed by a computer, the program causing the computer to:

acquire point cloud map data which includes:

high reflection intensity map data that is point cloud data including points, on a reference plane, whose reflection intensity is equal to or lamer than a first threshold value and which represents road marking paint; an

three-dimensional space map data that is point cloud data of features existing in a three-dimensional space,

acquire scan data that is point cloud data measured by a lidar of a vehicle which receives reflected light of emitted light;

generate, from the scan data, high reflection intensity scan data including points, on the reference plane, whose reflection intensity is equal to or larger than a second threshold value and which represents the road marking paint, wherein the acquiring scan data includes identifying a peak reflection intensity from a histogram of the scan data and set the second threshold value based on the identified peak reflection intensity for each frame of the scan data;

generate the scan data or data obtained by filtering the scan data as three-dimensional space scan data; and

perform:

a first matching between the three-dimensional space map data and the three-dimensional space scan data; and

a second matching between the high reflection intensity map data and the high reflection intensity scan,

wherein the first threshold value is different from the second threshold value; and

estimating a position of the vehicle based on results of the first matching and the second matching; and

controlling the vehicle based on the estimated position.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE SECOND ASSIGNEE NAME PIONEER SMART SENSING INNOVATIONS PREVIOUSLY RECORDED ON REEL 063754 FRAME 0541. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 26, 2023
From: SUZUKI, MASAMI; KATO, MASAHIRO
To: PIONEER CORPORATION; PIONEER SMART SENSING INNOVATIONS CORPORATION
Reel/Frame 063789/0257 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2023
From: SUZUKI, MASAMI; KATO, MASAHIRO
To: PIONEER CORPORATION; PIONEER SMART SENSING INNOVATIONS
Reel/Frame 063754/0541 →
Priority Claims (1)
JP 2020-169915 · Oct 7, 2020 · national
Continuity (1)
Related Publication 20250085114A1 · Mar 13, 2025
References Cited (33)
US 9080866B1 · Dowdall · 2015 [cited by examiner]
US 20100157280A1 · Kusevic · 2010 [cited by examiner]
US 20120081544A1 · Wee · 2012 [cited by examiner]
US 20170227647A1 · Baik · 2017 [cited by applicant]
US 20170365094A1 · Liu · 2017 [cited by examiner]
US 20180299273A1 · Cai · 2018 [cited by examiner]
US 20190101649A1 · Jensen · 2019 [cited by examiner]
US 20190163989A1 · Guo · 2019 [cited by examiner]
US 20200225032A1 · Chen et al. · 2020 [cited by applicant]
US 20200393566A1 · Zeng · 2020 [cited by examiner]
US 20200408557A1 · Fasola · 2020 [cited by examiner]
US 20210003712A1 · Zhang · 2021 [cited by examiner]
US 20210027501A1 · Moss · 2021 [cited by examiner]
US 20210201070A1 · Omari · 2021 [cited by examiner]
US 20210405200A1 · Ding · 2021 [cited by examiner]
US 20220035011A1 · Pacala · 2022 [cited by examiner]
CN 111046735A · 2020 [cited by examiner]
JP 2013257742A · 2013 [cited by applicant]
JP 2017004176A · 2017 [cited by examiner]
JP 2017091128A · 2017 [cited by applicant]
JP 2020034322A · 2020 [cited by applicant]
WO WO2016002776A1 · 2016 [cited by examiner]
WO 2018221455A1 · 2018 [cited by applicant]
Tanaka Shinya—English Description of JP-2017004176-A via Espacenet Patent Translate, retrieved Sep. 12, 2025 (Year: 2025). [cited by examiner]
L. Chen, J. Yang and H. Kong, “Lidar-histogram for fast road and obstacle detection,” 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore, 2017, pp. 1343-1348, (Year: 2017). [cited by examiner]
Shimbo, Kenichi—English description of WO-2016002776-A1, via Google Patents, Jan. 23, 2026 (Year: 2026). [cited by examiner]
Li, Kuang-Yu—English description of CN-111046735-A via Espacenet Patent Translate, retrieved Jun. 1, 2026 (Year: 2026). [cited by examiner]
Yoneda, et al., “Urban Road Localization by using Multiple Layer Map Matching and Line Segment Matching”, 2015 IEEE Intelligent Vehicles Symposium (IV), Jun. 28-Jul. 1, 2015, COEX, Seoul, Korea, in 6 pages. [cited by applicant]
Fu, et al., “An Efficient Scan-to-Map Matching Approach Based on Multi-channel Lidar”, J Intell Robot Syst (2018) 91: 501-513, https://doi.org/10.1007/s10846-017-0717-0, dated Oct. 19, 2017, in 13 pages. [cited by applicant]
European Patent Office, Extended European Search Report, Application No. 21877655.7, dated Oct. 10, 2024, in 10 pages. [cited by applicant]
Takai, et al., Accurate Registraton of MMS Point Clouds of Urban Areas Using Trajectory, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. II-5/W2, 2013 ISPRS Workshop Laser Scann… [cited by applicant]
Seki, et al., Recognition of the Road Object in 3D Road Data, the Institute of Electronics, Information and Communication Engineers, Nov. 10, 2021, in 6 pages. [cited by applicant]
Patent Cooperation Treaty, International Search Report, Application No. PCT/JP2021/036968, dated Nov. 9, 2021, in 4 pages. [cited by applicant]