IP Library Granted Patent US 12,669,593
Granted Patent B2
US 12,669,593 · App. 18/089,279 · Granted Jun 30, 2026

Point cloud positioning error detection method and system

Inventors: Wei-Yuan Hsieh (Taipei City, TW); Ming-Xuan Wu (New Taipei City, TW); Chia-Jui Hu (New Taipei City, TW)
Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
G01S7/497G01S17/89
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,669,593
App. No.
18/089,279
Filed
Dec 27, 2022
Granted
Jun 30, 2026
Kind
B2
Art Unit
2857
USPC
702/152
Abstract

A point cloud positioning error detection method, performed by a processing device, includes: obtaining a plurality of pieces of first point data and a target point cloud map, wherein the target point cloud map includes a plurality of pieces of target point data, registering the first point data and the target point data to obtain a plurality of pieces of second point data, selecting a plurality of pieces of third point data from the second point data according to a first default distance, calculating a plurality of matching scores of the third point data relative to the target point data, obtaining a plurality of step vectors corresponding to the third point data, respectively, when said registering converges, and obtaining a plurality of effective values according to directions of the step vectors, and outputting a localization fault detection result based on an intersection of the matching scores and the effective values.

Claims (69)

1 . A point cloud positioning error detection method, performed by a processing device, comprising:

obtaining a plurality of pieces of first point data and a target point cloud map, wherein the target point cloud map comprises a plurality of pieces of target point data, wherein the plurality of pieces of first point data are generated by a point cloud generator sensing a surrounding of a vehicle;

registering the pieces of first point data and the pieces of target point data to obtain a plurality of pieces of second point data with a plurality of iterations;

selecting a plurality of pieces of third point data from the pieces of second point data according to a first default distance;

calculating a plurality of matching scores of the pieces of third point data relative to the pieces of target point data;

obtaining a plurality of step vectors corresponding to the pieces of third point data, respectively, when said registering converges, and obtaining a plurality of effective values according to directions of the step vectors; and

outputting a localization fault detection result based on an intersection of the matching scores and the effective values,

wherein outputting the localization fault detection result based on the intersection of the matching scores and the effective values comprises:

obtaining a distribution of the matching scores relative to the effective values;

setting a first point at the distribution according to an average value of the matching scores;

setting a second point at the distribution according to a plurality of positive effective values among the effective values;

setting a third point at the distribution according to a plurality of negative effective values among the effective values;

setting an ineffective range with the first point, the second point and the third point;

calculating an ineffective ratio of a part of the pieces of third point data falling in the ineffective range relative to the pieces of third point data; and

outputting the localization fault detection result according to the ineffective ratio and an ineffective threshold;

wherein the localization fault detection result is outputted to an automobile computer, for the automobile computer to use the localization fault detection result for positioning.

2 . The point cloud positioning error detection method according to claim 1 , wherein calculating the matching scores of the pieces of third point data relative to the pieces of target point data comprises:

for each of the pieces of third point data as a target piece of third point data, performing:

determining one or more pieces of target point data among the pieces of target point data, wherein a distance between each of the one or more pieces of target point data and the target piece of third point data is not greater than a second default distance;

calculating one or more distances between the one or more pieces of target point data and the target piece of third point data; and

designating the matching score according to a comparison result of the distances and a third default distance,

wherein the matching score is inversely proportional to the distances.

3 . The point cloud positioning error detection method according to claim 1 , wherein selecting the pieces of third point data from the pieces of second point data according to the first default distance comprises:

for each of the pieces of second point data as a target piece of second point data, performing:

determining a piece of target point data among the pieces of target point data closest to the target piece of second point data;

determining whether a distance between the piece of target point data and the target piece of second point data is greater than the first default distance;

if the distance is greater than the first default distance, abandoning the target piece of second point data; and

if the distance is not greater than the first default distance, using the target piece of second point data as one of the pieces of third point data.

4 . The point cloud positioning error detection method according to claim 1 , wherein obtaining the effective values according to the directions of the step vectors comprises:

enclosing the pieces of third point data according to a default three-dimensional block to obtain a plurality of point cloud blocks;

determining a plurality of normal vectors of the point cloud blocks;

determining a component of each one of the step vectors on a corresponding one of the normal vectors;

if a direction of the component is in a positive direction, setting the effective value to be positive; and

if the direction of the component is in a negative direction, setting the effective value to be negative.

5 . A point cloud positioning error detection system, comprising:

a point cloud generator configured to generate a plurality of pieces of first point data by sensing a surrounding of a vehicle; and

a processing device connected to the point cloud generator, and configured to perform:

registering the pieces of first point data and a plurality of pieces of target point data of a target point cloud map to obtain a plurality of pieces of second point data with a plurality of iterations;

selecting a plurality of pieces of third point data from the pieces of second point data according to a first default distance;

calculating a plurality of matching scores of the pieces of third point data relative to the pieces of target point data;

obtaining a plurality of step vectors corresponding to the pieces of third point data, respectively, when said registering converges, and obtaining a plurality of effective values according to directions of the step vectors; and

outputting a localization fault detection result based on an intersection of the matching scores and the effective values,

wherein the processing device performing outputting the localization fault detection result based on the intersection of the matching scores and the effective values comprises:

obtaining a distribution of the matching scores relative to the effective values;

setting a first point at the distribution according to an average value of the matching scores;

setting a second point at the distribution according to a plurality of positive effective values among the effective values;

setting a third point at the distribution according to a plurality of negative effective values among the effective values;

setting an ineffective range with the first point, the second point and the third point;

calculating an ineffective ratio of a part of the pieces of third point data falling in the ineffective range relative to the pieces of third point data; and

outputting the localization fault detection result according to the ineffective ratio and an ineffective threshold;

wherein the localization fault detection result is outputted to an automobile computer, for the automobile computer to use the localization fault detection result for positioning.

6 . The point cloud positioning error detection system according to claim 5 , wherein the processing device performing calculating the matching scores of the pieces of third point data relative to the pieces of target point data comprises:

for each of the pieces of third point data as a target piece of third point data, performing:

determining one or more pieces of target point data among the pieces of target point data, wherein a distance between each of the one or more pieces of target point data and the target piece of third point data is not greater than a second default distance;

calculating one or more distances between the one or more pieces of target point data and the target piece of third point data; and

designating the matching score according to a comparison result of the distances and a third default distance,

wherein the matching score is inversely proportional to the distances.

7 . The point cloud positioning error detection system according to claim 5 , wherein the processing device performing selecting the pieces of third point data from the pieces of second point data according to the first default distance comprises:

for each of the pieces of second point data as a target piece of second point data, performing:

determining a piece of target point data among the pieces of target point data closest to the target piece of second point data;

determining whether a distance between the piece of target point data and the target piece of second point data is greater than the first default distance;

if the distance is greater than the first default distance, abandoning the target piece of second point data; and

if the distance is not greater than the first default distance, using the target piece of second point data as one of the pieces of third point data.

8 . The point cloud positioning error detection system according to claim 5 , wherein the processing device performing obtaining the effective values according to the directions of the step vectors comprises:

enclosing the pieces of third point data according to a default three-dimensional block to obtain a plurality of point cloud blocks;

determining a plurality of normal vectors of the point cloud blocks;

determining a component of each one of the step vectors on a corresponding one of the normal vectors;

if a direction of the component is in a positive direction, setting the effective value to be positive; and

if the direction of the component is in a negative direction, setting the effective value to be negative.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2023
From: HSIEH, WEI-YUAN; WU, MING-XUAN; HU, CHIA-JUI
To: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE
Reel/Frame 062697/0833 →
Priority Claims (1)
TW 111143155 · Nov 11, 2022 · national
Continuity (2)
Provisional Application 63408689 · Sep 21, 2022
Related Publication 20240094362A1 · Mar 21, 2024
References Cited (24)
US 10082797B2 · Micks et al. · 2018 [cited by applicant]
US 10565457B2 · Luo et al. · 2020 [cited by applicant]
US 10628949B2 · Aflalo et al. · 2020 [cited by applicant]
US 20160065534A1 · Liu · 2016 [cited by examiner]
US 20170046840A1 · Chen et al. · 2017 [cited by applicant]
US 20200234491A1 · Pöyhtäri · 2020 [cited by examiner]
US 20210025998A1 · Huber · 2021 [cited by applicant]
US 20230052072A1 · Jia et al. · 2023 [cited by applicant]
CN 104700451B · 2015 [cited by applicant]
CN 106546977A · 2017 [cited by applicant]
CN 105976312B · 2019 [cited by applicant]
CN 109270545B · 2020 [cited by applicant]
CN 114387319A · 2022 [cited by applicant]
CN 114565726A · 2022 [cited by applicant]
TW I617995B · 2018 [cited by applicant]
“Towards a Point Cloud Structural Similarity Metric,” 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), London, UK, 2020 (Year: 2020). [cited by examiner]
Biber, Peter et al. “The Normal Distributions Transform: A New Approach to Laser Scan Matching.” IEEE International Conference on Intelligent Robots and Systems. 3. 2743-2748 vol. 3. 10.1109/IROS.2003.1249285. (Year: 20… [cited by examiner]
TW Office Action dated Mar. 21, 2024 as received in Application No. 111143155. [cited by applicant]
Salti et al. “A Performance Evaluation of 3D Keypoint Detectors” 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, May 2011. [cited by applicant]
Deng et al. “A Robust Loss for Point Cloud Registration” Aug. 2021 IEEE/CVF International Conference on Computer Vision (ICCV) pp. 6118-6127. [cited by applicant]
Yang et al. “An analytical approach to evaluate point cloud registration error utilizing targets” ISPRS Journal of Photogrammetry and Remote Sensing vol. 143, Sep. 2018, pp. 48-56. [cited by applicant]
Lachhani et al. “Error Metric for Indoor 3D Point Cloud Registration” Conference: Irish Machine Vision and Image Processing Conferencevol. 2014 Aug. 2014. [cited by applicant]
Bueno et al. “Evaluation of point cloud registration using Monte Carlo method” Measurement vol. 92, Oct. 2016, pp. 264-270. [cited by applicant]
Shen et al. “Reliable Inlier Evaluation for Unsupervised Point Cloud Registration” The Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI-22) Feb. 2022. [cited by applicant]