IP Library Granted Patent US 11,543,506
Granted Patent B2
US 11,543,506 · App. 16/912,176 · Granted Jan 3, 2023

Method and computer device for calibrating LIDAR system

Inventor: Andrey Sergeevich Voynov (Moscow, RU)
Assignee: YANDEX SELF DRIVING GROUP LLC
G01S7/497B60W50/06B60W60/0025G01S7/4808B60W2420/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,543,506
App. No.
16/912,176
Granted
Jan 3, 2023
Kind
B2
Abstract

Methods and devices for determining axis of symmetry of self-driving vehicle (SDV) and for calibrating a Light Detection and Ranging (LIDAR) system are disclosed. One of the axes of the system of coordinates of the LIDAR system extends along a normal direction of a ground surface. the method includes acquiring a subset of detected points in the system of coordinates; generating a subset of mirror-image points based on the subset of detected points; projecting the subset of mirror-image points onto the subset of detected points so as to define pairs of overlapping data points; using symmetrically opposite detected points for determining the axis of symmetry of the SDV in the system of coordinates of the LIDAR system; and calibrating the LIDAR system using an angular offset between the axis of symmetry of the SDV and an other one of the axes of the system of coordinates of the LIDAR system.

Claims (68)

1. A method of calibrating a Light Detection and Ranging (LIDAR) system, the LIDAR system having a system of coordinates, the system of coordinates having axes, one of the axes extending along a normal direction of a ground surface, the LIDAR system mountable on a self-driving vehicle (SDV), the SDV located on the ground surface, the method executable by an electronic device associated with the SDV, the method comprising:

acquiring, by the electronic device, from the LIDAR system a subset of detected data points in the system of coordinates of the LIDAR system and representing an outer surface of the SDV,

the subset of detected data points being a subset of a plurality of detected data points of the LIDAR system;

generating, by the electronic device, a subset of mirror-image data points based on the subset of detected data points,

the subset of mirror-image data points representing a mirror-image of the outer surface of the SDV;

projecting, by the electronic device, the subset of mirror-image data points onto the subset of detected data points so as to define pairs of overlapping data points,

each given pair of overlapping data points including:

(i) a first data point from the subset of detected data points and (ii) a second data point from the subset of mirror-image data points,

such that the second data point is a mirror-image of a third data point in the subset of detected data points that is symmetrically opposite to the first data point;

using, by the electronic device, (i) at least two first data points and (ii) at least two respective third data points that are symmetrically opposite to the at least two first data points for determining the axis of symmetry of the SDV in the system of coordinates of the LIDAR system; and

calibrating, by the electronic device, the LIDAR system using an angular offset between the axis of symmetry of the SDV and an other one of the axes of the system of coordinates of the LIDAR system.

2. The method of claim 1 , wherein the method further comprises, prior to the acquiring the subset of detected data points:

acquiring the plurality of detected data points from the LIDAR system.

3. The method of claim 2 , wherein the method further comprises:

filtering, by the electronic device, the plurality of detected data points for determining the subset of detected data points.

4. The method of claim 3 , wherein the filtering the plurality of detected data points comprises:

applying, by the electronic device, an approximation rule onto the plurality of detected data points detected by the LIDAR system.

5. The method of claim 4 , wherein the approximation rule comprises:

an indication of a threshold distance deemed to include the detected subset of data points.

6. The method of claim 1 , wherein the method further comprises, prior to acquiring the plurality of detected data points:

providing, by the electronic device, an indication to increase the outer surface of the SDV.

7. The method of claim 6 , wherein the providing the indication to increase the outer surface comprises:

providing, by the electronic device, an indication to fully open opposite doors of the SDV.

8. The method of claim 6 , wherein the providing the indication to increase the outer surface further comprises:

providing, by the electronic device, an indication to fully open a trunk of the SDV.

9. The method of claim 1 , wherein the projecting, by the electronic device, the subset of mirror-image data points onto the subset of detected data points comprises:

iteratively minimizing, by the electronic device, the distance between the subset of mirror-image data points and the subset of detected data points.

10. The method of claim 9 , wherein the iteratively minimizing the distance comprises determining a transformation rule between the subset of mirror-image data points and the subset of detected data points so as to:

overlap a given mirror-image data point with a given detected data point,

the given mirror-image data point having been generated based on a given other detected point that is symmetrically opposite to the given detected data point.

11. The method of claim 10 , wherein the iteratively minimizing the distance comprises:

applying, by the electronic device, an Iterative Closest Point (ICP) algorithm.

12. The method of claim 1 , wherein the (i) at least two first data points and (ii) at least two respective third data points comprises, respectively, two first data points and (ii) two respective third data points.

13. The method of claim 1 , wherein the (i) at least two first data points and (ii) at least two respective third data points comprises, respectively, three first data points and (ii) three respective third data points.

14. The method of claim 1 , wherein the using (i) at least two first data points and (ii) at least two respective third data points that are symmetrically opposite to the at least two first data points for determining the axis of symmetry of the SDV comprises:

selecting, by the electronic device, the (i) at least two first data points and (ii) at least two respective third data points;

for each pair of the (i) at least two first data points and (ii) at least two respective third data points, determining, by the electronic device, a mid point; and

determining, by the electronic device, a line through the respective mid points as the axis of symmetry of the SDV.

15. The method of claim 1 , wherein the system of coordinates of the LIDAR system has three orthogonal axes.

16. The method of claim 1 , wherein the plurality of detected data points is gathered in a system of spherical coordinates and is mapped to the system of coordinates of the LIDAR system having three orthogonal axes.

17. The method of claim 1 , wherein the method further comprises, prior to the calibrating:

determining, by the electronic device, the normal direction of the ground surface based on the plurality of detected data points of the LIDAR system;

anchoring, by the electronic device, the one of the axes of the system of coordinates based on the normal direction of the ground surface,

such that the one of the axes extends in the normal direction.

18. The method of claim 1 , wherein the method further comprises:

determining, by the electronic device, the angular offset between the axis of symmetry of the SDV and the one of the axes of the system of coordinates of the LIDAR system.

19. The method of claim 1 , wherein the method further comprises iteratively repeating the calibrating the LIDAR system during operation of the SDV.

20. A method of determining an axis of symmetry of a self-driving vehicle (SDV), the SDV being mountable with a Light Detection and Ranging (LIDAR) system, the LIDAR system having a system of coordinates, the system of coordinates having axes, the method executable by an electronic device associated with the SDV, the method comprising:

acquiring, by the electronic device, from the LIDAR system a subset of detected data points in the system of coordinates of the LIDAR system and representing an outer surface of the SDV,

the subset of detected data points being a subset of a plurality of detected data points of the LIDAR system;

generating, by the electronic device, a subset of mirror-image data points based on the subset of detected data points,

the subset of mirror-image data points representing a mirror-image of the outer surface of the SDV;

projecting, by the electronic device, the subset of mirror-image data points onto the subset of detected data points so as to define pairs of overlapping data points,

each given pair of overlapping data points including:

(i) a first data point from the subset of detected data points and (ii) a second data point from the subset of mirror-image data points,

such that the second data point is a mirror-image of a third data point in the subset of detected data points that is symmetrically opposite to the first data point;

using, by the electronic device, (i) at least two first data points and (ii) at least two respective third data points that are symmetrically opposite to the at least two first data points for determining the axis of symmetry of the SDV in the system of coordinates of the LIDAR system.

21. An electronic device for calibrating a Light Detection and Ranging (LIDAR) system, the LIDAR system having a system of coordinates, the system of coordinates having axes, one of the axes extending along a normal direction of a ground surface, the LIDAR system mountable on a self-driving vehicle (SDV), the SDV located on the ground surface, the electronic device being configured to:

acquire from the LIDAR system a subset of detected data points in the system of coordinates of the LIDAR system and representing an outer surface of the SDV,

the subset of detected data points being a subset of a plurality of detected data points of the LIDAR system;

generate a subset of mirror-image data points based on the subset of detected data points,

the subset of mirror-image data points representing a mirror-image of the outer surface of the SDV;

project the subset of mirror-image data points onto the subset of detected data points so as to define pairs of overlapping data points,

each given pair of overlapping data points including:

(i) a first data point from the subset of detected data points and (ii) a second data point from the subset of mirror-image data points,

such that the second data point is a mirror-image of a third data point in the subset of detected data points that is symmetrically opposite to the first data point;

use (i) at least two first data points and (ii) at least two respective third data points that are symmetrically opposite to the at least two first data points for determining the axis of symmetry of the SDV in the system of coordinates of the LIDAR system; and

calibrate the LIDAR system using an angular offset between the axis of symmetry of the SDV and an other one of the axes of the system of coordinates of the LIDAR system.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2024
From: DIRECT CURSUS TECHNOLOGY L.L.C
To: Y.E. HUB ARMENIA LLC
Reel/Frame 068534/0619 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2023
From: YANDEX SELF DRIVING GROUP LLC
To: DIRECT CURSUS TECHNOLOGY L.L.C
Reel/Frame 065447/0048 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2022
From: VOYNOV, ANDREY SERGEEVICH
To: YANDEX.TAXI LLC
Reel/Frame 061947/0837 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2022
From: YANDEX.TAXI LLC
To: YANDEX SELF DRIVING GROUP LLC
Reel/Frame 061947/0886 →