IP Library Granted Patent US 10,663,584
Granted Patent B2
US 10,663,584 · App. 15/606,573 · Granted May 26, 2020

Publishing LIDAR cluster data

Inventors: Katsuhiro Sakai (Ann Arbor, MI); Nobuhide Kamata (Ann Arbor, MI); Michael J. Delp (Ann Arbor, MI); Michael R. James (Northville, MI)
Assignee: Toyota Motor Engineering & Manufacturing North America, Inc.
G01S17/08G01S7/003G01S7/4808G01S17/42G01S17/66G01S17/89G01S17/936B60Y2400/301
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,663,584
App. No.
15/606,573
Granted
May 26, 2020
Kind
B2
Abstract

Systems and methods for publishing LIDAR cluster data are described. The vehicle can identify one or more clusters based on data from the LIDAR sensor. The identified one or more clusters can be representative of at least one object in an external environment of the vehicle. Additionally, the vehicle can publish the identified one or more clusters before the LIDAR sensor completes a full 360 degree rotation about the axis of rotation.

Claims (70)

1. A system for publishing cluster data in a vehicle, the system comprising:

a LIDAR sensor configured to rotate 360 degrees about an axis of rotation;

one or more processors operatively connected to the LIDAR sensor; and

memory operatively connected to the one or more processors, the memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:

identify one or more clusters based on data received from the LIDAR sensor, the identified one or more clusters being representative of at least one object in an external environment of the vehicle; and

publish the identified one or more clusters before the LIDAR sensor completes a full 360 degree rotation about the axis of rotation by:

identifying a perceived end of a first cluster of the one or more clusters;

determining whether data from any of the one or more clusters is present within a threshold discontinuity interval following the perceived end of the first cluster as subsequent data is received from the LIDAR sensor; and

publishing at least the first cluster if no data from the one or more clusters is present within the threshold discontinuity interval.

2. The system of claim 1 , wherein identify one or more clusters based on data from the LIDAR sensor comprises:

receive point cloud data as the LIDAR sensor is rotating about the axis of rotation; and

identify one or more clusters in the point cloud data.

3. The system of claim 1 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to refrain from publishing at least the first cluster responsive to data from the one or more clusters being present within the threshold discontinuity interval.

4. The system of claim 1 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

monitor an angle from a start of the first cluster responsive to data from the one or more clusters being present within the threshold discontinuity interval while the one or more processors:

identify a second cluster as subsequent data is received from the LIDAR sensor;

identify a perceived end of the second cluster;

determine whether data from any of the one or more clusters is present within a threshold discontinuity interval following the perceived end of the second cluster; and

if no data from the one or more clusters is present within the threshold discontinuity interval, publish at least the first and second cluster before the LIDAR sensor completes a full 360 degree rotation about the axis of rotation.

5. The system of claim 4 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

compare the angle from the start of the first cluster to a publishing threshold angle; and

publish at least one cluster from within the angle responsive to the angle being greater than the publishing threshold angle.

6. The system of claim 5 , the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

store data from the LIDAR sensor that was not published, the stored data being published before the LIDAR sensor completes a full 360 degree rotation about the axis of rotation.

7. The system of claim 1 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

determine one or more maneuvers for the vehicle to execute based at least in part on the published one or more clusters; and

generate one or more control signals to cause the vehicle to execute the one or more maneuvers.

8. A system for publishing cluster data in a vehicle, the system comprising:

a LIDAR sensor rotating about an axis of rotation, the LIDAR sensor transmitting a signal and generating data responsive to detecting the transmitted signal reflected off a surface;

one or more processors communicably coupled to the LIDAR sensor; and

memory communicably coupled to the one or more processors, the memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:

receive point cloud data generated by the LIDAR sensor as the LIDAR sensor is rotating;

identify one or more clusters in the point cloud data, the identified one or more clusters being representative of at least one object in an external environment of the vehicle;

identify a perceived end of a first cluster of the one or more clusters;

determine whether data from any of the one or more clusters is present within a threshold discontinuity interval following the perceived end of the first cluster as subsequent point cloud data is received;

publish at least the first cluster if no data from the one or more clusters is present within the threshold discontinuity interval; and

refrain from publishing at least the first cluster if data from the one or more clusters is present within the threshold discontinuity interval.

9. The system of claim 8 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

monitor an angle from a start of the first cluster responsive to data from the one or more clusters being present within the threshold discontinuity interval while the one or more processors:

identify a second cluster as subsequent point cloud data is received;

identify a perceived end of the second cluster;

determine whether data from any of the one or more clusters is present within a threshold discontinuity interval following the perceived end of the second cluster; and

if no data from the one or more clusters is present within the threshold discontinuity interval, publish at least the first and second cluster prior to a full rotation of the LIDAR sensor.

10. The system of claim 9 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

compare the angle from the start of the first cluster to a publishing threshold angle; and

publish at least one cluster from within the angle responsive to the angle being greater than the publishing threshold angle.

11. The system of claim 10 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

store data from the point cloud that was not published, the stored data being published prior to a complete 360° rotation of the LIDAR sensor.

12. The system of claim 8 , wherein the memory further includes instructions that, when executed by the one or more processors, cause the one or more processors to:

determine one or more maneuvers for the vehicle to execute based at least in part on the published first cluster; and

generate one or more control signals to cause the vehicle to execute the one or more maneuvers.

13. A method of publishing cluster data in a vehicle, the method comprising:

identifying one or more clusters based on data from a LIDAR sensor as the LIDAR sensor rotates about an axis of rotation, the identified one or more clusters being representative of at least one object in an external environment of the vehicle; and

publishing the identified one or more clusters before the LIDAR sensor completes a full 360 degree rotation about the axis of rotation by:

identifying a perceived end of a first cluster of the one or more clusters;

determining whether data from any of the one or more clusters is present within a threshold discontinuity interval following the perceived end of the first cluster as subsequent data is received from the LIDAR sensor; and

publishing at least the first cluster if no data from the one or more clusters is present within the threshold discontinuity interval.

14. The method of claim 13 , further comprising:

if data from the one or more clusters is present within the threshold discontinuity interval, not publishing at least the first cluster.

15. The method of claim 13 , further comprising:

if data from any of the one or more clusters is present within the threshold discontinuity interval, monitoring an angle from a start of the first cluster while performing the following:

identifying a second cluster as subsequent point cloud data is received;

identifying a perceived end of the second cluster;

determining whether data from any of the one or more clusters is present within a threshold discontinuity interval following the perceived end of the second cluster; and

if no data from the one or more clusters is present within the threshold discontinuity interval, publishing at least the first and second cluster prior to a full rotation of the LIDAR sensor.

16. The method of claim 15 , further comprising:

comparing the angle to a publishing threshold angle; and

publishing at least one cluster from within the angle responsive to the angle being greater than the publishing threshold angle.

17. The method of claim 16 , wherein the threshold discontinuity interval is a fixed angle.

18. The method of claim 16 , wherein a size of the threshold discontinuity interval is a function of a distance to the perceived end of the first cluster.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 052764/0156 →
CHANGE OF ADDRESS Recorded Nov 30, 2018
From: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 047688/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2017
From: SAKAI, KATSUHIRO; KAMATA, NOBUHIDE; DELP, MICHAEL J.; JAMES, MICHAEL R.
To: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
Reel/Frame 042625/0305 →
Continuity (1)
Related Publication 20180341019A1 · Nov 29, 2018
Cited By (3)
US 12,399,278 US 12,399,279 US 12,405,356