IP Library Granted Patent US 11,506,500
Granted Patent B2
US 11,506,500 · App. 17/202,602 · Granted Nov 22, 2022

Aligning measured signal data with SLAM localization data and uses thereof

Inventors: Ji Zhang (Pittsburgh, PA); Kevin Joseph Dowling (Gibsonia, PA)
Assignee: Kaarta, Inc.
G01C21/206G01C21/165G01S5/0252G06T17/05H04W4/029H04W4/38H04W84/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,506,500
App. No.
17/202,602
Granted
Nov 22, 2022
Kind
B2
Abstract

A method includes retrieving a map of a 3D geometry of an environment the map including a plurality of non-spatial attribute values each corresponding to one of a plurality of non-spatial attributes and indicative of a plurality of non-spatial sensor readings acquired throughout the environment, receiving a plurality of sensor readings from a device within the environment wherein each of the sensor readings corresponds to at least one of the non-spatial attributes and matching the plurality of received sensor readings to at least one location in the map to produce a determined sensor location.

Claims (42)

1. A method comprising:

obtaining a map of a 3D geometry of an environment;

receiving a plurality of sensor readings from a plurality of sensors of a device within the environment wherein each of the sensor readings corresponds to at least one non-spatial attribute of a location within the environment; and

matching the plurality of received sensor readings to a representative corresponding location in the map to produce a resulting map of 3D aspects of the environment, the map comprising at least one non-spatial attribute value for each non-spatial attribute at the corresponding location within the environment,

wherein time information is used to synchronize the sensor readings with the location in the map.

2. The method of claim 1 , wherein obtaining a map further comprises:

obtaining point cloud data from at least one of the plurality of sensors.

3. The method of claim 2 , further comprising:

receiving a pulse-per-second (PPS) signal;

generating synchronization signals for the plurality of sensors based on the PPS signal; and

generating the time information based on the synchronization signals.

4. The method of claim 3 , wherein the synchronization signals are configured based on a type of sensor.

5. The method of claim 1 , further comprising:

sending a pulse-per-second (PPS) signal to the plurality of sensors;

triggering the sensor readings in synchronization with the PPS signal;

sending a time string to the plurality of sensors in association with the PPS signal; and

associating the time string with the sensor readings.

6. The method of claim 1 , wherein each of the sensor readings is derived from at least one of LIDAR, a camera, a depth camera, an infrared camera, an IMU, an ultrasonic sensor, a Wi-Fi sensor, a Bluetooth sensor, a temperature sensor, magnetometer, SONAR, RADAR, X-ray imaging, magnetic resonance imaging, tomography imaging, ground penetrating radar, radioactivity detector, or a barometer.

7. The method of claim 1 , wherein a portion of the plurality of non-spatial attribute values are determined via an interpolation of the non-spatial sensor readings.

8. The method of claim 1 , wherein the received plurality of sensor readings correspond to a generally stationary position of the device.

9. The method of claim 1 , wherein the received plurality of sensor readings correspond to a movement of the device through the environment.

10. The method of claim 1 , wherein non-spatial attributes include at least one of a radio frequency, a thermal, a visual, an acoustic, an electrical, a magnetic, or a radioactive attribute.

11. A system comprising:

a device comprising at least one sensor the device adapted to receive a plurality of sensor readings within an environment wherein each of the sensor readings corresponds to at least one non-spatial attribute; and

a processor adapted to obtain a map of a 3D geometry of the environment, the map comprising a plurality of non-spatial attribute values each corresponding to one of a plurality of non-spatial attributes and indicative of a plurality of non-spatial sensor readings acquired throughout the environment, wherein the processor is further adapted to match the plurality of received sensor readings to at least one location in the map,

wherein time information is used to synchronize the sensor readings with the at least one location in the map.

12. The system of claim 11 , wherein the processor is adapted to obtain a map by obtaining point cloud data from at least one of the plurality of sensors.

13. The system of claim 12 , wherein the processor is configured to generate a time string associated with the sensor readings by:

receiving a pulse-per-second (PPS) signal;

generating synchronization signals for the plurality of sensors based on the PPS signal; and

generating the time information based on the synchronization signals.

14. The system of claim 13 , wherein the synchronization signals are configured based on a type of sensor.

15. The system of claim 11 , wherein the processor is configured to generate a time string associated with the sensor readings by:

sending a pulse-per-second (PPS) signal to the plurality of sensors;

triggering the sensor readings in synchronization with the PPS signal;

sending the time string to the plurality of sensors is association with the PPS signal; and

associating the time string with the sensor readings.

16. The system of claim 11 , wherein each of the sensor readings is derived from at least one of LIDAR, a camera, a depth camera, an infrared camera, an IMU, an ultrasonic sensor, a Wi-Fi sensor, a Bluetooth sensor, a temperature sensor, magnetometer, SONAR, RADAR, X-ray imaging, magnetic resonance imaging, tomography imaging, ground penetrating radar, radioactivity detector, or a barometer.

17. The system of claim 11 , wherein a portion of the plurality of non-spatial attribute values are determined via an interpolation of the non-spatial sensor readings.

18. The system of claim 11 , wherein the received plurality of sensor readings correspond to a generally stationary position of the device.

19. The system of claim 11 , wherein the received plurality of sensor readings correspond to a movement of the device through the environment.

20. The system of claim 11 , wherein non-spatial attributes include at least one of a radio frequency, a thermal, a visual, an acoustic, an electrical, a magnetic, or a radioactive attribute.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2023
From: KAARTA, INC.
To: CARNEGIE MELLON UNIVERSITY
Reel/Frame 064603/0891 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2021
From: ZHANG, JI; DOWLING, KEVIN JOSEPH
To: KAARTA, INC.
Reel/Frame 055712/0361 →
Continuity (14)
Continuation 16745775 · Jan 17, 2020
Continuation PCTUS2018042346 · Jul 16, 2018
Continuation In Part PCTUS2018040269 · Jun 29, 2018
Continuation PCTUS2018015403 · Jan 26, 2018
Continuation In Part PCTUS2018015403 · Jan 26, 2018
Continuation In Part PCTUS2017055938 · Oct 10, 2017
Continuation In Part PCTUS2017021120 · Mar 7, 2017
Continuation PCTUS2017021120 · Mar 7, 2017
Provisional Application 62533261 · Jul 17, 2017
Provisional Application 62527341 · Jun 30, 2017
Provisional Application 62451294 · Jan 27, 2017
Provisional Application 62406910 · Oct 11, 2016
Provisional Application 62307061 · Mar 11, 2016
Related Publication 20210293546A1 · Sep 23, 2021
Cited By (1)
US 12,307,704