IP Library Granted Patent US 12,189,398
Granted Patent B2
US 12,189,398 · App. 17/667,540 · Granted Jan 7, 2025

Circuitry and method

Inventors: Timo Grebner (Ulm, DE); Christian Waldschmidt (Ulm, DE); Daniel Felipe Ardila Palomino (Stuttgart, DE)
Assignee: SONY GROUP CORPORATION
G05D1/0274G05D1/0088G05D1/0257G05D1/0278
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,189,398
App. No.
17/667,540
Granted
Jan 7, 2025
Kind
B2
Abstract

A circuitry for simultaneous localization and mapping for a mobile platform, wherein the circuitry is configured to: estimate, based on obtained radar detection data, an ego-motion of the mobile platform; and update, based on the estimated ego-motion and the obtained radar detection data, a set of particles, wherein each particle of the set of particles includes a location and an orientation of the mobile platform and an occupancy grid map that represents an environment of the mobile platform, wherein the occupancy grid map includes a plurality of cells and each cell of the plurality of cells is assigned an occupation probability which indicates a probability that the cell is occupied by a target.

Claims (34)

1. A circuitry for simultaneous localization and mapping for a mobile platform, the circuitry being configured to:

estimate, based on obtained radar detection data, an ego-motion of the mobile platform,

update, based on the estimated ego-motion and the obtained radar detection data, a set of particles, wherein each particle of the set of particles includes a location and an orientation of the mobile platform and an occupancy grid map that represents an environment of the mobile platform, wherein the occupancy grid map includes a plurality of cells and each cell of the plurality of cells is assigned an occupation probability which indicates a probability that the cell is occupied by a target, and

estimate, based on the obtained radar detection data, a location of the target, wherein the occupation probability is updated based on the estimated location of the target,

wherein the occupation probability is updated further based on a detection probability of the target, wherein the detection probability is based on a first probability distribution of a distance of the target to the mobile platform, a second probability distribution for a detection angle of the target to a radar sensor on the mobile platform, and a third probability distribution for a detection noise level of the target.

2. The circuitry according to claim 1 , wherein the circuitry is further configured to determine a particle weight for each particle of the set of particles, wherein the particle weight indicates a quality estimation of the particle.

3. The circuitry according to claim 2 , wherein the particle weight of each particle of the set of particles is determined based on the occupation probability of at least a part of the cells of the plurality of cells of the occupancy grid map of the particle.

4. The circuitry according to claim 3 , wherein the particle weight is determined based on a number of targets in the occupancy grid map.

5. The circuitry according to claim 3 , wherein the particle weight is determined based on an average probability of the occupancy grid map in a local update area corresponding to local grids of the radar sensors.

6. The circuitry according to claim 3 , wherein the particle weight is determined by multiplying a particle weight determined based on a number of targets in the occupancy grid map with a particle weight determined based on an average probability of the occupancy grid map in a local update area corresponding to local grids of the radar sensors.

7. The circuitry according to claim 2 , wherein the circuitry is further configured to perform particle resampling when the particle weight of a predetermined number of particles of the set of particles is below a predetermined threshold.

8. The circuitry according to claim 7 , wherein the particle resampling includes drawing with replacement from the set of particles, wherein a probability that a particle of the set of particles is drawn is based on the corresponding particle weight of the particle.

9. The circuitry according to claim 1 , wherein the circuitry is further configured to perform dead reckoning based on the estimated ego-motion, wherein the location and the orientation of the mobile platform of each particle of the set of particles are updated based on the dead reckoning.

10. The circuitry according to claim 1 , wherein the circuitry is further configured to perform scattering of at least one of the location and the orientation of the mobile platform, wherein at least one of the location and the orientation of the mobile platform is updated based on the scattering.

11. The circuitry according to claim 10 , wherein the circuitry is further configured to

determine a location of the target based on the scattered location and orientation of the mobile platform.

12. The circuitry according to claim 1 , wherein the circuitry is further configured to initialize the occupancy grid map of each particle of the set of particles based on a free-space model.

13. A method for simultaneous localization and mapping for a mobile platform, the method comprising:

estimating, based on obtained radar detection data, an ego-motion of the mobile platform;

updating, based on the estimated ego-motion and the obtained radar detection data, a set of particles, wherein each particle of the set of particles includes a location and an orientation of the mobile platform and an occupancy grid map that represents an environment of the mobile platform, wherein the occupancy grid map includes a plurality of cells and each cell of the plurality of cells is assigned an occupation probability which indicates a probability that the cell is occupied by a target; and

estimating, based on the obtained radar detection data, a location of the target, wherein the occupation probability is updated based on the estimated location of the target,

wherein the occupation probability is updated further based on a detection probability of the target, wherein the detection probability is based on a first probability distribution of a distance of the target to the mobile platform, a second probability distribution for a detection angle of the target to a radar sensor on the mobile platform, and a third probability distribution for a detection noise level of the target.

14. The method according to claim 13 , further comprising:

determining a particle weight for each particle of the set of particles, wherein the particle weight indicates a quality estimation of the particle.

15. The method according to claim 14 , wherein the particle weight of each particle of the set of particles is determined based on the occupation probability of at least a part of the cells of the plurality of cells of the occupancy grid map of the particle.

16. The method according to claim 14 , further comprising:

performing particle resampling when the particle weight of a predetermined number of particles of the set of particles is below a predetermined threshold.

17. The method according to claim 16 , wherein the particle resampling includes drawing with replacement from the set of particles, wherein a probability that a particle of the set of particles is drawn is based on the corresponding particle weight of the particle.

18. The method according to claim 13 , further comprising:

performing dead reckoning based on the estimated ego-motion, wherein the location and the orientation of the mobile platform of each particle of the set of particles are updated based on the dead reckoning.

19. The method according to claim 13 , further comprising:

performing scattering of at least one of the location and the orientation of the mobile platform, wherein at least one of the location and the orientation of the mobile platform is updated based on the scattering.

20. The method according to claim 13 , further comprising:

initializing the occupancy grid map of each particle of the set of particles based on a free-space model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2022
From: GREBNER, TIMO; WALDSCHMIDT, CHRISTIAN; PALOMINO, DANIEL FELIPE ARDILA
To: SONY GROUP CORPORATION
Reel/Frame 059091/0072 →
CHANGE OF NAME Recorded Feb 9, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 059053/0826 →
Priority Claims (1)
EP 21157448 · Feb 16, 2021 · regional
Continuity (1)
Related Publication 20220261008A1 · Aug 18, 2022
References Cited (24)
US 11274929B1 · Afrouzi · 2022 [cited by examiner]
US 20020003488A1 · Levin · 2002 [cited by examiner]
US 20140129027A1 · Schnittman · 2014 [cited by examiner]
US 20180345958A1 · Lo · 2018 [cited by examiner]
US 20190384318A1 · Fuchs · 2019 [cited by examiner]
US 20200103523A1 · Liu · 2020 [cited by examiner]
US 20200307561A1 · Bush · 2020 [cited by examiner]
US 20200341486A1 · Dia · 2020 [cited by examiner]
US 20200370920A1 · Ahmed · 2020 [cited by examiner]
US 20200409382A1 · Herman · 2020 [cited by examiner]
US 20210101624A1 · Philbin · 2021 [cited by examiner]
CN 108759833A · 2018 [cited by applicant]
CN 110007670A · 2019 [cited by examiner]
CN 110888125B · 2020 [cited by applicant]
CN 112306058A · 2021 [cited by examiner]
CN 115113629A · 2022 [cited by examiner]
DE 102020210380A1 · 2022 [cited by examiner]
EP 2479584A2 · 2012 [cited by examiner]
WO 2019185739A1 · 2019 [cited by applicant]
Rlabbe (2020, Oct. 13). “Kalman-and-Bayesian-Filters-in-Python” https://github.com/rlabbe/Kalman-and-Bayesian-Filters-in-Python/blob/f15d2b5316aa6171e21539e823a24fc241840b68/12- Particle-Filters.ipynb (Year: 2020). [cited by examiner]
Anonymous. “Detection of Signals in Noise.” Archive.Org, Aug. 30, 2017, web.archive.org/web/20170830045122/https://123.physics.ucdavis.edu/week_5_files/filters/matched_filter.pdf. (Year: 2017). [cited by examiner]
Schneider, Barry. Army Research Laboratory, 1999, A Matlab Radar Range Equation and Probability of Detection Evaluation Tool, https://apps.dtic.mil/sti/tr/pdf/ADA360040.pdf. Accessed 2 Sep. 2024. (Year: 1999). [cited by examiner]
Deusch Hendrik: “Random Finite Set-Based Localization and SLAM for Highly Automated Vehicles”, Schriftenreihe des Instituts fur Mess-, Regel-und Mikrotechnik, Universitat Ulm, Dec. 1, 2016, XP055843799, 149 pages. [cited by applicant]
Steiner et al., “Ego-Motion Estimation Using Distributed Single-Channel Radar Sensors”, DOI: 10.1109/ICMIM.2018.8443509, 2018, 5 pages. [cited by applicant]