IP Library Granted Patent US 12,228,939
Granted Patent B2
US 12,228,939 · App. 16/912,758 · Granted Feb 18, 2025

Occupancy verification device and method

Inventors: Cornelius Buerkle (Karlsruhe, DE); Fabian Oboril (Karlsruhe, DE)
Assignee: Intel Corporation
G05D1/0253B60W60/0016G05D1/0217G06T7/70G06V20/56G06T2207/20084G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,228,939
App. No.
16/912,758
Granted
Feb 18, 2025
Kind
B2
Abstract

An occupancy verification including one or more processors, configured to receive occupancy grid data representing a plurality of cells of an occupancy grid and for each cell of the plurality of cells, a probability of whether the cell is occupied; receive object location data, representing one or more locations of one or more objects identified using a model; map the object location data to one or more cells of the plurality of cells based on the one or more locations of the one or more objects; determine comparison grid data, representing the plurality of cells of the occupancy grid and for each cell of the plurality of cells, a probability of whether the cell is occupied based on whether the object location data are mapped to the cell; and compare the occupancy grid data to the comparison grid data using at least one comparing rule.

Claims (34)

1. An occupancy grid data verification device, comprising: an artificial neural network, configured to receive sensor data and to output object location data using the sensor data, wherein the object location data represent one or more locations of one or more objects as determined by the artificial neural network; one or more processors, configured to:

receive occupancy grid data, representing a plurality of cells of an occupancy grid for an autonomous driving system and for each cell of the plurality of cells, receive data representing a probability of whether the cell is occupied;

map the object location data to one or more cells of the plurality of cells of the occupancy grid based on the one or more locations of the one or more objects;

determine comparison grid data, wherein determining the comparison grid data comprises determining an occupancy status for each cell of the plurality of cells based on whether the object location data are mapped to the cell;

compare the occupancy grid data to the comparison grid data using at least one comparing rule;

output trust data representing a result of the comparison;

wherein the occupancy grid data further represent velocities associated with one or more cells of the plurality of cells; and wherein the object location data further represent velocities of the one or more objects; and wherein the one or more processors are further configured to:

determine velocity comparison grid data, wherein determining the velocity comparison grid data comprises determining a velocity associated with each cell of the plurality of cells based on a velocity of an object from the object location data that is mapped to the cell;

compare the velocities of the occupancy grid data with the velocity comparison grid data based on at least one velocity comparing rule; and

output velocity trust data representing a result of the comparison.

2. The occupancy verification device of claim 1 , wherein the at least one comparing rule comprises determining a distance between the occupancy grid data and the comparison grid data in accordance with a pre-defined distance metric.

3. The occupancy verification device of claim 2 , wherein the at least one comparing rule comprises determining a Bhattacharyya distance between the occupancy grid data and the comparison grid data.

4. The occupancy verification device of claim 1 , wherein determining the comparison grid data comprises determining the occupancy status as occupied if one or more objects represented by the object location data are mapped to the cell and determining the occupancy status as non-occupied if none of the one or more objects represented by the object location data are mapped to the cell.

5. The occupancy verification device of claim 1 , wherein the trust data comprise a tag representing an instruction to deactivate the object, an instruction to increase an occupancy probability of one or more cells to which the object location data were mapped, an instruction to define one or more cells to which the object location data were mapped as being occupied, or an instruction not to consider an object of the one or more objects in a driving decision if a result of the comparison is outside of a predetermined range.

6. The occupancy verification device of claim 1 , wherein the locations of the one or more objects are locations relative to an ego vehicle.

7. The occupancy verification device of claim 1 , wherein the one or more processors receive the object location data from a neural network.

8. The occupancy verification device of claim 1 , wherein the at least one velocity comparing rule comprises determining a Bhattacharyya distance between the velocities of the occupancy grid data and the velocity comparison grid data.

9. A non-transitory computer readable medium, comprising instructions which, if executed, cause one or more processors to:

receive occupancy grid data, representing a plurality of cells of an occupancy grid for an autonomous driving system and for each cell of the plurality of cells, receive data representing a probability of whether the cell is occupied;

implement an artificial neural network to generate object location data based on sensor data, wherein the object location data represent one or more locations of one or more objects identified using a model;

map the object location data to one or more cells of the plurality of cells of the occupancy grid based on the one or more locations of the one or more objects;

determine comparison grid data, wherein determining the comparison grid data comprises determining an occupancy status for each cell of the plurality of cells based on whether the object location data are mapped to the cell;

compare the occupancy grid data to the comparison grid data using at least one comparing rule; and

output trust data representing a result of the comparison;

wherein the occupancy grid data further represent velocities associated with one or more cells of the plurality of cells; and wherein the object location data further represent velocities of the one or more objects; further comprising:

determining velocity comparison grid data, wherein determining the velocity

comparison grid data comprises determining a velocity associated with each cell of the plurality of cells based on a velocity of an object from the object location data that is mapped to the cell;

comparing the velocities of the occupancy grid data with the velocity comparison grid data based on at least one velocity comparing rule; and

outputting velocity trust data representing a result of the comparison.

10. The non-transitory computer readable medium of claim 9 , wherein the at least one comparing rule comprises determining a Bhattacharyya distance between the occupancy grid data and the comparison grid data.

11. The non-transitory computer readable medium of claim 9 , wherein the trust data comprise a tag representing an instruction to deactivate the object, an instruction to increase an occupancy probability of one or more cells to which the object location data were mapped, an instruction to define one or more cells to which the object location data were mapped as being occupied, or an instruction not to consider an object of the one or more objects in a driving decision if a result of the comparison is outside of a predetermined range.

12. The occupancy grid data verification device of claim 1 , wherein at least one cell of the plurality of cells comprises a stored velocity value for an object corresponding to the cell; and

wherein the processor being configured to determine the velocity comparison grid data comprises receiving a velocity value associated with an object detected by the artificial neural network and comparing this velocity value with the stored velocity value in a corresponding cell of the occupancy grid.

13. The occupancy grid data verification device of claim 1 wherein the processor receiving data representing a probability of whether the cell is occupied comprises the processor receiving data about whether the cell is currently occupied.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2020
From: BUERKLE, CORNELIUS; OBORIL, FABIAN
To: INTEL CORPORATION
Reel/Frame 053557/0933 →
Continuity (1)
Related Publication 20200326721A1 · Oct 15, 2020
References Cited (70)
US 8645480B1 · Emigh · 2014 [cited by examiner]
US 10611371B2 · Kusano · 2020 [cited by examiner]
US 11016491B1 · Millard · 2021 [cited by examiner]
US 11093759B2 · Doria · 2021 [cited by examiner]
US 11126180B1 · Kobilarov · 2021 [cited by examiner]
US 11170299B2 · Kwon · 2021 [cited by examiner]
US 11340079B1 · Ebrahimi Afrouzi · 2022 [cited by examiner]
US 11403853B2 · Murveit · 2022 [cited by examiner]
US 11409841B2 · Steyer · 2022 [cited by examiner]
US 11427210B2 · Rosman · 2022 [cited by examiner]
US 11435946B2 · Bielby · 2022 [cited by examiner]
US 11501105B2 · Kangaspunta · 2022 [cited by examiner]
US 11554795B2 · Roskopf · 2023 [cited by examiner]
US 11577722B1 · Packer · 2023 [cited by examiner]
US 11592818B2 · Tariq · 2023 [cited by examiner]
US 11630210B2 · Lin · 2023 [cited by examiner]
US 11634162B2 · Haynes · 2023 [cited by examiner]
US 11636307B2 · Urtasun · 2023 [cited by examiner]
US 11648945B2 · Sajjadi Mohammadabadi · 2023 [cited by examiner]
US 11691650B2 · Li · 2023 [cited by examiner]
US 11726492B2 · Philbin · 2023 [cited by examiner]
US 11727690B2 · Bansal · 2023 [cited by examiner]
US 11804050B1 · Milletari · 2023 [cited by examiner]
US 11900797B2 · Ramamoorthy · 2024 [cited by examiner]
US 11950166B2 · Refaat · 2024 [cited by examiner]
US 11994866B2 · Philbin · 2024 [cited by examiner]
US 20150073707A1 · Ma et al. · 2015 [cited by applicant]
US 20180188040A1 · Chen · 2018 [cited by examiner]
US 20180188043A1 · Chen · 2018 [cited by examiner]
US 20180218226A1 · Wellington · 2018 [cited by examiner]
US 20180300561A1 · Steyer et al. · 2018 [cited by applicant]
US 20190047439A1 · Natroshvili et al. · 2019 [cited by applicant]
US 20190072965A1 · Zhang · 2019 [cited by examiner]
US 20190197029A1 · Gonzalez Aguirre et al. · 2019 [cited by applicant]
US 20190226854A1 · Geissler et al. · 2019 [cited by applicant]
US 20190258251A1 · Ditty · 2019 [cited by examiner]
US 20190272446A1 · Kangaspunta · 2019 [cited by examiner]
US 20190279049A1 · Doria · 2019 [cited by examiner]
US 20190384309A1 · Silva · 2019 [cited by examiner]
US 20190391578A1 · Tariq · 2019 [cited by examiner]
US 20200103523A1 · Liu · 2020 [cited by examiner]
US 20200148215A1 · Mohajerin · 2020 [cited by examiner]
US 20200183011A1 · Lin · 2020 [cited by examiner]
US 20200192391A1 · Vora · 2020 [cited by examiner]
US 20200219264A1 · Brunner · 2020 [cited by examiner]
US 20200257931A1 · Yershov · 2020 [cited by examiner]
US 20200276988A1 · Graves · 2020 [cited by examiner]
US 20200278681A1 · Gier · 2020 [cited by examiner]
US 20200284590A1 · Chen · 2020 [cited by examiner]
US 20200293796A1 · Sajjadi Mohammadabadi · 2020 [cited by examiner]
US 20210004012A1 · Marchetti-Bowick · 2021 [cited by examiner]
US 20210101624A1 · Philbin · 2021 [cited by examiner]
US 20210276598A1 · Amirloo Abolfathi · 2021 [cited by examiner]
US 20210300424A1 · McGill · 2021 [cited by examiner]
US 20210347382A1 · Huang · 2021 [cited by examiner]
CN 108431549A · 2018 [cited by examiner]
EP 3690753A1 · 2020 [cited by examiner]
WO 2018118071A1 · 2018 [cited by applicant]
DeepLearning BasedVideoSystemForAccurateAndRealTimeParkingMeasurement.pdf (Year: 2019). [cited by examiner]
Deep Learning-Based Video System for Accurate and Real-Time Parking Measurement Mar. 4, 2019 | Bill Yang Cai et al. | IEEE Internet of Things Journal (vol. 6, Issue: 5, pp. 7693-7701) (Year: 2019). [cited by examiner]
European Search Report issued for the European Patent Application No. 20207113.0, dated Mar. 30, 2021 (for Informational purposes only). [cited by applicant]
Nuss et al., A random finite set approach for Dynamic Occupancy Grid Maps with Real-Time Application,The International Journal of Robotics Research, Jul. 2018, 20 pages, vol. 37, issue 8, SAGE journals. [cited by applicant]
Steyer et al., Grid-Based Environment Estimation Using Evidential Mapping and Particle Tracking, IEEE Transactions On Intelligent Vehicles, vol. 3, No. 3, Sep. 2018, 13 pages. [cited by applicant]
Homm et al., Efficient Occupancy Grid Computation on the GPU with Lidar and Radar for Road Boundary Detection, 2010 IEEE Intelligent Vehicles Symposium, Jun. 21-24, 2010, 8 pages, University of California, San Diego, CA… [cited by applicant]
Li et al., Building Variable Resolution Occupancy Grid Map from Stereoscopic System—a Quadtree based Approach, Intelligent Vehicles Symposium (IV), IEEE, Jun. 2013, 7 pages. [cited by applicant]
Droeschel et al., Continuous Mapping and Localization for Autonomous Navigation in Rough Terrain using a 3D Laser Scanner, Robotics and Autonomous Systems, Oct. 27, 2016, vol. 88, 20 pages, Elsevier. [cited by applicant]
Dia et al., Evaluation of Occupancy Grid Resolution through a Novel Approach for Inverse Sensor Modeling, IFAC Papers OnLine, 50-1 (2017) 13841-13847, 7 pages, ScienceDirect. [cited by applicant]
Erdinc et al., The Bin-Occupancy Filter and its Connection to the PHD Filters, IEEE Transactions on Signal Processing, Nov. 2009, 13 pages, vol. 57, Issue: 11, IEEE. [cited by applicant]
Elfes, Using Occupancy Grids for Mobile Robot Perception and Navigation, Computer, Jun. 1989, 12 pages, vol. 22, Issue 6, IEEE. [cited by applicant]
Tanzmeister et al., Evidential Grid-Based Tracking and Mapping, IEEE Transactions on Intelligent Transportation Systems, Jun. 2017, 14 pages, vol. 18, Issue 6, IEEE. [cited by applicant]