IP Library › Granted Patent US 12,491,905
Granted Patent B2
US 12,491,905 · App. 18/069,658 · Granted Dec 9, 2025

Evaluating integrity of vehicle pose estimates via semantic labels

Inventor: Christopher Monaco (Sunnyvale, CA)
Assignee: MERCEDES-BENZ GROUP AG
B60W60/001B60W40/10B60W2554/4041B60W2554/4049
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,491,905
App. No.
18/069,658
Granted
Dec 9, 2025
Kind
B2
Abstract

Subject matter disclosed herein may relate to systems, devices and/or processes for monitoring and/or evaluating vehicle pose integrity for use with an autonomous driving controller. A system may include memory, the memory comprising one or more memory devices and a processor coupled to the one or more memory devices, the processor configured to access, from the one or more memory devices, sensor measurements generated by one or more sensors mounted in a vehicle. The system may additionally observe one or more semantic classes to one or more physical entities based on the generated sensor measurements and extract one or more semantically-labeled map parameters from an electronic map the system may additionally determine a correlation between the one or more observed semantic classes and one or more expected classes extracted from the semantically-labeled map parameters.

Claims (53)

1 . A vehicle pose integrity monitor for use with an autonomous driving controller, comprising:

a memory, the memory comprising one or more memory devices; and

a processor coupled to the one or more memory devices, the processor configured to:

access, from the one or more memory devices, sensor measurements generated by one or more sensors mounted in a vehicle;

observe one or more semantic classes to one or more physical entities based on the generated sensor measurements;

extract one or more semantically-labeled map parameters from an electronic map;

determine a correlation between the one or more observed semantic classes and one or more expected classes extracted from the semantically-labeled map parameters based on a computation of true positive rate counts, false positive rate counts, true negative rate counts, and false negative rate counts;

compute a localization integrity based on the correlation; and

generate one or more operations to direct at least one autonomous driving application to perform one or more functions to influence a motion vector of the vehicle.

2 . The vehicle pose integrity monitor of claim 1 , wherein the one or more physical entities comprises:

a non-drivable region, a drivable region, a structure, a lane marking, a natural object or a traffic sign, or a combination thereof.

3 . The vehicle pose integrity monitor of claim 1 , wherein the processor is further configured to:

execute one or more operations to plan motion of the vehicle based on the computed localization integrity.

4 . The vehicle pose integrity monitor of claim 1 , wherein the processor is further configured to:

compute one or more vehicle pose hypotheses; and

compute positive or negative deviations from the computed one or more vehicle pose hypotheses.

5 . The vehicle pose integrity monitor of claim 4 , wherein the processor is further configured to:

compute at least one sample point to represent a deviation from the computed one or more vehicle pose hypotheses.

6 . The vehicle pose integrity monitor of claim 5 , wherein the processor is further configured to:

compute a correlation coefficient for each of the one or more computed vehicle pose hypotheses.

7 . The vehicle pose integrity monitor of claim 6 , wherein the one or more computed vehicle pose hypotheses comprises a plurality of computed vehicle pose hypotheses, and wherein the processor is further configured to:

compute a transformation of a distribution of the plurality of computed vehicle pose hypotheses.

8 . The vehicle pose integrity monitor of claim 7 , wherein the transformation operates to transform a nonlinear function that represents, or is derived from, the distribution of the plurality of computed vehicle pose hypotheses.

9 . The vehicle pose integrity monitor of claim 8 , wherein the computed vehicle pose hypotheses comprises a critical input for generating the one or more expected semantic classes.

10 . The vehicle pose integrity monitor of claim 9 , wherein the transformation operates to create a weighted average of each of the one or more computed vehicle pose hypotheses.

11 . A method to provide vehicle pose integrity for use with an autonomous driving controller, the method being performed by one or more processors and comprising:

accessing, from one or more memory devices, sensor measurements generated by one or more sensors mounted in a vehicle;

observing one or more semantic classes to one or more physical entities based on the generated sensor measurements;

extracting one or more semantically-labeled map parameters from an electronic map;

computing a correlation between the one or more observed semantic classes and one or more expected classes extracted from the semantically-labeled map parameters based on a computation of true positive rate counts, false positive rate counts, true negative rate counts, and false negative rate counts;

computing a localization integrity based on the correlation; and

generating one or more operations to direct at least one autonomous driving application to perform one or more functions to influence a motion vector of the vehicle.

12 . The method of claim 11 , wherein the one or more physical entities comprises: a non-drivable region, a drivable region, a structure, a lane marking, a natural object or a traffic sign, or a combination thereof.

13 . The method of claim 11 , further comprising:

executing one or more operations to plan motion of the vehicle based on the computed localization integrity.

14 . The method of claim 11 , further comprising:

computing one or more vehicle pose hypotheses; and

computing positive or negative deviations from the computed one or more vehicle pose hypotheses.

15 . The method of claim 14 , further comprising:

computing at least one sample point to represent a deviation from the computed one or more vehicle pose hypotheses.

16 . The method of claim 15 , further comprising:

computing a correlation coefficient for each of the one or more computed vehicle pose hypotheses.

17 . The method of claim 16 , wherein the one or more computed vehicle pose hypotheses comprises a plurality of computed vehicle pose hypotheses, and further comprising:

computing a transformation of a distribution of the plurality of computed vehicle pose hypotheses.

18 . The method of claim 17 , wherein the transformation operates to transform a nonlinear function that represents, or is derived from, the distribution of the plurality of computed vehicle pose hypotheses.

19 . The method of claim 18 , wherein the computed vehicle pose hypotheses comprises a critical input for generating the one or more expected semantic classes.

20 . A non-transitory computer-readable medium comprising encoded program instructions for causing one or more processors of a vehicle pose integrity monitor to perform at least the following:

access sensor measurements generated by one or more sensors mounted in a vehicle;

observe one or more semantic classes to one or more physical entities based on the generated sensor measurements;

extract one or more semantically-labeled map parameters from an electronic map;

compute a correlation between the one or more observed semantic classes and one or more expected classes extracted from the semantically-labeled map parameters based on a computation of true positive rate counts, false positive rate counts, true negative rate counts, and false negative rate counts;

compute a localization integrity based on the correlation; and

generate one or more operations to direct at least one autonomous driving application to perform one or more functions to influence a motion vector of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2025
From: MONACO, CHRISTOPHER
To: MERCEDES-BENZ GROUP AG
Reel/Frame 072065/0566 →
Continuity (1)
Related Publication 20240208530A1 · Jun 27, 2024
References Cited (18)
US 11030525B2 · Wang et al. · 2021 [cited by applicant]
US 11430182B1 · Yang · 2022 [cited by examiner]
US 20170316333A1 · Levinson et al. · 2017 [cited by applicant]
US 20180336421A1 · Huang et al. · 2018 [cited by applicant]
US 20210182596A1 · Adams et al. · 2021 [cited by applicant]
US 20220024485A1 · Theverapperuma et al. · 2022 [cited by applicant]
US 20220234621A1 · Fasola · 2022 [cited by examiner]
CN 110146096A · 2019 [cited by examiner]
CN 113256711A · 2021 [cited by applicant]
DE 102019216722A1 · 2021 [cited by examiner]
DE 102022000563A1 · 2022 [cited by examiner]
DE 102021111325A1 · 2022 [cited by examiner]
Roh et al “Accurate Mobile Urban Mapping via Digital Map-Based SLAM.” https://doi.org/10.3390/s16081315, Sensors, Jun. 7, 2016, 24 pages. [cited by applicant]
Balakrishnan et al “An Integrity Assessment Framework for Multi-modal Vehicle Localization,” https://hal.archives- ouvertes.fr/hal-02393213, 2019 IEEE Intelligent Transportation Systems Conference- ITSC, Oct. 2019, Auck… [cited by applicant]
Taira et al “InLoc: Indoor Visual Localization with Dense Matching and View Synthesis,” 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Mar. 28, 2018, 11 pages. [cited by applicant]
Balakrishnan et al “Integrity Monitoring of Multimodal Perception System for Vehicle Localization,” https://doi.org/10.3390/s20164654, Sensors, Jul. 22, 2020, 16 pages. [cited by applicant]
Taira et al“Is This the Right Place? Geometric-Semantic Pose Verification for Indoor Visual Localization,” 2019 IEEE/CVF International Conference on Computer Vision, Aug. 13, 2019, 11 pages. [cited by applicant]
Toft et al “Semantic Match Consistency for Long-Term Visual Localization,” European Conference on Computer Vision (ECCV 2018), Munich, Germany, Sep. 8-14, 2018, 17 pages. [cited by applicant]