IP Library Granted Patent US 12,657,969
Granted Patent B2
US 12,657,969 · App. 18/023,413 · Granted Jun 16, 2026

Critical scenario identification for verification and validation of vehicles

Inventors: Saadhana B Venkataraman (Chennai, IN); Vijaya Sarathi Indla (Bangalore, IN); Bony Mathew (Perumbavoor, IN); Saikat Mukherjee (Bangalore, IN); Ram Padhy (Ganjam, IN); Sagar Pathrudkar (Pune, IN); Bristi Singh (Bangalore, IN)
Assignee: Siemens Industry Software NV
G07C5/0808G08G1/0112
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,657,969
App. No.
18/023,413
Granted
Jun 16, 2026
Kind
B2
Abstract

A scenario identification system and a computer implemented method for identifying one or more critical scenarios from vehicle data associated with one or more vehicles are provided. The scenario identification system obtains at least the inertial measurement unit (IMU) data from the vehicle data, derives one or more IMU-based driving parameters from the IMU data, and analyzes the IMU-based driving parameters based on one or more predefined thresholds for identifying the critical scenario(s).

Claims (47)

1 . A computer implemented method for identifying one or more critical scenarios from vehicle data associated with one or more vehicles, the computer implemented method, the method comprising:

obtaining a predefined type of data from the vehicle data recorded by physical IMU sensors mounted on the one or more vehicles, wherein the predefined type of data comprises at least inertial measurement unit (IMU) data, wherein the IMU data is purely searchable text data available in a structured format including timestamps of time instances at which the IMU data was recorded, angular velocity at the time instances, and linear acceleration at the time instances, wherein the structured and searchable format enables automated detection of threshold exceedances used by a data analysis module to identify the one or more critical scenarios;

deriving one or more IMU-based driving parameters from the predefined type of data;

analyzing the one or more IMU-based driving parameters based on one or more predefined thresholds for identifying the one or more critical scenarios;

generating, by a scenario management module of a scenario identification system, one or more traffic scenarios using the vehicle data corresponding to the IMU-based driving parameters exceeding the predefined thresholds;

validating, by the scenario management module, the one or more traffic scenarios for criticality; and

providing the one or more validated traffic scenarios, including associated criticality indices, to a traffic modeling device or vehicle-control verification system for use in verifying, validating, or updating one or more autonomous-vehicle behavior policies that control operation of a vehicle.

2 . The computer implemented method of claim 1 , wherein the IMU-based driving parameters comprise one or more of an acceleration of the vehicle, a velocity of the vehicle, or a trajectory of the vehicle.

3 . The computer implemented method of claim 1 , wherein obtaining the predefined type of data from the vehicle data comprises performing one of:

selecting the IMU data from the vehicle data; or

computing the IMU data based on the vehicle data.

4 . A scenario identification system for identifying one or more critical scenarios from vehicle data associated with one or more vehicles, the scenario identification system comprising:

a non-transitory computer readable storage medium configured to store computer program instructions defined by modules of the scenario identification system;

at least one processor communicatively coupled to the non-transitory computer readable storage medium, the at least one processor configured to execute the defined computer program instructions;

a data reception module configured to operably communicate with the one or more vehicles to receive the vehicle data recorded by physical IMU sensors mounted on the one or more vehicles;

a data processing module configured to:

obtain a predefined type of data from the vehicle data, wherein the predefined type of data comprises at least inertial measurement unit (IMU) data, wherein the IMU data is purely searchable text data available in a structured format including timestamps of time instances at which the IMU data was recorded, angular velocity at the time instances, and linear acceleration at the time instances, wherein the structured and searchable format enables automated detection of threshold exceedances used by a data analysis module to identify the one or more critical scenarios; and

derive IMU-based driving parameters from the predefined type of data, the IMU-based driving parameters comprising at least acceleration, velocity, and trajectory;

the data analysis module configured to analyze the IMU-based driving parameters based on one or more predefined thresholds for identifying the one or more critical scenarios;

a scenario management module configured to:

generate one or more traffic scenarios using the vehicle data corresponding to the one or more IMU-based driving parameters exceeding the one or more predefined thresholds;

validate the one or more traffic scenarios for criticality;

provide the one or more validated traffic scenarios, including associated criticality indices, to a traffic modeling device or vehicle-control verification system for use in verifying, validating, or updating one or more autonomous-vehicle behavior policies that control operation of a vehicle; and

a scenario management database configured to store the vehicle data, the IMU data, the one or more IMU-based driving parameters, the one or more predefined thresholds corresponding to each of the one or more IMU-based driving parameters, and the one or more traffic scenarios.

5 . The scenario identification system of claim 4 , further comprising a data reception module configured to operably communicate with the one or more vehicles and one or more traffic modeling devices for receiving the vehicle data.

6 . A system comprising:

a primary vehicle comprising one or more physical sensors configured to acquire vehicle data related to the primary vehicle;

a scenario identification system for identifying one or more critical scenarios from the vehicle data associated with the primary vehicle, the scenario identification system comprising:

a non-transitory computer readable storage medium configured to store computer program instructions defined by modules of the scenario identification system;

at least one processor communicatively coupled to the non-transitory computer readable storage medium, the at least one processor configured to execute the defined computer program instructions;

a data reception module configured to operably communicate with the one or more vehicles to receive the vehicle data;

a data processing module configured to:

obtain a predefined type of data from the vehicle data, wherein the predefined type of data comprises at least inertial measurement unit (IMU) data, wherein the IMU data is purely searchable text data available in a structured format including timestamps of time instances at which the IMU data was recorded, angular velocity at the time instances, and linear acceleration at the time instances, wherein the structured and searchable format enables automated detection of threshold exceedances used by a data analysis module to identify the one or more critical scenarios; and

derive one or more IMU-based driving parameters from the predefined type of data;

a data analysis module configured to analyze the one or more IMU-based driving parameters based on one or more predefined thresholds for identifying the one or more critical scenarios;

a scenario management module configured to:

generate one or more traffic scenarios using the vehicle data corresponding to the one or more IMU-based driving parameters exceeding the one or more predefined thresholds;

validate the one or more traffic scenarios for criticality; and

provide the one or more validated traffic scenarios, including associated criticality indices, to a traffic modeling device or vehicle-control verification system for use in verifying, validating, or updating one or more autonomous-vehicle behavior policies that control operation of a vehicle; and

a scenario management database configured to store the vehicle data, the IMU data, the one or more IMU-based driving parameters, the one or more predefined thresholds corresponding to each of the one or more IMU-based driving parameters, and the one or more traffic scenarios.

7 . The system of claim 6 , wherein the data processing module is configured to:

translate the vehicle data to one or more features comprising objects that are located through detection and segmentation;

inputting the located objects to one or more filters; and

deriving a state of each object in the surrounding using a random variable concept having a probability assigned to each variable;

wherein the state is used to derive information related to force, angular measurements and magnetic field.

8 . The system of claim 6 , wherein the one or more sensors comprise at least a LIDAR system.

9 . The system of claim 6 , wherein the predefined thresholds comprise where when a lateral acceleration of the primary vehicle is greater than 2.5 meters/sec2 or when the lateral deceleration of the primary vehicle is greater than 2.9 meters/sec2.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2023
From: B VENKATARAMAN, SAADHANA; INDIA, VIJAYA SARATHI; MATHEW, BONY; MUKHERJEE, SAIKAT; PADHY, RAM; PATHRUDKAR, SAGAR; SINGH, BRISTI
To: SIEMENS TECHNOLOGY AND SERVICES PVT. LTD.
Reel/Frame 065110/0187 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2023
From: SIEMENS TECHNOLOGY AND SERVICES PVT. LTD.
To: SIEMENS INDUSTRY SOFTWARE NV
Reel/Frame 065110/0194 →
Continuity (1)
Related Publication 20240013592A1 · Jan 11, 2024
References Cited (21)
US 10636295B1 · Kim et al. · 2020 [cited by applicant]
US 11577741B1 · Reschka · 2023 [cited by examiner]
US 20170108612A1 · Aguib · 2017 [cited by examiner]
US 20180165960A1 · Seo · 2018 [cited by examiner]
US 20190065933A1 · Bogdoll et al. · 2019 [cited by applicant]
US 20190271614A1 · Ahner et al. · 2019 [cited by applicant]
US 20200143843A1 · Luo · 2020 [cited by examiner]
US 20200160070A1 · Sholingar et al. · 2020 [cited by applicant]
US 20210063974A1 · Okawa · 2021 [cited by examiner]
US 20210094540A1 · Bagschik · 2021 [cited by examiner]
US 20210190258A1 · Nancollis · 2021 [cited by examiner]
US 20210364305A1 · Rizk · 2021 [cited by examiner]
US 20210389769A1 · Hari · 2021 [cited by examiner]
US 20220068052A1 · Maeta · 2022 [cited by examiner]
CN 108428343A · 2018 [cited by applicant]
CN 111209790A · 2020 [cited by applicant]
GB 2560096A · 2018 [cited by applicant]
JP 2019182399A · 2019 [cited by applicant]
JP 2020015493A · 2020 [cited by applicant]
JP 2020123351A · 2020 [cited by applicant]
International Serach Report and Written Opinion for International Application PCT/EP2020/074101 mailed Apr. 29, 2021. [cited by applicant]