IP Library Granted Patent US 12,304,510
Granted Patent B2
US 12,304,510 · App. 18/002,087 · Granted May 20, 2025

System for testing a driver assistance system of a vehicle

Inventors: Rolf Hettel (Hockenheim, DE); Tobias Düser (Bühl, DE)
Assignee: AVL LIST GMBH
B60W50/04B60W40/08G01M17/007B60W2540/22B60W2540/221B60W2540/223B60W2540/229B60W2540/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,304,510
App. No.
18/002,087
Granted
May 20, 2025
Kind
B2
Abstract

The invention relates to a system for testing a driver assistance system of a vehicle, where the driver assistance system has at least one interior sensor and is designed to process sensor signals of the at least one interior sensor for monitoring a driver of the vehicle, the system comprising: simulation means for simulating at least one physical property of the driver which characterizes a physiological condition of the driver, in particular the driver's attentiveness, activity, fatigue, mood, state of health, and/or drug influence, and is able to be detected by the at least one interior sensor such that it can generate sensor signals as a function of the at least one simulated physical property; and an interface which interacts with the driver assistance system such that sensor signals are provided the driver assistance system as a function of the at least one simulated physical property. The invention further relates to a corresponding method.

Claims (22)

1. A system for testing a driver assistance system in a vehicle, wherein the driver assistance system has at least one interior sensor and is designed to process sensor signals of the at least one interior sensor, the system comprising:

a computing unit simulating at least one physical property of an emulated driver which characterizes a physiological condition of the emulated driver, in particular the emulated driver's attentiveness, activity, fatigue, mood, state of health and/or drug influence, and is able to be detected by the at least one interior sensor such that it can generate sensor signals as a function of the at least one simulated physical property; and

an interface which interacts with the driver assistance system such that sensor signals are provided to the driver assistance system as a function of the at least one simulated physical property.

2. The system according to claim 1 , wherein the interface is a stimulation device configured to stimulate the interior sensor on the basis of the at least one simulated physical property.

3. The system according to claim 2 , wherein the stimulation device is configured to generate a response signal for reception by the at least one interior sensor based on a signal emitted by the at least one interior sensor, wherein the response signal is generated based on the at least one simulated physical property, and wherein the emulated driver is emulated when generating the response signal.

4. The system according to claim 2 , wherein the stimulation device is configured to be mounted on a driver's seat and/or a gear selector lever and/or steering wheel.

5. The system according to claim 1 , wherein the computing unit is configured to generate raw sensor data and the interface is configured to inject the raw sensor data into a sensor chip of the interior sensor, in particular a perception chip of a camera.

6. The system according to claim 1 , wherein the computing unit is configured to generate the sensor signals and the interface is configured to inject the sensor signals into the driver assistance system.

7. The system according to claim 1 , wherein the at least one physical property is/are selected from among the following group of properties: biometric properties, seated position, posture, position of the head, position of the hand, viewing direction, facial expression, occluded field of view, in particular due to a hat, mask or sunglasses, weight, blood pressure, heart rate, eye movement, eyelid movement, pupil size, or driver blood alcohol concentration.

8. The system according to claim 1 , wherein the at least one interior sensor is/are selected from among the following group of sensors:

camera, in particular stereoscopic camera, infrared camera, capacitive sensor, photodiode, mechanical force sensor or resistive sensor, steering angle sensor, steering torque sensor, or microphone.

9. The system according to claim 1 , wherein the system comprises a system of a test bench, particularly a vehicle test bench.

10. A method for testing a driver assistance system of a vehicle, wherein the driver assistance system has at least one interior sensor and is designed to process sensor signals of the at least one interior sensor, wherein, the method comprising:

simulating, by a computing unit, at least one physical property of an emulated driver which characterizes a physiological condition of the emulated driver, in particular the emulated driver's attentiveness, activity, fatigue, mood, state of health, and/or drug influence, and is able to be detected by the at least one interior sensor such that that it can generate sensor signals as a function of the at least one simulated physical property and the sensor signals are provided to the driver assistance system as a function of the at least one simulated physical property.

11. The method according to claim 10 , wherein simulating the emulated driver is based on recorded data of an actual person, in particular video data of the person, for which one or more physiological conditions within the data are known.

12. The method according to claim 10 , wherein the at least physical property is simulated by means of a driver model which is trained on the basis of real data.

13. The method according to claim 12 , wherein the driver model comprises a driver animation, in particular a 3D animation, able to emulate physiological conditions.

14. The method according to claim 10 , wherein an activity of the driver assistance system is monitored and an evaluation of a function of the driver assistance system is made on the basis of the activity.

15. The method according to claim 10 , wherein the at least one interior sensor is stimulated on the basis of the at least one simulated physical property such that it provides the sensor signals.

16. A vehicle comprising a system for testing a driver assistance system in a vehicle, wherein the driver assistance system has at least one interior sensor and is designed to process sensor signals of the at least one interior sensor, the system comprising:

a computing unit simulating at least one physical property of an emulated driver which characterizes a physiological condition of the emulated driver, in particular the emulated driver's attentiveness, activity, fatigue, mood, state of health and/or drug influence, and is able to be detected by the at least one interior sensor such that it can generate sensor signals as a function of the at least one simulated physical property; and

an interface which interacts with the driver assistance system such that sensor signals are provided to the driver assistance system as a function of the at least one simulated physical property.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2023
From: HETTEL, ROLF; DÜSER, TOBIAS
To: AVL LIST GMBH
Reel/Frame 064036/0127 →
Priority Claims (1)
AT A 50515/2020 · Jun 16, 2020 · national
Continuity (1)
Related Publication 20230219584A1 · Jul 13, 2023
References Cited (98)
US 10228693B2 · Micks et al. · 2019 [cited by applicant]
US 10399565B2 · Posch et al. · 2019 [cited by applicant]
US 10482003B1 · Bondor et al. · 2019 [cited by applicant]
US 10636295B1 · Kim et al. · 2020 [cited by applicant]
US 10913455B2 · Bruns et al. · 2021 [cited by applicant]
US 11086318B1 · Davis · 2021 [cited by applicant]
US 11137763B2 · Heit et al. · 2021 [cited by applicant]
US 11397136B2 · Schyr et al. · 2022 [cited by applicant]
US 11417057B2 · Atsmon · 2022 [cited by examiner]
US 20040176936A1 · Ohtsu · 2004 [cited by examiner]
US 20070063854A1 · Zhang et al. · 2007 [cited by applicant]
US 20070182529A1 · Dobler et al. · 2007 [cited by applicant]
US 20110313740A1 · Ikeda · 2011 [cited by examiner]
US 20120135382A1 · Winston et al. · 2012 [cited by applicant]
US 20130238166A1 · Breu et al. · 2013 [cited by applicant]
US 20150105936A1 · Grineenval et al. · 2015 [cited by applicant]
US 20160171133A1 · Pfister · 2016 [cited by examiner]
US 20160210382A1 · Alaniz et al. · 2016 [cited by applicant]
US 20160280233A1 · Priller · 2016 [cited by applicant]
US 20160379091A1 · Lin · 2016 [cited by applicant]
US 20170132117A1 · Stefan et al. · 2017 [cited by applicant]
US 20170270236A1 · Yamaura et al. · 2017 [cited by applicant]
US 20170278402A1 · Yalla et al. · 2017 [cited by applicant]
US 20170286570A1 · Kim · 2017 [cited by examiner]
US 20170355377A1 · Vijaya Kumar · 2017 [cited by examiner]
US 20180060467A1 · Schulte et al. · 2018 [cited by applicant]
US 20180079425A1 · Fleck et al. · 2018 [cited by applicant]
US 20180275658A1 · Iandola et al. · 2018 [cited by applicant]
US 20180339706A1 · Biondo · 2018 [cited by examiner]
US 20190047588A1 · Yabuuchi · 2019 [cited by examiner]
US 20190111933A1 · Schoeggl et al. · 2019 [cited by applicant]
US 20190195734A1 · Breton · 2019 [cited by examiner]
US 20200209874A1 · Chen et al. · 2020 [cited by applicant]
US 20200216078A1 · Katz · 2020 [cited by examiner]
US 20210237743A1 · Boström · 2021 [cited by examiner]
US 20210291839A1 · Hutchings · 2021 [cited by examiner]
US 20230043713A1 · Sakurai · 2023 [cited by examiner]
US 20230214712A1 · Furlan · 2023 [cited by examiner]
CN 101041355 · 2007 [cited by applicant]
CN 103209876 · 2013 [cited by applicant]
CN 105718065 · 2016 [cited by applicant]
CN 108646586 · 2018 [cited by applicant]
CN 108681264 · 2018 [cited by applicant]
CN 212579772U · 2021 [cited by examiner]
CN 110949396B · 2021 [cited by examiner]
DE 4200694 · 1993 [cited by applicant]
DE 19614061 · 1996 [cited by applicant]
DE 102007031040 · 2009 [cited by applicant]
DE 102007043910 · 2009 [cited by applicant]
DE 102008002699 · 2009 [cited by applicant]
DE 102009028767 · 2011 [cited by applicant]
DE 102010029922 · 2011 [cited by applicant]
DE 102011000409 · 2012 [cited by applicant]
DE 102011087781 · 2013 [cited by applicant]
DE 102011088807 · 2013 [cited by applicant]
DE 102011121537 · 2013 [cited by applicant]
DE 102012001666 · 2013 [cited by applicant]
DE 102012002333 · 2013 [cited by applicant]
DE 102012201896 · 2013 [cited by applicant]
DE 102013200116 · 2014 [cited by applicant]
DE 102014118625 · 2016 [cited by applicant]
DE 102015104890 · 2016 [cited by applicant]
DE 102018200011 · 2019 [cited by applicant]
DE 102018205804 · 2019 [cited by applicant]
DE 102019105363 · 2020 [cited by applicant]
DE 102019206049 · 2020 [cited by applicant]
DE 102019206052 · 2020 [cited by applicant]
EP 0836945 · 1998 [cited by applicant]
EP 2284057 · 2011 [cited by applicant]
EP 3438901 · 2019 [cited by applicant]
EP 3745381 · 2020 [cited by applicant]
EP 3745382 · 2020 [cited by applicant]
JP 2008123197 · 2008 [cited by applicant]
JP 2008146332 · 2008 [cited by applicant]
JP 2015516623 · 2015 [cited by applicant]
JP 2016531044 · 2016 [cited by applicant]
JP 2017105453 · 2017 [cited by applicant]
JP 2017173309 · 2017 [cited by applicant]
WO WO2004045895 · 2004 [cited by applicant]
WO WO2012088635 · 2012 [cited by applicant]
WO WO2013060507 · 2013 [cited by applicant]
WO WO2013174974 · 2013 [cited by applicant]
WO WO2015032508 · 2015 [cited by applicant]
WO WO2017167790 · 2017 [cited by applicant]
WO WO2017210222 · 2017 [cited by applicant]
WO WO2019108985 · 2019 [cited by applicant]
WO WO2019119012 · 2019 [cited by applicant]
WO WO2019201400 · 2019 [cited by applicant]
WO WO2019220436A2 · 2019 [cited by examiner]
WO WO2020083996 · 2020 [cited by applicant]
International Search Report and Written Opinion for International (PCT) Patent Application No. PCT/AT2021/060203, dated Oct. 14, 2021, 9 pages. [cited by applicant]
English Translation of the International Search Report for International (PCT) Patent Application No. PCT/ AT2021/060203, dated Oct. 14, 2021, 2 pages. [cited by applicant]
“ASAM OpenScenario: User Guide,” ASAM e.V., last updated Mar. 16, 2020, Version 1.0.0, 54 pages. [cited by applicant]
Bako Rajaonah et al: “Trust and the use of adaptive cruise control: a study of a cut-in situation”, Cognition, Technology & Work, Springer-Verlag, LO, vol. 8, No. 2, Mar. 14, 2006; pp. 146-155. [cited by applicant]
Elrofai et al. “Scenario-Based Safety Validation of Connected and Automated Driving,” StreetWise, TNO, Jul. 1, 2018, pp. 1-28 [Retrieved online from: publications.tno.nl/publication/34626550/AyT8Zc/TNO-2018-streetwise.p… [cited by applicant]
Erdogan et al. “Real-World Maneuver Extraction for Autonomous Vehicle Validation: A Comparative Study,” IEEE, 2019 IEEE Intelligent Vehicles Symposium (IV), Jun. 9-12, 2019, Paris, France, pp. 267-272. [cited by applicant]
MSC Software “Virtual Test Drive (VTD): Webinar-Leverage Simulation to Achieve Safety for Autonomous Vehicles,” YouTube, Jun. 10, 2019, 39 pages [retrieved online from: www.youtube.com/watch?v=NksyrGA8Cek]. [cited by applicant]
Vernaza et al. “Simul-A2: Agent-based Simulator for evaluate ADA Systems,” 17th International Conference on Information Fusion (Fusion), International, Jul. 7, 2014, 7 pages. [cited by applicant]
Cited By (1)
US 12,555,417