IP Library › Granted Patent US 10,255,168
Granted Patent B2
US 10,255,168 · App. 15/340,856 · Granted Apr 9, 2019

Method and device for generating test cases for autonomous vehicles

Inventors: Frederic Stefan (Aachen, DE); Alain Marie Roger Chevalier (Henri-Chapelle, BE); Michael Marbaix (Haillot, BE); Evangelos Bitsanis (Aachen, DE)
Assignee: Ford Global Technologies, LLC
G06F11/3684G06F11/3604
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,255,168
App. No.
15/340,856
Filed
Nov 1, 2016
Granted
Apr 9, 2019
Kind
B2
Art Unit
2113
USPC
714/38
Abstract

Test cases for autonomous vehicles are generated automatically by using data which have been collected from vehicles participating in public road traffic. A test planning system for autonomous vehicle includes defined application cases for autonomous vehicles. The vehicles are configured to identify test cases with prediction analyzes of a reference catalog of driving situations and the defined application cases, and compare, via a comparative analyzes, the test cases and the defined application cases to compile an expanded set of test cases, wherein the expanded set of test cases are compared to the defined application cases to output a complete set of test cases. The system also includes a central database configured to query the complete set of test cases.

Claims (32)

1. A method for testing autonomous vehicles comprising:

collecting data from vehicles participating in public road traffic;

analyzing the data to identify a plurality of classifications representative of driving situations and a frequency of occurrence of each of the driving situations;

generating a first set of real-world test cases from the analyzed data;

generating a second set of test cases using predefined system application cases;

performing a comparative analysis between the first set of real-world test cases and the second set of test cases to identify at least one test case from the first set that is comparable with at least one test case from the second set; and

merging the a least one test case from the first set with its comparable at least one test case from the second set to form a combined test case.

2. The method as claimed in claim 1 , further comprising:

generating a third set of test cases using safety- and reliability-related application cases; and

performing a second comparative analysis between the third set and a combined set made up of a plurality of combined test cases to identify comparable members thereof; and

merging the comparable test case members identified to form a further combined set of test cases.

3. The method as claimed in claim 1 , wherein the collected data from the vehicles participating in public road traffic represents a real driver experience of drivers of the vehicles.

4. The method as claimed in claim 1 further comprising identifying average test steps and acceptance criteria for all test cases based on real world scenarios by analyzing the collected data.

5. The method as claimed in claim 1 , wherein, during the merging, the single case based on the comparable test cases is preserved and modified on the basis of an application case identified from data from real world scenarios.

6. The method as claimed in claim 1 further comprising storing the test cases for test documentation and conduct, wherein the test cases are obtained automatically at a system level.

7. The method as claimed in claim 1 further comprising:

applying a rule for continuous integration to update the test cases from real-world scenarios; and

outputting a signal when new test cases from the real-world scenarios are identified.

8. A tool for project life cycle management of autonomous vehicles:

a test planning system having continuous integration rules and including defined application cases for autonomous vehicles configured to identify test cases with prediction analyses of a reference catalogue of driving situations and the defined application cases, and compare, via a comparative analyses, the test cases and the defined application cases to merge comparable cases with predetermined rules to compile an expanded set of test cases, wherein the expanded set of test cases are compared to the defined application cases to output a complete set of test cases; and

a central database configured to query the test planning system.

9. The tool as claimed in claim 8 , wherein the expanded set of test cases comprises a single case.

10. The tool as claimed in claim 8 , wherein the continuous integration rules are configured to regularly update the test cases.

11. The tool as claimed in claim 8 , wherein the defined application cases include system and safety and reliability application cases.

12. The tool as claimed in claim 8 , wherein the reference catalogue of driving situations includes data from real world scenarios.

13. A test planning system for autonomous vehicle comprising:

defined application cases for autonomous vehicles configured to identify test cases with prediction analyses of a reference catalogue of driving situations and the defined application cases, and compare, via a comparative analyses, the test cases and the defined application cases to compile an expanded set of test cases, wherein the expanded set of test cases are compared to the defined application cases to output a complete set of test cases; and

a central database configured to query the complete set of test cases.

14. The test planning system as claimed in claim 13 further comprising continuous integrations rules configured to regularly update the test case.

15. The test planning system as claimed in claim 13 , wherein the comparative analyses is further configure to merge comparable cases using predetermined rules such that the expanded set of test cases defines a single case.

16. The test planning system as claimed in claim 13 , wherein the reference catalogue of driving situations includes data from real world scenarios.

17. The test planning system as claimed in claim 13 , wherein the complete set of test cases is a test scenario to be defined in order to achieve a representative set of test cases.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2016
From: STEFAN, FREDERIC; CHEVALIER, ALAIN MARIE ROGER; MARBAIX, MICHAEL; BITSANIS, EVANGELOS
To: FORD GLOBAL TECHNOLOGIES, LLC
Reel/Frame 040193/0024 →
Priority Claims (1)
DE 10 2015 221 886 · Nov 6, 2015 · national
Continuity (1)
Related Publication 20170132117A1 · May 11, 2017
Cited By (6)
US 12,204,823 US 12,367,086 US 12,475,281 US 12,613,795 US 12,623,674 US 12,724,689