IP Library Granted Patent US 11,556,128
Granted Patent B2
US 11,556,128 · App. 17/024,505 · Granted Jan 17, 2023

Method, electronic device and storage medium for testing autonomous driving system

Inventor: Qingyu Li (Beijing, CN)
Assignee: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
G05D1/0088B60W30/09B60W50/14G05D1/0214G08G1/166G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,556,128
App. No.
17/024,505
Granted
Jan 17, 2023
Kind
B2
Abstract

A method, an electronic device and a computer-readable storage medium for testing an autonomous driving system which relate to the technical field of autonomous driving are proposed. An embodiment for testing the autonomous driving system includes: obtaining scenario description information of a testing scenario; analyzing the scenario description information, and determining a scenario risk, a scenario probability and a scenario complexity corresponding to the testing scenario; obtaining a scenario weight of the testing scenario according to the scenario risk, scenario probability and scenario complexity; determining a test period corresponding to the scenario weight, where the test period is used for the autonomous driving system being tested in the testing scenario. The technical solution may reduce the testing pressure of the autonomous driving system and improve the testing efficiency of the autonomous driving system.

Claims (60)

1. A method for testing an autonomous driving system, comprising:

obtaining scenario description information of a testing scenario;

analyzing the scenario description information, and determining a scenario risk, a scenario probability and a scenario complexity corresponding to the testing scenario;

obtaining a scenario weight of the testing scenario according to the scenario risk, the scenario probability and the scenario complexity; and

determining a number of testing times corresponding to the scenario weight, wherein the autonomous driving system is to be tested in the testing scenario for the number of testing times, and wherein the number of testing time increases as the scenario weights increases,

wherein obtaining the scenario weight of the testing scenario according to the scenario risk, the scenario probability and the scenario complexity comprises:

determining a risk level according to the scenario risk, determining a probability level according to the scenario probability, and determining a complexity level according to the scenario complexity; and

obtaining the scenario weight of the testing scenario, according to a summing result of weight values corresponding respectively to the risk level, the probability level and the complexity level.

2. The method according to claim 1 , wherein the scenario complexity includes an environment complexity and a mission complexity corresponding to the testing scenario.

3. The method according to claim 1 , wherein determining the complexity level according to the scenario complexity comprises:

obtaining a standard complexity corresponding to a standard scenario;

comparing the scenario complexity with the standard complexity to determine differed attributes, and obtaining level up values corresponding respectively to the differed attributes; and

determining the complexity level according to a summing result between the obtained level up values and an initial level.

4. The method according to claim 1 , further comprising:

obtaining problems occurring in the autonomous driving system being tested in the testing scenario; and

determining a degree of importance of the problems occurring in the autonomous driving system, according to the scenario weight corresponding to the testing scenario.

5. The method according to claim 1 , further comprising:

obtaining, respectively, driving scores for the autonomous driving system being tested in a plurality of testing scenarios; and

performing weighted averaging for the driving scores according to the scenario weights corresponding respectively to the plurality of testing scenarios, and taking a calculation result as a final score of the autonomous driving system.

6. An electronic device, comprising:

at least one processor; and

a storage communicatively connected with the at least one processor; wherein,

the storage stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform a method for testing an autonomous driving system, wherein the method comprises:

obtaining scenario description information of a testing scenario;

analyzing the scenario description information, and determining a scenario risk, a scenario probability and a scenario complexity corresponding to the testing scenario;

obtaining a scenario weight of the testing scenario according to the scenario risk, the scenario probability and the scenario complexity; and

determining a number of testing times corresponding to the scenario weight, wherein the autonomous driving system is to be tested in the testing scenario for the number of testing times, and wherein the number of testing time increases as the scenario weights increases,

wherein obtaining the scenario weight of the testing scenario according to the scenario risk, the scenario probability and the scenario complexity comprises:

determining a risk level according to the scenario risk, determining a probability level according to the scenario probability, and determining a complexity level according to the scenario complexity; and

obtaining the scenario weight of the testing scenario, according to a summing result of weight values corresponding respectively to the risk level, the probability level and the complexity level.

7. The electronic device according to claim 6 , wherein the scenario complexity includes an environment complexity and a mission complexity corresponding to the testing scenario.

8. The electronic device according to claim 6 , wherein determining the complexity level according to the scenario complexity comprises:

obtaining a standard complexity corresponding to a standard scenario;

comparing the scenario complexity with the standard complexity to determine differed attributes, and obtaining level up values corresponding respectively to the differed attributes; and

determining the complexity level according to a summing result between the obtained level up values and an initial level.

9. The electronic device according to claim 6 , wherein the method further comprises:

obtaining problems occurring in the autonomous driving system being tested in the testing scenario; and

determining a degree of importance of the problems occurring in the autonomous driving system, according to the scenario weight corresponding to the testing scenario.

10. The electronic device according to claim 6 , wherein the method further comprises:

obtaining, respectively, driving scores for the autonomous driving system being tested in a plurality of testing scenarios; and

performing weighted averaging for the driving scores according to the scenario weights corresponding respectively to the plurality of testing scenarios, and taking a calculation result as a final score of the autonomous driving system.

11. A non-transitory computer-readable storage medium storing computer instructions therein, wherein the computer instructions are used to cause the computer to perform a method for testing an autonomous driving system, wherein the method comprises:

obtaining scenario description information of a testing scenario;

analyzing the scenario description information, and determining a scenario risk, a scenario probability and a scenario complexity corresponding to the testing scenario;

obtaining a scenario weight of the testing scenario according to the scenario risk, the scenario probability and the scenario complexity; and

determining a number of testing times corresponding to the scenario weight, wherein the autonomous driving system is to be tested in the testing scenario for the number of testing times, and wherein the number of testing time increases as the scenario weights increases,

wherein obtaining the scenario weight of the testing scenario according to the scenario risk, the scenario probability and the scenario complexity comprises:

determining a risk level according to the scenario risk, determining a probability level according to the scenario probability, and determining a complexity level according to the scenario complexity; and

obtaining the scenario weight of the testing scenario, according to a summing result of weight values corresponding respectively to the risk level, the probability level and the complexity level.

12. The non-transitory computer-readable storage medium according to claim 11 , wherein the scenario complexity includes an environment complexity and a mission complexity corresponding to the testing scenario.

13. The non-transitory computer-readable storage medium according to claim 11 , wherein determining the complexity level according to the scenario complexity comprises:

obtaining a standard complexity corresponding to a standard scenario;

comparing the scenario complexity with the standard complexity to determine differed attributes, and obtaining level up values corresponding respectively to the differed attributes; and

determining the complexity level according to a summing result between the obtained level up values and an initial level.

14. The non-transitory computer-readable storage medium according to claim 11 , wherein the method further comprises:

obtaining problems occurring in the autonomous driving system being tested in the testing scenario; and

determining a degree of importance of the problems occurring in the autonomous driving system, according to the scenario weight corresponding to the testing scenario.

15. The non-transitory computer-readable storage medium according to claim 11 , wherein the method further comprises:

obtaining, respectively, driving scores for the autonomous driving system being tested in a plurality of testing scenarios; and

performing weighted averaging for the driving scores according to the scenario weights corresponding respectively to the plurality of testing scenarios, and taking a calculation result as a final score of the autonomous driving system.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058241/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2021
From: LI, QINGYU
To: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
Reel/Frame 056787/0481 →
Priority Claims (1)
CN 202010002080.X · Jan 2, 2020 · national
Continuity (1)
Related Publication 20210208586A1 · Jul 8, 2021