IP Library › Granted Patent US 12675300
Granted Patent B2
US 12675300 · App. 17/733,274 · Granted Jul 7, 2026

Schema driven user interface creation to develop autonomous driving applications

Inventors: Sachit Vithaldas (Mountain View, CA); Daniel Stonier (Lexington, MA)
Assignees: Toyota Research Institute, Inc.; Toyota Jidosha Kabushiki Kaisha
G06F9/451G06F3/04847
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12675300
App. No.
17/733,274
Granted
Jul 7, 2026
Kind
B2
Abstract

Arrangements described herein can facilitate the development of autonomous driving applications by enabling a user to modify existing parameters and/or define new parameters in scenario files and/or to create driving evaluation tools. A first user interface based on a schema can be generated. A first input, such as a new parameter or a modification to an existing parameter defined by a schema, can be provided on the first user interface. A second user interface can be generated using the first input provided on the first user interface. The second user interface can include the new parameter or the modification to the existing parameter. A second input relating to the new parameter or the modification to the existing parameter can be received on the second user interface. Valid data can be generated based on the second input and that conforms with the schema.

Claims (53)

1 . A system comprising:

one or more processors programmed to initiate executable operations comprising:

generating a first user interface based on a schema;

receiving, on the first user interface, a first input being a new parameter defined by a schema and including a range and/or a type of valid inputs for the new parameter, the new parameter not previously included in the first user interface and being a new agent, a new object, a new behavior, a new trajectory, a new trigger, or a new constraint in a simulated driving scenario;

generating, using the first input, a second user interface including the new parameter and a menu reflecting the range and/or the type of valid inputs for the new parameter, the new parameter not previously included in and not previously being definable by the second user interface;

receiving, on the second user interface, a second input relating to the new parameter; and

generating, based on the second input, valid data conforming with the schema defined in the first input, whereby a user can preview the new parameter without having to wait for the new parameter to be incorporated into an editor or simulator.

2 . The system of claim 1 , wherein the one or more processors are a part of an editor for a simulation or real-world driving data.

3 . The system of claim 1 , wherein the schema is part of a local scenario file.

4 . The system of claim 1 , further including:

causing a playback of the simulated driving scenario with the new parameter defined by the schema.

5 . The system of claim 1 , further including:

causing the new parameter defined by the schema to be uploaded to a simulator, whereby the new parameter defined by the schema can be incorporated into a simulation.

6 . The system of claim 1 , further including:

causing a simulation to run on the simulated driving scenario with the new parameter defined by the schema.

7 . The system of claim 1 , wherein the valid inputs include a position relative to other objects or agents in the simulated driving scenario.

8 . The system of claim 1 , wherein the valid inputs include time of day.

9 . A system comprising:

one or more processors programmed to initiate executable operations comprising:

generating a first user interface based on a schema;

receiving, on the first user interface, a first input being a new parameter defined by a schema and including a range and/or a type of valid inputs for the new parameter, the new parameter not previously included in the first user interface and being an evaluation tool for a simulation of a driving scenario or for real-world driving data;

generating, using the first input, a second user interface including the new parameter and a menu reflecting the range and/or the type of valid inputs for the new parameter, the new parameter not previously included in and not previously definable by the second user interface;

receiving, on the second user interface, a second input relating to the new parameter; and

generating, based on the second input, valid data conforming with the schema defined in the first input, whereby a user can preview the new parameter without having to wait for the new parameter to be incorporated into an editor or simulator.

10 . The system of claim 9 , wherein the evaluation tool is used on real-world driving data from an external source.

11 . The system of claim 10 , wherein the real-world driving data is a driving log.

12 . The system of claim 9 , wherein the evaluation tool is used in connection with a simulation of a driving scenario.

13 . The system of claim 9 , wherein the new parameter includes at least one of a check of a speed of a vehicle and a check of a distance to objects.

14 . A method comprising:

generating a first user interface based on a schema;

receiving, on the first user interface, a first input including a new parameter defined by a schema and a range and/or a type of valid inputs for the new parameter, the new parameter not previously included in the first user interface and being a new agent, a new object, a new behavior, a new trajectory, a new trigger, or a new constraint in a simulated driving scenario;

generating, using the first input, a second user interface including the new parameter and a menu reflecting the range and/or the type of valid inputs for the new parameter, the new parameter not previously included in and not previously definable by the second user interface;

receiving, on the second user interface, a second input relating to the new parameter; and

generating, based on the second input, valid data conforming with the schema defined in the first input, whereby a user can preview the new parameter without having to wait for the new parameter to be incorporated into an editor or simulator.

15 . The method of claim 14 , further including:

causing a playback of the simulated driving scenario with the new parameter defined by the schema.

16 . The method of claim 14 , further including:

causing the new parameter defined by the schema to be uploaded to a simulator, whereby the new parameter defined by the schema can be incorporated into a simulation.

17 . The method of claim 14 , further including:

causing a simulation to run on the simulated driving scenario with the new parameter defined by the schema.

18 . The method of claim 14 , wherein the new parameter is not recognized by a simulator, and wherein the method further includes:

receiving a user-created algorithm to enable the new parameter to be processed by the simulator.

19 . The method of claim 14 , further including:

causing the new parameter to be uploaded for incorporation into a simulator and/or an editor; and

receiving or accessing a subsequent version of the simulator and/or the editor, wherein the new parameter is incorporated into the subsequent version of the simulator and/or the editor, whereby the new parameter is available for use by all users.

20 . A method comprising:

generating a first user interface based on a schema;

receiving, on the first user interface, a first input including a new parameter defined by a schema and a range and/or a type of valid inputs for the new parameter, the new parameter not previously included in the first user interface and being an evaluation tool for a simulation of a driving scenario or for real-world driving data;

generating, using the first input, a second user interface including the new parameter and a menu reflecting the range and/or the type of valid inputs for the new parameter, the new parameter not previously included in and not previously definable by the second user interface;

receiving, on the second user interface, a second input relating to the new parameter; and

generating, based on the second input, valid data conforming with the schema defined in the first input, whereby a user can preview the new parameter without having to wait for the new parameter to be incorporated into an editor or simulator.

21 . The method of claim 20 , wherein the evaluation tool is used in a simulation of a driving scenario.

22 . The method of claim 20 , wherein the evaluation tool is used on real-world driving data from an external source.