IP Library Granted Patent US 11,551,494
Granted Patent B2
US 11,551,494 · App. 16/863,311 · Granted Jan 10, 2023

Predictive mobile test device control for autonomous vehicle testing

Inventor: James William Morrisey, IV (Pittsburgh, PA)
Assignee: UATC, LLC
G07C5/0858B60W60/0011G07C5/0808B60W2050/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,551,494
App. No.
16/863,311
Granted
Jan 10, 2023
Kind
B2
Abstract

Example aspects of the present disclosure are directed to improved systems and methods for testing autonomous vehicle operation through the use of mobile test devices that are controlled at least in part in response to predictive motion planning associated with autonomous vehicles. More particularly, the motion of a mobile test device can be controlled based on the motion plan of an autonomous vehicle to cause desired interactions between the mobile test device and the autonomous vehicle. Motion planning data associated with the autonomous vehicle can be obtained by an autonomous vehicle (AV) test system prior to the autonomous vehicle implementing or completely implementing a motion plan. In this manner, the AV test system can proactively control the mobile test device based on predictive motion planning data to facilitate interactions between the mobile test device and the autonomous vehicle that may not otherwise be achievable.

Claims (64)

1. A computer-implemented method, comprising:

obtaining data indicative of a target interaction between an autonomous vehicle and a mobile test device in an environment;

obtaining motion planning data generated by an autonomy computing system of the autonomous vehicle while operating within the environment, the motion planning data indicative of a first motion plan, the motion planning data obtained prior to the autonomous vehicle executing the first motion plan;

determining one or more motion parameters for the mobile test device based at least in part on the motion planning data and the data indicative of the target interaction, wherein determining the one or more motion parameters comprises:

determining one or more first motion parameters for the mobile test device to reach an interaction point with the autonomous vehicle at a target time based at least in part on the first motion plan of the autonomous vehicle; and

generating one or more control commands for the mobile test device based at least in part on the one or more motion parameters.

2. The computer-implemented method of claim 1 , wherein the one or more control commands are generated by a computing system remotely located from the mobile test device, the method further comprising:

transmitting, from the computing system to the mobile test device, the one or more control commands.

3. The computer-implemented method of claim 1 , wherein the one or more control commands are generated by a computing system local with the mobile test device, the method further comprising:

providing, by the computing system, one or more control signals to one or more control devices to control the mobile test device based on the one or more control commands.

4. The computer-implemented method of claim 1 , further comprising:

generating the data indicative of the target interaction between the autonomous vehicle and the mobile test device, where the data indicative of the target interaction includes data indicative of at least one of a target geographic location, a target velocity of the mobile test device, or a target orientation of the mobile test device.

5. The computer-implemented method of claim 1 , wherein obtaining motion planning data generated by the autonomy computing system of the autonomous vehicle comprises:

obtaining data indicative of a second motion plan prior to the autonomous vehicle executing the second motion plan;

wherein the motion planning data indicative of the first motion plan is obtained prior to the data indicative of the second motion plan.

6. The computer-implemented method of claim 5 , wherein determining one or more motion parameters for the mobile test device based at least in part on the motion planning data and the data indicative of the target interaction comprises:

determining one or more second motion parameters for the mobile test device to reach the interaction point with the autonomous vehicle at a target time based at least in part on the second motion plan of the autonomous vehicle, wherein the one or more second motion parameters are determined prior to the autonomous vehicle executing the second motion plan.

7. The computer-implemented method of claim 1 , wherein determining one or more motion parameters for the mobile test device based at least in part on the motion planning data and the data indicative of the target interaction comprises:

determining a motion trajectory for the mobile test device based at least in part on the interaction point and the target time.

8. The computer-implemented method of claim 1 , further comprising:

obtaining motion planning data generated by the autonomy computing system of the autonomous vehicle in association with the targeted interaction;

comparing the motion planning data with one or more validation criteria for the autonomous vehicle; and

generating validation data associated with the autonomous vehicle based on comparing the motion planning data with one or more validation criteria.

9. A computing system, comprising:

one or more processors; and

one or more non-transitory computer-readable media that store instructions that are executable by the one or more processors to cause the computing system to perform operations, the operations comprising:

obtaining data indicative of a target interaction between an autonomous vehicle and a mobile test device in an environment;

obtaining motion planning data generated by an autonomy computing system of the autonomous vehicle while operating within the environment, the motion planning data indicative of a first motion plan, the motion planning data obtained prior to the autonomous vehicle executing the first motion plan;

determining one or more motion parameters for the mobile test device based at least in part on the motion planning data and the data indicative of the target interaction, wherein determining the one or more motion parameters comprises:

determining one or more first motion parameters for the mobile test device to reach an interaction point with the autonomous vehicle at a target time based at least in part on the first motion plan of the autonomous vehicle; and

generating one or more control commands for the mobile test device based at least in part on the one or more motion parameters.

10. The computing system of any of claim 9 , wherein the computing system is remotely located from the mobile test device, the operations further comprising:

transmitting, to the mobile test device, the one or more control commands.

11. The computing system of claim 9 , wherein the computing system is local with the mobile test device, the operations further comprising:

providing one or more control signals to one or more control devices to control the mobile test device based on the one or more control commands.

12. The computing system of claim 9 , further comprising:

generating the data indicative of the target interaction between the autonomous vehicle and the mobile test device, where the data indicative of the target interaction includes data indicative of at least one of a target geographic location, a target velocity of the mobile test device, or a target orientation of the mobile test device.

13. The computing system of claim 9 , wherein obtaining motion planning data generated by the autonomy computing system of the autonomous vehicle comprises:

obtaining data indicative of a second motion plan prior to the autonomous vehicle executing the second motion plan;

wherein the motion planning data indicative of the first motion plan is obtained prior to the data indicative of the second motion plan.

14. The computing system of claim 13 , wherein determining one or more motion parameters for the mobile test device based at least in part on the motion planning data and the data indicative of the target interaction comprises:

determining one or more second motion parameters for the mobile test device to reach the interaction point with the autonomous vehicle at a target time based at least in part on the second motion plan of the autonomous vehicle, wherein the one or more second motion parameters are determined prior to the autonomous vehicle executing the second motion plan.

15. The computing system of claim 9 , wherein determining one or more motion parameters for the mobile test device based at least in part on the motion planning data and the data indicative of the target interaction comprises:

determining a motion trajectory for the mobile test device based at least in part on the interaction point and the target time.

16. The computing system of claim 9 , further comprising:

obtaining motion planning data generated by the autonomy computing system of the autonomous vehicle in association with the target interaction;

comparing the motion planning data with one or more validation criteria for the autonomous vehicle; and

generating validation data associated with the autonomous vehicle based on comparing the motion planning data with one or more validation criteria.

17. A mobile test device for testing autonomous vehicle response to object movement, comprising:

a device propulsion system;

one or more communication interfaces;

one or more processors; and

one or more non-transitory computer-readable media that store instructions that are executable by the one or more processors to cause the one or more processors to perform operations, the operations comprising:

obtaining motion planning data generated by an autonomy computing system of an autonomous vehicle while operating within an environment, the motion planning data indicative of a first motion plan, the motion planning data obtained prior to the autonomous vehicle executing the first motion plan;

determining one or more motion parameters for the mobile test device based at least in part on the motion planning data, wherein determining the one or more motion parameters comprises:

determining one or more first motion parameters for the mobile test device to reach an interaction point with the autonomous vehicle at a target time based at least in part on the first motion plan of the autonomous vehicle; and

providing one or more control signals to the device propulsion system based at least in part on the one or more motion parameters.

18. The mobile test device of claim 17 , wherein obtaining motion planning data generated by an autonomy computing system of an autonomous vehicle while operating within an environment comprises:

obtaining data associated with a second motion plan prior to the autonomous vehicle executing the second motion plan;

wherein the motion planning data indicative of the first motion plan is obtained prior to the data indicative of the second motion plan.

19. The mobile test device of claim 18 , wherein determining one or more motion parameters for the mobile test device based at least in part on the motion planning data comprises:

determining one or more second motion parameters for the mobile test device to reach the interaction point with the autonomous vehicle at a target time based at least in part on the second motion plan of the autonomous vehicle, wherein the one or more second motion parameters are determined prior to the autonomous vehicle executing the second motion plan.

20. The mobile test device of any of claim 17 , wherein determining one or more motion parameters for the mobile test device based at least in part on the motion planning data comprises:

determining a motion trajectory for the mobile test device based at least in part on the interaction point and the target time.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2024
From: UATC, LLC
To: AURORA OPERATIONS, INC.
Reel/Frame 067733/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2020
From: MORRISEY, JAMES WILLIAM, IV
To: UATC, LLC
Reel/Frame 054763/0255 →
Continuity (2)
Provisional Application 62952819 · Dec 23, 2019
Related Publication 20210192874A1 · Jun 24, 2021