HUMAN DRIVING BEHAVIOR MODELING SYSTEM USING MACHINE LEARNING
A human driving behavior modeling system using machine learning is disclosed. A particular embodiment can be configured to: obtain training image data from a plurality of real world image sources and perform object extraction on the training image data to detect a plurality of vehicle objects in the training image data; categorize the detected plurality of vehicle objects into behavior categories based on vehicle objects performing similar maneuvers at similar locations of interest; train a machine learning module to model particular human driving behaviors based on use of the training image data from one or more corresponding behavior categories; and generate a plurality of simulated dynamic vehicles that each model one or more of the particular human driving behaviors trained into the machine learning module based on the training image data.
1 . A system comprising:
a data processor;
a vehicle object extraction module, executable by the data processor, to obtain training image data from a plurality of real world image sources and to perform object extraction on the training image data to detect a plurality of vehicle objects in the training image data;
a vehicle behavior classification module, executable by the data processor, to categorize the detected plurality of vehicle objects into behavior categories based on vehicle objects performing similar maneuvers at similar locations of interest;
a machine learning module, executable by the data processor, trained to model particular human driving behaviors based on use of the training image data from one or more corresponding behavior categories; and
a simulated vehicle generation module, executable by the data processor, to generate a plurality of simulated dynamic vehicles that each model one or more of the particular human driving behaviors trained into the machine learning module based on the training image data.
2 . The system of claim 1 being further configured to include a driving environment simulator to incorporate the plurality of simulated dynamic vehicles into a traffic environment testbed for testing, evaluating, or analyzing autonomous vehicle subsystems.
3 . The system of claim 1 wherein the plurality of real world image sources are from the group consisting of: on-vehicle cameras, stationary cameras, cameras in unmanned aerial vehicles (UAVs or drones), satellite images, simulated images, and previously-recorded images.
4 . The system of claim 1 wherein the object extraction performed on the training image data is performed using semantic segmentation.
5 . The system of claim 1 wherein the object extraction performed on the training image data includes determining a trajectory for each of the plurality of vehicle objects.
6 . The system of claim 1 wherein the behavior categories are from the group consisting of: vehicle/driver behavior categories related to traffic areas/locations, vehicle/driver behavior categories related to traffic conditions, and vehicle/driver behavior categories related to special vehicles.
7 . The system of claim 2 wherein the autonomous vehicle subsystems are from the group consisting of: an autonomous vehicle motion planning module, and an autonomous vehicle control module.
8 . A method comprising:
using a data processor to obtain training image data from a plurality of real world image sources and using the data processor to perform object extraction on the training image data to detect a plurality of vehicle objects in the training image data;
using the data processor to categorize the detected plurality of vehicle objects into behavior categories based on vehicle objects performing similar maneuvers at similar locations of interest;
training a machine learning module to model particular human driving behaviors based on use of the training image data from one or more corresponding behavior categories; and
using the data processor to generate a plurality of simulated dynamic vehicles that each model one or more of the particular human driving behaviors trained into the machine learning module based on the training image data.
9 . The method of claim 8 including incorporating the plurality of simulated dynamic vehicles into a driving environment simulator for testing, evaluating, or analyzing autonomous vehicle subsystems.
10 . The method of claim 8 wherein the plurality of real world image sources are from the group consisting of: on-vehicle cameras, stationary cameras, cameras in unmanned aerial vehicles (UAVs or drones), satellite images, simulated images, and previously-recorded images.
11 . The method of claim 8 wherein the object extraction performed on the training image data is performed using semantic segmentation.
12 . The method of claim 8 wherein the object extraction performed on the training image data includes determining a trajectory for each of the plurality of vehicle objects.
13 . The method of claim 8 wherein the behavior categories are from the group consisting of: vehicle/driver behavior categories related to traffic areas/locations, vehicle/driver behavior categories related to traffic conditions, and vehicle/driver behavior categories related to special vehicles.
14 . The method of claim 9 wherein the autonomous vehicle subsystems are from the group consisting of: an autonomous vehicle motion planning module, and an autonomous vehicle control module.
15 . A non-transitory machine-useable storage medium embodying instructions which, when executed by a machine, cause the machine to:
a vehicle object extraction module, executable by the data processor, to obtain training image data from a plurality of real world image sources and to perform object extraction on the training image data to detect a plurality of vehicle objects in the training image data;
a vehicle behavior classification module, executable by the data processor, to categorize the detected plurality of vehicle objects into behavior categories based on vehicle objects performing similar maneuvers at similar locations of interest;
a machine learning module, executable by the data processor, trained to model particular human driving behaviors based on use of the training image data from one or more corresponding behavior categories; and
a simulated vehicle generation module, executable by the data processor, to generate a plurality of simulated dynamic vehicles that each model one or more of the particular human driving behaviors trained into the machine learning module based on the training image data.
16 . The non-transitory machine-useable storage medium of claim 15 being further configured to include a driving environment simulator to incorporate the plurality of simulated dynamic vehicles into a traffic environment testbed for testing, evaluating, or analyzing autonomous vehicle subsystems.
17 . The non-transitory machine-useable storage medium of claim 15 wherein the plurality of real world image sources are from the group consisting of: on-vehicle cameras, stationary cameras, cameras in unmanned aerial vehicles (UAVs or drones), satellite images, simulated images, and previously-recorded images.
18 . The non-transitory machine-useable storage medium of claim 15 wherein the object extraction performed on the training image data is performed using semantic segmentation.
19 . The non-transitory machine-useable storage medium of claim 15 wherein the object extraction performed on the training image data includes determining a trajectory for each of the plurality of vehicle objects.
20 . The non-transitory machine-useable storage medium of claim 15 wherein the behavior categories are from the group consisting of: vehicle/driver behavior categories related to traffic areas/locations, vehicle/driver behavior categories related to traffic conditions, and vehicle/driver behavior categories related to special vehicles.