Quantitative pilot evaluation during training
A device for pilot training includes a memory, an interface, and one or more processors. The memory is configured to store at least one computational model of at least one human sensory system. The interface is configured to receive sensor data and aircraft state data from a flight simulator. The sensor data includes pilot activity data and motion data. The motion data is indicative of detected motion of a simulated aircraft of the flight simulator. The processor(s) are configured to process the motion data and the pilot activity data based on the at least one computational model to predict a pilot estimated aircraft state. The processor(s) are configured to determine an estimated error based on a comparison of the pilot estimated aircraft state and a detected aircraft state. The aircraft state data indicates the detected aircraft state. The processor(s) are configured to provide the estimated error to a second device.
1. A device for pilot training, the device comprising:
a memory configured to store one or more computational models of one or more human sensory systems;
a plurality of interfaces configured to receive an experience level associated with a pilot using a flight simulator, sensor data, and aircraft state data from the flight simulator, wherein the sensor data comprises pilot activity data and motion data, and wherein the motion data is indicative of detected motion of a simulated aircraft of the flight simulator; and
one or more processors configured to:
adjust the one or more computational models based on the experience level;
process the motion data and the pilot activity data based on the experience level and the one or more computational models to predict a pilot estimated aircraft state;
determine an estimated error based on a comparison of the pilot estimated aircraft state and a detected aircraft state, wherein the aircraft state data indicates the detected aircraft state;
determine a probability that a confidence indicator indicates a confidence in the estimated error;
in response to a determination that the probability is greater than a confidence threshold, determine that the estimated error exceeds an error threshold value, wherein the error threshold value is based on the experience level; and
provide the estimated error to a trainer associated with the flight simulator via a second device to enable the trainer to provide one or more instructions to a user of the flight simulator during use of the flight simulator based on the estimated error exceeding the error threshold value, wherein the one or more instructions comprise an instruction to more frequently observe one or more components of an instrument display.
2. The device of claim 1 , wherein the pilot activity data indicates pilot monitoring activity, pilot control activity, or both.
3. The device of claim 1 , wherein the one or more computational models comprise a vestibular model, a visual model, a proprioceptive model, or a combination thereof.
4. The device of claim 1 , wherein the motion data comprises angular motion data, linear motion data, or both.
5. The device of claim 1 , wherein the detected aircraft state comprises a detected lateral position, a detected longitudinal position, a detected altitude, a detected attitude, a detected linear motion, a detected angular motion, or a combination thereof, of the simulated aircraft.
6. The device of claim 1 , wherein the aircraft state data indicates that the simulated aircraft has the detected aircraft state at a first time, and wherein the one or more processors are configured to predict the pilot estimated aircraft state based, at least in part, on determining that the pilot activity data indicates that an aircraft state indicator is in a line-of-sight of a pilot at a second time and that the second time is within a threshold duration of the first time.
7. The device of claim 6 , wherein the aircraft state indicator comprises the instrument display, a simulated external environmental feature, or both.
8. The device of claim 7 , wherein components of the instrument display comprise an altimeter, an attitude indicator, a heading indicator, an airspeed indicator, a turn coordinator, a vertical speed indicator, a latitude indicator, a longitude indicator, or a combination thereof.
9. The device of claim 1 , wherein the memory is further configured to store an aircraft dynamics model, and wherein the one or more processors are configured to process one or more of the aircraft state data, the motion data, or the pilot activity data based on the aircraft dynamics model to predict the pilot estimated aircraft state.
10. A method of pilot training, the method comprising:
receiving, at a device, sensor data and aircraft state data from a flight simulator, wherein the sensor data comprises pilot activity data and motion data, and wherein the motion data is indicative of detected motion of a simulated aircraft of the flight simulator;
adjusting, at the device, one or more computational models of at least one human sensory system based on an experience level associated with a pilot using the flight simulator;
processing, at the device, the motion data and the pilot activity data based on the experience level and based on the one or more computational models to predict a pilot estimated aircraft state;
determining, at the device, an estimated error based on a comparison of the pilot estimated aircraft state and a detected aircraft state, wherein the aircraft state data indicates the detected aircraft state;
determining a probability that a confidence indicator indicates a confidence in the estimated error;
in response to a determination that the probability is greater than a confidence threshold, determining that the estimated error exceeds an error threshold value, wherein the error threshold value is based on the experience level; and
providing the estimated error to a trainer associated with the flight simulator via a second device to enable the trainer to provide one or more instructions to a user of the flight simulator during use of the flight simulator based on the estimated error exceeding the error threshold value, wherein the one or more instructions comprise an instruction to more frequently observe one or more components of an instrument display.
11. The method of claim 10 , wherein the pilot activity data comprises first activity sensor data received from a non-contact sensor, second activity sensor data received from a contact sensor, or both.
12. The method of claim 10 , wherein the pilot estimated aircraft state comprises an estimated lateral position, an estimated longitudinal position, an estimated altitude, an estimated attitude, an estimated linear motion, an estimated angular motion, or a combination thereof, of the simulated aircraft.
13. The method of claim 10 , wherein the aircraft state data indicates that the simulated aircraft has the detected aircraft state at a first time, and wherein the pilot estimated aircraft state is predicted based, at least in part, on determining that the pilot activity data indicates that an aircraft state indicator is in a line-of-sight of a pilot at a second time and that the second time is within a threshold duration of the first time.
14. The method of claim 13 , wherein the aircraft state indicator comprises the instrument display, a simulated external environmental feature, or both.
15. The method of claim 14 , wherein the instrument display comprises an altimeter, an attitude indicator, a heading indicator, an airspeed indicator, a turn coordinator, a vertical speed indicator, a latitude indicator, a longitude indicator, or a combination thereof.
16. A computer-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to initiate, perform, or control operations to:
receive sensor data and aircraft state data from a flight simulator, wherein the sensor data comprises pilot activity data of a pilot and motion data, and wherein the motion data is indicative of detected motion of a simulated aircraft of the flight simulator;
adjust one or more computational models based on an experience level of the pilot;
process the motion data and the pilot activity data based on the experience level and based on one or more computational models to predict a pilot estimated aircraft state;
determine an estimated error based on a comparison of the pilot estimated aircraft state and a detected aircraft state, wherein the aircraft state data indicates the detected aircraft state;
determine a probability that a confidence indicator indicates a confidence in the estimated error;
in response to a determination that the probability is greater than a confidence threshold, determine that the estimated error exceeds an error threshold value, wherein the error threshold value is based on the experience level; and
provide the estimated error to a trainer associated with the flight simulator via a device to enable the trainer to provide one or more instructions to a user of the flight simulator during use of the flight simulator based on the estimated error exceeding that error threshold value, wherein the one or more instructions comprise an instruction to more frequently observe one or more components of an instrument display.
17. The computer-readable storage device of claim 16 , wherein the detected aircraft state comprises a detected lateral position, a detected longitudinal position, a detected altitude, a detected attitude, a detected linear motion, a detected angular motion, or a combination thereof, of the simulated aircraft.
18. The computer-readable storage device of claim 17 , wherein the pilot estimated aircraft state comprises an estimated lateral position, an estimated longitudinal position, an estimated altitude, an estimated attitude, an estimated linear motion, an estimated angular motion, or a combination thereof, of the simulated aircraft.
19. The computer-readable storage device of claim 18 , wherein the estimated error is based on one or more of a difference between the detected lateral position and the estimated lateral position, the detected longitudinal position and the estimated longitudinal position, the detected altitude and the estimated altitude, the detected attitude and the estimated attitude, the detected linear motion and the estimated linear motion, or the detected angular motion and the estimated angular motion.
20. The computer-readable storage device of claim 16 , wherein the aircraft state data indicates that the simulated aircraft has the detected aircraft state at a first time, and wherein the pilot estimated aircraft state is predicted based, at least in part, on determining that the pilot activity data indicates that an aircraft state indicator is in a line-of-sight of a pilot at a second time and that the second time is within a threshold duration of the first time.