System and method for aircraft configuration checking
The method can include: optionally determining an aircraft state; determining a transition event; verifying an aircraft configuration; determining an aircraft alert state; and performing an action. However, the method can additionally or alternatively include any other suitable elements. The method functions to facilitate configuration checking and/or validation of configuration changes. Additionally or alternatively, the method can function to facilitate human-in-the-loop operation of a semi-autonomous aircraft (e.g., with an autonomous agent fulfilling the roles of one pilot of a multi-pilot aircraft). Additionally or alternatively, the method can function to autonomously respond to inconsistencies or failures associated with aircraft configuration changes.
1. A method for an aircraft, comprising:
at a first computing system, determining an aircraft transition event;
in response to the aircraft transition event, automatically initializing a checklist procedure to verify an aircraft configuration with the first computing system, the checklist procedure comprising a plurality of checks,
for a first subset of the plurality of checks: prompting a pilot to verify a respective state parameter of the aircraft configuration and confirming the respective state parameter based on a pilot input, and
for a remainder of the plurality of checks: autonomously verifying a respective state parameter of an aircraft configuration based on a set of onboard sensors and notifying the pilot of the verification; and
automatically performing an action, with the first computing system, based on the checklist procedure.
2. The method of claim 1 , wherein the checklist procedure is executed at an autonomous computing system onboard the aircraft, the autonomous computing system communicatively coupled to an aircraft computing system which comprises a flight management system (FMS), wherein performing the action comprises controlling the aircraft according to a flight command at an aircraft computing system.
3. The method of claim 2 , wherein the autonomous computing system comprises a portable device.
4. The method of claim 2 , wherein the autonomous computing system performs a set of co-pilot operations for the checklist procedure.
5. The method of claim 2 , wherein each check of the checklist procedure is completed sequentially and with inputs from both the pilot and the autonomous computing system.
6. The method of claim 1 , wherein the checklist procedure is manually initialized via voice input.
7. The method of claim 1 , wherein the checklist procedure is automatically triggered based on the aircraft state.
8. The method of claim 1 , wherein prompting the pilot comprises an auditory checklist challenge, wherein the pilot input comprises an audio input from an onboard audio sensor, wherein confirming the respective system state based on a pilot input comprises a Natural Language Processing (NLP) evaluation of the audio input.
9. The method of claim 8 , wherein, for a first subset of checks, the respective system state is further confirmed based on integrated onboard sensing.
10. The method of claim 1 , wherein the set of onboard sensors comprises a camera, wherein, for the remainder of checks, autonomously verifying the respective state parameter comprises: estimating an instrument state by computer vision (CV) analysis of an image from the camera.
11. The method of claim 10 , wherein the instrument state comprises a gauge value.
12. The method of claim 11 , further comprising: receiving instrument state data from a Remote Data Concentrator (RDC) of the aircraft.
13. The method of claim 1 , wherein, for the remainder of checks, autonomously verifying the respective state parameter comprises measuring the instrument state with a set of portable sensors.
14. The method of claim 1 , wherein the action comprises: triggering a secondary checklist procedure based on the first checklist procedure.
15. The method of claim 1 , further comprising: triggering a request for pilot intervention based on at least one of the plurality of checks.
16. The method of claim 1 , further comprising: escalating an alert state based on a failure to complete a check of the checklist, wherein the action is based on the alert state.
17. The method of claim 1 , wherein the plurality of checks comprises a first check, a second check, and a third check, the checklist procedure comprising:
automatically prompting a pilot to verify a first state parameter associated with the first check;
determining a first pilot input and, based on the first pilot input, confirming the first state parameter;
in response to confirmation of the first state parameter, automatically determining a second set of sensor data associated with a second check; and
verifying a second state parameter of the aircraft state based on a set of onboard sensors and notifying the pilot of the verification of the second state parameter.
18. A method for an aircraft, comprising:
in response to an aircraft transition event, retrieving a checklist associated with the aircraft transition event, the checklist comprising a sequence of checks, each check associated with a respective aircraft component and comprising challenge text and a predefined set of respective responses;
for a first check of the sequence, providing a first synthetic utterance of the challenge text using text-to-speech transformation,
receiving audio data and instrument state data;
determining a pilot response to the first synthetic utterance, within the predefined set of respective responses for the first check, by Natural Language Processing (NLP) of the audio data;
based on the pilot response and the instrument state data, autonomously verifying the first check of the sequence using the instrument state data;
based on the autonomous verification of the first check, updating an aircraft configuration at an aircraft computing system; and
controlling the aircraft based on the updated aircraft configuration.
19. The method of claim 18 , wherein instrument state data comprises estimated instrument states determined by computer vision (CV) analysis of a set of indicators.
20. The method of claim 19 , wherein the CV analysis, the NLP, and the text-to-speech transformation are executed at a portable device which is communicatively coupled to the aircraft computing system.
21. The method of claim 18 , further comprising: receiving a second set of instrument state data after the first check; and based on the second set of instrument state data, automatically requesting pilot intervention based on a second check of the sequence.