Unmanned aerial vehicle with immunity to hijacking, jamming, and spoofing attacks
An unmanned aerial vehicle (UAV) or “drone” executes a neural network to assist with detecting and responding to attacks. The neural network may monitor, in real time, the data stream from a plurality of onboard sensors during navigation and may communicate with a high-altitude pseudosatellite (“HAPS”) platform. For example, if the neural network detects a cyber-attack but determines that it does not interfere with external communications, it may shift navigation control of the drone to the HAPS.
1. An unmanned aerial vehicle (UAV) comprising:
a flight package;
a UAV navigation system;
a UAV image-acquisition device;
a UAV communications array including a plurality of agile transceivers;
a computer memory including a plurality of pre-stored waypoints and flight images of a pre programmed flight path; and
a drone inspection neural network including a neural compute engine and a predictor,
the neural compute engine including a processor and instructions, stored in the computer memory and executable by the processor, for using real time data received from one or more of the UAV image-acquisition device, the UAV communications array or the UAV navigation system as input to reconstruct a real time 3D map of the UAV operating environment and to position the UAV in real time in the 3D map;
the neural network-based predictor computationally trained to:
receive the real time 3D map and the real time UAV data and
identify and classify (a) that an attack on the UAV is occurring, (b) characteristics and type of attack, and (c) if the attack is new and uncharacterized,
where the neural compute engine is configured to:
send attack data to a HAPS or cloud based neural compute engine if the attack is classified as uncharacterized,
request updated predictor weight and configuration files identifying the characteristics and type of attack, and
receive updated weight and configuration files with classifications for the type of attack. and mitigation instructions in real time.
2. The UAV of claim 1 , with the neural compute engine configured to identify a mitigation action to be taken in response to the classified attack type, and cause the action to be taken.
3. The UAV of claim 1 , where the UAV communication array is configured to communicate with terrestrial and High Altitude Pseudo Satellite (HAPS) based communications networks, to establish a data link with the HAPS or the cloud based neural compute engine.
4. The UAV of claim 1 , where the cloud based or HAPS based neural compute engines enable dynamic increase in UAV neural compute power in real time.
5. The UAV of claim 1 , further comprising a database of actions, the neural compute engine being configured to select and cause execution of a mitigating action from the database of actions in response to the detected attack that has been classified by the predictor.
6. The UAV of claim 5 , wherein the attack is GPS spoofing and the mitigating action is causing the UAV to navigate without GPS.
7. The UAV of claim 6 , wherein navigation of the UAV is executed using optical flow or inertial navigation, and a UAV position along a prestored waypoint flight plan is tracked using classification of real time flight images from the UAV that are compared to prestored images of waypoints along the prestored waypoint flight plan, wherein the prestored images of the waypoints are separate and distinct from the real time flight images.
8. The UAV of claim 5 , wherein the UAV communications array tunes into a plurality of National Airspace Navigational Aids to track UAV position along a prestored waypoint flight plan.
9. The UAV of claim 5 , wherein the attack is GPS spoofing and the action is causing transfer of navigation control to the HAPS vehicle based neural compute engine, wherein the HAPS vehicle based neural compute engine is separate and distinct from the neural compute engine of the UAV.
10. The UAV of claim 5 , wherein the attack is RF blocking and the action is execution of a preprogrammed flight plan that does not require external communication, wherein the preprogrammed flight plan is separate and distinct from the pre programmed flight path of the UAV.
11. The UAV of claim 10 , wherein the preprogrammed flight plan relies on (i) at least one of inertial navigation or optical flow to navigate the UAV along a preprogrammed waypoint flight plan and (ii) classifying when the UAV reaches each waypoint using image matching utilizing prestored waypoint images.
12. The UAV of claim 5 , wherein the attack is a laser attack and the action is to plot and cause the UAV to follow a flight path away from a source of the laser.
13. The UAV of claim 5 , wherein the neural compute engine is further configured to communicate with a HAPS vehicle in order to computationally identify the mitigation action.
14. A method for a UAV including a flight package, a UAV navigation system, a UAV image-acquisition device, a UAV communications array including a plurality of agile transceivers, a computer memory including a plurality of pre-stored waypoints and flight images of a pre programmed flight path, a drone inspection neural network including a neural compute engine and a predictor, the neural compute engine including a processor and instructions, stored in the computer memory and executable by the processor, and the neural network-based predictor, the method comprising:
using, by the neural compute engine, real time data received from one or more of the UAV image-acquisition device, the UAV communications array or the UAV navigation system as input to reconstruct a real time 3D map of the UAV operating environment and to position the UAV in real time in the 3D map;
receiving, using the neural network-based predictor, the real time 3D map and the real time UAV data;
identifying and classifying, using the neural network-based predictor, (a) that an attack on the UAV is occurring, (b) characteristics and type of attack, and (c) if the attack is new and uncharacterized
sending, using the neural compute engine, attack data to a HAPS or cloud based neural compute engine if the attack is classified as uncharacterized,
requesting, using the neural compute engine, updated predictor weight and configuration files identifying the characteristics and type of attack, and
receiving, using the neural compute engine, updated weight and configuration files with classifications for the type of attack, and mitigation instructions in real time.
15. The method of claim 14 , further comprising: identifying, using the neural compute engine, a mitigation action to be taken in response to the classified attack type, and cause the action to be taken.
16. The method of claim 14 , where the UAV communication array is configured to communicate with terrestrial and High Altitude Pseudo Satellite (HAPS) based communications networks, to establish a data link with the HAPS or the cloud based neural compute engine.
17. The method of claim 14 , wherein the cloud based or HAPS based neural compute engines enable dynamic increase in UAV neural compute power in real time.
18. The method of claim 14 , wherein the UAV further includes a database of actions, and the method further comprising:
selecting and causing, using the neural compute engine, execution of a mitigating action from the database of actions in response to the detected attack that has been classified by the predictor.
19. The method of claim 18 , wherein the attack is GPS spoofing and the mitigating action is causing the UAV to navigate without GPS.
20. The method of claim 19 , wherein navigation of the UAV is executed using optical flow or inertial navigation, and a UAV position along a prestored waypoint flight plan is tracked using classification of real time flight images from the UAV that are compared to prestored images of waypoints along the prestored waypoint flight plan, wherein the prestored images of the waypoints are separate and distinct from the real time flight images.
21. The method of claim 18 , wherein the UAV communications array tunes into a plurality of National Airspace Navigational Aids to track UAV position along a prestored waypoint flight plan.
22. The UAV of claim 18 , wherein the attack is GPS spoofing and the action is causing transfer of navigation control to the HAPS vehicle based neural compute engine, wherein the HAPS vehicle based neural compute engine is separate and distinct from the neural compute engine of the UAV.
23. The UAV of claim 18 , wherein the attack is RF blocking and the action is execution of a preprogrammed flight plan that does not require external communication, wherein the preprogrammed flight plan is separate and distinct from the pre programmed flight path of the UAV.
24. The UAV of claim 23 , wherein the preprogrammed flight plan relies on (i) at least one of inertial navigation or optical flow to navigate the UAV along a preprogrammed waypoint flight plan and (ii) classifying when the UAV reaches each waypoint using image matching utilizing prestored waypoint images.
25. The UAV of claim 18 , wherein the attack is a laser attack and the action is to plot and cause the UAV to follow a flight path away from a source of the laser.
26. The UAV of claim 18 , wherein the neural compute engine further configured to communicate with a HAPS vehicle in order to computationally identify the mitigation action.