Drone flight control center and pilot monitor
View Patent ↗An sUAS operations device that allows a pilot to fly an sUAS. The device includes a sensor interface to receive signals from a sensor attached to the pilot to monitor physiological responses of the pilot during the flight. The system records a video of the flight and synchronizes it with the sensor feedback to allow correlation of the stress levels with the flight. The system also may provide feedback to the pilot during flight.
1 . A ground control station for an unmanned aerial vehicle (UAV), comprising:
controls to allow a pilot to control flight of a UAV;
a display to allow the pilot to view at least one of a video feed of the UAV and a video feed from the UAV;
one or more ports to allow the station to receive signals from one or more sensors connected to the pilot and one or more video feeds;
a memory to store the one or more video feeds and signals received through the one or more ports; and
one or more processors configured to execute code that causes the one more processors to:
apply artificial intelligence to the signals and the one or more video feeds to provide a pilot stress-related incident prediction; and
notify the pilot if the incident prediction is above a threshold indicating a likelihood of an occurrence of a pilot stress-related incident.
2 . The ground control station as claimed in claim 1 , wherein the one or more processors are further configured to execute code to store at least one of the signals from the one or more sensors and the one or more video feeds.
3 . The ground control station as claimed in claim 1 , wherein the one or more sensors comprise a wrist-mounted sensor, or a sensor positioned on the ground control station positioned to contact at least one hand of the pilot.
4 . The ground control station as claimed in claim 1 , wherein the one or more video feeds comprise one or more of a video feed from the UAV, a video feed of a view of the pilot, and a video feed of the pilot.
5 . The ground control station as claimed in claim 1 , wherein the one or more processors are further configured to execute code that causes the one or more processors to train the artificial intelligence.
6 . The ground control station as claimed in claim 5 , wherein the code that causes the one or more processors to train the artificial intelligence comprises code that causes the one or more processors to train the artificial intelligence on one or more dataset comprised of signals, video feeds, and results.
7 . A ground control system, comprising:
one or more sensors configured to be in contact with a pilot;
controls to allow a pilot to control flight of a UAV;
one or more cameras, at least one camera attached to the UAV;
a display to allow the pilot to view at least one of a graphic of the UAV and video from the UAV;
one or more ports to allow the system to receive signals from the one or more sensors connected to the pilot and one or more video feeds;
a memory to store the one or more video feeds and signals received through the one or more ports; and
one or more processors configured to execute code that causes the one more processors to:
apply artificial intelligence to the signals and the one or more video feeds to provide a pilot stress-related incident prediction; and
notify the pilot if the incident prediction is above a threshold indicating a likelihood of an occurrence of a pilot stress-related incident.
8 . The ground control system as claimed in claim 7 , wherein the one or more sensors comprise one or more of heart rate monitors, galvanic skin sensors, and EEGs.
9 . The ground control system as claimed in claim 7 , wherein the one or more sensors are configured to reside on one or more of a wrist, ear, and hand of the pilot.
10 . The ground control system as claimed in claim 7 , wherein the one or more cameras include additional cameras on one or more of the ground control system and near eyes of the pilot.
11 . The ground control system as claimed in claim 7 , wherein the one or more processors are further configured to execute code to store at least one of the signals from the one or more sensors and the one or more video feeds.
12 . The ground control system as claimed in claim 7 , wherein the one or more processors are further configured to execute code that causes the one or more processors train the artificial intelligence.
13 . The ground control system as claimed in claim 12 , wherein the code that causes the one or more processors to train the artificial intelligence comprises code that causes the one or more processors to train the artificial intelligence on one or more dataset comprised of signals, video feeds, and results.