Unmanned aerial vehicle flight control system
Methods, systems and apparatus, including computer programs encoded on computer storage media for unmanned aerial vehicle flight for performing an inspection of land, property, structures or other objects. Automated aerial surveys allow a UAV to obtain aerial data without human manual control of a UAV. For certain aerial surveys, a UAV is not capable of completing the survey without refueling, or exchanging out used batteries for fresh batteries. For such aerial surveys, a method and system is needed to allow an operator to automatically perform an aerial survey while determining battery usage and replacement. Also, in circumstances where manual control of the UAV is needed, contingency-based software controls may be needed.
1. A flight system comprising:
one or more processors comprising hardware;
a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:
receive multiple jobs, each job including a respective flight plan associated with a location for an aerial survey to be performed by an unmanned aerial vehicle (UAV);
display, one or more jobs via a user interface, each job having an associated image of the location where the aerial survey is to be performed and a textual description of the job;
receive, via the user interface, a selection of a job to be performed;
analyze the associated image to determine a home location for the UAV;
receive confirmation that pre-flight checks of the UAV have been performed;
instruct the UAV to autonomously perform the aerial survey, the aerial survey comprising a flight pattern, wherein the flight pattern includes a path from the home location to a starting location, the starting location beginning a path where the UAV periodically obtains sensor information describing a property, land, or other structure;
determine that a contingency event has occurred, the contingency event indicating a loss or degradation of a global positioning satellite (GPS) signal; and
responsive to the contingency event, display, via the user interface, an indication of a physical location of the UAV and instruct the UAV to switch to manual control; or based on a resolution of the contingency event, instruct the UAV to autonomously land at the home location.
2. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
determine a number of batteries needed for at least one job based on the respective flight plan; and
display, via the user interface, an indication of the number of batteries needed for the at least one job.
3. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
monitor a battery state or level while the UAV is performing the aerial survey;
determine that the battery state or level has reached a threshold value; and
responsive to a determination that the battery state or level has been reached, instruct the UAV to land at the home location.
4. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
determine that a pop-up temporary flight restriction has occurred in the area of flight of the UAV; and
instruct the UAV to land at the home location.
5. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
determine a magnetic heading of the UAV indicating a front portion of the UAV; and
when the UAV is instructed to return to the home location, rotate the UAV such that the front portion of the UAV is maintained toward the magnetic heading while the UAV returns to the home location.
6. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
display, via the user interface, locations along the flight path where a battery change occurred.
7. The flight system of claim 1 ,
wherein the soft controls are displayed only when the contingency event has occurred or is predicted to occur; and
wherein the soft controls include user interface affordances, such as a button, icon, arrow, switch, stick controls, or other software controls, allowing directional flight controls to be sent to the UAV.
8. The flight system of claim 1 , wherein the flight pattern includes waypoints, or periodic observations, where the UAV obtain sensor information, wherein the sensor information are multiple digital photographs taken at a given waypoint or at the given periodic observation at multiple focus values.
9. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
determine the existence of an inflight compliance violation, where the violation occurs after launching the UAV, and the violation is a pop-up temporary flight restriction; and
instruct the UAV to return to the home location, after determining the inflight compliance violation.
10. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
display a listing of the jobs for those jobs in order of closest location proximity for the job and the location of the user device used to perform the job.
11. The flight system of claim 1 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
obtain instructions via the user interface to land the UAV at the home location.
12. A method performed by one or more processors comprising hardware, the method comprising:
receiving, one or more jobs, each job including a respective flight plan associated with a location for an aerial survey to be performed by an unmanned aerial vehicle (UAV);
displaying, the one or more jobs via a user interface, each job having an associated image of the location where the aerial survey is to be performed and a textual description of the job;
receiving, via the user interface, a selection of a job to be performed;
determining a home location for the UAV;
receiving confirmation that UAV pre-flight checks have been performed;
instructing the UAV to perform the aerial survey, the aerial survey comprising a flight pattern, wherein the flight pattern includes a path from the home location to a starting location, the starting location beginning a path where the UAV periodically obtains sensor information describing a property, land, or other structure;
determining that a contingency event has occurred, the contingency event indicating a loss or degradation of a global positioning satellite (GPS) signal; and
responsive to the contingency event, displaying, via the user interface, an indication of a physical location of the UAV and instructing the UAV to switch to manual control; or based on a resolution of the contingency event, instructing the UAV to autonomously land at the home location.
13. The method of claim 12 , further comprising:
displaying, via the user interface, an indication of the battery life remaining for the UAV.
14. The method of claim 12 , further comprising:
while the UAV is performing the aerial survey, monitoring a battery state or level;
determining that the battery state or level has reached a threshold value; and
responsive to a determination that the battery state or level has been reached, instructing the UAV to land at the home location.
15. The method of claim 12 , further comprising:
determining that a pop-up temporary flight restriction has occurred in the area of flight of the UAV; and
instructing the UAV to land at the home location.
16. The method of claim 12 , further comprising:
determining a magnetic heading of the UAV indicating a front portion of the UAV; and
when the UAV is instructed to return to the home location, rotate the UAV such that the front portion of the UAV is maintained toward the magnetic heading while the UAV returns to the home location.
17. The method of claim 12 , further comprising:
displaying, via the user interface, locations along the flight path where a battery change occurred.
18. The method of claim 12 , wherein the flight pattern includes waypoints, or periodic observations, where the UAV obtain sensor information, wherein the sensor information are multiple digital photographs taken at a given waypoint or at the given periodic observation at multiple focus values.
19. The method of claim 12 , further comprising:
determining the existence of an inflight compliance violation, where the violation occurs after launching the UAV, and the violation is a pop-up temporary flight restriction; and
instructing the UAV to return to the home location, after determining the inflight compliance violation.
20. The method of claim 12 , further comprising:
displaying a listing of the jobs for those jobs in order of closest location proximity for the job and the location of the user device used to perform the job.
21. A non-transitory computer storage medium storing instructions, that when executed by an unmanned aerial vehicle (UAV) comprising one or more processors, cause the UAV to perform operations comprising:
receiving, one or more jobs, each job including a respective flight plan associated with a location for an aerial survey to be performed by the UAV;
displaying, via a user interface, the one or more jobs in an order based on an estimated job completion time, each job having an associated image of the location where the aerial survey is to be performed and a textual description of the job;
receiving, via the user interface, a selection of a job to be performed;
determining a home location for the UAV;
receiving confirmation that UAV pre-flight checks have been performed;
instructing the UAV to perform the aerial survey, the aerial survey comprising a flight pattern, wherein the flight pattern includes a path from the home location to a starting location, the starting location beginning a path where the UAV periodically obtains sensor information describing a property, land, or other structure;
determining that a contingency event has occurred, the contingency event indicating a loss or degradation of a global positioning satellite (GPS) signal; and
responsive to the contingency event, displaying, via the user interface, an indication of a physical location of the UAV and instructing the UAV to switch to manual control; or based on a resolution of the contingency event, instructing the UAV to autonomously land at the home location.
22. The non-transitory computer storage medium of claim 21 , wherein the operations further comprise:
displaying, via the user interface, an indication of the battery life remaining for the UAV.
23. The non-transitory computer storage medium of claim 21 , wherein the operations further comprise:
while the UAV is performing the aerial survey, monitoring a battery state or level; and
determining that the battery state or level has reached a threshold value;
responsive to a determination that the battery state or level has been reached, instructing the UAV to land at the home location.
24. The non-transitory computer storage medium of claim 21 , wherein the operations further comprise:
determining that a pop-up temporary flight restriction has occurred in the area of flight of the UAV; and
instructing the UAV to land at the home location.
25. The non-transitory computer storage medium of claim 21 , wherein the operations further comprise:
determining a magnetic heading of the UAV indicating a front portion of the UAV; and
when the UAV is instructed to return to the home location, rotate the UAV such that the front portion of the UAV is maintained toward the magnetic heading while the UAV returns to the home location.
26. The non-transitory computer storage medium of claim 21 , wherein the operations further comprise:
displaying, via the user interface, locations along the flight path where a battery change occurred.
27. The non-transitory computer storage medium of claim 21 , wherein the flight pattern includes waypoints, or periodic observations, where the UAV obtain sensor information, wherein the sensor information are multiple digital photographs taken at a given waypoint or at the given periodic observation at multiple focus values.
28. The non-transitory computer storage medium of claim 21 , wherein the operations further comprise:
determining the existence of an inflight compliance violation, where the violation occurs after launching the UAV, and the violation is a pop-up temporary flight restriction; and
instructing the UAV to return to the home location, after determining the inflight compliance violation.
29. The non-transitory computer storage medium of claim 21 , wherein the operations further comprise:
displaying a listing of the jobs for those jobs in order of closest location proximity for the job and the location of the user device used to perform the job.