Structure scan using unmanned aerial vehicle
Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.
1. A method, comprising:
generating a three-dimensional map of a structure by performing a coarse scan of the structure from a first distance using a sensor of an unmanned aerial vehicle;
generating a set of facets representing polygons on multiple planes of a three-dimensional space fit to points in the three-dimensional map, wherein a facet of the set of facets is based on a user edit, within a graphical representation of an image of the structure, of a polygon represented by the facet, wherein the image of the structure is based on the coarse scan and an edited polygon represented by the facet and that results from the user edit is different than the polygon; and
generating a scan plan including a sequence of poses for the unmanned aerial vehicle to navigate to for capturing images of the structure from a second distance based on the set of facets, wherein the first distance is greater than the second distance.
2. The method of claim 1 , wherein the coarse scan is performed from a single pose in which an entirety of the structure is within a field of view of the sensor.
3. The method of claim 2 , wherein the structure is one of a bridge, a building, a portion of a building, or a building under construction.
4. The method of claim 1 , wherein the three-dimensional map includes one of a voxel occupancy map or a signed distance map.
5. The method of claim 1 , wherein the sensor is a distance sensor and the first distance represents a safe operating distance from the structure, and wherein generating the three-dimensional map comprises:
performing a low-resolution scan of the structure using the distance sensor from the safe operating distance.
6. The method of claim 1 , comprising:
presenting, for display at a remote controller device, an overview image of the structure; and
receiving, from the remote controller device, input associated with the overview image, wherein the input is used to generate one or more facets of the set of facets.
7. The method of claim 6 , comprising:
presenting, for display at the remote controller device, a graphical representation of the scan plan overlaid on the overview image of the structure.
8. The method of claim 7 , wherein the scan plan is generated at the remote controller device.
9. An unmanned aerial vehicle, comprising:
a camera;
a memory storing instructions; and
a processor configured to execute the instructions to:
cause the camera to capture one or more first images during an initial coarse scan of a structure from a first distance;
generate a three-dimensional map of the structure based on the one or more first images; and
generate, based on a set of facets generated to represent on multiple planes of a three-dimensional space fit to points in the three-dimensional map, a scan plan including a sequence of poses for the unmanned aerial vehicle to navigate to for capturing one or more second images of the structure from a second distance, wherein the first distance is greater than the second distance, wherein a facet of the set of facets is based on a user edit, within a graphical representation of an image of the structure, of a polygon represented by the facet, and wherein the image of the structure is based on the coarse scan and an edited polygon represented by the facet and that results from the user edit is different than the polygon.
10. The unmanned aerial vehicle of claim 9 , comprising:
a propulsion mechanism configured to fly the unmanned aerial vehicle,
wherein the processor is configured to execute the instructions to:
cause the propulsion mechanism to fly the unmanned aerial vehicle to the first distance from the structure to perform the initial coarse scan; and
cause the propulsion mechanism to fly the unmanned aerial vehicle to the second distance from the structure to perform an inspection of the structure according to the sequence of poses.
11. The unmanned aerial vehicle of claim 10 , wherein, to cause the propulsion mechanism to fly the unmanned aerial vehicle to the second distance from the structure to perform the inspection of the structure according to the sequence of poses, the processor is configured to execute the instructions to:
cause the propulsion mechanism to fly the unmanned aerial vehicle to an adjusted pose location determined to avoid a detected object.
12. The unmanned aerial vehicle of claim 9 , wherein the one or more first images include an overview image of the structure, and wherein the processor is configured to execute the instructions to:
receive, from a remote controller device, input associated with the overview image; and
generate one or more facets of the set of facets based on the input.
13. The unmanned aerial vehicle of claim 9 , comprising:
a distance sensor configured to produce output used to generate the three-dimensional map of the structure.
14. The unmanned aerial vehicle of claim 9 , wherein the three-dimensional map includes one of a voxel occupancy map or a signed distance map.
15. A system, comprising:
an unmanned aerial vehicle configured to generate a scan plan including a sequence of poses to navigate to for capturing inspection images of a structure based on a set of facets generated to represent polygons on multiple planes of a three-dimensional space fit to points in a three-dimensional map of the structure, wherein the three-dimensional map of the structure is generated based on output of a coarse scan of the structure, wherein a facet of the set of facets is based on a user edit, within a graphical representation of an image of the structure, of a polygon represented by the facet, and wherein the image of the structure is based on the coarse scan and an edited polygon represented by the facet and that results from the user edit is different than the polygon; and
a remote controller device configured to display, via a graphical user interface, information associated with one or more of the structure or the scan plan.
16. The system of claim 15 , wherein the output of the coarse scan includes initial scan images captured from a first distance, wherein the inspection images are captured from a second distance, and wherein the first distance is greater than the second distance.
17. The system of claim 15 , wherein the output of the coarse scan includes an overview image of the structure, and wherein the information associated with the structure displayed at the remote controller device includes the overview image.
18. The system of claim 17 , wherein one or more facets of the set of facets are generated based on input via a user interaction with the overview image at the remote controller device while the overview image is displayed at the remote controller device.
19. The system of claim 18 , wherein one or more points in the overview image at a location of the user interaction are projected onto one or more points of the three-dimensional map.
20. The system of claim 18 , wherein one or more points of a top surface of the three-dimensional map are projected onto the overview image and associated with a location of the user interaction.