Computer Vision Systems and Methods for Detecting Structures Using Aerial Imagery and Heightmap Data
Computer vision systems and methods for detecting structures using aerial imagery and heightmap data are provided. The system receives aerial imagery and at least one heightmap, and merges the aerial imagery and the heightmap to create a combined image. The system determines one or more structures of the land property based at least in part on the combined image and a computer vision model, which can detect one or more objects in the combined image. The system can generate and place a bounding box or a polygon around each of the detected objects, and generate and assign a structure classification to the bounding box or the polygon to indicate the structure of the object. The system can also determine a geographic location of each structure using the two-dimensional (2D) spatial information of the aerial imagery and the depth information of the heightmap.
1 . A computer vision system for detecting structures in aerial imagery and heightmap data, comprising:
a processor in communication with a database, the processor:
receiving an aerial image and at least one heightmap;
merging the aerial image with the at least one heightmap to create a combined image; and
processing the combined image using a computer vision model to detect one or more objects in the combined image.
2 . The system of claim 1 , wherein the processor merges the aerial image with the at least one heightmap by aligning the heightmap with the aerial image.
3 . The system of claim 2 , wherein the processor merges the aerial image with the at least one heightmap by mean shifting a plurality of values in the heightmap to zero.
4 . The system of claim 3 , wherein the processor merges the aerial image with the at least one heightmap by resizing the heightmap to the size of the aerial image.
5 . The system of claim 4 , wherein the processor merges the aerial iamge with the at least one heightmap by concatenating the aerial image with the heightmap to create the combined image.
6 . The system of claim 1 , wherein the computer vision model comprises a convolutional neural network.
7 . The system of claim 1 , wherein the detected one or more objects comprises one or more of a roof, a pool, a fence, or a boundary of a land property.
8 . The system of claim 1 , wherein the processor generates and places a bounding box or a polygon around each of the detected one or more objects in the image.
9 . The system of claim 8 , wherein the processor generates and assigns a structure classification to the bounding box or the polygon to indicate the structure of the object.
10 . The system of claim 1 , wherein the processor determines a geographic location of each of the one or more objects using two-dimensional spatial information of the aerial image and depth information of the heightmap.
11 . The system of claim 1 , wherein the processor stores data associated with the combined image including one or more of geographic coordinates, footprint polygons, bounding boxes, structure classifications, timestamps of the aerial image or the heightmap, or metadata in a geospatial database.
12 . A computer vision method for detecting structures in aerial imagery and heightmap data, comprising:
receiving by a processor an aerial image and at least one heightmap;
merging the aerial image with the at least one heightmap to create a combined image; and
processing the combined image using a computer vision model executed by the processor to detect one or more objects in the combined image.
13 . The method of claim 12 , further comprising merging the aerial image with the at least one heightmap by aligning the heightmap with the aerial image.
14 . The method of claim 13 , further comprising merging the aerial image with the at least one heightmap by mean shifting a plurality of values in the heightmap to zero.
15 . The method of claim 14 , further comprising merging the aerial image with the at least one heightmap by resizing the heightmap to the size of the aerial image.
16 . The method of claim 15 , further comprising merging the aerial image with the at least one heightmap by concatenating the aerial image with the heightmap to create the combined image.
17 . The method of claim 12 , wherein the computer vision model comprises a convolutional neural network.
18 . The method of claim 12 , wherein the detected one or more objects comprises one or more of a roof, a pool, a fence, or a boundary of a land property.
19 . The method of claim 12 , further comprising and generating a bounding box or a polygon around each of the detected one or more objects in the image.
20 . The method of claim 19 , further comprising generating and assigning a structure classification to the bounding box or the polygon to indicate the structure of the object.
21 . The method of claim 12 , further comprising determining a geographic location of each of the one or more objects using two-dimensional spatial information of the aerial image and depth information of the heightmap.
22 . The system of claim 1 , further comprising storing data associated with the combined image including one or more of geographic coordinates, footprint polygons, bounding boxes, structure classifications, timestamps of the aerial image or the heightmap, or metadata in a geospatial database.