GENERATING AND VALIDATING A VIRTUAL 3D REPRESENTATION OF A REAL-WORLD STRUCTURE
A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
1 - 20 . (canceled)
21 . A method for generating a virtual 3D representation of a structure, the method comprising:
receiving a plurality of images of a real-world structure;
identifying one or more landmarks in each image of the plurality of images;
providing metadata for each image of the plurality of images, wherein the metadata comprises a geometric constraint of each of the identified landmarks in each image of the of the plurality of images;
correlating images of the plurality of images; and
generating the 3D model of the real-world structure based on:
the identified landmarks in the plurality of images;
the correlations between the images of the plurality of images; and
the metadata comprising the geometrical constraint for the identified landmarks.
22 . The method of claim 21 , wherein the metadata further comprises a classification of the one or more identified landmarks.
23 . The method of claim 21 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure.
24 . The method of claim 23 , wherein the geometric properties comprise a position of the identified landmarks.
25 . The method of claim 23 , wherein generating the 3D model of the real-world structure comprises generating a surface of the structure based on the identified landmarks.
26 . The method of claim 25 , further comprising generating one or more other surfaces based on the identified landmarks.
27 . The method of claim 26 , wherein surfaces comprise one or more of a side of the structure and a back of the structure.
28 . The method of claim 21 , wherein correlating the images comprises correlating according to the metadata for each image.
29 . The method of claim 28 , wherein the metadata comprises pose information of a camera associated with each of the images.
30 . The method of claim 28 , wherein correlating the images comprises correlating according to the geometric constraints of the identified landmarks identified in each of the images.
31 . The method of claim 30 , wherein the geometric constraints comprise geometric properties associated with the structure.
32 . The method of claim 31 , wherein the geometric properties comprise a position of the one or more identified landmarks in each of the images.
33 . The method of claim 21 , wherein correlating the images further comprises generating a data map of correlations between the identified landmarks in different images of the plurality of images.
34 . The method of claim 21 , further comprising providing a scale for the 3D model.
35 . The method of claim 34 , wherein the scale is based on measurements of structural aspects within one image of the images.
36 . Non-transitory computer storage media storing instructions that when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:
receiving a plurality of images of a real-world structure;
identifying one or more landmarks in each image of the plurality of images;
providing metadata for each image of the plurality of images, wherein the metadata comprises a geometric constraint of each of the identified landmarks in each image of the of the plurality of images;
correlating images of the plurality of images; and
generating the 3D model of the real-world structure based on:
the identified landmarks in the plurality of images;
the correlations between the images of the plurality of images; and
the metadata comprising the geometrical constraint for the identified landmarks.
37 . The non-transitory computer storage media of claim 36 , wherein the metadata further comprises a classification of the one or more identified landmarks.
38 . The non-transitory computer storage media of claim 36 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure.
39 . The non-transitory computer storage media of claim 38 , wherein the geometric properties comprise a position of the identified landmarks.
40 . The non-transitory computer storage media of claim 38 , wherein generating the 3D model of the real-world structure comprises generating a surface of the structure based on the identified landmarks.
41 . The non-transitory computer storage media of claim 40 , further comprising generating one or more other surfaces based on the identified landmarks.
42 . The non-transitory computer storage media of claim 41 , wherein surfaces comprise one or more of a side of the structure and a back of the structure.
43 . The non-transitory computer storage media of claim 36 , wherein correlating the images comprises correlating according to the metadata for each image.
44 . The non-transitory computer storage media of claim 43 , wherein the metadata comprises pose information of a camera associated with each of the images.
45 . The non-transitory computer storage media of claim 44 , wherein correlating the images comprises correlating according to the geometric constraints of the identified landmarks identified in each of the images.
46 . The non-transitory computer storage media of claim 45 , wherein the geometric constraints comprise geometric properties associated with the structure.
47 . The non-transitory computer storage media of claim 46 , wherein the geometric properties comprise a position of the one or more identified landmarks in each of the images.
48 . The non-transitory computer storage media of claim 36 , wherein correlating the images further comprises generating a data map of correlations between the identified landmarks in different images of the plurality of images.
49 . The non-transitory computer storage media of claim 36 , further comprising providing a scale for the 3D model.
50 . The non-transitory computer storage media of claim 49 , wherein the scale is based on measurements of structural aspects within one image of the images.