GENERATING AND VALIDATING A VIRTUAL 3D REPRESENTATION OF A REAL-WORLD STRUCTURE
A computer system maintains structure data indicating geometrical constraints for each structure category of a plurality of structure categories. The computer system generates a virtual 3D representation of a structure based on a set of images depicting the structure. For each image in the set of images, one or more landmarks are identified. Based on the landmarks, a candidate structure category is selected. The virtual 3D representation is generated based on the geometrical constraints of the candidate structure category and the landmarks identified in the set of images.
1 - 20 . (canceled)
21 . A method for generating a virtual 3D representation of a structure, the method comprising:
receiving a plurality of images of a real-world structure;
identifying one or more landmarks in each image of the plurality of images;
providing metadata for the one or more identified landmarks in each image of the plurality of images, wherein the metadata comprises a geometric constraint of the one or more identified landmarks;
correlating a first landmark of the one more of the identified landmarks in a first image of the plurality of images with a second landmark of the one or more identified landmarks in a second image of the plurality of images; and
generating a 3D representation of the real-world structure based on:
the identified landmarks in the plurality of images;
the correlations between the first and second identified landmarks; and
the metadata comprising the geometrical constraints for the identified landmarks.
22 . The method of claim 21 , wherein the metadata further comprises a classification of the one or more identified landmarks.
23 . The method of claim 21 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure.
24 . The method of claim 23 , wherein the geometric properties comprise a position of the identified landmarks.
25 . The method of claim 23 , wherein generating the 3D representation of the real-world structure comprises generating a surface of the structure based on the identified landmarks.
26 . The method of claim 25 , further comprising generating one or more other surfaces based on the identified landmarks.
27 . The method of claim 26 , wherein the surfaces comprise one or more of a side of the structure and a back of the structure.
28 . The method of claim 21 , wherein correlating the first identified landmark further comprises correlating the first identified landmark to the second identified landmark according to the metadata of the first and second identified landmarks.
29 . The method of claim 28 , wherein the geometric constraints of the first and second identified landmarks comprise geometric properties associated with the structure.
30 . The method of claim 29 , wherein the geometric properties comprise a position of the first and second identified landmarks.
31 . The method of claim 21 , wherein correlating the first identified landmark further comprises generating a data map of correlations between the first and second identified landmarks.
32 . The method of claim 21 , further comprising providing a scale for the 3D model.
33 . The method of claim 29 , where the scale is based on measurements of structural aspects within an image of the plurality of images.
34 . Non-transitory computer storage media storing instructions that when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising:
receiving a plurality of images of a real-world structure;
identifying one or more landmarks in each image of the plurality of images;
providing metadata for the one or more identified landmarks in each image of the plurality of images, wherein the metadata comprises a geometric constraint of the one or more identified landmarks;
correlating a first landmark of the one more of the identified landmarks in a first image of the plurality of images with a second landmark of the one or more identified landmarks in a second image of the plurality of images; and
generating a 3D representation of the real-world structure based on:
the identified landmarks in the plurality of images;
the correlations between the first and second identified landmarks; and
the metadata comprising the geometrical constraints for the identified landmarks.
35 . The non-transitory computer storage media of claim 34 , wherein the metadata further comprises a classification of the one or more identified landmarks.
36 . The non-transitory computer storage media of claim 34 , wherein the geometric constraints of the one or more identified landmarks comprise geometric properties associated with the structure.
37 . The non-transitory computer storage media of claim 36 , wherein the geometric properties comprise a position of the identified landmarks.
38 . The non-transitory computer storage media of claim 36 , wherein generating the 3D representation of the real-world structure comprises generating a surface of the structure based on the identified landmarks.
39 . The non-transitory computer storage media of claim 38 , further comprising generating one or more other surfaces based on the identified landmarks.
40 . The non-transitory computer storage media of claim 39 , wherein the surfaces comprise one or more of a side of the structure and a back of the structure.
41 . The non-transitory computer storage media of claim 34 , wherein correlating the first identified landmark further comprises correlating the first identified landmark to the second identified landmark according to the metadata of the first and second identified landmarks.
42 . The non-transitory computer storage media of claim 41 , wherein the geometric constraints of the first and second identified landmarks comprise geometric properties associated with the structure.
43 . The non-transitory computer storage media of claim 42 , wherein the geometric properties comprise a position of the first and second identified landmarks.
44 . The non-transitory computer storage media of claim 34 , wherein correlating the first identified landmark further comprises generating a data map of correlations between the first and second identified landmarks.
45 . The non-transitory computer storage media of claim 34 , further comprising providing a scale for the 3D model.
46 . The non-transitory computer storage media of claim 45 , where the scale is based on measurements of structural aspects within an image of the plurality of images.