Computer vision systems and methods for end to end image inspection
A system and method for generating models from digital images in an interactive environment comprising a memory and a processor in communication with the memory. The processor captures or derives metadata for one or more digital images. The processor derives transforms from the metadata to align the digital images with one or more three-dimensional (“3D”) models of objects/structures represented in the digital image. The processor generates an interactive environment which allows a user to view a contextual model of each of the objects/structures in two dimensional (“2D”) and 3D views.
1. A system for generating models from digital images in an interactive environment, comprising:
a memory; and
a processor in communication with the memory, the processor:
capturing or deriving metadata for one or more digital images;
deriving transforms from the metadata to align the digital images with one or more three-dimensional (“3D”) models of objects/structures represented in the digital images; and
generating an interactive environment which allows a user to view a contextual model of each of the objects/structures in two dimensional (“2D”) and 3D views,
wherein the processor:
derives from the metadata a relative depth transform to map world coordinates to image coordinates;
uses the relative depth transform to analyze a view of each of the digital images in context with the contextual models;
generates a list of preferred images for each model surface; and
sorts the list by a metric.
2. The system of claim 1 , wherein the metadata comprises camera intrinsic values and extrinsic values.
3. The system of claim 1 , wherein the metadata comprises at least one of data relating to a global coordinate system, Global Positioning System data, a timestamp, or elevation data.
4. The system of claim 1 , wherein each surface has a specific identification.
5. The system of claim 1 , wherein the metric comprises at least one of camera distance to surface, camera orientation, surface orientation, surface area, area of visible surface, image pixel area, pixel area of visible surface, location of surface in image coordinates, location of projected image in surface coordinates, or surface shape.
6. The system of claim 5 , wherein the processor excludes an image from the list that does not include a model surface in its frame or has a surface facing away from a camera.
7. The system of claim 1 , wherein the interactive environment comprises at least one of a workspace, a surface list, an image list or image notes.
8. The system of claim 1 , wherein the interactive environment allows the user to generate annotations.
9. A method for generating models from digital images in an interactive environment, comprising the steps of:
capturing or deriving metadata for one or more digital images;
deriving transforms from the metadata to align the digital images with one or more three-dimensional (“3D”) models of objects/structures represented in the digital images; and
generating an interactive environment which allows a user to view a contextual model of each of the objects/structures in two dimensional (“2D”) and 3D views,
wherein the step of deriving transforms from the metadata to align the digital images comprises:
deriving from the metadata a relative depth transform to map world coordinates to image coordinates;
using the relative depth transform to analyze a view of each of the digital images in context with the contextual models;
generating a list of preferred images for each model surface; and
sorting the list by a metric.
10. The method of claim 9 , wherein the metadata comprises camera intrinsic values and extrinsic values.
11. The method of claim 9 , wherein the metadata comprises at least one of data relating to a global coordinate system, Global Positioning System data, a timestamp, or elevation data.
12. The method of claim 9 , wherein each surface has a specific identification.
13. The method of claim 9 , wherein the metric comprises at least one of camera distance to surface, camera orientation, surface orientation, surface area, area of visible surface, image pixel area, pixel area of visible surface, location of surface in image coordinates, location of projected image in surface coordinates, or surface shape.
14. The method of claim 13 , further comprising excluding an image from the list that does not include a model surface in its frame or has a surface facing away from a camera.
15. The method of claim 9 , wherein the interactive environment comprises at least one of a workspace, a surface list, an image list or image notes.
16. The method of claim 9 , wherein the interactive environment allows the user to generate annotations.