Automated guide for image capturing for 3D model creation
An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system.
1. A method for capturing images used to create 3D models, comprising:
displaying, on a device, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated;
determining, by one or more processors, whether a quality-based condition is satisfied;
wherein determining whether the quality-based condition is satisfied comprises generating a bounding box around an entirety of the target object; and
determining, by one or more processors, whether an entirety of the bounding box is within an image frame comprising the visual content;
at least while the quality-based condition is not satisfied, displaying, on the device, a visual indication associated with the quality-based condition concurrent with displaying the visual content;
capturing the visual content displayed on the device, as an image, in response to activation of the capture control.
2. The method of claim 1 , further comprising:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication.
3. The method of claim 1 , further comprising:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication.
4. The method of claim 1 , wherein:
the target object is a building; and
determining, by one or more processors, whether the visual content comprises one or more of: a corner of the building, a top of the building, or a bottom of the building.
5. One or more non-transitory computer-readable media storing one or more sequences of instructions that, when executed by one or more processors, cause:
displaying, on a device, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated;
determining, by one or more processors, whether a quality-based condition is satisfied;
wherein determining whether the quality-based condition is satisfied comprises generating a bounding box around an entirety of the target object; and
determining, by one or more processors, whether an entirety of the bounding box is within an image frame comprising the visual content;
at least while the quality-based condition is not satisfied, displaying, on the device, a visual indication associated with the quality-based condition concurrent with displaying the visual content;
capturing the visual content displayed on the device, as an image, in response to activation of the capture control.
6. The one or more non-transitory computer-readable media of claim 5 , wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication.
7. The one or more non-transitory computer-readable media of claim 5 , wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication.
8. The one or more non-transitory computer-readable media of claim 5 , wherein:
the target object is a building; and
determining, by one or more processors, whether the visual content comprises one or more of: a corner of the building, a top of the building, or a bottom of the building.
9. A method for capturing images used to create 3D models, comprising:
displaying, on a device display, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated;
determining, by one or more processors, whether a quality-based condition is satisfied;
wherein determining whether the quality-based condition is satisfied comprises:
generating a bounding box for the target object; and
determining whether the bounding box satisfies a condition of being disposed entirely inside an image frame comprising the visual content;
at least while the quality-based condition is not satisfied, displaying, on the device display, a visual indication associated with the quality-based condition concurrent with displaying the visual content; and
capturing the visual content displayed on the device, as an image, in response to activation of the capture control.
10. The method of claim 9 , wherein determining whether the bounding box satisfies a condition of being disposed entirely inside the image frame further comprises determining whether the bounding box satisfies a condition of being disposed entirely inside the visual content.
11. The method of claim 9 , further comprising:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication.
12. The method of claim 9 , further comprising:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication.
13. The method of claim 9 , wherein:
the target object is a building; and
determining, by one or more processors, whether the visual content comprises one or more of: corners of the building, a top of the building, or a bottom of the building.
14. One or more non-transitory computer-readable media storing one or more sequences of instructions that, when executed by one or more processors, cause:
displaying, on a device display, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated;
determining, by one or more processors, whether a quality-based condition is satisfied;
wherein determining whether the quality-based condition is satisfied comprises:
generating a bounding box for an entirety of the target object; and
determining, by one or more processors, whether the bounding box satisfies a condition of being disposed entirely inside an image frame comprising the visual content;
at least while the quality-based condition is not satisfied, displaying, on the device display, a visual indication associated with the quality-based condition concurrent with displaying the visual content; and
capturing the visual content displayed on the device, as an image, in response to activation of the capture control.
15. The one or more non-transitory computer-readable media of claim 14 , wherein determining whether the bounding box satisfies a condition of being disposed entirely inside the image frame further comprises determining whether the generated bounding box satisfies a condition of being disposed entirely inside the visual content.
16. The one or more non-transitory computer-readable media of claim 14 , wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication.
17. The one or more non-transitory computer-readable media of claim 14 , wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause:
detecting that the quality-based condition is satisfied; and
in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication.
18. The one or more non-transitory computer-readable media of claim 14 , wherein:
the target object is a building; and
determining, by one or more processors, whether the visual content comprises one or more of: a corner of the building, a top of the building, or a bottom of the building.