Systems and methods for provoking image capture of a physical space using live and historical feedback
Systems and methods are disclosed with associated techniques for ensuring that structures are fully imaged, which may permit individuals to utilize mobile computing devices to record imagery of structures for the purpose of documenting their presence, size, location, and the like. As digital images are captured by a computing device, those digital images may be presented in the form of a video feed on a display of the computing device. One or more digital elements can then be overlaid on the video feed. To incentivize a user to move the computing device in a predetermined manner by guided live feedback, the appearance of these digital elements may be manipulated based on movements of the computing device.
1 . A method, comprising:
receiving, at a mobile computing device, a first input that represents a request to image a floor of a room, wherein the mobile computing device comprises:
a camera configured to automatically capture digital images;
one or more position sensors;
an augmented reality (AR) framework executed by the mobile computing device and in communication with the one or more position sensors and the camera, the AR framework configured to generate one or more overlays for providing on-screen guidance to a user to capture images of the floor; and
a display configured to output the digital images and the one or more overlays as a video;
receiving live sensor data from the mobile computing device;
processing the live sensor data to generate on-screen guidance for the user; and
displaying the on-screen guidance on the mobile computing device, wherein the on-screen guidance comprises a map reflecting historical actions of the user to affect current on-screen guidance, wherein the map is displayed on a portion of the display, indicates previously imaged portions of the floor, and is updated live during a capture process.
2 . The method of claim 1 , wherein the on-screen guidance is updated as the user performs the capture process.
3 . The method of claim 1 , wherein the digital images and the live sensor data are processed to generate one or more top-down map images comprising a visual representation of a scanned floor region.
4 . The method of claim 1 , wherein the map is persistent.
5 . The method of claim 1 , wherein the previously imaged portions of the floor are represented by visual overlays comprising one or more of colorized portions, grayscale portions, boundaries, and tiles.
6 . The method of claim 1 , wherein a vertex-based contour is generated around previously captured floor regions.
7 . The method of claim 1 , further comprising instructing the user to orient the camera towards the floor during the capture process.
8 . The method of claim 7 , wherein an accelerometer of the mobile computing device is utilized to determine an orientation of the camera.
9 . The method of claim 8 , further comprising pausing the capture process if the orientation of the camera exceeds a predetermined angular threshold.
10 . The method of claim 1 , further comprising prompting the user to capture all available portions of the floor of the room based on information derived from the digital images and the live sensor data.
11 . The method of claim 1 , wherein the map reflecting historical actions of the user reflects the user's free-form progress in performing image capture.
12 . A system, comprising:
a mobile computing device, comprising:
a processor,
memory in communication with the processor;
a camera configured to automatically capture digital images;
one or more position sensors;
an augmented reality (AR) framework executed by the mobile computing device and in communication with the one or more position sensors and the camera, the AR framework configured to generate one or more overlays for providing on-screen guidance to a user to capture images of a floor; and
a display configured to output the digital images and the one or more overlays as a video;
wherein the mobile computing device is configured to:
receive live sensor data;
process the live sensor data to generate on-screen guidance for the user; and
display the on-screen guidance, wherein the on-screen guidance comprises a map reflecting historical actions of the user to affect current on-screen guidance, wherein the map is displayed on a portion of the display, indicates previously imaged portions of the floor, and is updated live during a capture process.
13 . The system of claim 12 , wherein the on-screen guidance is updated as the user performs the capture process.
14 . The system of claim 13 , wherein the mobile computing device further comprising an accelerometer that is utilized to determine an orientation of the camera, and wherein the on-screen guidance comprises instructions to orient the camera towards the floor during the capture process.
15 . The system of claim 14 , wherein a capture process is paused, and on-screen guidance is displayed to reorient the camera if the orientation of the camera exceeds a predetermined angular threshold.
16 . The system of claim 12 , wherein the digital images and the live sensor data are processed to generate one or more top-down map images comprising a visual representation of a scanned floor region.
17 . The system of claim 12 , wherein the one or more overlays comprise the map indicating previously imaged portions of the floor.
18 . The system of claim 17 , wherein the map is persistent.
19 . The system of claim 12 , wherein previously captured floor regions are represented by visual overlays comprising one or more of colorized portions, grayscale portions, boundaries, and tiles.
20 . A non-transitory medium with instructions stored thereon that, when executed by a processor of a computing device, cause the computing device to perform operations comprising:
receiving, at a mobile computing device, a first input that represents a request to image a floor of a room, wherein the mobile computing device comprises:
a camera configured to automatically capture digital images;
one or more position sensors;
an augmented reality (AR) framework executed by the mobile computing device and in communication with the one or more position sensors and the camera, the AR framework configured to generate one or more overlays for providing on-screen guidance to a user to capture images of the floor; and
a display configured to output the digital images and the one or more overlays as a video;
receiving live sensor data from the mobile computing device;
processing the live sensor data to generate on-screen guidance for the user; and
displaying the on-screen guidance on the mobile computing device, wherein the on-screen guidance comprises a map reflecting historical actions of the user to affect current on-screen guidance, wherein the map is displayed on a portion of the display, indicates previously imaged portions of the floor, and is updated live during a capture process.