ROOM AXIS ESTIMATION
Systems and methods are provided for estimating an axis of a room based on a computer vision scan of the room and its contents, and a process of axis majority voting. A method is provided that includes capturing a plurality of images of the interior environment having one or more walls and a plurality of objects, each wall and object having a surface oriented along a corresponding plane; determining, based on information received from an AR engine, local axis orientations for at least a portion of the walls and objects. The method includes estimating a room axis of the interior environment based on a voting process, wherein a majority of matching local axis orientations are utilized to determine the room axis; and outputting an indication of the room axis.
1 . A computer-implemented method for estimating a room axis, comprising:
receiving, at a mobile computing device, an input command to initiate capturing visual documentation of an interior environment;
capturing, with a camera of the mobile computing device in communication with an augmented reality (AR) engine, a plurality of images of the interior environment, wherein the interior environment comprises one or more walls and a plurality of objects, each wall and object having a surface oriented along a corresponding plane;
determining, based on information received from the AR engine, local axis orientations for at least a portion of the walls and objects;
estimating a room axis of the interior environment based on a voting process, wherein a majority of matching local axis orientations are utilized to estimate the room axis; and
outputting an indication of the room axis.
2 . The method of claim 1 , further comprising outputting annotations corresponding to the local axis orientations.
3 . The method of claim 2 , wherein outputting at least a portion of the annotations is performed during the capturing to provide feedback to a user.
4 . The method of claim 2 , wherein the annotations align with the local axis orientations and correspond to locations and angles where the objects are physically placed in the interior environment.
5 . The method of claim 2 , wherein the annotations align with the local axis orientations and correspond to locations and angles where physical walls meet a physical floor.
6 . The method of claim 1 , wherein the plurality of images are captured as a user moves to different locations in the interior environment.
7 . The method of claim 1 , wherein the visual documentation comprises a three-dimensional (3D) mapping of the interior environment.
8 . The method of claim 1 , further comprising capturing dimensions of the interior environment based on the estimated room axis.
9 . The method of claim 1 , wherein the interior environment comprises one or more of a kitchen, a living room, a utility room, an office, a bedroom, a bathroom, and a garage.
10 . A system for capturing spatial documentation of an environment, comprising:
a mobile computing device, comprising:
a camera configured to capture video;
one or more processors in communication with the camera;
an augmented reality (AR) engine in communication with the one or more processors;
a first memory configured for storing captured video;
a second memory storing computer code that causes the one or more processors to:
receive, at a mobile computing device, an input command to initiate capturing visual documentation of an interior environment;
capture, with a camera of the mobile computing device in communication with the augmented reality (AR) engine, a plurality of images of the interior environment, wherein the interior environment comprises one or more walls and a plurality of objects, each wall and object having a surface oriented along a corresponding plane;
determine, based on information received from the AR engine, local axis orientations for at least a portion of the walls and objects;
estimate a room axis of the interior environment based on a voting process, wherein a majority of matching local axis orientations are utilized to estimate the room axis; and
output an indication of the room axis.
11 . The system of claim 10 , wherein the computer code further causes the one or more processors to output, for display on the mobile computing device, annotations corresponding to the local axis orientations.
12 . The system of claim 11 , wherein at least a portion of the annotations are output during the capturing to provide feedback to a user.
13 . The system of claim 11 , wherein the annotations align with the local axis orientations and correspond to locations and angles where the objects are physically placed in the interior environment.
14 . The system of claim 11 , wherein the annotations align with the local axis orientations and correspond to locations and angles where physical walls meet a physical floor.
15 . The system of claim 10 , wherein the plurality of images are captured as a user moves to different locations in the interior environment.
16 . The system of claim 10 , wherein the visual documentation comprises a three-dimensional (3D) mapping of the interior environment.
17 . The system of claim 10 , wherein the computer code further causes the one or more processors to capture dimensions of the interior environment based on the estimated room axis.
18 . A non-transitory computer-readable medium with instructions stored thereon that, when executed by a processor of a computing device, cause the computing device to perform operations comprising:
receiving, at a mobile computing device, an input command to initiate capturing visual documentation of an interior environment;
capturing, with a camera of the mobile computing device in communication with an augmented reality (AR) engine, a plurality of images of the interior environment, wherein the interior environment comprises one or more walls and a plurality of objects, each wall and object having a surface oriented along a corresponding plane;
determining, based on information received from the AR engine, local axis orientations for at least a portion of the walls and objects;
estimating a room axis of the interior environment based on a voting process, wherein a majority of matching local axis orientations are utilized to estimate the room axis; and
outputting an indication of the room axis.
19 . The non-transitory computer-readable medium of claim 18 , wherein the instructions further cause the computing device to output, for display, annotations corresponding to the local axis orientations, wherein outputting at least a portion of the annotations is performed during the capturing to provide feedback to a user while the plurality of images are captured as a user moves to different locations in the interior environment.
20 . The non-transitory computer-readable medium of claim 18 , wherein the annotations align with the local axis orientations and correspond to locations and angles where the objects are physically placed in the interior environment or where physical walls meet a physical floor.