Systems and methods for augmented reality- assisted home inspection
The following relates generally to using augmented reality (AR) for inspection of a property. In some examples, underlay layer data may be received (e.g., from a camera of an AR viewer device); and overlay layer data may be received (e.g., from a different camera or other overlay layer device). An AR display may be created by correlating the underlay layer data with the overlay layer data. A property inspection indicia may be identified based upon the correlated overlay layer data.
1 . A computer-implemented method of using Augmented Reality (AR) for inspection of a property, the method comprising:
generating, in real time, overlay layer data by snaking a camera behind a wall;
receiving, with one or more processors, underlay layer data indicative of a field of view associated with an AR viewer device;
receiving, with the one or more processors, the overlay layer data;
correlating, with the one or more processors, the overlay layer data with the underlay layer data;
identifying, with the one or more processors, a property inspection indicia based upon the correlated overlay layer data generated by snaking the camera behind the wall;
creating, with the one or more processors, an AR display based upon the correlation, the AR display including (i) an indication of the property inspection indicia, and (ii) the camera snaking behind the wall; and
displaying, with the one or more processors, the AR display to a user via the AR viewer device.
2 . The computer-implemented method of claim 1 , wherein the property inspection indicia comprises:
a water leakage;
a water damage;
an insulation deficiency;
a fire hazard;
a structural deficiency; and/or
building code compliance information.
3 . The computer-implemented method of claim 1 , wherein the overlay layer data further comprises data generated from:
a thermal imaging camera;
a stud finder device;
an ultrasound (US) imager; and/or
an analysis of a blueprint of a building on the property.
4 . The computer-implemented method of claim 1 , wherein:
the underlay layer data is generated by an underlay layer camera coupled to the AR viewer device.
5 . The computer-implemented method of claim 1 , further comprising:
in response to identifying the property inspection indicia, with the one or more processors, storing an image of the AR display; and
generating, with the one or more processors, a report that correlates: (i) the stored image, and (ii) a description of the property inspection indicia.
6 . The computer-implemented method of claim 5 , wherein generating the report further comprises:
correlating, with the one or more processors, the stored image to a location on the property; and
including, with the one or more processors, the correlated location in the report.
7 . The computer-implemented method of claim 1 , wherein the property inspection indicia is generated in response to a user input.
8 . The computer-implemented method of claim 1 , wherein identifying the property inspection indicia comprises:
routing, with the one or more processors, the underlay layer data and/or the overlay layer data to a machine learning algorithm.
9 . The computer-implemented method of claim 8 , further comprising:
detecting, with the one or more processors, a user input indicating whether an output of the machine learning algorithm is correct; and
training the machine learning algorithm by routing, via the one or more processors, an indication of the user input to the machine learning algorithm, wherein the user input and the output of the machine learning algorithm are used as inputs for positive or negative reinforcement training of the machine learning algorithm.
10 . The computer-implemented method of claim 9 , wherein routing the indication of the user input to the machine learning algorithm further comprises:
routing, via the one or more processors, to the machine learning algorithm, overlay layer data corresponding the user input, wherein the overlay layer data corresponding the user input includes: (i) image data of home inspection indicia, (ii) thermal image data of home inspection indicia, and/or (iii) stud finder data of home inspection indicia.
11 . The computer-implemented method of claim 9 , wherein the machine learning algorithm is further configured to produce an estimate of an age the property inspection indicia.
12 . The computer-implemented method of claim 1 , wherein:
receiving the underlay layer data comprises receiving, with the one or more processors, the underlay layer data from a first camera with a field of view including a front side of the wall.
13 . The computer-implemented method of claim 1 , wherein correlating the overlay layer data with the underlay layer data comprises:
identifying a location of a property based upon the field of view associated with the AR viewer device;
identifying overlay layer data associated with an object located at the identified location of the property; and
analyzing the underlay layer data to detect a presence of the object.
14 . The computer-implemented method of claim 13 , wherein creating the AR display further comprises including a text box with text describing the object.
15 . The computer-implemented method of claim 13 , wherein creating the AR display further comprises including a warning that the object is associated with a building code violation.
16 . The computer-implemented method of claim 13 , wherein identifying the location of the property viewable via the AR viewer device further comprises:
generating, with the one or more processors, location data of the AR viewer device based upon information received from a Wi-Fi router and/or a beacon device;
receiving, with the one or more processors, orientation data of the AR viewer device from an orientation sensor of the AR viewer device; and
comparing the location data and the orientation data to a layout of the property.
17 . The computer-implemented method of claim 1 , wherein correlating the overlay layer data with the underlay layer data comprises:
based upon the underlay data, identifying an object located within the field of view associated with the AR viewer device; and
obtaining overlay layer data corresponding to the identified object.
18 . The computer-implemented method of claim 17 , wherein creating the AR display further comprises including a text box with text describing the identified object.
19 . The computer-implemented method of claim 17 , wherein creating the AR display further comprises including a warning that the identified object is associated with a building code violation.
20 . A computer system configured to use Augmented Reality (AR) for inspection of a property, the computer system comprising one or more processors configured to:
receive underlay layer data indicative of a field of view associated with an AR viewer device;
receive overlay layer data generated by a camera snaking behind a wall;
correlate the overlay layer data with the underlay layer data;
identify a property inspection indicia based upon the correlated overlay layer data generated by snaking the camera behind the wall;
create an AR display based upon the correlation, the AR display including (i) an indication of the property inspection indicia, and (ii) the camera snaking behind the wall; and
display the AR display to a user via the AR viewer device.
21 . The computer system of claim 20 , wherein the property inspection indicia comprises:
a water leakage;
a water damage;
an insulation deficiency;
a fire hazard;
a structural deficiency; and/or
building code compliance information.
22 . The computer system of claim 20 , wherein the overlay layer data further comprises data generated from:
a thermal imaging camera;
a stud finder device;
an ultrasound (US) imager; and/or
an analysis of a blueprint of a building on the property.
23 . The computer system of claim 20 , further comprising: (i) the AR viewer device, and (ii) an underlay layer camera, wherein the underlay layer data comprises data generated by the underlay layer camera.
24 . The computer system of claim 20 , wherein the one or more processors are configured to generate the property inspection indicia by routing the underlay layer data and/or the overlay layer data into a machine learning algorithm.
25 . A computer device for using Augmented Reality (AR) for inspection of a property, the computer device comprising:
one or more processors; and
one or more memories coupled to the one or more processors;
the one or more memories including computer-executable instructions stored therein that, when executed by the one or more processors, cause the one or more processors to:
receive underlay layer data indicative of a field of view associated with an AR viewer device;
receive overlay layer data generated by a camera snaking behind a wall;
correlate the overlay layer data with the underlay layer data;
identify a property inspection indicia based upon the correlated overlay layer data generated by snaking the camera behind the wall;
create an AR display based upon the correlation, the AR display including (i) an indication of the property inspection indicia, and (ii) the camera snaking behind the wall; and
display the AR display to a user via the AR viewer device.
26 . The computer device of claim 25 , wherein the one or more memories including computer-executable instructions stored therein that, when executed by the one or more processors, further cause the one or more processors to generate the property inspection indicia by routing the underlay layer data and/or the overlay layer data into a machine learning algorithm.