Generation and display of interactive 3D real estate models
Systems and methods are disclosed for the generation and interactive display of three-dimensional (3D) models that accurately represent buildings and other large, complex objects possessing both internal and external features. More specifically, an exterior mesh can be generated that captures all the external features of the building. An interior mesh can also be generated that captures all the internal features of the building. The exterior mesh and the interior mesh may be layered and combined using geographical coordinates (e.g., global positioning system (GPS) data) in order to create a combined mesh that can be used to render a 3D model of the object. Any images taken of external or internal features may also be appended to the 3D model or even overlaid on the 3D model (like textures), based on the location and directional view associated with those images.
1. A computer-implemented method comprising:
as implemented by a model generation and display system comprising one or more hardware processors,
generating an exterior point cloud based on an exterior of a building, wherein the exterior point cloud comprises location and depth information for an exterior plurality of points;
generating an interior point cloud based on an interior of the building, wherein the interior point cloud comprises location and depth information for a plurality of interior points;
orienting the exterior point cloud relative to the interior point cloud by referencing the location and depth information for the exterior plurality of points and the location and depth information for the interior plurality of points;
generating a combined point cloud from the oriented exterior point cloud and the interior point cloud;
rendering a three-dimensional (3D) model of the building from the combined point cloud;
generating first metadata that associates an image of the interior of the building with a portion of the 3D model, wherein the portion of the 3D model corresponds with a geographic location identified in second metadata of the image;
classifying, using machine learning, the location within the 3D model as being a first type of room; and
causing a monitor array to display the 3D model, wherein user input received via a sensor embedded in a table separate from the monitor array that detects movement controls a view of the 3D model displayed by the monitor array.
2. The computer-implemented method of claim 1 , wherein the image includes one of a captured image of the exterior of the building or a captured image of the interior of the building.
3. The computer-implemented method of claim 2 , wherein a view of the 3D model comprises the captured image overlaid on a portion of the 3D model.
4. The computer-implemented method of claim 3 , wherein the view of the 3D model shows an interior structure of the building and one or more second images of the interior.
5. The computer-implemented method of claim 1 , further comprising:
generating display data for a view of the 3D model of the building; and
providing the display data for the view to a display setup, wherein the display setup includes the monitor array and the table.
6. The computer-implemented method of claim 1 , wherein generating the exterior plurality of points of the building further comprises:
directing a vehicle to fly around the building;
obtaining dimension data for the exterior of the building using the vehicle;
obtaining location and depth information for the exterior plurality of points using the vehicle; and
capturing second images of the exterior of the building using the vehicle.
7. The computer-implemented method of claim 1 , wherein generating the interior plurality of points of the building further comprises:
obtaining location and depth information for the interior plurality of points using a mobile device;
generating dimension data for a portion of the interior of the building based on the obtained location and depth information for the interior plurality of points; and
capturing second images of the interior of the building using the mobile device.
8. The computer-implemented method of claim 7 , wherein the second images of the interior of the building are 360 degree images.
9. The computer-implemented method of claim 1 , wherein the location information for the exterior plurality of points is associated with global positioning system (GPS) coordinates.
10. The computer-implemented method of claim 1 , wherein the location information for the interior plurality of points is associated with global positioning system (GPS) coordinates.
11. The computer-implemented method of claim 1 , wherein the table depicts a second view of the 3D model, and wherein the view of the 3D model displayed by the monitor array is different from the second view of the 3D model.
12. Non-transitory computer storage media storing instructions that when executed by a system of one or more computers, cause the one or more computers to perform operations comprising:
generating an exterior point cloud based on an exterior of a building, wherein the exterior point cloud comprises location and depth information for an exterior plurality of points;
generating an interior point cloud based on an interior of the building, wherein the interior point cloud comprises location and depth information for a plurality of interior points;
orienting the interior point cloud relative to the exterior point cloud by referencing the location and depth information for the plurality of interior points and the location and depth information for the exterior plurality of points;
generating a combined point cloud from the oriented interior point cloud and the exterior point cloud;
rendering a three-dimensional (3D) model of the building from the combined point cloud;
generating first metadata that associates an image of the interior of the building with a portion of the 3D model, wherein the portion of the 3D model corresponds with a geographic location identified in second metadata of the image;
classifying, using machine learning, the location within the 3D model as being a first type of room; and
causing a monitor array to display the 3D model, wherein user input received via a sensor embedded in a table separate from the monitor array that detects movement controls a view of the 3D model displayed by the monitor array.
13. The non-transitory computer storage media of claim 12 , wherein the instructions further cause the one or more computers to perform operations comprising:
generating display data for a view of the 3D model of the building; and
providing the display data to for the view to a display setup, wherein the display setup includes the monitor array and the table.
14. The non-transitory computer storage media of claim 12 , wherein the instructions further cause the one or more computers to perform operations comprising:
directing a vehicle to fly around the building;
obtaining dimension data for the exterior of the building using the vehicle;
obtaining location and depth information for the exterior plurality of points using the vehicle; and
capturing second images of the exterior of the building using the vehicle.
15. The non-transitory computer storage media of claim 12 , wherein the instructions further cause the one or more computers to perform operations comprising:
obtaining dimension data for the interior of the building through a mobile device;
obtaining location and depth information for the interior plurality of points using the mobile device; and
capturing second images of the interior of the building using the mobile device.
16. A model generation and display system comprising:
computer storage media storing instructions; and
one or more hardware processors configured to execute the instructions, wherein the instructions, when executed, cause the one or more hardware processors to perform operations comprising:
generating an exterior property representation based on an exterior of a building;
generating an interior property representation based on an interior of the building;
orienting the exterior property representation relative to the interior property representation;
generating a combined property representation from the oriented exterior property representation and the interior property representation;
rendering a three-dimensional (3D) model of the building from the combined property representation;
dividing the 3D model into a plurality of locations based in part on structural features identified by machine learning in the combined property representation of the 3D model;
generating first metadata that associates an image of the interior of the building with a portion of the 3D model, wherein the portion of the 3D model corresponds with a geographic location identified in second metadata of the image;
classifying, using machine learning, a location of the plurality of locations within the 3D model as being a first part of a building; and
causing a monitor array to display the 3D model, wherein user input received via a sensor embedded in a table separate from the monitor array that detects movement controls a view of the 3D model displayed by the monitor array.
17. The model generation and display system of claim 16 , wherein the instructions, when executed, cause the one or more hardware processors to further perform operations comprising:
generating display data for a view of the 3D model of the building; and
providing the display data for the view to a display setup, wherein the display setup includes the monitor array and the table.
18. The model generation and display system of claim 16 , wherein the instructions, when executed, cause the one or more hardware processors to further perform operations comprising:
associating the location with a hotspot,
wherein the 3D model comprises an icon associated with the location.
19. The model generation and display system of claim 18 , wherein the instructions, when executed, cause the one or more hardware processors to further perform operations comprising:
receiving a user selection of the icon; and
causing the monitor array to display an image comprising the hotspot and an additional information item associated with the hotspot.
20. The model generation and display system of claim 19 , wherein the instructions, when executed, cause the one or more hardware processors to further perform operations comprising causing the monitor array to display at least one of: a location of the image, or a direction of the image.