MACHINE LEARNING-BASED PROPERTY IMAGE MATCHING ANALYSIS
Systems and methods for retrieving property using machine learning based image matching. In some embodiments, images from a user request can be provided to a matching model configured to retrieve similar images and corresponding property listings. In some embodiments, this allows a user to find additional similar listings based on photo gallery images of existing property listings. In some embodiments, this allows a user to upload a new image to search for existing properties. By accessing a machine learning model, such as a matching model, the property listing system can retrieve a number of matching images associated with property listings to be scored, ranked, and presented to a user.
1 . A system, comprising:
a computer-readable storage medium storing computer-executable instructions; and
one or more processors, wherein the computer-executable instructions, when executed by the one or more processors, cause the one or more processors to:
process a first image and an instruction received from a user device;
provide the first image and the instruction as an input to a matching model, wherein providing the first image and the instruction as input to the matching model causes the matching model to output a second image associated with a first property listing;
determine a first confidence score relating to a first similarity between the first image and the second image;
determine that the first confidence score is above a confidence threshold; and
cause the first property listing to be displayed in a user interface on the user device, wherein the first property listing includes the second image.
2 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the one or more processors to process a third image received from the user device.
3 . The system of claim 2 , wherein the computer-executable instructions, when executed, further cause the one or more processors to:
provide the first image, the third image, and the instruction as input to the matching model to cause the matching model to output the second image associated with the first property listing;
determine a second confidence score relating to a second similarity between the third image and the second image; and
determine that the first confidence score and the second confidence score are above the confidence threshold.
4 . The system of claim 2 , wherein the computer-executable instructions, when executed, further cause the one or more processors to:
provide the first image, the third image, and the instruction as input to the matching model to cause the matching model to output the second image associated with the first property listing and a fourth image associated with a second property listing;
determine a second confidence score relating to a second similarity between the third image and the fourth image; and
rank the second image and the fourth image based on a comparison between the first confidence score and the second confidence score.
5 . The system of claim 2 , wherein ranking of the first image and the third image is based on a weighted average.
6 . The system of claim 1 , wherein the instruction is a request for property listings similar to the first image.
7 . The system of claim 1 , wherein the matching model is to output a third image associated with a second property listing.
8 . The system of claim 7 , wherein the computer-executable instructions, when executed, further cause the one or more processors to:
determine a second confidence score relating to a similarity between the first image and the third image; and
rank the first property listing and the second property listing based on a comparison between the first confidence score and the second confidence score.
9 . The system of claim 1 , wherein the computer-executable instructions, when executed, further cause the one or more processors to filter the first property listing based on a filter parameter.
10 . The system of claim 1 , wherein the matching model is a machine learning model.
11 . A method, comprising:
accessing a first property listing on a user device, wherein the first property listing includes a first image;
providing the first image as input into a matching model, wherein providing the first image as input to the matching model causes the matching model to output a second image included with a second property listing;
determining a first confidence score relating to a first similarity between the first image and the second image;
determining that the first confidence score is above a confidence threshold; and
displaying the second property listing, wherein the second property listing includes the second image.
12 . The method of claim 11 , wherein the first property listing includes a plurality of images.
13 . The method of claim 11 , wherein the matching model is to output a third image associated with the second property listing.
14 . The method of claim 13 , further comprising:
determining a second confidence score relating to a similarity between the first image and the third image; and
ranking the first property listing and the second property listing based on a comparison between the first confidence score and the second confidence score.
15 . The method of claim 14 , wherein ranking of the first image and the third image is based on a weighted average.
16 . The method of claim 11 , further comprising filtering the first property listing based on a filter parameter.
17 . One or more non-transitory computer-readable media storing computer-executable instructions that, when executed by a computing system comprising a processor, cause the computing system to:
process a first image and an instruction received from a user device;
provide the first image and the instruction as an input to a matching model, wherein providing the first image and the instruction as input to the matching model causes the matching model to output a second image associated with a first property listing;
determine a first confidence score relating to a similarity between the first image and the second image;
determine that the first confidence score is above a confidence threshold; and
cause the first property listing to be displayed in a user interface on the user device, wherein the first property listing includes the second image.
18 . The one or more non-transitory computer-readable media of claim 17 , wherein the matching model is to output a third image associated with a second property listing.
19 . The one or more non-transitory computer-readable media of claim 18 , wherein the computer-executable instructions, when executed, further cause the computing system to:
determine a second confidence score relating to a similarity between the first image and the third image; and
rank the first property listing and the second property listing based on a comparison between the first confidence score and the second confidence score.
20 . The one or more non-transitory computer-readable media of claim 17 , wherein the computer-executable instructions, when executed, further cause the computing system to filter the first property listing based on a filter parameter.