Technology for analyzing images depicting vehicles according to base image models
A method and system for analyzing images of a target vehicle according to a base image model corresponding to the target vehicle. According to certain aspects, the method and system receive a set of images from an electronic device and analyze the set of images to identify the target vehicle and a set of information associated with the target vehicle. The method and system may determine that the set of images does not meet a threshold criteria for further image analysis using a base image model corresponding to the target vehicle. In response, the method and system may generate and transmit a notification to the electronic device indicating that the set of images does not meet the threshold criteria.
1. A computer-implemented method in a server device of analyzing images, the method comprising:
receiving an initial set of images from an electronic device via a network connection; analyzing at least a portion of the initial set of images to identify (i) a target vehicle that is depicted in the at least the portion of the initial set of images, and (ii) a set of information associated with the target vehicle;
accessing a particular base image model corresponding to the target vehicle; determining, based at least in part on the set of information associated with the target vehicle, that the initial set of images does not collectively meet a threshold criteria corresponding to a completeness, among an entirety of the initial set of images, of a plurality of types of image perspectives required for the particular base image model for further image analysis using the particular base image model, wherein different pluralities of types of image perspectives are required for different base image models;
in response to determining that the initial set of images does not collectively meet the threshold criteria, generating a notification indicating that the entirety of the initial set of images does not collectively meet the threshold criteria, and transmitting the notification to the electronic device via the network connection;
receiving, via the network connection subsequent to the transmitted notification, an additional set of images of the target vehicle; and
performing the further image analysis, using the particular base image model, on a combination of at least a part of the initial set of images and at least a part of the additional set of images to thereby detect damage to the target vehicle.
2. The computer-implemented method of claim 1 , further comprising:
analyzing at least some of the additional set of images to identify an additional set of information associated with the target vehicle; and
determining, based at least in part on the additional set of information associated with the target vehicle, that the combination of the at least the part of the initial set of images and the at least the part of the additional set of images collectively meets the threshold criteria for the further image analysis using the particular base image model.
3. The computer-implemented method of claim 1 , wherein:
analyzing the at least the portion of the initial set of images to identify the set of information associated with the target the vehicle comprises analyzing the at least the portion of the initial set of images to identify a set of perspective views of the target vehicle depicted in the at least the portion of the initial set of images; and
determining that the initial set of images does not collectively meet the threshold criteria for the further image analysis using the particular base image model comprises determining that a set of types of perspective views of the target vehicle included in the set of perspective views of the target vehicle excludes one or more types of image perspectives required for the particular base image model corresponding to the target vehicle.
4. The computer-implemented method of claim 1 , further comprising accessing telematics data associated with the target vehicle, the telematics data indicating damage to a portion of the target vehicle; and wherein:
analyzing the at least the portion of the initial set of images comprises analyzing the at least the portion of the initial set of images to determine that the damage to the portion of the target vehicle is not depicted in the at least the portion of the initial set of images; and
generating the notification comprises generating a notification to capture one or more images depicting the damage to the portion of the target vehicle.
5. The computer-implemented method of claim 1 , further comprising:
accessing telematics data associated with the target vehicle, wherein the telematics data indicates a first notice of loss (FNOL) event associated with the target vehicle has occurred; and in response to accessing the telematics data, requesting the electronic device to transmit the initial set of images.
6. The computer-implemented method of claim 1 , wherein:
analyzing the at least the portion of the initial set of images comprises analyzing the at least the portion of the initial set of images to identify a set of components of the target vehicle depicted in the at least the portion of the initial set of images; and
determining that the initial set of images does not collectively meet the threshold criteria for the further image analysis using the particular base image model comprises determining that the set of components does not match a set of base vehicle components associated with the particular base image model.
7. The computer-implemented method of claim 1 , wherein
determining that the initial set of images does not collectively meet the threshold criteria for the further image analysis using the particular base image model comprises at least one of:
determining that the initial set of images is unable to be aligned with the particular base image model; or
analyzing the initial set of images according to t the particular base image model, wherein the analyzing is indeterminate.
8. The computer-implemented method of claim 1 , wherein the particular base image model is three-dimensional, and wherein at least some of the images included in the initial set of images are two-dimensional.
9. The computer-implemented method of claim 1 , wherein performing the further image analysis, using the particular base image model, on the combination of the at least the part of the initial set of images and the at least the part of the additional set of images to thereby detect the damage to the target vehicle comprises aligning the at least the part of initial set of images and the at least the part of the additional set of images with the particular base image model, and applying one or more convolutional neural networks to one or more portions of the aligned images of the target vehicle to thereby detect the damage to the target vehicle.
10. The computer-implemented method of claim 1 , wherein the method further comprises determining the completeness of the entirety of the initial set of images; and the completeness of the entirety of the initial set of images further corresponds to at least one of: an amount of image perspectives of the target vehicle, an amount of identified vehicle components, or one or more types of identified vehicle components.
11. A system for analyzing images, comprising:
a communication module configured to communicate with an electronic device via a network connection;
a memory storing a set of base images models corresponding to a set of vehicles; and a processor interfaced with the communication module and the memory, and configured to execute a set of instructions to cause the processor to:
receive an initial set of images from an electronic device via the communication module;
analyze at least a portion of the initial set of images to identify (i) a target vehicle that is depicted in the at least the portion of the initial set of images, and (ii) a set of information associated with the target vehicle;
access, from the memory, a particular base image model corresponding to the target vehicle;
determine, based at least in part on the set of information associated with the target vehicle, that the initial set of images does not collectively meet a threshold criteria corresponding to a completeness, among the entirety of the initial set of images, of a plurality of types of image perspective views required for the particular base image model for further image analysis using the particular base image model, wherein different pluralities of types of image perspectives are required for different base image models;
in response to determining that the initial set of images does not collectively meet the threshold criteria, generate a notification indicating that the entirety of the initial set of images does not collectively meet the threshold criteria, and transmit the notification to the electronic device via the communication module;
receive, via the communication module subsequent to the transmitted notification, an additional set of images of the target vehicle; and
perform the further image analysis, using the particular base image model, on a combination of at least a part of the initial set of images and at least a part of the additional set of images to thereby detect damage to the target vehicle.
12. The system of claim 11 , wherein the processor is further configured to:
analyze at least some of the additional set of images to identify an additional set of information associated with the target vehicle; and
determine, based at least in part on the additional set of information associated with the target vehicle, that the combination of the at least the part of the initial set of images and the at least the part of the additional set of images collectively meets the threshold criteria for the further image analysis using the particular base image model.
13. The system of claim 11 , wherein:
the set of information associated with the target vehicle includes a set of perspective views of the target vehicle depicted in at least the portion of the initial set of images; and
the determination that the initial set of images does not collectively meet the threshold criteria for the further image analysis using the particular base image model includes a determination that a set of types of perspective views of the target vehicle included in the set of perspective views of the target vehicle excludes one or more types of image perspectives required for the particular base image model corresponding to the target vehicle.
14. The system of claim 11 , wherein:
the processor is further configured to access telematics data associated with the target vehicle, the telematics data indicating damage to a portion of the target vehicle;
the analysis of the at least the portion of the initial set of images includes an analysis of the at least the portion of the initial set of images to determine that the damage to the portion of the target vehicle is not depicted in the at least the portion of the initial set of images; and
the generated notification includes an indication that a depiction of the damage to the portion of the target vehicle is not included in the initial set of images.
15. The system of claim 11 , wherein the processor is further configured to:
access telematics data associated with the target vehicle, wherein the telematics data indicates that a first notice of loss (FNOL) event associated with the target vehicle has occurred, and
in response to accessing the telematics data, request the electronic device to transmit the initial set of images.
16. The system of claim 11 , wherein:
the analysis of the at least the portion of the initial set of images includes an analysis of the at least the portion of the initial set of images to identify a set of components of the target vehicle depicted in the at least the portion of the initial set of images; and
the determination that the initial set of images does not collectively meet the threshold criteria for the further image analysis using the particular base image model includes a determination that the set of components does not match a set of base vehicle components associated with the particular base image model.
17. The system of claim 11 , wherein the determination that the initial set of images does not collectively meet the threshold criteria for the further image analysis using the particular base image model includes at least one of: a determination that the initial set of images is unable to be aligned with the particular base image model, or a determination that an analysis of the initial set of images according to the particular base image model is indeterminate.
18. The system of claim 11 , wherein the particular base image model is three-dimensional, and wherein at least some of the images included in the initial set of images are two-dimensional.
19. The system of claim 11 , wherein the performance of the further image analysis, using the particular base image model, on the combination of the at least the part of the initial set of images and the at least the part of the additional set of images to thereby detect the damage to the target vehicle comprises an alignment of the at least the part of the initial set of images and the at least the part of the additional set of images the particular base image model, and an application of one or more convolutional neural networks to one or more portions of the aligned images of the target vehicle to thereby detect the damage to the target vehicle.
20. The system of claim 11 , wherein the set of instructions, when executed by the processor, is further configured to determine the completeness among the entirety of the initial set of images; and the completeness of the entirety of the initial set of images further corresponds to at least one of: an amount of image perspectives of the target vehicle, an amount of identified vehicle components, or one or more types of identified vehicle components.