IP Library Granted Patent US 10,776,624
Granted Patent B1
US 10,776,624 · App. 15/915,747 · Granted Sep 15, 2020

Systems and methods for hail damage verification on rooftops using computer vision and artificial intelligence

Inventor: Brian N. Harvey (Bloomington, IL)
Assignee: State Farm Mutual Automobile Insurance Company
G06K9/00637G06K9/6202G06N3/04G06N3/08G06T7/62G06T2207/10032G06T2207/20081G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,776,624
App. No.
15/915,747
Filed
Mar 8, 2018
Granted
Sep 15, 2020
Kind
B1
Art Unit
2664
USPC
382/103
Abstract

A computer system for verifying hail damage and/or detecting hail fraud includes a processor and a non-transitory, tangible, computer-readable storage medium having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations including: (i) receiving at least one image of at least a portion of a rooftop; (ii) analyzing the at least one image to identify a plurality of damaged locations; (iii) analyzing damaged locations to determine a shape and a size of each of the damaged locations; and (vi) determining, based upon the analyzing, whether the damaged locations are a result of hail damage by comparing the shape and the size of at least one damaged location to the shape and the size of at least one other damaged location.

Claims (51)

1. A computer system for verifying hail damage using computer vision and artificial intelligence, the computer system comprising:

a processor; and

a non-transitory, tangible, computer-readable storage medium having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:

receiving at least one image of at least a portion of a single rooftop;

analyzing the at least one image to identify a selected damage area on the single rooftop, the selected damage area including a plurality of damaged locations including a first damaged location and a second damaged location;

analyzing, using at least one of a computer vision and an artificial intelligence algorithm, the first damaged location of the plurality of damaged locations to determine a shape and a size of the first damaged location of the plurality of damaged locations;

analyzing, using the at least one of the computer vision and the artificial intelligence algorithm, the second damaged location of the plurality of damaged locations to determine a shape and size of the second damaged location of the plurality of damaged locations;

comparing, based upon the analysis, the shape and the size of the first damaged location to the shape and the size of the second damaged location; and

determining, based upon the comparison, whether the plurality of damaged locations are a result of hail damage.

2. The computer system of claim 1 , wherein the processor is further configured to perform operations comprising:

determining that the plurality of damaged locations are not the result of hail damage when the shape and the size of the first damaged location of the plurality of damaged locations are substantially identical to the shape and the size of the second damaged location of the plurality of damaged locations; and

determining that the plurality of damaged locations are the result of hail damage when the shape and the size of the first damaged location of the plurality of damaged locations are not substantially identical to the shape and the size of the second damaged location of the plurality of damaged locations.

3. The computer system of claim 1 , wherein the processor is further configured to perform operations comprising analyzing the plurality of damaged locations to determine a distance between each of the plurality of damaged locations.

4. The computer system of claim 3 , wherein the processor is further configured to perform operations comprising determining, based upon the analyzing, that the plurality of damaged locations are not a result of hail damage based upon the distance between at least some of the plurality of damaged locations being substantially uniform.

5. The computer system of claim 4 , wherein the processor is further configured to perform operations comprising determining that the plurality of damaged locations are a result of mechanical damage delivered by an individual.

6. The computer system of claim 3 , wherein the processor is further configured to perform operations comprising determining, based upon the analyzing, that the plurality of damaged locations are a result of hail damage based upon the distance between at least some of the plurality of damaged locations being not substantially uniform.

7. The computer system of claim 1 , wherein analyzing the plurality of damaged locations using an artificial intelligence algorithm comprises implementing a machine learning algorithm to compare the plurality of damaged locations to a plurality of patterns and shapes associated with known hail damage.

8. The computer system of claim 1 , wherein analyzing the plurality of damaged locations using a computer vision algorithm comprises implementing an image recognition algorithm to identify variations in an impact signature of each of the plurality of damaged locations.

9. The computer system of claim 1 , wherein at least one of the shape and the size of at least one of the plurality of damaged locations is associated with mechanical damage delivered by a tool.

10. The computer system of claim 1 , wherein the processor is further configured to perform operations comprising receiving at least one image of a soft metal component mounted on the single rooftop.

11. The computer system of claim 10 , wherein the processor is further configured to perform operations comprising analyzing the at least one image of the soft metal component to identify at least one damaged location in the soft metal component.

12. The computer system of claim 11 , wherein the processor is further configured to perform operations comprising determining, in response to the analyzing, that the plurality of damaged locations in the soft metal component are a result of hail damage.

13. The computer system of claim 10 , wherein the processor is further configured to perform operations comprising analyzing the at least one image of the soft metal component to determine that the soft metal component is undamaged.

14. The computer system of claim 13 , wherein the processor is further configured to perform operations comprising determining, in response to the analyzing, that the plurality of damaged locations are not a result of hail damage.

15. A computer-implemented method for verifying hail damage using computer vision and artificial intelligence, the method implemented using a computer system including a processor in communication with at least one memory, the method comprising:

receiving at least one image of at least a portion of a single rooftop;

analyzing the at least one image to identify a selected damage area on the single rooftop, the selected damage area including a plurality of damaged locations including a first damaged location and a second damaged location;

analyzing, using at least one of a computer vision and an artificial intelligence algorithm, the first damaged location of the plurality of damaged locations to determine a shape and a size of the first damaged location of the plurality of damaged locations;

analyzing, using the at least one of the computer vision and the artificial intelligence algorithm, the second damaged location of the plurality of damaged locations to determine a shape and size of the second damaged location of the plurality of damaged locations;

comparing, based upon the analysis, the shape and the size of the first damaged location to the shape and the size of the second damaged location; and

determining, based upon the comparison, whether the plurality of damaged locations are a result of hail damage.

16. The computer-implemented method of claim 15 , wherein said determining comprises:

determining that the plurality of damaged locations are not the result of hail damage when the shape and the size of the first damaged location of the plurality of damaged locations are substantially identical to the shape and the size of the second damaged location of the plurality of damaged locations; and

determining that the plurality of damaged locations are the result of hail damage when the shape and the size of the first damaged location of the plurality of damaged locations are not substantially identical to the shape and the size of the second damaged location of the plurality of damaged locations.

17. The computer-implemented method of claim 15 further comprising analyzing the plurality of damaged locations to determine a distance between each of the plurality of damaged locations.

18. The computer-implemented method of claim 17 further comprising determining, based upon the analyzing, that the plurality of damaged locations are not a result of hail damage based upon the distance between at least some of the plurality of damaged locations being substantially uniform.

19. The computer-implemented method of claim 17 further comprising determining, based upon the analyzing, that the plurality of damaged locations are a result of hail damage based upon the distance between at least some of the plurality of damaged locations being not substantially uniform.

20. The computer-implemented method of claim 15 , wherein analyzing the plurality of damaged locations using an artificial intelligence algorithm comprises implementing a machine learning algorithm to compare the plurality of damaged locations to a plurality of patterns and shapes associated with known hail damage.

21. At least one non-transitory computer-readable storage media having computer-executable instructions embodied thereon, wherein when executed by a computer system including at least one processor in communication with a memory, the computer-executable instructions cause the at least one processor to perform operations comprising:

receiving at least one image of at least a portion of a single rooftop;

analyzing the at least one image to identify a selected damage area on the single rooftop, the selected damage area including a plurality of damaged locations including a first damaged location and a second damaged location;

analyzing, using at least one of a computer vision and an artificial intelligence algorithm, the first damaged location of the plurality of damaged locations to determine a shape and a size of the first damaged location of the plurality of damaged locations;

analyzing, using the at least one of the computer vision and the artificial intelligence algorithm, the second damaged location of the plurality of damaged locations to determine a shape and size of the second damaged location of the plurality of damaged locations;

comparing, based upon the analysis, the shape and the size of the first damaged location to the shape and the size of the second damaged location; and

determining, based upon the comparison, whether the plurality of damaged locations are a result of hail damage.

22. The at least one non-transitory computer-readable storage media of claim 21 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising:

determining that the plurality of damaged locations are not the result of hail damage when the shape and the size of the first damaged location of the plurality of damaged locations are substantially identical to the shape and the size of the second damaged location of the plurality of damaged locations; and

determining that the plurality of damaged locations are the result of hail damage when the shape and the size of the first damaged location of the plurality of damaged locations are not substantially identical to the shape and the size of the second damaged location of the plurality of damaged locations.

23. The at least one non-transitory computer-readable storage media of claim 21 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising analyzing the plurality of damaged locations to determine a distance between each of the plurality of damaged locations.

24. The at least one non-transitory computer-readable storage media of claim 23 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising determining, based upon the analyzing, that the plurality of damaged locations are not a result of hail damage based upon the distance between at least some of the plurality of damaged locations being substantially uniform.

25. The at least one non-transitory computer-readable storage media of claim 23 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising: determining, based upon the analyzing, that the plurality of damaged locations are a result of hail damage based upon the distance between at least some of the plurality of damaged locations being not substantially uniform.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2018
From: HARVEY, BRIAN N.
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 045275/0044 →
Continuity (3)
Provisional Application 62518942 · Jun 13, 2017
Provisional Application 62532450 · Jul 14, 2017
Provisional Application 62543014 · Aug 9, 2017
Cited By (1)
US 12,626,307