IP Library Granted Patent US 10,776,881
Granted Patent B1
US 10,776,881 · App. 15/915,800 · Granted Sep 15, 2020

Systems and methods for hail damage verification on rooftops using computer vision and artificial intelligence

Inventor: Brian N. Harvey (Bloomington, IL)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
G06Q40/08G06K9/00637G06K9/6202G06K9/6262G06N20/00G06T7/62G06T2207/10032G06T2207/20081G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,776,881
App. No.
15/915,800
Granted
Sep 15, 2020
Kind
B1
Abstract

A computer system for verifying hail damage and/or detecting hail fraud includes a processor and a non-transitory, tangible, computer-readable storage medium having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations including: (i) receiving at least one image of at least a portion of a rooftop; (ii) analyzing the at least one image to identify a plurality of damaged locations; (iii) analyzing damaged locations to determine a distance between each of the damaged locations; and (iv) determining, based upon the analyzing, whether the damaged locations are a result of hail damage by determining the distance between at least some of damaged locations.

Claims (45)

1. A computer system for verifying hail damage using computer vision and artificial intelligence, the computer system comprising:

a processor; and

a non-transitory, tangible, computer-readable storage medium having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:

receiving at least one image of at least a portion of a single rooftop;

analyzing the at least one image to identify a plurality of damaged locations in a selected damage area on the single rooftop;

analyzing, using at least one of a computer vision and an artificial intelligence algorithm, the plurality of damaged locations to determine (i) a distance between each of the plurality of damaged locations and (ii) a positioning of each damaged location relative to one another;

comparing, based upon the analysis, (i) the distance between at least some of the plurality of damaged locations to one another and (ii) the positioning for the at least some of the plurality of damaged locations to one another;

determining, based upon the comparison, whether the distance and the positioning between each damaged location of the at least some of the plurality of damaged locations are substantially uniform relative to one another; and

if, based upon the determination, the distance and the positioning for the at least some of the plurality of damaged locations are not substantially uniform, determining that the plurality of damaged locations are a result of hail damage.

2. The computer system of claim 1 , wherein the processor is further configured to perform operations comprising determining that the plurality of damaged locations are not the result of hail damage when the distance and the positioning for the at least some of the plurality of damaged locations are substantially uniform.

3. The computer system of claim 1 , wherein the processor is further configured to perform operations comprising analyzing the plurality of damaged locations to determine a shape and a size of each of the plurality of damaged locations.

4. The computer system of claim 3 , wherein the processor is further configured to perform operations comprising determining, based upon the analyzing, that the plurality of damaged locations are not a result of hail damage based upon the shape and the size of at least one of the plurality of damaged locations being substantially identical to the shape and the size of at least one other damaged location of the plurality of damaged locations.

5. The computer system of claim 4 , wherein the processor is further configured to perform operations comprising determining that the plurality of damaged locations are a result of mechanical damage delivered by an individual.

6. The computer system of claim 4 , wherein at least one of the shape and the size of at least one of the plurality of damaged locations is associated with mechanical damage delivered by a tool.

7. The computer system of claim 3 , wherein the processor is further configured to perform operations comprising determining, based upon the analyzing, that the plurality of damaged locations are a result of hail damage based upon the shape and the size of at least one of the plurality of damaged locations not being substantially identical to the shape and the size of at least one other damaged location of the plurality of damaged locations.

8. The computer system of claim 1 , wherein analyzing the plurality of damaged locations using an artificial intelligence algorithm comprises implementing a machine learning algorithm to compare the plurality of damaged locations to a plurality of patterns and shapes associated with known hail damage.

9. The computer system of claim 1 , wherein analyzing the plurality of damaged locations using a computer vision algorithm comprises implementing an image recognition algorithm to identify variations in an impact signature of each of the plurality of damaged locations.

10. The computer system of claim 1 , wherein the processor is further configured to perform operations comprising receiving at least one image of a soft metal component mounted on the single rooftop.

11. The computer system of claim 10 , wherein the processor is further configured to perform operations comprising analyzing the at least one image of the soft metal component to identify at least one damaged location in the soft metal component.

12. The computer system of claim 11 , wherein the processor is further configured to perform operations comprising determining, in response to the analyzing, that the plurality of damaged locations in the soft metal component are a result of hail damage.

13. The computer system of claim 10 , wherein the processor is further configured to perform operations comprising analyzing the at least one image of the soft metal component to determine that the soft metal component is undamaged.

14. The computer system of claim 13 , wherein the processor is further configured to perform operations comprising determining, in response to the analyzing, that the plurality of damaged locations are not a result of hail damage.

15. A computer-implemented method for verifying hail damage using computer vision and artificial intelligence, the method implemented using a computer system including a processor in communication with at least one memory, the method comprising:

receiving at least one image of at least a portion of a single rooftop;

analyzing the at least one image to identify a plurality of damaged locations in a selected damage area on the single rooftop;

analyzing, using at least one of a computer vision and an artificial intelligence algorithm, the plurality of damaged locations to (i) determine a distance between each of the plurality of damaged locations and (ii) a positioning of each damaged location relative to one another;

comparing, based upon the analysis, (i) the distance between at least some of the plurality of damaged locations to one another and (ii) the positioning for the at least some of the plurality of damaged locations to one another;

determining, based upon the comparison, whether the distance and the positioning between each damaged location of the at least some of the plurality of damaged locations are substantially uniform relative to one another; and

if, based upon the determination, the distance and the positioning for the at least some of the plurality of damaged locations are not substantially uniform, determining that the plurality of damaged locations are a result of hail damage.

16. The computer-implemented method of claim 15 , wherein said determining comprises determining that the plurality of damaged locations are not the result of hail damage when the distance and the positioning for the at least some of the plurality of damaged locations are substantially uniform.

17. The computer-implemented method of claim 15 further comprising analyzing the plurality of damaged locations to determine a shape and a size of each of the plurality of damaged locations.

18. The computer-implemented method of claim 17 further comprising determining, based upon the analyzing, that the plurality of damaged locations are not a result of hail damage based upon the shape and the size of at least one of the plurality of damaged locations being substantially identical to the shape and the size of at least one other damaged location of the plurality of damaged locations.

19. The computer-implemented method of claim 17 comprising determining, based upon the analyzing, that the plurality of damaged locations are a result of hail damage based upon the shape and the size of at least one of the plurality of damaged locations not being substantially identical to the shape and the size of at least one other damaged location of the plurality of damaged locations.

20. The computer-implemented method of claim 15 , wherein analyzing the plurality of damaged locations using an artificial intelligence algorithm comprises implementing a machine learning algorithm to compare the plurality of damaged locations to a plurality of patterns and shapes associated with known hail damage.

21. At least one non-transitory computer-readable storage media having computer-executable instructions embodied thereon, wherein when executed by a computer system including at least one processor in communication with a memory, the computer-executable instructions cause the at least one processor to perform operations comprising:

receiving at least one image of at least a portion of a single rooftop;

analyzing the at least one image to identify a plurality of damaged locations in a selected damage area on the single rooftop;

analyzing, using at least one of a computer vision and an artificial intelligence algorithm, the plurality of damaged locations to (i) determine a distance between each of the plurality of damaged locations and (ii) a positioning of each damaged location relative to one another;

comparing, based upon the analysis, (i) the distance between at least some of the plurality of damaged locations to one another and (ii) the positioning for the at least some of the plurality of damaged locations to one another;

determining, based upon the comparison, whether the distance and the positioning between each damaged location of the at least some of the plurality of damaged locations are substantially uniform relative to one another; and

if, based upon the determination, the distance and the positioning for the at least some of the plurality of damaged locations are not substantially uniform, determining that the plurality of damaged locations are a result of hail damage.

22. The at least one non-transitory computer-readable storage media of claim 21 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising determining that the plurality of damaged locations are not the result of hail damage when the distance and the positioning for the at least some of the plurality of damaged locations are substantially uniform.

23. The at least one non-transitory computer-readable storage claim 21 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising analyzing the plurality of damaged locations to determine a shape and a size of each of the plurality of damaged locations.

24. The at least one non-transitory computer-readable storage claim 23 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising determining, based upon the analyzing, that the plurality of damaged locations are not a result of hail damage based upon the shape and the size of at least one of the plurality of damaged locations being substantially identical to the shape and the size of at least one other damaged location of the plurality of damaged locations.

25. The at least one non-transitory computer-readable storage claim 23 , wherein the computer-executable instructions cause the at least one processor to perform operations further comprising determining, based upon the analyzing, that the plurality of damaged locations are a result of hail damage based upon the shape and the size of at least one of the plurality of damaged locations not being substantially identical to the shape and the size of at least one other damaged location of the plurality of damaged locations.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2018
From: HARVEY, BRIAN N.
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 045275/0044 →
Continuity (3)
Provisional Application 62518942 · Jun 13, 2017
Provisional Application 62532450 · Jul 14, 2017
Provisional Application 62543014 · Aug 9, 2017
Cited By (1)
US 12,626,307