IP Library Granted Patent US 12,488,397
Granted Patent B2
US 12,488,397 · App. 18/595,784 · Granted Dec 2, 2025

Systems and methods for detecting, extracting, and categorizing structure data from imagery

Inventors: Ron Richardson (South Jordan, UT); Cory Shelton (Cedar Hills, UT); Corey David Reed (Cedar Hills, UT)
Assignee: Insurance Services Office, Inc.
G06Q40/08G06F16/29G06N20/00G06T7/0002G06V20/176G06T2200/24G06T2207/10032G06T2207/20081G06T2207/20104G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,488,397
App. No.
18/595,784
Filed
Mar 5, 2024
Granted
Dec 2, 2025
Kind
B2
Art Unit
3694
USPC
705/4
Abstract

Systems and methods for detecting, extracting, and categorizing structure data from aerial imagery following a major weather event are provided. The system processes digital images and weather data to automatically detect, extract, and categorize structure data following a major weather event. After receiving an indication of a region of interest (“ROI”) from a user, the system retrieves weather mapping data for the ROI and retrieves information related to attributes of structures within the ROI from a machine learning subsystem. The system then cross-references the property data, the weather data, and the structure attributes and assigns a risk rating to the structures within the ROI. Finally, the system generates and delivers a data package to the user.

Claims (35)

1 . A method for predicting damage to a structure, comprising:

receiving at a computer system an indication of a geospatial region of interest from a user;

retrieving by the computer system one or more aerial images associated with the region of interest from an aerial image database;

processing the one or more aerial images using a machine learning algorithm executed by the computer system to extract one or more attributes of a structure within the region of interest;

retrieving by the computer system weather data associated with the region of interest from a weather database;

determining by the computer system a likelihood of damage to the structure based on the one or more extracted attributes and the weather data associated with the region of interest;

transmitting a data package from the computer system which includes the likelihood of damage to the structure; and

displaying a project map which includes a plurality of user-selectable display layers that can be toggled on and off, wherein at least one of the user-selectable display layers includes a graphical depiction of a weather event overlaid on the property.

2 . The method of claim 1 , wherein geospatial region of interest is indicated by latitude and longitude coordinates.

3 . The method of claim 1 , wherein the geospatial region of interest is indicated by a bounded polygon displayed on a computer display.

4 . The method of claim 3 , wherein the bounded polygon is determined by one or more of a postal address, property survey data, or a selection made by a user in a geospatial mapping interface.

5 . The method of claim 1 , wherein the one or more aerial images comprises one or more of a satellite image, an image captured by an unmanned aerial vehicle (UAV), a photographic aerial image, a scanned image, or a LIDAR image.

6 . The method of claim 1 , wherein the weather data includes data relating to one or more of hail storms, wind, and hurricanes.

7 . The method of claim 1 , wherein the machine learning algorithm extracts attributes relating to a roof of a structure including one or more of a roof type, a roof area, a slope, a roof material, or an eave height.

8 . The method of claim 1 , further comprising calculating by the computer system a risk rating level correlated to the likelihood of damage and including the risk rating level in the data package.

9 . The method of claim 1 , further comprising processing the data package to generate a visualization of damage and displaying the visualization to a user.

10 . The method of claim 1 , further comprising detecting, extracting, and categorizing structure data from one or more of a wildfire, lightning, arson, hurricanes, hailstorms, tornadoes, and non-weather-related data.

11 . A system for predicting damage to a structure, comprising:

a memory storing one or more aerial images; and

a processor in communication with the memory, the processor:

receiving an indication of a geospatial region of interest from a user;

retrieving one or more aerial images associated with the region of interest from the memory;

processing the one or more aerial images using a machine learning algorithm to extract one or more attributes of a structure within the region of interest;

retrieving weather data associated with the region of interest from a weather database;

determining a likelihood of damage to the structure based on the one or more extracted attributes and the weather data associated with the region of interest; and

transmitting a data package which includes the likelihood of damage to the structure; and

displaying a project map which includes a plurality of user-selectable display layers that can be toggled on and off, wherein at least one of the user-selectable display layers includes a graphical depiction of a weather event overlaid on the property.

12 . The system of claim 11 , wherein geospatial region of interest is indicated by latitude and longitude coordinates.

13 . The system of claim 11 , wherein the geospatial region of interest is indicated by a bounded polygon displayed on a computer display.

14 . The system of claim 13 , wherein the bounded polygon is determined by one or more of a postal address, property survey data, or a selection made by a user in a geospatial mapping interface.

15 . The system of claim 11 , wherein the one or more aerial images comprises one or more of a satellite image, an image captured by an unmanned aerial vehicle (UAV), a photographic aerial image, a scanned image, or a LIDAR image.

16 . The system of claim 11 , wherein the weather data includes data relating to one or more of hail storms, wind, and hurricanes.

17 . The system of claim 11 , wherein the machine learning algorithm extracts attributes relating to a roof of a structure including one or more of a roof type, a roof area, a slope, a roof material, or an eave height.

18 . The system of claim 11 , wherein the processor calculates a risk rating level correlated to the likelihood of damage and includes the risk rating level in the data package.

19 . The system of claim 11 , wherein the processor detects, extracts, and categorizes structure data from one or more of a wildfire, lightning, arson, hurricanes, hailstorms, tornadoes, and non-weather-related data.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 5, 2024
From: RICHARDSON, RON; SHELTON, CORY; REED, COREY DAVID
To: INSURANCE SERVICES OFFICE, INC.
Reel/Frame 066652/0663 →
Continuity (3)
Continuation 17339510 · Jun 4, 2021
Provisional Application 63034670 · Jun 4, 2020
Related Publication 20250078165A1 · Mar 6, 2025
References Cited (25)
US 8489641B1 · Seefeld · 2013 [cited by examiner]
US 10204193B2 · Koger · 2019 [cited by examiner]
US 10672081B1 · Lyons · 2020 [cited by examiner]
US 11922509B2 · Richardson et al. · 2024 [cited by applicant]
US 20120311053A1 · Labrie · 2012 [cited by examiner]
US 20150025914A1 · Lekas · 2015 [cited by examiner]
US 20150302529A1 · Jagannathan · 2015 [cited by examiner]
US 20160343093A1 · Riland · 2016 [cited by examiner]
US 20180190132A1 · Cronkhite · 2018 [cited by examiner]
US 20180336418A1 · Splittstoesser · 2018 [cited by examiner]
US 20190028534A1 · Bloomquist · 2019 [cited by examiner]
US 20190236365A1 · Speasl · 2019 [cited by examiner]
US 20200098130A1 · Porter · 2020 [cited by examiner]
US 20200134573A1 · Vickers · 2020 [cited by examiner]
US 20210383481A1 · Richardson et al. · 2021 [cited by applicant]
LandSurf: A smart tool for evaluating properties and lands; 2017 Sensors Networks Smart and Emerging Technologies (SENSET) (pp. 1-4); John S. Massaad, Aziz M. Barbar, Anis Ismail; Sep. 1, 2017. (Year: 2017). [cited by examiner]
Pairs AutoGeo: an Automated Machine Learning Framework for Massive Geospatial Data; 2020 IEEE International Conference on Big Data (Big Data) (pp. 1755-1763); Wang Zhou, Levente J. Klein, Siyuan Lu; Dec. 10, 2020. (Year… [cited by examiner]
International Search Report of the International Searching Authority mailed on Sep. 8, 2021, issued in connection with International Application No. PCT/US2021/35938 (3 pages). [cited by applicant]
Wiritten Opinion of the International Searching Authority mailed on Sep. 8, 2021, issued in connection with International Application No. PCT/US2021/35938 (7 pages). [cited by applicant]
Office Action mailed Jul. 20, 2022, issued in connection with U.S. Appl. No. 17/339,510 (24 pages). [cited by applicant]
Arshad, et al., “Computer Vision and IoT-Based Sensors in Flood Monitoring and Mapping: A Systematic Review,” Sensors (Basel, Switzerland), Nov. 16, 2019 (19 pages). [cited by applicant]
Office Action mailed May 2, 2023, issued in connection with U.S. Appl. No. 17/339,510 (28 pages). [cited by applicant]
Albrechet, et al., “Next-Generation Geospatial Temporal Information Technologies for Disaster Management,” IBM Journal of Research and Development (2020) (14 pages). [cited by applicant]
Notice of Allowance mailed Nov. 13, 2023, issued in connection with U.S. Appl. No. 17/339,510 (11 pages). [cited by applicant]
Extended European Search Report dated Dec. 5, 2023, issued by the European Patent Offfice in connection with European Patent Application No. 21818668.2 (7 pages). [cited by applicant]