IP Library Granted Patent US 12,360,286
Granted Patent B2
US 12,360,286 · App. 17/966,510 · Granted Jul 15, 2025

Hail predictions using artificial intelligence

Inventors: Michael Ulin (Portland, OR); Masoumeh Rezaei Abkenar (Brossard, CA); Bryn Ronalds (Montreal, CA); Frederick Dube Fortier (Oakland, CA); Kristie Sarkar (San Francisco, CA)
Assignee: Zesty.ai, Inc.
G01W1/10G01W1/14G06N3/08G06Q40/08G06V10/82G06V20/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,360,286
App. No.
17/966,510
Filed
Oct 14, 2022
Granted
Jul 15, 2025
Kind
B2
Art Unit
3694
USPC
705/4
Abstract

The disclosure includes systems and methods for receiving a location; determine a hail size associated with the location using a first hail model; determine a hail frequency associated with the location using a first hail frequency model; obtain first feature data associated with the location, the first feature data including the hail size associated with the location, the hail frequency associated with the location, and data describing a first set of features at the location; determine a damage frequency associated with the location by applying a first damage frequency model to the first feature data; obtain second feature data associated with the location, the second feature data including data describing a second set of features at the location; and determine a damage severity associated with the location by applying a first damage severity model to the second feature data.

Claims (40)

1. A computer implemented method comprising:

receiving, using one or more processors, a location;

training, using the one or more processors, a first hail machine learning model that discounts older hail data;

determine, using the one or more processors, a hail size associated with the location using the first hail machine learning model;

determine, using the one or more processors, a hail frequency associated with the location using a first hail frequency machine learning model;

obtain, using the one or more processors, first feature data associated with the location, the first feature data including the hail size associated with the location, the hail frequency associated with the location, and data describing a first set of features at the location;

determine, using the one or more processors, a damage frequency associated with the location by applying a first damage frequency machine learning model to the first feature data;

obtain, using the one or more processors, second feature data associated with the location, the second feature data including data describing a second set of features at the location; and

determine, using the one or more processors, a damage severity associated with the location by applying a first damage severity machine learning model to the second feature data.

2. The computer implemented method of claim 1 , wherein the location is represented by a latitude and longitude.

3. The computer implemented method of claim 1 , wherein the hail size represents one or more of an average hail size associated with the location and a maximum hail size associated with the location.

4. The computer implemented method of claim 1 , wherein hail frequency represents one or more of a probability of a hail event and a probability of a hail event in which hail exceeds a size threshold.

5. The computer implemented method of claim 1 , wherein one or more of the first set of features and the second set of features include one or more of: a building area, a vegetation density, a roof material, a roof quality, a roof pitch, a roof height, presence of skylights, a portion of a roof covered by skylights, presence of a solar panel, a portion of the roof covered by solar panels, a number of roof facets, a roof shape, a land cover code, a temperature, a precipitation type or measure, and an elevation.

6. The computer implemented method of claim 1 , wherein the first set of features at the location includes a first feature that is obtained actively by applying a feature model to an aerial image of the location.

7. The computer implemented method of claim 6 , wherein the feature model is a convolutional neural network.

8. The computer implemented method of claim 1 further comprising:

determining, based on one or more of the damage frequency and damage severity, one or more of: a remedial action to reduce a risk of hail; whether to approve or deny hail insurance coverage or an insurance claim; an insurance premium associated with the location, an adjustment to an insurance premium associated with location; and to warn one or more of a property owner, resident, financier and insurer associated with the location of a risk of damage posed by hail.

9. The computer implemented method of claim 1 , wherein the first set of features at the location and the second set of features at the location are not mutually exclusive.

10. The computer implemented method of claim 1 , wherein the second set of features includes one or more of a roof area, a building area, a vegetation density, a roof material, a roof quality, a roof pitch, a roof height, presence of skylights, a portion of a roof covered by skylights, presence of a solar panel, a portion of the roof covered by solar panels, a number of roof facets, a roof shape, a land cover code, a temperature, a precipitation type or metric, and an elevation.

11. A system comprising:

a processor; and

a memory, the memory storing instructions that, when executed by the processor, cause the system to:

receive a location;

train a first hail machine learning model that discounts older hail data;

determine a hail size associated with the location using the first hail machine learning model;

determine a hail frequency associated with the location using a first hail frequency machine learning model;

obtain first feature data associated with the location, the first feature data including the hail size associated with the location, the hail frequency associated with the location, and data describing a first set of features at the location;

determine a damage frequency associated with the location by applying a first damage frequency machine learning model to the first feature data;

obtain second feature data associated with the location, the second feature data including data describing a second set of features at the location; and

determine a damage severity associated with the location by applying a first damage severity machine learning model to the second feature data.

12. The system of claim 11 , wherein the location is represented by a latitude and longitude.

13. The system of claim 11 , wherein the hail size represents one or more of an average hail size associated with the location and a maximum hail size associated with the location.

14. The system of claim 11 , wherein hail frequency represents one or more of a probability of a hail event and a probability of a hail event in which hail exceeds a size threshold.

15. The system of claim 11 , wherein one or more of the first set of features and the second set of features include one or more of: a building area, a vegetation density, a roof material, a roof quality, a roof pitch, a roof height, presence of skylights, a portion of a roof covered by skylights, presence of a solar panel, a portion of the roof covered by solar panels, a number of roof facets, a roof shape, a land cover code, a temperature, a precipitation type or metric, and an elevation.

16. The system of claim 11 , wherein the first set of features at the location includes a first feature that is obtained actively by applying a feature model to an aerial image of the location.

17. The system of claim 16 , wherein the feature model is a convolutional neural network.

18. The system of claim 11 , the memory further storing instructions that, when executed by the processor, cause the system to:

determine, based on one or more of the damage frequency and damage severity, one or more of: a remedial action to reduce a risk of hail; whether to approve or deny hail insurance coverage or an insurance claim; an insurance premium associated with the location, an adjustment to an insurance premium associated with location; and to warn one or more of a property owner, resident, financier and insurer associated with the location of a risk of damage posed by hail.

19. The system of claim 11 , wherein the first set of features at the location and the second set of features at the location are not mutually exclusive.

20. The system of claim 11 , wherein the second set of features includes one or more of a roof area, a building area, a vegetation density, a roof material, a roof quality, a roof pitch, a roof height, presence of skylights, a portion of a roof covered by skylights, presence of a solar panel, a portion of the roof covered by solar panels, a number of roof facets, a roof shape, a land cover code, a temperature, a precipitation type or metric, and an elevation.

Assignments (2)
SECURITY INTEREST Recorded Apr 28, 2025
From: ZESTY.AI, INC.
To: CANADIAN IMPERIAL BANK OF COMMERCE
Reel/Frame 070957/0919 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2022
From: ULIN, MICHAEL; ABKENAR, MASOUMEH REZAEI; RONALDS, BRYN; FORTIER, FREDERICK DUBE; SARKAR, KRISTIE
To: ZESTY.AI, INC.
Reel/Frame 061443/0300 →
Continuity (1)
Related Publication 20240125971A1 · Apr 18, 2024
References Cited (144)
US 4550376A · Maciejczak · 1985 [cited by applicant]
US 5742335A · Cannon · 1998 [cited by applicant]
US 5794216A · Brown · 1998 [cited by applicant]
US 7958034B2 · Ehrhart · 2011 [cited by applicant]
US 8078436B2 · Pershing · 2011 [cited by applicant]
US 8081795B2 · Brown · 2011 [cited by applicant]
US 8170840B2 · Pershing · 2012 [cited by applicant]
US 8209152B2 · Pershing · 2012 [cited by applicant]
US 8280633B1 · Eldering · 2012 [cited by applicant]
US 8289160B1 · Billman · 2012 [cited by applicant]
US 8497905B2 · Nixon · 2013 [cited by applicant]
US 8542880B2 · Thornberry et al. · 2013 [cited by applicant]
US 8774525B2 · Pershing · 2014 [cited by applicant]
US 8775219B2 · Swanson et al. · 2014 [cited by applicant]
US 8818770B2 · Pershing · 2014 [cited by applicant]
US 8823732B2 · Adams et al. · 2014 [cited by applicant]
US 8825454B2 · Pershing · 2014 [cited by applicant]
US 9046759B1 · Tarlinton · 2015 [cited by applicant]
US 9147287B2 · Ciarcia · 2015 [cited by applicant]
US 9489397B1 · Olson · 2016 [cited by applicant]
US 9536148B2 · Gross · 2017 [cited by applicant]
US 9542417B2 · Hieronymus et al. · 2017 [cited by applicant]
US 9648355B2 · Roskowski · 2017 [cited by applicant]
US 9721400B1 · Oakes, III · 2017 [cited by examiner]
US 9824290B2 · Millin et al. · 2017 [cited by applicant]
US 9875509B1 · Harvey et al. · 2018 [cited by applicant]
US 9911228B2 · Pershing et al. · 2018 [cited by applicant]
US 9959581B2 · Pershing · 2018 [cited by applicant]
US 10025989B2 · Drako · 2018 [cited by applicant]
US 10102586B1 · Marlow et al. · 2018 [cited by applicant]
US 10127440B1 · Drako · 2018 [cited by applicant]
US 10134092B1 · Harvey et al. · 2018 [cited by applicant]
US 10311302B2 · Kottenstette et al. · 2019 [cited by applicant]
US 10387582B2 · Lewis et al. · 2019 [cited by applicant]
US 10440229B2 · Drako · 2019 [cited by applicant]
US 10453147B1 · Davis · 2019 [cited by applicant]
US 10503843B2 · Keane · 2019 [cited by applicant]
US 10505923B2 · Drako et al. · 2019 [cited by applicant]
US 10529029B2 · Okazaki · 2020 [cited by applicant]
US 10534784B2 · Cousins et al. · 2020 [cited by applicant]
US 10650285B1 · Okazaki · 2020 [cited by applicant]
US 10671648B2 · Barrow et al. · 2020 [cited by applicant]
US 10755357B1 · Davis et al. · 2020 [cited by applicant]
US 10915829B1 · Wani · 2021 [cited by applicant]
US 10977490B1 · Bokshi-Drotar · 2021 [cited by applicant]
US 11030491B2 · Okazaki · 2021 [cited by applicant]
US 11131597B1 · Oakes, III · 2021 [cited by applicant]
US 11195058B2 · Okazaki · 2021 [cited by applicant]
US 11347976B2 · Okazaki · 2022 [cited by applicant]
US 11551040B2 · Okazaki · 2023 [cited by applicant]
US 11593887B1 · Gaudin · 2023 [cited by applicant]
US 12093869B1 · Kownacki · 2024 [cited by applicant]
US 20080208637A1 · McKay et al. · 2008 [cited by applicant]
US 20100034483A1 · Giuffrida et al. · 2010 [cited by applicant]
US 20110031309A1 · Duhaime et al. · 2011 [cited by applicant]
US 20110033110A1 · Shimamura et al. · 2011 [cited by applicant]
US 20110064308A1 · Stein et al. · 2011 [cited by applicant]
US 20130060600A1 · Schoolman · 2013 [cited by applicant]
US 20130226667A1 · Terrazas et al. · 2013 [cited by applicant]
US 20130262029A1 · Pershing · 2013 [cited by applicant]
US 20130321392A1 · Van Der Merwe · 2013 [cited by applicant]
US 20140132409A1 · Billman et al. · 2014 [cited by applicant]
US 20150120332A1 · Mildenhall et al. · 2015 [cited by applicant]
US 20150120333A1 · Fiete et al. · 2015 [cited by applicant]
US 20150186953A1 · Gross · 2015 [cited by applicant]
US 20150193881A1 · Emison · 2015 [cited by applicant]
US 20150228031A1 · Emison et al. · 2015 [cited by applicant]
US 20150235322A1 · Emison · 2015 [cited by applicant]
US 20150254555A1 · Williams, Jr. et al. · 2015 [cited by applicant]
US 20150302529A1 · Jagannathan · 2015 [cited by applicant]
US 20150317740A1 · Emison · 2015 [cited by applicant]
US 20160004571A1 · Smith · 2016 [cited by applicant]
US 20160048925A1 · Emison et al. · 2016 [cited by applicant]
US 20160048934A1 · JGross · 2016 [cited by applicant]
US 20160055594A1 · Emison · 2016 [cited by applicant]
US 20160063516A1 · Terrazas et al. · 2016 [cited by applicant]
US 20160360181A1 · Drako · 2016 [cited by applicant]
US 20170039307A1 · Koger · 2017 [cited by applicant]
US 20170076438A1 · Kottenstette et al. · 2017 [cited by applicant]
US 20170084077A1 · Liu et al. · 2017 [cited by applicant]
US 20170192424A1 · Poole et al. · 2017 [cited by applicant]
US 20170228743A1 · Cousins et al. · 2017 [cited by applicant]
US 20170352100A1 · Shreve et al. · 2017 [cited by applicant]
US 20180089763A1 · Okazaki · 2018 [cited by applicant]
US 20180201257A1 · Dudar · 2018 [cited by examiner]
US 20180276527A1 · Motoya · 2018 [cited by examiner]
US 20180292573A1 · Cecelski et al. · 2018 [cited by applicant]
US 20180324595A1 · Shima · 2018 [cited by examiner]
US 20180332004A1 · Drako et al. · 2018 [cited by applicant]
US 20180336452A1 · Tschernezki et al. · 2018 [cited by applicant]
US 20180348766A1 · Lewis et al. · 2018 [cited by applicant]
US 20190064346A1 · Jones et al. · 2019 [cited by applicant]
US 20190066217A1 · Stoner, Jr. et al. · 2019 [cited by applicant]
US 20190088032A1 · Milbert et al. · 2019 [cited by applicant]
US 20190138849A1 · Zhang · 2019 [cited by applicant]
US 20190147247A1 · Harris et al. · 2019 [cited by applicant]
US 20190147749A1 · Lewis et al. · 2019 [cited by applicant]
US 20190162875A1 · Cousins et al. · 2019 [cited by applicant]
US 20190188516A1 · Porter et al. · 2019 [cited by applicant]
US 20190197311A1 · Sun et al. · 2019 [cited by applicant]
US 20190228251A1 · Melendez et al. · 2019 [cited by applicant]
US 20190228362A1 · Anagnostou et al. · 2019 [cited by applicant]
US 20190228477A1 · Carter et al. · 2019 [cited by applicant]
US 20190251397A1 · Tremblay et al. · 2019 [cited by applicant]
US 20190295328A1 · Martin de los Santos · 2019 [cited by applicant]
US 20190304026A1 · Lyman et al. · 2019 [cited by applicant]
US 20190318440A1 · Wani et al. · 2019 [cited by applicant]
US 20190370894A1 · Meyers · 2019 [cited by applicant]
US 20190378216A1 · Fiete et al. · 2019 [cited by applicant]
US 20190384866A1 · Porter et al. · 2019 [cited by applicant]
US 20190385363A1 · Porter et al. · 2019 [cited by applicant]
US 20200004901A1 · Esteban · 2020 [cited by applicant]
US 20200005075A1 · Porter et al. · 2020 [cited by applicant]
US 20200005536A1 · Esteban et al. · 2020 [cited by applicant]
US 20200082168A1 · Fathi et al. · 2020 [cited by applicant]
US 20200082615A1 · Reed et al. · 2020 [cited by applicant]
US 20200098130A1 · Porter et al. · 2020 [cited by applicant]
US 20200098170A1 · Sehgal et al. · 2020 [cited by applicant]
US 20200100066A1 · Lewis et al. · 2020 [cited by applicant]
US 20200110972A1 · Esteban et al. · 2020 [cited by applicant]
US 20200117959A1 · Sargent · 2020 [cited by applicant]
US 20200134573A1 · Vickers · 2020 [cited by applicant]
US 20200143212A1 · Okazaki · 2020 [cited by applicant]
US 20200151500A1 · Kossyk et al. · 2020 [cited by applicant]
US 20200159252A1 · Giuffrida et al. · 2020 [cited by applicant]
US 20200160599A1 · Nunez et al. · 2020 [cited by applicant]
US 20200167870A1 · Isaacson et al. · 2020 [cited by applicant]
US 20210027532A1 · Lin · 2021 [cited by applicant]
US 20210089839A1 · Okazaki · 2021 [cited by applicant]
US 20210118117A1 · Albrecht et al. · 2021 [cited by applicant]
US 20210133891A1 · Jagannathan · 2021 [cited by applicant]
US 20210358049A1 · Schwartz · 2021 [cited by applicant]
US 20210390624A1 · Hayward · 2021 [cited by examiner]
US 20220051344A1 · Dhuvur · 2022 [cited by applicant]
CN 201620636U · 2010 [cited by applicant]
WO 20056446A1 · 2020 [cited by applicant]
Mueller, M., et al., “Discrimination between roofing materials and streets within urban areas based on hyperspectral, shape, and context information,” 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion… [cited by applicant]
PCT International Search Report and Written Opinion, International Application No. PCT/US2021/045953 Zesty.AI, Inc., filing date Aug. 13, 2021, date of mailing Nov. 16, 2021, 9 pgs. [cited by applicant]
PCT International Search Report and Written Opinion, International Application No. PCT/US2021/062628 Zesty.AI, Inc., International filing date Dec. 9, 2021, date of mailing Feb. 24, 2022, 16 pgs. [cited by applicant]
Fatemeh Alidoost, NPL, “2D Image-To-3D Model: Knowledge-Based 3D Building Reconstruciton (3DBR) Using Single Aerial Images and Convolutional Neural Networks (CNNs)”, Sep. 23, 2019 (Year: 2019). [cited by applicant]
Jeremy Castagno, NPL, “Roof Shape Classification from LiDAR and Satellite Image Data Fusion Using Supervised Learning”, Nov. 15, 2018 (Year: 2018). [cited by applicant]
Tahnmineh Partovi, NPL, “Automatic 3-D Building Model Reconstruction from Very High Resolution Stereo Satellite Imagery”, Jul. 11, 2019 (Year: 2019). [cited by applicant]
Planning for Atmospheric Hazards and Disaster Management Under Changing Climate Conditions; 2006 IEEE EIC Climate Change Conference (pp. 1-9); H. Auld, D. MacIver, J. Klaassen, N. Comer, B. Tugwood; May 10, 2006. (Year:… [cited by applicant]
Predicting Storm Outages Through New Representations of Weather and Vegetation; IEEE Access (vol. 7, 2019, pp. 29639-29654); Diego Cerrai, David W. Wanik, Md Abul Ehsan Bhuiyan, Xinxuan Zhang, Jaemo Yang, Maria E. B. Fr… [cited by applicant]