IP Library Granted Patent US 50,484
Granted Patent E1
US 50,484 · App. 15/998,604 · Granted Jul 8, 2025

System and method for managing water

Inventors: Kristin Lavigne (Lincoln, MA); David Murr (Minneapolis, MN); Lars P. Dyrud (Crownsville, MD); Jonathan T. Fentzke (Arlington, VA); Indra Epple (Somerville, MA); Shadrian Strong (Catonsville, MD)
Assignee: Eagle View Technologies, Inc.
G06V20/188G06F18/241G06F18/24323G06Q50/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 50,484
App. No.
15/998,604
Granted
Jul 8, 2025
Kind
E1
Abstract

A device includes an image data receiving component, a vegetation index generation component, a GLC matrix component, a plurality of classifying components and a voting component. The image data receiving component receives multiband image data of a geographic region. The vegetation index generation component generates a normalized difference vegetation index based on the received multiband image data. The GLC matrix component generates a grey level co-occurrence matrix image band based on the received multiband image data. The classifying components generate land cover classifications based on the received multiband image data, the normalized difference vegetation index and the grey level co-occurrence matrix image band. The voting component generates a final land cover classification based a majority vote of the land cover classifications.

Claims (103)

1. A device comprising at least one non-transitory computer-readable media storing a set of instructions for running on a computer system, that when executed cause the computer system to:

an image data receiving component operable to receive multiband image data of an image of a geographic region;

a vegetation index generation component operable to generate a normalized difference vegetation index based on the received multiband image data of the image;

a grey level co-occurrence matrix generation component operable to generate a grey level co-occurrence matrix image band based on the received multiband image data of the image;

a first classification component operable generate a first land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix image band;

a second classification component operable generate a second land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix image band;

a third classification component operable generate a third land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix image band; and

a voting component operable to generate a final land cover classification based on a majority vote of the first land cover classification, the second land cover classification and the third land cover classification;

generate a model based on the final land cover classification of the geographic region, by:

extrapolating a first predicted water usage forecast for the geographic region based at least on the final land cover classification of the geographic region, a water budget, and a difference of an amount of water between the water budget and one or more water meter readings of the geographic region;

iteratively extrapolating a second predicted water usage forecast for the geographic region based at least on the final land cover classification, the water budget, and a difference of an amount of water between the water budget and one or more current water readings for the geographic region; and

deriving a relationship between the final land cover classification and water use, without using the water budget; and

predict a third predicted water usage forecast based on the generated model.

2. The device of claim 1 , wherein said image data receiving component is operable to the at least one non-transitory computer-readable media storing a set of instructions for running on a computer system, that when executed further cause the computer system to:

receive the multiband image data of the image of a the geographic region as an RGB and near infra-red image data of the geographic region.

3. The device of claim 2 ,

wherein the multiband image data of the image corresponds to an array of pixels of the image, and

wherein said first classification component is operable to the at least one non-transitory computer-readable media storing the set of instructions for running on the computer system, that when executed further cause the computer system to:

generate the first land cover classification by classifying each of the pixels of the multiband image data of the image as one of the group consisting of grass, a tree, a shrub, a man-made surface, a man-made pool, a natural water body and artificial turf.

4. The device of claim 3 , wherein said first classification component generating the first land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix image band, further comprises utilizing one of the group consisting of a simple classification and regression tree classifier, a naïve Bayes classifier, a random forecasts classifier, a GMO max entropy classifier, an MCP classifier, a Pegasos classifier, an ICPamir classifier, a voting SVM classifier, a margin SVM classifier and a Winnow classifier.

5. The device of claim 4 1 , further comprising a parcel data receiving component operable to wherein the at least one non-transitory computer-readable media storing the set of instructions for running on the computer system, that when executed further cause the computer system to:

receive parcel data.

6. The device of claim 1 ,

wherein the multiband image data of the image corresponds to an array of pixels, and

wherein said first classification component operable the at least one non-transitory computer-readable media storing the set of instructions for running on the computer system, that when executed further cause the computer system to:

generate the first land cover classification by classifying each of pixels of the multiband image data of the image as one of the group consisting of grass, a tree, a shrub, a man-made surface, a man-made pool, a natural water body and artificial turf.

7. The device of claim 1 , wherein said first classification component comprises generating the first land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix image band, further comprises utilizing one of the group consisting of a simple classification and regression tree classifier, a naïve Bayes classifier, a random forecasts classifier, a GMO max entropy classifier, a MCP classifier a, a Pegasos classifier, an ICPamir classifier, a voting SVM classifier, a margin SVM classifier and a Winnow classifier.

8. The device of claim 1 , further comprising a regression component operable to extrapolate a predicted water usage based on a history of water usage.

9. A method, comprising:

receiving, via an image data receiving component, multiband image data of an image of a geographic region;

generating, via a vegetation index generation component, a normalized difference vegetation index based on the received multiband image data of the image;

generating, via a grey level co-occurrence matrix generation component, a grey level co-occurrence matrix based on the received multiband image data of the image;

generating, via a first classification component, a first land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix;

generating, via a second classification component, a second land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix;

generating, via a third classification component, a third land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix;

generating, via a voting component, a final land cover classification based on a majority vote of the first land cover classification, the second land cover classification and the third land cover classification;

generating a model based on the final land cover classification of the geographic region, by:

extrapolating a first predicted water usage forecast for the geographic region based at least on the final land cover classification of the geographic region, a water budget, and a difference of an amount of water between the water budget and one or more water meter readings for the geographic region;

iteratively extrapolating a second predicted water usage forecast for the geographic region based at least on the final land cover classification, the water budget, and a difference of an amount of water between the water budget and one or more current water meter readings for the geographic region; and

deriving a relationship between the final land cover classification and water use, without using the water budget; and

predicting a third predicted water usage forecast based on the generated model.

10. The method of claim 9 , wherein said receiving multiband image data of the image of a the geographic region further comprises:

receiving the multiband image data of the image of a the geographic region as an RGB and near infra-red image data of the geographic region.

11. The method of claim 10 , wherein the multiband image data of the image corresponds to an array of pixels, and wherein said generating a first land cover classification further comprises:

generating the first land cover classification by classifying each of pixels of the multiband image data of the image as one of the group consisting of grass, a tree, a shrub, a man-made surface, a man-made pool, a natural water body and artificial turf.

12. The method of claim 11 , wherein said generating a first land cover classification, further comprises:

generating comprises generating via one of the group consisting of a simple classification and regression tree classifier, a naïve Bayes classifier, a random forecasts classifier, a GMO max entropy classifier, an MCP classifier, a Pegasos classifier, an ICPamir classifier, a voting SVM classifier, a margin SVM classifier and a Winnow classifier.

13. The method of claim 12 9 , further comprising:

receiving, via a parcel data receiving component, parcel data.

14. The method of claim 9 , wherein the multiband image data of the image corresponds to an array of pixels, and wherein said generating a first land cover classification further comprises:

generating the first land cover classification by classifying each of pixels of the multiband image data of the image as one of the group consisting of grass, a tree, a shrub, a man-made surface, a man-made pool, a natural water body and artificial turf.

15. The method of claim 9 , wherein said generating a first land cover classification further comprises:

generating comprises generating via one of the group consisting of a simple classification and regression tree classifier, a naïve Bayes classifier, a random forecasts classifier, a GMO max entropy classifier, an MCP classifier, a Pegasos classifier, an ICPamir classifier, a voting SVM classifier, a margin SVM classifier and a Winnow classifier.

16. The method of claim 9 , further comprising extrapolating, via a regression component, a predicted water usage based on a history of water usage.

17. A One or more non-transitory, tangible, computer-readable media having computer-readable instructions stored thereon, for use with a computer and being capable of instructing the computer to perform the method comprising:

receiving, via an image data receiving component, multiband image data of an image of a geographic region;

generating, via a vegetation index generation component, a normalized difference vegetation index based on the received multiband image data of the image;

generating, via a grey level co-occurrence matrix generation component, a grey level co-occurrence matrix based on the received multiband image data of the image;

generating, via a first classification component, a first land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix;

generating, via a second classification component, a second land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix;

generating, via a third classification component, a third land cover classification based on the received multiband image data of the image, the normalized difference vegetation index and the grey level co-occurrence matrix; and

generating, via a voting component, a final land cover classification based on a majority vote of the first land cover classification, the second land cover classification and the third land cover classification;

generating a model based on the final land cover classification of the geographic region, by:

extrapolating a first predicted water usage forecast for the geographic region based at least on the final land cover classification of the geographic region, a water budget, and a difference of an amount of water between the water budget and one or more water meter readings for the geographic region;

iteratively extrapolating a second predicted water usage forecast for the geographic region based on at least the final land cover classification, the water budget, and a difference of an amount of water between the water budget and one or more current water meter readings for the geographic region;

deriving a relationship between the final land cover classification and water use, without using the water budget; and

predicting a third predicted water usage forecast based on the generated model.

18. The one or more non-transitory, tangible computer-readable media of claim 17 , wherein the computer-readable instructions are capable of instructing the computer to perform the method such that said receiving multiband image data of the image of a the geographic region comprises receiving the multiband image data of the image of a the geographic region as an RGB and near infra-red image data of the image of the geographic region.

19. The one or more non-transitory, tangible, computer-readable media of claim 18 , wherein the multiband image data of the image corresponds to an array of pixels, and wherein said generating a first land cover classification further comprises:

generating the first land cover classification by classifying each of pixels of the multiband image data of the image as one of the group consisting of grass, a tree, a shrub, a man-made surface, a man-made pool, a natural water body and artificial turf.

20. The one or more non-transitory, tangible, computer-readable media of claim 19 , wherein the computer-readable instructions are capable of instructing the computer to perform the method such that said generating a first land cover classification further comprises generating comprises generating via one of the group consisting of a simple classification and regression tree classifier, a naïve Bayes classifier, a random forecasts classifier, a GMO max entropy classifier, an MCP classifier, a Pegasos classifier, an ICPamir classifier, a voting SVM classifier, a margin SVM classifier and a Winnow classifier.

21. The device of claim 5 , wherein the geographic region is determined based on the parcel data.

22. A system comprising at least one non-transitory computer-readable media storing instructions for running on a computer, that when executed cause the computer to:

receive multiband image data of an image of a geographic region of interest for water management, the multiband image data of the image comprising pixels;

classify one or more of the pixels of the multiband image data of the image as one of a group of predetermined land covers by:

generating, for each of the pixels of the one or more pixels, a plurality of land cover classifications; and

determining, for each of the pixels of the one or more pixels, a final land cover classification from the plurality of land cover classifications;

generate a model based on the final land cover classification of the geographic region, by:

extrapolating a predicted water usage forecast for the geographic region based at least on the final land cover classification of the geographic region, a water budget, and a difference of an amount of water between the water budget and one or more water meter readings for the geographic region;

iteratively extrapolating a second predicted water usage forecast for the geographic region based at least on the final land cover classification, the water budget, and a difference of an amount of water between the water budget and one or more current water meter readings for the geographic region;

deriving a relationship between the final land cover classification and water use, without using the water budget; and

predict a third predicted water usage forecast based on the generated model.

23. The system of claim 22 , wherein determining, for each of the pixels of the one or more pixels, the final land cover classification from the plurality of land cover classifications is based on a majority vote of the plurality of land cover classifications.

24. The system of claim 22 , wherein determining, for each of the pixels of the one or more pixels, the final land cover classification from the plurality of land cover classifications, further comprises:

receiving image training data indicative of an analysis of imagery depicting vegetation and one or more man-made surface.

25. The system of claim 22 , wherein classifying one or more of the pixels of the multiband image data of the image as one of the group of predetermined land covers, further comprises:

utilizing image training data indicative of an analysis of imagery depicting vegetation or one or more man-made surface.

26. The method of claim 22 , wherein iteratively extrapolating, with the system, a second predicted water usage forecast is further based on one or more of: demographic data, economic data, and parcel information;

wherein the parcel information comprises one or more of: an area of the geographic region, an area of a dwelling located within the geographic region, and number of bathrooms located within the dwelling.

27. A method, comprising:

receiving, with one or more computers, multiband image data of an image of a geographic region, the multiband image data of the image having pixels;

receiving, with the one or more computers, image training data indicative of an analysis of imagery depicting vegetation and one or more man-made surface;

classifying, with the one or more computers, one or more of the pixels of the multiband image data of the image as one of a group of predetermined land covers by:

generating, with the one or more computers, a plurality of land cover classifications, for each of the pixels of the one or more pixels, based on analyzing the received multiband image data of the image with the image training data; and

generating, with the one or more computers, a final land cover classification for the geographic region based on the plurality of land cover classifications;

generating a model based on the final land cover classification of the geographic region, by:

extrapolating, with the one or more computers, a first predicted water usage forecast for the geographic region based at least on the final land cover classification, a water budget, and a difference of an amount of water between the water budget and one or more water meter readings for the geographic region;

iteratively extrapolating, with the one or more computers, a second predicted water usage forecast for the geographic region based at least on the final land cover classification, the water budget, and a difference of an amount of water between the water budget and one or more current water meter readings for the geographic region;

deriving, with the one or more computers, a relationship between the final land cover classification and water use, without using the water budget; and

predicting, with the one or more computers, a third predicted water usage forecast based on the generated model.

28. The method of claim 27 , wherein generating, with the one or more computers, the final land cover classification is based on a majority vote of the plurality of land cover classifications.

29. The method of claim 27 , wherein iteratively extrapolating, with the one or more computers, the second predicted water usage forecast is further based on one or more of: demographic data, economic data, and parcel information;

wherein the parcel information comprises one or more of: an area of the geographic region, an area of a dwelling located within the geographic region, and number of bathrooms located within the dwelling located within the geographic region.

Assignments (2)
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: OMNIEARTH, INC.
To: EAGLE VIEW TECHNOLOGIES, INC.
Reel/Frame 066115/0970 →
Continuity (2)
Provisional Application 62091040 · Dec 12, 2014
Reissue 14696867 · Apr 27, 2015
References Cited (61)
US 5053778A · Imhoff · 1991 [cited by applicant]
US 5323317A · Hampton et al. · 1994 [cited by applicant]
US 5793888A · Delanoy · 1998 [cited by applicant]
US 5963880A · Smith · 1999 [cited by examiner]
US 7058197B1 · McGuire · 2006 [cited by examiner]
US 7386170B2 · Ronk · 2008 [cited by examiner]
US 7647181B2 · Vaatveit · 2010 [cited by examiner]
US 7729533B2 · Sathyanarayana · 2010 [cited by examiner]
US 7805380B1 · Hornbeck · 2010 [cited by examiner]
US 8001115B2 · Davis · 2011 [cited by examiner]
US 8095434B1 · Puttick et al. · 2012 [cited by applicant]
US 8243997B2 · Davis · 2012 [cited by examiner]
US 8250481B2 · Klaric · 2012 [cited by examiner]
US 8655601B1 · Sridhar et al. · 2014 [cited by applicant]
US 9141872B2 · Marchisio · 2015 [cited by examiner]
US 9147132B2 · Marchisio · 2015 [cited by examiner]
US 9202252B1 · Smith · 2015 [cited by examiner]
US 9258952B2 · Walker · 2016 [cited by examiner]
US 9275297B2 · Tabb · 2016 [cited by examiner]
US 9418290B2 · Lavigne et al. · 2016 [cited by applicant]
US 9536148B2 · Gross · 2017 [cited by applicant]
US 9552638B2 · Lavigne et al. · 2017 [cited by applicant]
US 9875430B1 · Keisler · 2018 [cited by examiner]
US 10400551B2 · Murr et al. · 2019 [cited by applicant]
US 20030088527A1 · Hung · 2003 [cited by examiner]
US 20070030998A1 · O'Hara · 2007 [cited by examiner]
US 20070112695A1 · Wang · 2007 [cited by examiner]
US 20070116365A1 · Kloer · 2007 [cited by applicant]
US 20090271045A1 · Savelle, Jr. · 2009 [cited by examiner]
US 20100223276A1 · Al-Shameri · 2010 [cited by examiner]
US 20120323798A1 · Den Herder et al. · 2012 [cited by applicant]
US 20130046746A1 · Bennett · 2013 [cited by applicant]
US 20130116994A1 · Abbott Donnelly · 2013 [cited by examiner]
US 20150027040A1 · Redden · 2015 [cited by applicant]
US 20150071528A1 · Marchisio · 2015 [cited by examiner]
US 20150294154A1 · Sant et al. · 2015 [cited by applicant]
US 20150347872A1 · Taylor et al. · 2015 [cited by applicant]
US 20150371115A1 · Marchisio · 2015 [cited by examiner]
US 20160088807A1 · Bermudez Rodriguez et al. · 2016 [cited by applicant]
US 20160239709A1 · Shriver · 2016 [cited by applicant]
US 20160253595A1 · Mathur et al. · 2016 [cited by applicant]
US 20170249496A1 · Fentzke et al. · 2017 [cited by applicant]
US 20170371897A1 · Strong et al. · 2017 [cited by applicant]
US 20180293671A1 · Murr et al. · 2018 [cited by applicant]
WO WO2016054694 · 2016 [cited by applicant]
Bruzzone et al., “Detection of land-cover transitions by combining multidate classifiers”, 2004, Science Direct—Pattern Recognition Letters, vol. 25, Issue 13, pp. 1491-1500 (Year: 2004). [cited by examiner]
Marceau et al., “Evaluation of the Grey-Level Co-Occurrence Matrix Method For Land-Cover Classification Using Spot Imagery”, 1990, IEEE—Transactions on Geoscience and Remote Sensing, vol. 28, No. 4, pp. 513-519 (Year: 1… [cited by examiner]
Lorenzo Bruzzone and Roberto Cossu, “A Multiple-Cascade-Classifier System for a Robust and Partially Unsupervised Updating of Land-Cover Maps”, IEEE Transactions On Geoscience and Remote Sensing, vol. 40, No. 9, pp. 198… [cited by examiner]
“OmniParcels for Insurance”, PowerPoint Presentation, OmniEarth, Inc., Mar. 25, 2016. [cited by applicant]
Kittler, et al.; On Combining Classifiers; IEEE Transactions on Pattern Analysis and Machine Intelligence; Mar. 1998; 226-240; vol. 20, IEEE Computer Society. [cited by applicant]
“OmniParcels/Yardographics/Water Resources”, OmniEarth, Inc., retrieved from the internet: https://parceldemo.omniearth.net/#/map/, Feb. 2016. [cited by applicant]
“OmniParcels Delivers Current, Searchable Property Attributes with Regular Updates”, via Internet Archive Wayback Machine [retrieved from the internet Jul. 25, 2017] retrieved from: https://web.archive.org/web/201603051… [cited by applicant]
Goldberg et al., “Extracting geographic features from the Internet to automatically build detailed regional gazetteers,” International Journal of Geographical Information Science, 23:1, 93-128, Jan. 2009. [cited by applicant]
Harris Geospatial Solutions, “Using ENVI and Geographic Information Systems (GIS)”, Jan. 31, 2013. [cited by applicant]
Commonwealth of Massachusetts Executive Office of Environmental Affairs, “Parcel Mapping Using GIS a Guide to Digital Parcel Map Development for Massachusetts Local Governments”, Aug. 1999. [cited by applicant]
European Court of Auditors, “The Land Parcel Identification System: a useful tool to determine the eligibility of agricultural land—but its management could be further improved”, Luxembourg, 2016. [cited by applicant]
Krizhevsky et al., “ImageNet Classification with Deep Convolutional Neural Networks”, Advances in Neural Information Processing Systems 25, pp. 1097-1105, Curran Associates, Inc., 2012. [cited by applicant]
Mountrakis et al., “Support vector machines in remote sensing: A review,” ISPRS Journal of Photogrammetry and Remote Sensing vol. 66, Issue 3, May 2011, pp. 247-259. [cited by applicant]
Brockwell et al., “Introduction to Time Series and Forecasting,” 2 [cited by applicant]
Ogata, “Modern Control Engineering,” 5 [cited by applicant]
Montgomery et al., “Introduction to Linear Regression Analysis,” 5 [cited by applicant]