IP Library Granted Patent US 11,625,913
Granted Patent B2
US 11,625,913 · App. 17/362,054 · Granted Apr 11, 2023

Satellite image classification across multiple resolutions and time using ordering constraint among instances

Inventors: Ankush Khandelwal (Minneapolis, MN); Anuj Karpatne (Minneapolis, MN); Vipin Kumar (Minneapolis, MN)
Assignee: Regents of the University of Minnesota
G06V20/13G06K9/6267G06T7/11G06T7/55G06V10/751G06V20/182G06K9/6255G06T2207/10032G06T2207/30188
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,625,913
App. No.
17/362,054
Granted
Apr 11, 2023
Kind
B2
Abstract

A method includes receiving a satellite image of an area and classifying each pixel in the satellite image as representing water, land or unknown using a model. For each of a plurality of possible water levels, a cost associated with the water level is determined, wherein determining the cost associated with a water level includes determining a number of pixels for which the model classification must change to be consistent with the water level and determining a difference between the water level and a water level determined for the area at a previous time point. The lowest cost water level is selected and used to reclassify at least one pixel.

Claims (37)

1. A method comprising:

receiving a satellite image of an area;

classifying each pixel in the satellite image using a model;

for each of a plurality of possible water levels, determining a cost associated with the water level, wherein determining the cost associated with a water level comprises:

determining a number of pixels for which the model classification must change to be consistent with the water level; and

determining a difference between the water level and a water level determined for the area at a previous time point;

selecting the lowest cost water level; and

using the selected lowest cost water level to reclassify at least one pixel.

2. The method of claim 1 wherein determining the cost associated with a water level further comprises applying a weight to the determined difference between the water level and the water level determined for the area at a previous time.

3. The method of claim 2 further comprising selecting the weight to provide a lowest cost.

4. The method of claim 1 further comprising:

receiving a plurality of satellite images of the area;

beginning with a last satellite image in the plurality of images, recursively determining a water level for each satellite image of the area.

5. The method of claim 4 wherein recursively determining a water level for a satellite image comprises:

for each of a plurality of possible water levels, determining a cost associated with the water level, wherein determining the cost associated with a water level comprises:

determining a number of pixels for which a model classification must change to be consistent with the water level;

determining a difference between the water level and a water level for the area at a previous time point; and

determining a cost for the water level for the area at the previous time point; and

selecting the lowest cost water level.

6. A method comprising:

receiving classifications of a plurality of pixels that form an image, each classification indicating whether the pixel represents water or land;

for each of a plurality of possible water levels, determining a cost associated with the water level, wherein determining the cost associated with a water level comprises:

determining a number of pixels for which the classifications must change to be consistent with the water level; and

determining a difference between the water level and a water level determined for the area at a previous time point;

selecting the lowest cost water level; and

using the selected lowest cost water level to reclassify at least one pixel.

7. The method of claim 6 wherein determining the cost associated with a water level further comprises applying a weight to the determined difference between the water level and the water level determined for the area at a previous time.

8. The method of claim 7 further comprising selecting the weight to provide a lowest cost.

9. The method of claim 6 further comprising:

receiving a plurality of images of the area;

beginning with a last image in the plurality of images, recursively determining a water level for each image of the area.

10. The method of claim 9 wherein recursively determining a water level for an image comprises:

for each of a plurality of possible water levels, determining a cost associated with the water level, wherein determining the cost associated with a water level comprises:

determining a number of pixels for which a classification must change to be consistent with the water level;

determining a difference between the water level and a water level for the area at a previous time point; and

determining a cost for the water level for the area at the previous time point; and

selecting the lowest cost water level.

Assignments (2)
CONFIRMATORY LICENSE Recorded May 21, 2024
From: REGENTS OF THE UNIVERSITY OF MINNESOTA
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 067472/0509 →
CONFIRMATORY LICENSE Recorded Jan 23, 2024
From: REGENTS OF THE UNIVERSITY OF MINNESOTA
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 066361/0947 →
Continuity (3)
Division 16103523 · Aug 14, 2018
Provisional Application 62545777 · Aug 15, 2017
Related Publication 20210357621A1 · Nov 18, 2021