IP Library Granted Patent US 11,210,552
Granted Patent B2
US 11,210,552 · App. 16/682,615 · Granted Dec 28, 2021

Systems, methods, and computer readable media for predictive analytics and change detection from remotely sensed imagery

Inventors: Ingo Kossyk (Seefeld-Hechendorf, DE); Suat Gedikli (Planegg, DE)
Assignee: Cape Analytics, Inc.
G06K9/6215G06K9/00637G06K9/00657G06K9/6262G06N3/04G06N3/08G06T7/74G06T7/97G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,210,552
App. No.
16/682,615
Granted
Dec 28, 2021
Kind
B2
Abstract

Systems and methods are provided for automatically detecting a change in a feature. For example, a system includes a memory and a processor configured to analyze a change associated with a feature over a period of time using a plurality of remotely sensed time series images. Upon execution, the system would receive a plurality of remotely sensed time series images, extract a feature from the plurality of remotely sensed time series images, generate at least two time series feature vectors based on the feature, where the at least two time series feature vectors correspond to the feature at two different times, create a neural network model configured to predict a change in the feature at a specified time, and determine, using the neural network model, the change in the feature at a specified time based on a change between the at least two time series feature vectors.

Claims (38)

1. A method of detecting a change in a feature in remotely sensed time series images, the method comprising:

receiving, at a server, a plurality of remotely sensed time series images;

extracting, at the server, a feature from the plurality of remotely sensed time series images;

generating, at the server, at least two time series feature vectors based on the feature, wherein the at least two time series feature vectors correspond to the feature at two different times;

creating, at the server, a neural network model configured to predict a change in the feature at a specified time; and

determining, at the server using the neural network model, the change in the feature at the specified time based on a change between the at least two time series feature vectors, wherein the neural network model receives as input the at least two time series feature vectors.

2. The method of claim 1 , wherein the feature is extracted by a convolutional neural network, and wherein the at least two time series feature vectors are generated by the convolutional neural network.

3. The method of claim 1 , wherein the neural network model is based on a neural network that comprises at least one of a recurrent neural network or a convolutional neural network.

4. The method of claim 1 , wherein the plurality of remotely sensed time series images are captured at regular intervals.

5. The method of claim 1 , wherein the plurality of remotely sensed time series images are captured at non-regular intervals.

6. The method of claim 1 , wherein the feature is at least one of a property condition, a neighborhood condition, a built environment, a vegetation state, a topology, a roof, a building, a tree, or a body of water.

7. The method of claim 1 , wherein the feature is defined by an aggregated state based on one or more sub-states of one or more partial features.

8. The method of claim 1 further comprising determining, at the server, a plurality of time series scores, each of which corresponds to the feature.

9. The method of claim 8 , wherein the change in the feature is determined based on the plurality of time series scores.

10. The method of claim 8 , wherein an insignificant change in the feature is discarded.

11. A server for detecting a change in a feature in remotely sensed time series images, the server comprising:

a memory that stores a module; and

a processor configured to run the module stored in the memory that is configured to cause the processor to:

receive a plurality of remotely sensed time series images;

extract a feature from the plurality of remotely sensed time series images;

generate at least two time series feature vectors based on the feature, wherein the at least two time series feature vectors correspond to the feature at two different times;

create a neural network model configured to predict a change in the feature at a specified time; and

determine, using the neural network model, the change in the feature at the specified time based on a change between the at least two time series feature vectors, wherein the neural network model receives as input the at least two time series feature vectors.

12. The server of claim 11 , wherein the feature is extracted by a convolutional neural network, and wherein the at least two time series feature vectors are generated by the convolutional neural network.

13. The server of claim 11 , wherein the neural network model is based on a neural network that comprises at least one of a recurrent neural network or a convolutional neural network.

14. The server of claim 11 , wherein the plurality of remotely sensed time series images is captured at regular intervals.

15. The server of claim 11 , wherein the plurality of remotely sensed time series images is captured at non-regular intervals.

16. The server of claim 11 , wherein the feature is at least one of a property condition, a neighborhood condition, a built environment, a vegetation state, a topology, a roof, a building, a tree, or a body of water.

17. The server of claim 11 , wherein the feature is defined by an aggregated state based on one or more sub-states one or more partial features.

18. The server of claim 11 , wherein the module stored in the memory is further configured to cause the processor to determine a plurality of time series scores, each of which corresponds to the feature.

19. The server of claim 18 , wherein the change in the feature is determined based on the plurality of time series scores.

20. The server of claim 18 , wherein an insignificant change is discarded.

21. A non-transitory computer readable medium storing executable instructions operable for detecting a change in a feature in remotely sensed time series images to cause a processor to perform operations comprising:

receiving a plurality of remotely sensed time series images;

extracting a feature from the plurality of remotely sensed time series images;

generating at least two time series feature vectors based on the feature, wherein the at least two time series feature vectors correspond to the feature at two different times;

creating a neural network model configured to predict a change in the feature at a specified time; and

determining, using the neural network model, the change in the feature at a specified time based on a change between the at least two time series feature vectors, wherein the neural network model receives as input the at least two time series feature vectors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2020
From: KOSSYK, INGO; GEDIKLI, SUAT
To: CAPE ANALYTICS, INC.
Reel/Frame 052289/0349 →
Continuity (2)
Provisional Application 62767257 · Nov 14, 2018
Related Publication 20200151500A1 · May 14, 2020
Cited By (39)
US 12,190,392 US 12,198,423 US 12,198,428 US 12,211,105 US 12,211,192 US 12,223,670 US 12,229,383 US 12,229,845 US 12,243,105 US 12,243,301 US 12,248,907 US 12,277,616 US 12,282,893 US 12,282,966 US 12,293,579 US 12,314,020 US 12,315,015 US 12,315,024 US 12,333,788 US 12,354,170 US 12,361,376 US 12,390,109 US 12,423,760 US 12,423,972 US 12,450,662 US 12,450,664 US 12,468,039 US 12,475,515 US 12,518,395 US 12,530,727 US 12,541,682 US 12,572,892 US 12,586,135 US 12,632,748 US 12,657,633 US 12,664,591 US 12,682,401 US 12,700,042 US 12,705,673