IP Library Granted Patent US 10,395,388
Granted Patent B2
US 10,395,388 · App. 16/027,235 · Granted Aug 27, 2019

Broad area geospatial object detection using autogenerated deep learning models

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,395,388
App. No.
16/027,235
Granted
Aug 27, 2019
Kind
B2
Abstract

A system for automated geospatial image analysis comprising a deep learning model that receives orthorectified geospatial images, pre-labeled to demarcate objects of interest. The module presents marked geospatial images and a second set of unmarked, optimized, training geospatial images to a convolutional neural network. This process may be repeated so that an image analysis software module can detect multiple object types or categories. The image analysis software module receives orthorectified geospatial images from one or more geospatial image caches. Using a multi-scale sliding window submodule, image analysis software scans geospatial images, detects objects present and geospatially locates them.

Claims (29)

1. A system for broad area geospatial object detection using auto-generated deep learning models, comprising:

a deep learning model training software module stored in a memory of and operating on a processor of a computing device; and

an image analysis software module stored in the memory of and operating on the processor of the computing device;

wherein the deep learning model training software module:

receives training data comprising a plurality of orthorectified geospatial images with a plurality of objects present therein, at least a first subset of the plurality of objects being labeled and a second subset of objects being unlabeled;

classifies the training data into a plurality of categories;

applies one or more image modification steps to the training data; and

generates an object classification model from the training data using a deep learning method comprising separate processing of the first and second subsets of the training data through a convolutional neural network system; and

wherein the image analysis software module:

receives orthorectified geospatial imagery;

applies a plurality of image modifications to the unanalyzed orthorectified geospatial imagery;

discards images unsuitable for analysis;

uses the object classification model to automatically identify and label all objects of interest in the received, unanalyzed orthorectified geospatial imagery; and

outputs the geospatial locations of the identified objects of interest.

2. A method for conducting automated identification of feature items from orthorectified geospatial imagery data comprising the following steps:

receiving, at a deep learning model training software module stored in a memory of and operating on a processor of a computing device, a plurality of orthorectified geospatial images, divided into discrete segments where a plurality of objects of interest are present therein, at least a first subset of the plurality of objects of interest being labeled and a second subset of objects of interest being unlabeled;

placing pre-labeled geospatial imagery segments into categories based upon the objects of interest they contain;

applying one or more image modification steps;

generating, using a convolutional neural network system operating as part of an image analysis software module stored in a memory of and operating on a processor of a computing device, an object classification model from the training data using a deep learning method comprising separate processing of the first and second subsets of the training data;

using the trained image analysis software module to identify feature items of interest within unanalyzed geospatial imagery data; and

reporting the identities and geospatial locations of a plurality of features of interest.

3. The system of claim 1 , wherein the plurality of categories are pre-defined.

4. The system of claim 1 , wherein the plurality of image modification steps are drawn from a set comprising artifact removal, color standardization, and resolution data determination.

5. The system of claim 1 , wherein the objects of interest are automatically identified and labeled regardless of the orientation of that feature item within the section.

6. The system of claim 5 , further wherein the objects of interest are automatically identified and labeled accounting for differences in item scale by using a multi-scale sliding window algorithm.

7. The method of claim 2 , wherein the plurality of categories are pre-defined.

8. The method of claim 2 , wherein the plurality of image modification steps are drawn from a set comprising artifact removal, color standardization, and resolution data determination.

9. The method of claim 2 , wherein the feature items of interest are identified regardless of the orientation of that feature item within the section.

10. The method of claim 9 , further wherein the feature items of interest are identified accounting for differences in item scale by using a multi-scale sliding window algorithm.

Assignments (17)
RELEASE OF SECURITY INTEREST Recorded Mar 3, 2026
From: SIXTH STREET LENDING PARTNERS, ACTING IN ITS CAPACITY AS AGENT
To: AURORA INSIGHT INC.; VANTOR INC. (F/K/A MAXAR INTELLIGENCE INC.); VANTOR SERVICES INC. (F/K/A MAXAR MISSION SOLUTIONS INC.); LANTERIS SPACE LLC (F/K/A MAXAR SPACE LLC); SPATIAL ENERGY, LLC; LANTERIS SPACE ROBOTICS LLC (F/K/A MAXAR SPACE ROBOTICS LLC); VANTOR HOLDINGS INC. (F/K/A MAXAR TECHNOLOGIES HOLDINGS INC.)
Reel/Frame 075021/0624 →
CERTIFICATE OF AMENDMENT Recorded Jan 7, 2026
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 074270/0330 →
CHANGE OF NAME Recorded Nov 4, 2025
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 073461/0767 →
RELEASE (REEL 060389/FRAME 0720) Recorded May 12, 2023
From: ROYAL BANK OF CANADA
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063633/0431 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 5, 2023
From: MAXAR INTELLIGENCE INC. (F/K/A DIGITALGLOBE, INC.); AURORA INSIGHT INC.; MAXAR MISSION SOLUTIONS INC. ((F/K/A RADIANT MISSION SOLUTIONS INC. (F/K/A THE RADIANT GROUP, INC.)); MAXAR SPACE LLC (F/K/A SPACE SYSTEMS/LORAL, LLC); SPATIAL ENERGY, LLC; MAXAR SPACE ROBOTICS LLC ((F/K/A SSL ROBOTICS LLC) (F/K/A MDA US SYSTEMS LLC)); MAXAR TECHNOLOGIES HOLDINGS INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 063660/0138 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 060389/0782 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0074 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 053866/0412 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0011 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 051258/0465 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063542/0300 →
CHANGE OF NAME Recorded Feb 15, 2023
From: DIGITALGLOBE, INC.
To: MAXAR INTELLIGENCE INC.
Reel/Frame 062760/0832 →
RELEASE OF SECURITY INTEREST Recorded Jun 21, 2022
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: DIGITALGLOBE, INC.; SPACE SYSTEMS/LORAL, LLC; RADIANT GEOSPATIAL SOLUTIONS LLC
Reel/Frame 060390/0282 →
SECURITY AGREEMENT Recorded Jun 17, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 060389/0782 →
SECURITY AGREEMENT Recorded Jun 16, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 060389/0720 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0412 →
CHANGE OF ADDRESS Recorded Mar 10, 2020
From: DIGITALGLOBE, INC.
To: DIGITALGLOBE, INC.
Reel/Frame 052136/0893 →
SECURITY AGREEMENT (NOTES) Recorded Dec 12, 2019
From: DIGITALGLOBE, INC.; RADIANT GEOSPATIAL SOLUTIONS LLC; SPACE SYSTEMS/LORAL, LLC (F/K/A SPACE SYSTEMS/LORAL INC.)
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, - AS NOTES COLLATERAL AGENT
Reel/Frame 051262/0824 →
AMENDED AND RESTATED U.S. PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Dec 11, 2019
From: DIGITALGLOBE, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 051258/0465 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2019
From: ESTRADA, ADAM; BROCK, BENJAMIN; JENKINS, ANDREW; MANGOLD, CHRIS
To: DIGITALGLOBE, INC.
Reel/Frame 048961/0060 →