IP Library Granted Patent US 10,733,759
Granted Patent B2
US 10,733,759 · App. 16/553,060 · Granted Aug 4, 2020

Broad area geospatial object detection using autogenerated deep learning models

Inventors: Adam Estrada (Bethesda, MD); Andrew Jenkins (Waterford, VA); Benjamin Brock (Upper Marlboro, MD); Chris Mangold (Union Bridge, MD)
Assignee: DIGITALGLOBE, INC.
G06T7/74G06K9/0063G06K9/4628G06K9/6272G06T5/005G06T7/33G06T7/344G06T2207/10032G06T2207/20081G06T2207/20084G06T2207/30184G06T2207/30212G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,733,759
App. No.
16/553,060
Granted
Aug 4, 2020
Kind
B2
Abstract

A system for automated geospatial image analysis comprising a deep learning model that receives orthorectified geospatial images, pre-labeled to demarcate objects of interest. The module presents marked geospatial images and a second set of unmarked, optimized, training geospatial images to a convolutional neural network. This process may be repeated so that an image analysis software module can detect multiple object types or categories. The image analysis software module receives orthorectified geospatial images from one or more geospatial image caches. Using a multi-scale sliding window submodule, image analysis software scans geospatial images, detects objects present and geospatially locates them.

Claims (33)

1. A system for broad area geospatial object detection using auto-generated deep learning models, comprising:

a deep learning model training software module stored in a memory of and operating on a processor of a computing device; and

an image analysis software module stored in the memory of and operating on the processor of the computing device;

wherein the deep learning model training software module:

receives training data comprising a plurality of orthorectified geospatial images with a plurality of labeled objects present therein;

classifies the training data into a plurality of categories;

applies one or more image modification steps to the training data; and

generates an object classification model from the training data using a deep learning method comprising processing of the training data through a convolutional neural network system; and

wherein the image analysis software module:

receives orthorectified geospatial imagery;

applies a plurality of image modifications to the orthorectified geospatial imagery;

discards images unsuitable for analysis;

uses the object classification model to automatically identify and label all objects of interest in the received orthorectified geospatial imagery; and

outputs the geospatial locations of the identified objects of interest.

2. A method for conducting automated identification of feature items from orthorectified geospatial imagery data comprising the following steps:

receiving, at a deep learning model training software module stored in a memory of and operating on a processor of a computing device, training data comprising a plurality of orthorectified geospatial images with a plurality of labeled objects present therein;

classifying the training data into a plurality of categories using the deep learning model training software module;

applying one or more image modification steps to the training data using the deep learning model training software module;

generating an object classification model from the training data using a deep learning method comprising processing of the training data through a convolutional neural network system operating as part of the deep learning model training software module;

receiving orthorectified geospatial imagery at an image analysis software module stored in the memory of and operating on the processor of the computing device;

applying a plurality of image modifications to the received orthorectified geospatial imagery using the image analysis software module;

discarding images unsuitable for analysis from the modified orthorectified geospatial imagery using the image analysis software module;

retaining images suitable for analysis from the modified orthorectified geospatial imagery using the image analysis software module;

using the object classification model to automatically identify and label all objects of interest in the retained orthorectified geospatial imagery using the image analysis software module; and

outputting the geospatial locations of the identified objects of interest using the image analysis software module.

3. The system of claim 1 , wherein the plurality of categories are pre-defined.

4. The system of claim 1 , wherein the plurality of image modification steps are drawn from a set comprising artifact removal, color standardization, and resolution data determination.

5. The system of claim 1 , wherein the objects of interest are automatically identified and labeled regardless of the orientation of that feature item within the section.

6. The system of claim 5 , further wherein the objects of interest are automatically identified and labeled accounting for differences in item scale by using a multi-scale sliding window algorithm.

7. The method of claim 2 , wherein the plurality of categories are pre-defined.

8. The method of claim 2 , wherein the plurality of image modification steps are drawn from a set comprising artifact removal, color standardization, and resolution data determination.

9. The method of claim 2 , wherein the feature items of interest are identified regardless of the orientation of that feature item within the section.

10. The method of claim 9 , further wherein the feature items of interest are identified accounting for differences in item scale by using a multi-scale sliding window algorithm.

Assignments (18)
RELEASE OF SECURITY INTEREST Recorded Mar 3, 2026
From: SIXTH STREET LENDING PARTNERS, ACTING IN ITS CAPACITY AS AGENT
To: AURORA INSIGHT INC.; VANTOR INC. (F/K/A MAXAR INTELLIGENCE INC.); VANTOR SERVICES INC. (F/K/A MAXAR MISSION SOLUTIONS INC.); LANTERIS SPACE LLC (F/K/A MAXAR SPACE LLC); SPATIAL ENERGY, LLC; LANTERIS SPACE ROBOTICS LLC (F/K/A MAXAR SPACE ROBOTICS LLC); VANTOR HOLDINGS INC. (F/K/A MAXAR TECHNOLOGIES HOLDINGS INC.)
Reel/Frame 075021/0624 →
RELEASE OF SECURITY INTEREST Recorded Jan 16, 2026
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: VANTOR INC. (F/K/A MAXAR INTELLIGENCE INC.); LANTERIS SPACE LLC (F/K/A MAXAR SPACE LLC & SPACE SYSTEMS/LORAL, LLC)
Reel/Frame 073503/0150 →
CERTIFICATE OF AMENDMENT Recorded Jan 7, 2026
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 074270/0330 →
CHANGE OF NAME Recorded Nov 4, 2025
From: MAXAR INTELLIGENCE INC.
To: VANTOR INC.
Reel/Frame 073461/0767 →
RELEASE (REEL 060389/FRAME 0720) Recorded May 12, 2023
From: ROYAL BANK OF CANADA
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063633/0431 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 5, 2023
From: MAXAR INTELLIGENCE INC. (F/K/A DIGITALGLOBE, INC.); AURORA INSIGHT INC.; MAXAR MISSION SOLUTIONS INC. ((F/K/A RADIANT MISSION SOLUTIONS INC. (F/K/A THE RADIANT GROUP, INC.)); MAXAR SPACE LLC (F/K/A SPACE SYSTEMS/LORAL, LLC); SPATIAL ENERGY, LLC; MAXAR SPACE ROBOTICS LLC ((F/K/A SSL ROBOTICS LLC) (F/K/A MDA US SYSTEMS LLC)); MAXAR TECHNOLOGIES HOLDINGS INC.
To: SIXTH STREET LENDING PARTNERS, AS ADMINISTRATIVE AGENT
Reel/Frame 063660/0138 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARKS - RELEASE OF REEL/FRAME 053866/0535 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC; MAXAR TECHNOLOGIES HOLDINGS INC.
Reel/Frame 063534/0566 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 053866/0412 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0011 →
TERMINATION AND RELEASE OF PATENT SECURITY AGREEMENT - RELEASE OF REEL/FRAME 060389/0782 Recorded May 4, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
Reel/Frame 063544/0074 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS AND TRADEMARK - RELEASE OF REEL/FRAME 053866/0719 Recorded May 4, 2023
From: ROYAL BANK OF CANADA, AS AGENT
To: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC; MAXAR TECHNOLOGIES HOLDINGS INC.
Reel/Frame 063534/0550 →
CHANGE OF NAME Recorded Feb 15, 2023
From: DIGITALGLOBE, INC.
To: MAXAR INTELLIGENCE INC.
Reel/Frame 062760/0832 →
SECURITY AGREEMENT Recorded Jun 17, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 060389/0782 →
SECURITY AGREEMENT Recorded Jun 16, 2022
From: MAXAR INTELLIGENCE INC.; MAXAR SPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 060389/0720 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0446 →
U.S. PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 053866/0719 →
PATENT SECURITY AGREEMENT Recorded Sep 23, 2020
From: DIGITALGLOBE, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
Reel/Frame 053866/0412 →
CHANGE OF ADDRESS Recorded Apr 21, 2020
From: DIGITALGLOBE, INC.
To: DIGITALGLOBE, INC.
Reel/Frame 052451/0256 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2019
From: BROCK, BENJAMIN; ESTRADA, ADAM; JENKINS, ANDREW; MANGOLD, CHRIS
To: DIGITALGLOBE, INC.
Reel/Frame 050363/0840 →