IP Library › Granted Patent US 12,489,518
Granted Patent B2
US 12,489,518 · App. 17/407,033 · Granted Dec 2, 2025

System for planetary-scale analytics

Inventors: Emiliano Kargieman (Buenos Aires, AR); Gerardo Gabriel Richarte (Caba, AR)
Assignee: Urugus S.A.
H04B7/18513G06V10/25G06V10/40G06V20/13G06V20/176G06V20/188H04N7/183G01C11/02G06V10/26
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,489,518
App. No.
17/407,033
Granted
Dec 2, 2025
Kind
B2
Abstract

A smart satellite system is capable of decision making and prioritization on the fly to optimize the use of downlink bandwidth to deliver prioritized data based upon opportunity and the resources of available payloads. By providing a satellite system with substantial processing power and a level of autonomy, the satellite is able to make decisions about capturing imagery data, including image data processing, object detection, image segmentation, and re-orientation of the satellite based upon the opportunity, from the satellite's perspective, for capturing image data of areas or objects of interest. Through the use of machine learning and in-orbit image analysis, the satellite may transmit only a subset of the captured images, portions of the captured images, or the result of image analysis, thereby efficiently using the downlink communication channel.

Claims (52)

1 . A satellite, comprising:

one or more sensors;

one or more processors; and

memory coupled to the one or more processors, the memory including one or more modules that are executable by the one or more processors to:

receive a request for data, the request for data including one or more image processing workflow specifications and/or an image analysis workflow used for on-board processing and analysis operations for the request for data;

receive raw image sensor data from the one or more sensors;

transform, on-board the satellite and based at least in part on the one or more image processing workflow specifications, the raw image sensor data to generate processed image sensor data suitable for interpretation and/or analysis;

determine, on-board the satellite and based at least in part on the processed image sensor data generated for the request for data, one or more artificial intelligence software building blocks and/or one or more artificial intelligence hardware building blocks, as part of the image analysis workflow to use or apply the image analysis workflow for the processed image sensor data;

analyze, based at least in part on the instantiated image analysis workflow, the processed image sensor data to generate analysis results;

store the analysis results in the memory on-board the satellite for further processing, for transmission to another location, or for further analysis; and

calculate a short-term planning for the satellite based on at least one of a prioritization of tasks, image analysis, the analysis results, or contracts uploaded to the satellite;

wherein the image analysis workflow further comprises an artificial intelligence configuration which is updated on-board the satellite with on-board data.

2 . The satellite as in claim 1 , wherein the analysis results include information associated with at least one object or feature of interest on the surface of the earth; and wherein the one or more modules are further executable to determine, based upon the information associated with the at least one object or feature of interest on the surface of the earth, a set of instructions to be executed by the one or more processors.

3 . The satellite as in claim 2 , wherein the set of instructions include capturing one or more images, repositioning the satellite, changing a priority of instructions the satellite is tasked to perform or creating a new task for the satellite to complete.

4 . The satellite as in claim 1 , wherein the one or more modules are further executable to feed the analysis results back into the artificial intelligence configuration to further train the artificial intelligence configuration.

5 . The satellite as in claim 4 , wherein the one or more modules are further executable to receive the artificial intelligence configuration from a ground station or from another satellite.

6 . The satellite as in claim 1 , wherein the one or more modules are further executable to receive executable code and/or configuration settings to be executed in orbit on-demand.

7 . The satellite as in claim 4 , wherein the artificial intelligence configuration comprises a neural network trained on the ground before being uploaded to the satellite, updated while on-board the satellite, or additionally trained while on-board the satellite.

8 . The satellite as in claim 7 , wherein the artificial intelligence configuration is trained for analyzing images to detect objects or features, as a land use classifier, for determining changes or events, or for determining environmental indicators.

9 . The satellite as in claim 4 , wherein the on-board data comprises at least one of imaging data, satellite health data, image analysis data, or satellite orientation data.

10 . The satellite as in claim 1 , wherein the one or more modules are further executable to receive tasking parameters including conditions precedent that trigger execution of one or more tasks.

11 . The satellite as in claim 10 , wherein the conditions include an available optical path to an area of interest or a point of interest, minimum sun elevation, maximum slant angle, task priorities, time of day, available payloads, and available power.

12 . A method under control of one or more processors in a satellite, the method comprising:

receiving a request for data, the request for data including a request to determine information associated with at least one object or feature of interest on the surface of the earth;

receiving raw image sensor data from one or more sensors on-board the satellite;

determining, on-board the satellite and based at least in part on the request for data, an image processing workflow used for on-board processing operations for the request for data;

processing, on-board the satellite and based at least in part on the image processing workflow, the raw image sensor data to generate processed image sensor data generated for the request for data;

determining, based at least in part on the processed image sensor data generated for the request for data, one or more artificial intelligence software building blocks and/or one or more artificial intelligence hardware building blocks, as part of an image analysis workflow to use or apply the image analysis workflow for the processed image sensor data;

analyzing, based at least in part on the instantiated image analysis workflow, the processed image sensor data to generate analysis results;

storing the analysis results in memory on-board the satellite for further processing, for transmission to another location, or for further analysis; and

calculate a short-term planning for the satellite based on at least one of a prioritization of tasks, image analysis, the analysis results, or contracts uploaded to the satellite;

wherein the image analysis workflow is performed on-board the satellite by an artificial intelligence configuration comprising a neural network.

13 . The method as in claim 12 , wherein the neural network is trained on the ground before being uploaded to the satellite, trained while on-board the satellite, or updated while on-board the satellite with data gathered by the one or more sensors on-board the satellite.

14 . The method as in claim 13 , wherein the data gathered by the one or more sensors on-board the satellite further comprises at least one of data available from the one or more sensors on-board the satellite, imaging data, satellite health data, image analysis data or satellite orientation data.

15 . The method as in claim 12 , wherein the analysis results include information associated with the at least one object or feature of interest on the surface of the earth.

16 . The method as in claim 12 , wherein the method further comprises determining, based at least in part on the analysis results, one or more tasks to perform; and performing the one or more tasks; wherein the one or more tasks to perform further comprise at least one of transmitting data or the analysis results to a location independent of the satellite, activating a payload of the satellite, and a new task determined based on artificial intelligence analysis.

17 . A satellite, comprising:

one or more sensors;

one or more processors; and

memory coupled to the one or more processors, the memory including one or more modules that are executable by the one or more processors to:

receive image sensor data from the one or more sensors;

determine, on-board the satellite and based at least in part on the image sensor data, an image processing workflow used for on-board processing operations for the image sensor data;

process, based at least in part on the image processing workflow, the image sensor data to generate processed image sensor data;

determine, based at least in part on the processed image sensor data generated for the image sensor data, one or more artificial intelligence software building blocks and/or one or more artificial intelligence hardware building blocks, as part of an image analysis workflow to use or apply the image analysis workflow for the processed image sensor data;

analyze, based at least in part on the instantiated image analysis workflow, the processed image sensor data to generate analysis results;

store the analysis results in the memory on-board the satellite for further processing, for transmission to another location, or for further analysis; and

calculate a short-term planning for the satellite based on at least one of a prioritization of tasks, image analysis, the analysis results, or contracts uploaded to the satellite;

wherein the image analysis workflow is performed on-board the satellite by an artificial intelligence configuration which is updated on-board the satellite with on-board data.

18 . The satellite of claim 17 , wherein the one or more modules are further executable to:

receive a request for data, the request for data including image processing workflow specifications and/or the image analysis workflow;

wherein the image analysis workflow comprises one or more machine learning modules.

19 . The satellite of claim 17 , wherein the one or more modules are further executable to feed the analysis results back into the artificial intelligence configuration to further train the artificial intelligence configuration.

Assignments (3)
SECURITY INTEREST Recorded Apr 12, 2024
From: URUGUS S.A.
To: ACQUIOM AGENCY SERVICES LLC
Reel/Frame 067085/0242 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2021
From: SATELLOGIC OVERSEAS (BVI)
To: URUGUS S.A.
Reel/Frame 057241/0739 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: KARGIEMAN, EMILIANO; RICHARTE, GERARDO GABRIEL
To: SATELLOGIC OVERSEAS, INC. (BVI)
Reel/Frame 057235/0169 →
Continuity (3)
Continuation 15445813 · Feb 28, 2017
Provisional Application 62301441 · Feb 29, 2016
Related Publication 20220038172A1 · Feb 3, 2022
References Cited (80)
US 5971324A · Williams et al. · 1999 [cited by applicant]
US 6084510A · Lemelson · 2000 [cited by examiner]
US 6128555A · Hanson et al. · 2000 [cited by applicant]
US 6157621A · Brown et al. · 2000 [cited by applicant]
US 8818029B1 · Mecikalski et al. · 2014 [cited by applicant]
US 9473898B1 · Patel et al. · 2016 [cited by applicant]
US 20080063237A1 · Rubenstein · 2008 [cited by applicant]
US 20100311417A1 · Korb et al. · 2010 [cited by applicant]
US 20120029812A1 · Altwaijry · 2012 [cited by examiner]
US 20120155704A1 · Williams et al. · 2012 [cited by applicant]
US 20120188372A1 · Ozkul · 2012 [cited by examiner]
US 20140029844A1 · Padwick · 2014 [cited by applicant]
US 20140040282A1 · Mann et al. · 2014 [cited by applicant]
US 20140218242A1 · Platzer · 2014 [cited by applicant]
US 20140222255A1 · You et al. · 2014 [cited by applicant]
US 20140222472A1 · Platzer · 2014 [cited by examiner]
US 20140278082A1 · De Vries et al. · 2014 [cited by applicant]
US 20140362174A1 · Fan et al. · 2014 [cited by applicant]
US 20150016669A1 · Tabb · 2015 [cited by examiner]
US 20150346031A1 · Sloan et al. · 2015 [cited by applicant]
US 20150371115A1 · Marchisio et al. · 2015 [cited by applicant]
US 20160020848A1 · Leonard · 2016 [cited by applicant]
US 20160164573A1 · Birk · 2016 [cited by examiner]
US 20160171059A1 · Diamond et al. · 2016 [cited by applicant]
US 20160307071A1 · Perronnin · 2016 [cited by examiner]
US 20170031056A1 · Vega-Avila · 2017 [cited by examiner]
US 20170250751A1 · Kargieman et al. · 2017 [cited by applicant]
US 20180137941A1 · Chen · 2018 [cited by examiner]
US 20180172823A1 · Tyc · 2018 [cited by applicant]
CN 102780523 · 2012 [cited by applicant]
CN 103530409 · 2014 [cited by applicant]
CN 104484647 · 2015 [cited by applicant]
CN 104849274 · 2015 [cited by applicant]
CN 105303184 · 2016 [cited by applicant]
EP 1698856 · 2006 [cited by applicant]
FR 2815804 · 2002 [cited by applicant]
JP 2001122199A · 2001 [cited by applicant]
JP 2003030649A · 2003 [cited by applicant]
JP 2008506167A · 2008 [cited by applicant]
JP 2013518246A · 2013 [cited by applicant]
WO WO03096142 · 2003 [cited by applicant]
WO WO2011089477 · 2011 [cited by applicant]
Sherwood et al., “The Autonomous Sciencecraft Experiment” (Year: 2003). [cited by examiner]
Rebecca (Onboard classifiers for science event detection on a remote sensing spacecraft Authors: Rebecca Castano et al in KDD '06: Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and d… [cited by examiner]
David (Onboard Machine Learning Classification of Images by a Cubesat in Earth Orbit by David R. Thompson et al. published on Jun. 2015 in AI Matters, vol. 1, Issue 4) 2015 (Year: 2015). [cited by examiner]
CN Office Action from corresponding CN Application No. 201780013996 mailed Feb. 3, 2021, a counterpart foreign application for U.S. Appl. No. 62/301,441, 13 pages. [cited by applicant]
The Chinese Office Action mailed on May 8, 2020 for Chinese Patent Application No. 201780013996.1, a counterpart of U.S. Appl. No. 15/445,813, 14 pages. [cited by applicant]
The Chinese Office Action (English translation) mailed on May 8, 2020 for Chinese Patent Application No. 201780013996.1, a counterpart of U.S. Appl. No. 15/445,813, 15 pages. [cited by applicant]
Dehghan, et. al., “Design and Implementation of Intelligent decision making system to generate flight scenario automatically”, IEEE, 2011, pp. 178-183. [cited by applicant]
European Office Action mailed Jul. 24, 2021 for European Patent Application No. 17799809.3, a counterpart foreign application of U.S. Appl. No. 15/445,813, 4 pages. [cited by applicant]
The Extended European Search Report mailed on Sep. 25, 2019 for European Patent Application No. 17799809.3, 14 pages. [cited by applicant]
The Israeli Office Action mailed on Nov. 10, 2020 for Israeli Patent Application No. 278550, a counterpart of U.S. Appl. No. 15/445,813, 2 pages. [cited by applicant]
The Section 18 Office Action mailed on Oct. 24, 2019 for Israeli Patent Application No. 261136, a counterpart of U.S. Appl. No. 15/445,813, 2 pages. [cited by applicant]
Israeli Office Action mailed Jun. 10, 2021 for Israeli Patent Application No. 278550, a foreign counterpart to U.S. Appl. No. 15/445,813, 13 pages. [cited by applicant]
The Israeli Section 18 Office Action mailed on Jul. 14, 2020 for Israeli Patent Application No. 261136, a counterpart of U.S. Appl. No. 15/445,813, 2 pages. [cited by applicant]
Japanese Office Action mailed Jan. 26, 2021 for Japanese Patent Application No. 2018-545329, 16 pages. [cited by applicant]
Lavigne et al, “Unsupervised Classification and clustering of image features for vehicle detection in large scale aerial images”, Information Fusion (Fusion), 2010 13th Conference on IEEE, Jul. 26, 2010, pp. 1-8. [cited by applicant]
Office Action dtd Aug. 1, 2021 for U.S. Appl. No. 15/445,813 “System for Planetary-Scale Analytics” Kargieman, 19 pages. [cited by applicant]
Non Final Office Action dated Mar. 2, 2020 for U.S. Appl. No. 15/445,813 “System for Planetary-Scale Analytics” Kargieman, 20 pages. [cited by applicant]
Non Final Office Action dtd Jul. 29, 2019 for U.S. Appl. No. 15/445,813 “System for Planetary-Scale Analytics” Kargieman, 23 pages. [cited by applicant]
Non Final Office Action dated Sep. 21, 2020 for U.S. Appl. No. 15/445,813, “System for Planetary-Scale Analytics”, Kargieman, 29 pages. [cited by applicant]
Office action for U.S. Appl. No. 15/445,813, mailed on M01/04/2019, Kargieman, “System for Planetary-Scale Analytics”, 14 pages. [cited by applicant]
Office Action for U.S. Appl. No. 15/445,813, Kargieman, “System for Planetary-Scale Analytics”, 19 Pages. [cited by applicant]
Office action for U.S. Appl. No. 15/445,813, mailed on Apr. 15, 2019, Kargieman, “System for Planetary-Scale Analytics”, 21 pages. [cited by applicant]
Final Office Action dated Jun. 5, 2020 for U.S. Appl. No. 15/445,813 “System for Planetary-Scale Analytics” Kargieman, 21 pages. [cited by applicant]
The PCT Search Report and Written Opinion, mailed on Nov. 13, 2017, for PCT Application No. PCT/US17/20039, 8 pages. [cited by applicant]
Verfaillie, et al., “A generic modular architecture for the control of an autonomous spacecraft”, 5th International Workshop on Planning and Scheduling for Space, 2006, 9 pages. [cited by applicant]
Japanese Office Action mailed May 10, 2022 for Japanese Application No. 2021-074154 a divisional patent applciation to 2018-545329 a foreign counterpart to U.S. Pat. No. 11,101,876, 11 pages. [cited by applicant]
Japanese Office Action mailed May 24, 2022 for Japanese Patent Application No. 2018-545329, a foreign counterpart to U.S. Pat. No. 11,101,876, 16 pages. [cited by applicant]
O. Benderli et al., GEZGIN & GEZGIN-2: Adaptive Real-Time Image Processing Subsystems for Earth Observing Small Satellites, First NASA/ESA Conference on Adaptive Hardware and Systems (AHS'06), IEEE, Jun. 15, 2006, pp. 1… [cited by applicant]
Office action for Japanese Patent Application No. 2021-074154, mailed on Nov. 15, 2022. Kargieman, Emiliano “System for Planetary-Scale Analytics”. [cited by applicant]
Canadian Office Action mailed Feb. 3, 2023 for Canadian Patent Application No. 3014446, a foreign counterpart to U.S. Pat. No. 11,101,876, 4 pages. [cited by applicant]
Israeli Notice of Allowance mailed on Mar. 10, 2024 for Israeli Patent Application No. 297135, a foreign counterpart of U.S. Appl. No. 17/407,033, 3 pages. [cited by applicant]
Chinese Office Action mailed Sep. 3, 2021 for Chinese Application No. 201780013996.1, a foreign counterpart to U.S. Pat. No. 11,101,876, 9 pages. [cited by applicant]
Japanese Office Action mailed Sep. 21, 2021 for Japanese Application No. 2018-545329, a foreign counterpart to U.S. Pat. No. 11,101,876, 15 pages. [cited by applicant]
Brazilian Office Action mailed Nov. 28, 2023 for Brazilian Application No. BR1120180172324, a foreign counterpart to U.S. Pat. No. 11,101,876, 8 pages. [cited by applicant]
Canadian Office Action mailed Dec. 6, 2023 for Canadian Application No. 3,014,446, a foreign counterpart to U.S. Pat. No. 11,101,876, 4 pages. [cited by applicant]
Office Action for Canadian Application No. 3,014,446, Dated Aug. 22, 2024, 8 pages. [cited by applicant]
Castano, et al., “Onboard classifiers for science event detection on a Remote Sensing Spacecraft”, Proceedings of the Twelfht ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Aug. 20, 2009, pp… [cited by applicant]
European Office Action mailed on May 31, 2024 for European Patent Application No. 22161426.6, a foreign counterpart of U.S. Appl. No. 15/445,813, 6 pages. [cited by applicant]