IP Library Granted Patent US 12,223,711
Granted Patent B2
US 12,223,711 · App. 17/332,165 · Granted Feb 11, 2025

System and method for energy project status detection

Inventors: Jingwen Zheng (Calgary, CA); Fanchi Meng (Calgary, CA); Jiarao Huang (Calgary, CA); Curtis Hess (Calgary, CA)
Assignee: RS Energy Group Topco, Inc.
G06V20/176G06T7/62H04Q9/00G06F2218/10G06T2207/10032H04Q2209/40H04Q2209/84
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,711
App. No.
17/332,165
Granted
Feb 11, 2025
Kind
B2
Abstract

A computing system receives an indication of an energy project. The computing system monitors satellite image data of the energy project. The computing system determines that a first activity has been initiated for the energy project based on a change in satellite image data. The computing system monitors telemetry data associated with a location corresponding to the energy project and the satellite image data of the energy project. The computing system converts the telemetry data associated with the location corresponding to the energy project to a telemetry activity index. The computing system converts the satellite image data associated with the energy project to a satellite activity index. The computing system determines that the first activity has ended for the energy project based on changes in at least one of the telemetry activity index and the pad activity index.

Claims (60)

1. A computer-implemented method for monitoring an energy project, comprising:

receiving, at a computing system, an indication of an energy project, wherein the indication comprises location data associated with the energy project; receiving, by the computing system, satellite image data of the energy project, wherein the satellite image data of the energy project corresponds to the location data associated with the energy project, the satellite image data comprising images across a plurality of spectrum bands, the plurality of spectrum bands comprising a first range of spectrum bands and a second range of spectrum bands distinct from the first range of spectrum bands, wherein the second range of spectrum bands comprises at least one non-visible spectrum band, wherein the first range of spectrum bands is dedicated to detecting a first type of feature and the second range of spectrum bands is dedicated to detecting a second type of feature, wherein the first type of feature is one of live vegetation, snow, water or clouds, the second type of feature is one of live vegetation, snow, water, or clouds, and the first type of feature is different from the second image type of feature;

processing, by the computing system, the satellite image data to determine that a first activity has been initiated for the energy project based on a change in the satellite image data, the processing comprising:

analyzing the plurality of spectrum bands of the satellite image data using a computer vision module of the computing system to determine that the first activity has been initiated based on a first indication of whether a first image feature of the first type was detected in the first range of spectrum bands and a second indication of whether a second image feature of the second type was detected in the second range of spectrum bands;

upon determining that the first activity has been initiated, monitoring, by the computing system, telemetry data associated with a location corresponding to the energy project;

continuing, by the computing system, to monitor the satellite image data of the energy project simultaneous with the telemetry data;

converting, by the computing system, the telemetry data associated with the location corresponding to the energy project to a telemetry activity index;

converting, by the computing system, the satellite image data associated with the energy project to a satellite activity index; and determining, by the computing system, that the first activity has ended for the energy project based on changes in at least one of the telemetry activity index and the satellite activity index.

2. The computer-implemented method of claim 1 , wherein receiving, at the computing system, the indication of the energy project comprises:

receiving the indication from a third party computing system of an approved permit.

3. The computer-implemented method of claim 1 , wherein receiving, at the computing system, the indication of the energy project comprises:

predicting, by a convolutional neural network, that energy project construction has begun based on a portion of the satellite image data of an area bounding the energy project.

4. The computer-implemented method of claim 1 , wherein converting, by the computing system, the satellite image data associated with the energy project to the satellite activity index comprises:

generating a time series representation of the satellite activity index.

5. The computer-implemented method of claim 4 , wherein determining, by the computing system, that the second first activity has occurred ended comprises:

applying a detection algorithm to the time series representation of the satellite activity index to identify peaks and valleys in the time series representation, wherein each peak and each valley corresponds to a respective activity associated with the energy project.

6. The computer-implemented method of claim 1 , wherein converting, by the computing system, the telemetry data associated with the location corresponding to the energy project to the telemetry activity index comprises:

generating a time series representation of the telemetry activity index.

7. The computer-implemented method of claim 6 , wherein determining, by the computing system, that the first activity has ended comprises:

applying a detection algorithm to the time series representation of the telemetry activity index to identify a consecutiveness and a magnitude of the telemetry data.

8. A system, comprising:

a processor; and

a memory having programming instruction stored thereon, which, when executed by the processor, causes the system to perform one or more operations comprising:

receiving an indication of an energy project, wherein the indication comprises location data associated with the energy project;

receiving satellite image data of the energy project, wherein the satellite image data of the energy project corresponds to the location data associated with the energy project, the satellite image data comprising images across a plurality of spectrum bands, the plurality of spectrum bands comprising a first range of spectrum bands and a second range of spectrum bands distinct from the first range of spectrum bands, wherein the second range of spectrum bands comprises at least one non-visible spectrum band, wherein the first range of spectrum bands is dedicated to detecting a first type of feature and the second range of spectrum bands is dedicated to detecting a second type of feature, wherein the first type of feature is one of live vegetation, snow, water or clouds, the second type of feature is one of live vegetation, snow, water, or clouds, and the first type of feature is different from the second image type of feature;

processing the satellite image data to determine that a first activity has been initiated for the energy project based on a change in the satellite image data, the processing comprising:

analyzing the plurality of spectrum bands of the satellite image data using a computer vision module of the system to determine that the first activity has been initiated based on a first indication of whether a first image feature of the first type was detected in the first range of spectrum bands and a second indication of whether a second image feature of the second type was detected in the second range of spectrum bands;

upon determining that the first activity has been initiated, monitoring telemetry data associated with a location corresponding to the energy project; continuing to monitor the satellite image data of the energy project simultaneous with the telemetry data; converting the telemetry data associated with the location corresponding to the energy project to a telemetry activity index;

converting the satellite image data associated with the energy project to a satellite activity index; and

determining that the first activity has ended for the energy project based on changes in at least one of the telemetry activity index and the satellite activity index.

9. The system of claim 8 , wherein receiving the indication of the energy project comprises:

receiving the indication from a third party computing system of a well permit.

10. The system of claim 8 , wherein receiving the indication of the energy project comprises:

predicting, by a convolutional neural network, that energy project construction has begun based on satellite image data of a portion of an area bounding the energy project.

11. The system of claim 8 , wherein converting the satellite image data associated with the energy project to the satellite activity index comprises:

generating a time series representation of the satellite activity index.

12. The system of claim 11 , wherein determining that the first activity has ended comprises:

applying a detection algorithm to the time series representation of the satellite activity index to identify peaks and valleys in the time series representation, wherein each peak and each valley corresponds to a respective activity associated with the energy project.

13. The system of claim 8 , wherein converting the telemetry data associated with the location corresponding to the energy project to the telemetry activity index comprises:

generating a time series representation of the telemetry activity index.

14. The system of claim 13 , wherein determining that the first activity has ended comprises:

applying a detection algorithm to the time series representation of the telemetry activity index to identify a consecutiveness and a magnitude of the telemetry data.

15. A non-transitory computer readable medium including one or more instructions that, when executed by a computing system, causes the computing system to perform one or more operations comprising:

receiving, at the computing system, an indication of an energy project, where in the indication comprises location data associated with the energy project; receiving, by the computing system, satellite image data of the energy project, wherein the satellite image data of the energy project corresponds to the location data associated with the energy project, the satellite image data comprising images across a plurality of spectrum bands, the plurality of spectrum bands comprising a first range of spectrum bands and a second range of spectrum bands distinct from the first range of spectrum bands, wherein the second range of spectrum bands comprises at least one non-visible spectrum band, wherein the first range of spectrum bands is dedicated to detecting a first type of feature and the second range of spectrum bands is dedicated to detecting a second type of feature, wherein the first type of feature is one of live vegetation, snow, water or clouds, the second type of feature is one of live vegetation, snow, water, or clouds, and the first type of feature is different from the second image type of feature;

processing, by the computing system, the satellite image data to determine that a first activity has been initiated for the energy project based on a change in the satellite image data, the processing comprising:

analyzing the plurality of spectrum bands of the satellite image data using a computer vision module of the computing system to determine that the first activity has been initiated based on a first indication of whether a first image feature of the first type was detected in the first range of spectrum bands and a second indication of whether a second image feature of the second type was detected in the second range of spectrum bands;

upon determining that the first activity has occurred, monitoring, by the computing system, telemetry data associated with a location corresponding to the energy project;

continuing, by the computing system, to monitor the satellite image data of the energy project simultaneous with the telemetry data; converting, by the computing system, the telemetry data associated with the location corresponding to the energy project to a telemetry activity index;

converting, by the computing system, the satellite image data associated with the energy project to a satellite activity index; and

determining, by the computing system, that the first activity has ended for the energy project based on changes in at least one of the telemetry activity index and the satellite activity index.

16. The non-transitory computer readable medium of claim 15 , wherein receiving, at the computing system, the indication of the energy project comprises:

receiving the indication from a third party computing system of an approved permit.

17. The non-transitory computer readable medium of claim 15 , wherein receiving, at the computing system, the indication of the energy project comprises:

predicting, by a convolutional neural network, that energy project construction has begun based on satellite image data of an area bounding the energy project.

18. The non-transitory computer readable medium of claim 15 , wherein converting, by the computing system, the satellite image data associated with the energy project to the satellite activity index comprises:

generating a time series representation of the satellite activity index.

19. The non-transitory computer readable medium of claim 18 , wherein determining, by the computing system, that the first activity has ended comprises:

applying a detection algorithm to the time series representation of the satellite activity index to identify peaks and valleys in the time series representation, wherein each peak and each valley corresponds to an activity associated with the energy project.

20. The non-transitory computer readable medium of claim 15 , wherein converting, by the computing system, the telemetry data associated with the location corresponding to the energy project to the telemetry activity index comprises:

generating a time series representation of the telemetry activity index.

Assignments (4)
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 065943/0625) Recorded Dec 29, 2025
From: GOLUB CAPITAL MARKETS LLC
To: RS ENERGY GROUP TOPCO, INC.
Reel/Frame 074107/0017 →
SECURITY INTEREST Recorded Dec 18, 2025
From: RS ENERGY GROUP TOPCO, INC.
To: GOLUB CAPITAL MARKETS LLC, AS COLLATERAL AGENT
Reel/Frame 073263/0276 →
SECURITY INTEREST Recorded Dec 22, 2023
From: RS ENERGY GROUP TOPCO, INC.
To: GOLUB CAPITAL MARKETS LLC, AS COLLATERAL AGENT
Reel/Frame 065943/0625 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2022
From: ZHENG, JINGWEN; HUANG, JIARAO; MENG, FANCHI; HESS, CURTIS
To: RS ENERGY GROUP TOPCO, INC.
Reel/Frame 060790/0915 →
Continuity (2)
Provisional Application 63031677 · May 29, 2020
Related Publication 20210374404A1 · Dec 2, 2021
References Cited (5)
US 10460170B1 · Adler · 2019 [cited by applicant]
US 20180137355A1 · Rostand · 2018 [cited by examiner]
US 20190384975A1 · Rostand · 2019 [cited by examiner]
Extended European Search Report from corresponding EP Appln. No. 21811769.5 dated May 24, 2024. [cited by applicant]
Examination Report from corresponding CA Appln. No. 3,173,607 dated Aug. 5, 2024. [cited by applicant]