IP Library Granted Patent US 11,580,728
Granted Patent B2
US 11,580,728 · App. 17/356,897 · Granted Feb 14, 2023

Electrical power grid modeling

Inventors: Ananya Gupta (San Francisco, CA); Phillip Ellsworth Stahlfeld (Mountain View, CA); Bangyan Chu (Fairfax, VA)
Assignee: X Development LLC
G06V20/182G06F16/29G06F16/587G06F30/18G06K9/6271G06T5/30G06T7/50G06T7/60G06T7/73G06T7/75G06T11/206G06T17/05G06V20/176H02J3/00G06T2207/10032G06T2207/30184G06V20/194H02J2203/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,580,728
App. No.
17/356,897
Granted
Feb 14, 2023
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on a storage device, for electric grid asset detection are enclosed. An electric grid asset detection method includes: obtaining overhead imagery of a geographic region that includes electric grid wires; identifying the electric grid wires within the overhead imagery; and generating a polyline graph of the identified electric grid wires. The method includes replacing curves in polylines within the polyline graph with a series of fixed lines and endpoints; identifying, based on characteristics of the fixed lines and endpoints, a location of a utility pole that supports the electric grid wires; detecting an electric grid asset from street level imagery at the location of the utility pole; and generating a representation of the electric grid asset for use in a model of the electric grid.

Claims (66)

1. An electric grid asset detection method comprising:

obtaining overhead imagery of a geographic region that includes electric grid wires;

identifying the electric grid wires within the overhead imagery;

generating a polyline graph of the identified electric grid wires;

replacing curves in polylines within the polyline graph with a series of fixed lines and endpoints;

identifying, based on characteristics of the fixed lines and endpoints, a location of a utility pole that supports the electric grid wires;

detecting an electric grid asset from street level imagery at the location of the utility pole; and

generating a representation of the electric grid asset for use in a model of the electric grid.

2. The method of claim 1 , wherein the overhead imagery comprises at least one of visible light imagery, infrared imagery, hyperspectral imagery, multispectral imagery, RADAR imagery, or LIDAR imagery.

3. The method of claim 1 , wherein generating the polyline graph of the identified electric grid wires comprises:

generating, from the overhead imagery, a segmented raster including a preliminary polygon encompassing electric grid wires; and

performing a thinning process on the preliminary polygon to generate the polyline graph.

4. The method of claim 1 , wherein replacing a curve in a polyline with a series of fixed lines and endpoints comprises:

identifying a curve in the polyline as viewed from an overhead perspective;

determining a change angle between a direction of the polyline on a first side of the curve and a direction of the polyline on a second side of the curve;

determining that the change angle is greater than a threshold angle; and

in response to determining that the change angle is greater than the threshold angle, replacing the curve with two or more fixed lines and one or more endpoints.

5. The method of claim 1 , wherein replacing a curve in a polyline with a series of fixed lines and endpoints comprises:

identifying a curve in the polyline as viewed from an overhead perspective;

determining a change angle between a direction of a first side of the curve and a direction of a second side of the curve;

determining that the change angle is less than a threshold angle; and

in response to determining that the change angle is less than the threshold angle, replacing the curve with a single fixed line.

6. The method of claim 1 , wherein identifying a location of a utility pole that supports the electric grid wires comprises determining that an endpoint corresponds to the location of a utility pole.

7. The method of claim 1 , wherein identifying the location of the utility pole that supports the electric grid wires comprises:

determining that a length of a fixed line exceeds a threshold length;

in response to determining that the length of the fixed line exceeds the threshold length, determining that at least one utility pole is located along the fixed line; and

identifying the location of the utility pole at a midpoint of the fixed line.

8. The method of claim 1 , wherein identifying the location of the utility pole that supports the electric grid wires comprises:

determining that a length of a fixed line exceeds a threshold length;

in response to determining that the length of the fixed line exceeds the threshold length, determining that at least one utility pole is located along the fixed line;

determining a median distance between utility poles in a geographic region where the electric grid wires are located; and

identifying the location of the utility pole along the fixed line, the location being a distance away from another utility pole that is equal to an integer multiple of the median distance.

9. The method of claim 1 , comprising:

generating an image mask corresponding to regions of the overhead imagery where grid wires are located;

generating filtered imagery by filtering the imagery to identify areas of high pixel contrast; and

applying the image mask to the filtered imagery to generate vector representations of individual electric grid wires.

10. The method of claim 1 , comprising:

obtaining, based on the location of the utility pole, and from a database of street level imagery, the street level imagery at the location of the utility pole.

11. The method of claim 1 , wherein the electric grid asset comprises one of a capacitor, a transformer, a switch, or a feeder.

12. The method of claim 1 , wherein the representation of the electric grid asset comprises at least one of a geographic location, an elevation, a classification, or a status of the electric grid asset.

13. The method of claim 1 , further comprising:

obtaining a set of surfels, wherein each surfel of the set of surfels represents a surface of an object within a region surrounding the utility pole;

classifying characteristics of each surfel; and

detecting one or more surfels that represent an electric grid asset based on the characteristics of each surfel.

14. The method of claim 13 , wherein obtaining the set of surfels comprises:

obtaining ranging data at the location of the utility pole; and

converting the ranging data into the set of surfels.

15. The method of claim 13 , wherein obtaining the set of surfels comprises:

obtaining the set of surfels from a database of surfels, wherein the database of surfels stores surfels generated from ranging data obtained from multiple geographic regions.

16. The method of claim 13 , wherein the characteristics of each surfel comprise at least one of a shape, a location, a height, a texture, a color, a depth, or an orientation of the surfel.

17. A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

obtaining overhead imagery of a geographic region that includes electric grid wires; identifying the electric grid wires within the overhead imagery;

generating a polyline graph of the identified electric grid wires; replacing curves in polylines within the polyline graph with a series of fixed lines and endpoints;

identifying, based on characteristics of the fixed lines and endpoints, a location of a utility pole that supports the electric grid wires;

detecting an electric grid asset from street level imagery at the location of the utility pole; and

generating a representation of the electric grid asset for use in a model of the electric grid.

18. The system of claim 17 , wherein the overhead imagery comprises at least one of visible light imagery, infrared imagery, hyperspectral imagery, multispectral imagery, RADAR imagery, or LIDAR imagery.

19. The system of claim 17 , wherein generating the polyline graph of the identified electric grid wires comprises:

generating, from the overhead imagery, a segmented raster including a preliminary polygon encompassing electric grid wires; and

performing a thinning process on the preliminary polygon to generate the polyline graph.

20. A non-transitory computer-readable medium storing instructions that are operable, when executed by one or more computers, to cause the one or more computers to perform operations comprising:

obtaining overhead imagery of a geographic region that includes electric grid wires; identifying the electric grid wires within the overhead imagery;

generating a polyline graph of the identified electric grid wires; replacing curves in polylines within the polyline graph with a series of fixed lines and endpoints;

identifying, based on characteristics of the fixed lines and endpoints, a location of a utility pole that supports the electric grid wires;

detecting an electric grid asset from street level imagery at the location of the utility pole; and

generating a representation of the electric grid asset for use in a model of the electric grid.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2021
From: GUPTA, ANANYA; STAHLFELD, PHILLIP ELLSWORTH; CHU, BANGYAN
To: X DEVELOPMENT LLC
Reel/Frame 056795/0292 →
Continuity (2)
Provisional Application 63044781 · Jun 26, 2020
Related Publication 20210407187A1 · Dec 30, 2021
Cited By (1)
US 12,718,554