IP Library Granted Patent US 10,571,575
Granted Patent B2
US 10,571,575 · App. 16/458,767 · Granted Feb 25, 2020

Augmented three dimensional point collection of vertical structures

Inventors: Stephen L. Schultz (West Henrietta, NY); David R. Nilosek (Rochester, NY); David S. Petterson (Avon, NY); Timothy S. Harrington (Rochester, NY)
Assignee: Pictometry International Corp.
G01S17/89G06T7/521G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,571,575
App. No.
16/458,767
Granted
Feb 25, 2020
Kind
B2
Abstract

Automated methods and systems are disclosed, including a method comprising: capturing images and three-dimensional LIDAR data of a geographic area with an image capturing device and a LIDAR system, the images depicting an object of interest and the three-dimensional LIDAR data including the object of interest, the image capturing device capturing the images of a vertical surface of the object of interest at one or more oblique angle, and the LIDAR system capturing the three-dimensional LIDAR data of a horizontal surface of the object of interest at a nadir angle; analyzing the images with a computer system to determine three dimensional locations of points on the object of interest; and updating the three-dimensional LIDAR data with the three dimensional locations of points on the object of interest determined by analyzing the images to create a 3D point cloud having a resolution greater than a resolution of the three-dimensional LIDAR data.

Claims (26)

1. An automated method, comprising:

capturing images and three-dimensional LIDAR data of a geographic area with an image capturing device and a LIDAR system, the images depicting an object of interest and the three-dimensional LIDAR data including the object of interest, the image capturing device capturing the images of a vertical surface of the object of interest at one or more oblique angle, and the LIDAR system capturing the three-dimensional LIDAR data of a horizontal surface of the object of interest at a nadir angle;

analyzing the images with a computer system to determine three dimensional locations of points on the object of interest; and

updating the three-dimensional LIDAR data with the three dimensional locations of points on the object of interest determined by analyzing the images to create a 3D point cloud having a resolution greater than a resolution of the three-dimensional LIDAR data.

2. The automated method of claim 1 , wherein the image capturing device and the LIDAR system are mounted to a platform, and wherein capturing images and three-dimensional LIDAR data are defined further as flying the platform over the geographic area.

3. The automated method of claim 2 , wherein the platform is unmanned.

4. The automated method of claim 2 , wherein the platform is manned.

5. The automated method of claim 1 , wherein the image capturing device and the LIDAR system are mounted to an airplane, and wherein capturing images and three-dimensional LIDAR data are defined further as flying over the geographic area with the airplane.

6. The automated method of claim 1 , wherein the object of interest includes a utility tower, and wherein the step of analyzing the images is defined further as utilizing GIS data of a utility network to assist in locating the object of interest within one or more images.

7. The automated method of claim 1 , wherein the object of interest includes a utility tower, and wherein the step of analyzing the images is defined further as scanning the images with an edge detection algorithm to locate utility wires depicted within the images, prior to determining three-dimensional location of points on the utility tower.

8. The automated method of claim 1 , further comprising obtaining measurements of the object of interest.

9. The automated method of claim 1 , further comprising obtaining measurements between the object of interest and one or more other objects captured in the 3D point cloud.

10. The automated method of claim 1 , further comprising forming a model of the object of interest from the 3D point cloud.

11. A system, comprising:

an image capturing device capturing images of a geographic area, the images depicting at least a vertical surface of an object of interest at one or more oblique angle;

one or more LIDAR system capturing at a nadir angle three-dimensional LIDAR data of the geographic area such that the three-dimensional LIDAR data includes at least a horizontal surface of the object of interest; and

a computer system analyzing the images to determine three dimensional locations of points on the object of interest and updating the three-dimensional LIDAR data with the three dimensional locations of points on the object of interest determined by analyzing the images to create a 3D point cloud having a resolution greater than a resolution of the three-dimensional LIDAR data.

12. The system of claim 11 , further comprising a platform upon which the one or more image capturing devices and the one or more LIDAR system are mounted.

13. The system of claim 12 , wherein the platform is unmanned.

14. The system of claim 12 , wherein the platform is manned.

15. The system of claim 11 , further comprising an airplane upon which the one or more image capturing devices and the one or more LIDAR system are mounted such that the images and three-dimensional LIDAR data are captured by flying over the geographic area with the airplane.

16. The system of claim 11 , wherein the object of interest includes a utility tower, and wherein analyzing the images is defined further as utilizing GIS data of a utility network to assist in locating the object of interest within one or more images.

17. The system of claim 11 , wherein the object of interest includes a utility tower, and wherein analyzing the images is defined further as scanning the images with an edge detection algorithm to locate utility wires depicted within the images, prior to determining three dimensional location of points on the utility tower.

18. The system of claim 11 , wherein the computer system further obtains measurements of the object of interest.

19. The system of claim 11 , wherein the computer system further obtains measurements between the object of interest and one or more other objects captured in the 3D point cloud.

20. The system of claim 11 , wherein the computer system further forms a model of the object of interest from the 3D point cloud.

Assignments (2)
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2019
From: SCHULTZ, STEPHEN L.; NILOSEK, DAVID R.; PETTERSON, DAVID S.; HARRINGTON, TIMOTHY S.
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 049643/0185 →
Continuity (4)
Continuation 15364812 · Nov 30, 2016
Continuation 15060264 · Mar 3, 2016
Division 14169872 · Jan 31, 2014
Related Publication 20200033479A1 · Jan 30, 2020
Cited By (9)
US 12,229,845 US 12,243,301 US 12,272,109 US 12,293,579 US 12,333,788 US 12,518,395 US 12,579,786 US 12,694,669 US 12,700,042