IP Library › Granted Patent US 11,295,523
Granted Patent B2
US 11,295,523 · App. 16/831,547 · Granted Apr 5, 2022

Estimating a condition of a physical structure

Inventors: James M. Freeman (Normal, IL); Roger D. Schmidgall (Normal, IL); Patrick H. Boyer (Bloomington, IL); Nicholas U. Christopulos (Bloomington, IL); Jonathan D. Maurer (Bloomington, IL); Nathan L. Tofte (Downs, IL); Jackie O. Jordan, II (Bloomington, IL)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
G06T17/20B64C39/024G01N21/64G01N21/8851G01N22/02G01S7/4817G01S13/89G01S15/89G01S17/86G01S17/89G06F30/13G06Q30/0278G06Q30/0283G06Q40/08G06Q50/16G06Q50/163G06T1/0007G06T7/0002H04N7/185H04N13/106H04N13/254H04N13/271H04N13/275H04R23/008G01N2201/06113G01N2201/10G06T2200/08G06T2207/10028G06T2207/10032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,295,523
App. No.
16/831,547
Granted
Apr 5, 2022
Kind
B2
Abstract

In a computer-implemented method and system for capturing the condition of a structure, the structure is scanned with an unmanned aerial vehicle (UAV). Data collected by the UAV corresponding to points on a surface of a structure is received and a 3D point cloud is generated for the structure, where the 3D point cloud is generated based at least in part on the received UAV data. A 3D model of the surface of the structure is reconstructed using the 3D point cloud.

Claims (46)

1. A computer-implemented method of inspecting a structure, the method comprising:

receiving, by one or more processors, data collected by an unmanned aerial vehicle (UAV) corresponding to points on a surface of the structure;

identifying, by the one or more processors, a plurality of coordinate sets associated with the UAV data, the plurality of coordinate sets each relating to vertical, horizontal, and depth distance measurements;

normalizing, by the one or more processors, the plurality of coordinate sets to share a common coordinate system;

generating, by the one or more processors, a 3D point cloud for the structure, wherein the 3D point cloud is generated based at least in part on the received UAV data and the normalized plurality of coordinate sets; and

reconstructing, by the one or more processors, a 3D model of the surface of the structure using the 3D point cloud.

2. The computer-implemented method of claim 1 , further comprising:

analyzing, by the one or more processors, the 3D model of the surface of the structure to estimate a condition of the structure.

3. The computer-implemented method of claim 1 , further comprising:

deploying the UAV to project light onto the surface of the structure and detect light reflected off the surface of the structure using a light sensor, wherein the UAV data includes visual features associated with the structure.

4. The computer-implemented method of claim 1 , further comprising:

deploying the UAV to project an audio signal in a direction of the structure and receive an audio signal reflected off the structure using an audio sensor, wherein the UAV data includes audio features associated with the structure.

5. The computer-implemented method of claim 1 , further comprising:

deploying the UAV to detect topographical features associated with the surface of the structure using a tactile sensor, wherein the UAV data includes the topographical features.

6. The computer-implemented method of claim 5 , wherein deploying the UAV to detect topographical features includes deploying the UAV to depress a pad on the surface of the structure and to detect topographical features associated with the surface of the structure based on an imprint left on the pad.

7. The computer-implemented method of claim 5 , wherein deploying the UAV to detect topographical features includes deploying the UAV to implement a roller across the surface of the structure and to detect topographical features associated with the surface of the structure based on an imprint on the roller.

8. The computer-implemented method of claim 1 , further comprising:

deploying the UAV to mechanically pull on an object associated with the surface of the structure and to detect a resistive force of the object, wherein the UAV data includes the resistive force of the object.

9. The computer-implemented method of claim 1 , further comprising:

deploying the UAV to spray a chemical onto the surface of the structure and detect a presence of the chemical on the structure using a chemical sensor, wherein the UAV data includes topographical features associated with the surface of the structure based on the presence of the chemical on the structure.

10. The computer-implemented method of claim 1 , further comprising:

deploying the UAV to capture thermal images of the structure to detect thermal features associated with the structure using a thermal sensor, wherein the UAV data includes the thermal features.

11. A property inspection system for capturing the condition of a structure, the property inspection system comprising:

an unmanned aerial vehicle (UAV); and

a computing device including:

one or more processors; and

a non-transitory computer-readable memory storing instructions thereon that, when executed by the one or more processors, cause the computing device to:

receive data collected by the UAV corresponding to points on a surface of the structure;

identify a plurality of coordinate sets associated with the UAV data, the plurality of coordinate sets each relating to vertical, horizontal, and depth distance measurements;

normalize the plurality of coordinate sets to share a common coordinate system;

generate a 3D point cloud for the structure, wherein the 3D point cloud is generated based at least in part on the received UAV data and the normalized plurality of coordinate sets; and

reconstruct a 3D model of the surface of the structure using the 3D point cloud.

12. The property inspection system of claim 11 , wherein the instructions further cause the computing device to:

analyze the 3D model of the surface of the structure to estimate a condition of the structure.

13. The property inspection system of claim 11 , wherein the instructions further cause the computing device to:

deploy the UAV to project light onto the surface of the structure and detect light reflected off the surface of the structure using a light sensor, wherein the UAV data includes visual features associated with the structure.

14. The property inspection system of claim 11 , wherein the instructions further cause the computing device to:

deploy the UAV to project an audio signal in a direction of the structure and receive an audio signal reflected off the structure using an audio sensor, wherein the UAV data includes audio features associated with the structure.

15. The property inspection system of claim 11 , wherein the instructions further cause the computing device to:

deploy the UAV to detect topographical features associated with the surface of the structure using a tactile sensor, wherein the UAV data includes the topographical features.

16. The property inspection system of claim 11 , wherein the instructions further cause the computing device to:

deploy the UAV to mechanically pull on an object associated with the surface of the structure and to detect a resistive force of the object, wherein the UAV data includes the resistive force of the object.

17. The property inspection system of claim 11 , wherein the instructions further cause the computing device to:

deploy the UAV to spray a chemical onto the surface of the structure and detect a presence of the chemical on the structure using a chemical sensor, wherein the UAV data includes topographical features associated with the surface of the structure based on the presence of the chemical on the structure.

18. The property inspection system of claim 11 , wherein the instructions further cause the computing device to:

deploy the UAV to capture thermal images of the structure to detect thermal features associated with the structure using a thermal sensor, wherein the UAV data includes the thermal features.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2020
From: FREEMAN, JAMES M.; SCHMIDGALL, ROGER D.; BOYER, PATRICK H.; CHRISTOPULOS, NICHOLAS U.; MAURER, JONATHAN D.; TOFTE, NATHAN L.; JORDAN, JACKIE O., II
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 052437/0673 →
Continuity (5)
Continuation 15975836 · May 10, 2018
Continuation 14958147 · Dec 14, 2015
Continuation 14496802 · Sep 25, 2014
Continuation 13836695 · Mar 15, 2013
Related Publication 20200387940A1 · Dec 10, 2020