IP Library Granted Patent US 12,468,039
Granted Patent B2
US 12,468,039 · App. 18/212,568 · Granted Nov 11, 2025

Robust laser scanning for generating a 3D model

Inventors: Nathan L. Tofte (Downs, IL); Patrick H. Boyer (Bloomington, IL); James M. Freeman (Normal, IL)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
G01S17/89G01S7/003G01S7/4808G01S7/4817G01S7/4972G01S17/10G01S17/42G01S17/66G01S17/88B64U2101/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,468,039
App. No.
18/212,568
Granted
Nov 11, 2025
Kind
B2
Abstract

In a method and system for scanning a structure, a structure scanner may acquire multiple scans of a surface of a structure. Each of the scans may correspond to different portions of the surface. The property inspection system may generate a 3D model of the surface using the scans. To account for potential changes in position and/or orientation of the structure scanner between scans, the structure scanner may self-calibrate using a fiducial marker. By correcting for changes in position and orientation over time, the structure scanner may accurately map the scans of the different portions of the surface to a 3D model of the surface.

Claims (47)

1 . A computer-implemented method for inspecting a structure, the method comprising:

scanning, by a laser tracking device, a three-dimensional (3D) biodegradable fiducial marker located on a structure, the 3D biodegradable fiducial marker having unique 3D surface features;

scanning, by a laser scanning device, a surface of the structure;

transmitting, via a communication link to a base station, the scan of the 3D biodegradable fiducial marker and the scan of the surface of the structure;

estimating, by one or more processors at the base station, a position and orientation of the laser tracking device relative to the 3D biodegradable fiducial marker based upon the scan of the 3D biodegradable fiducial marker;

generating, by the one or more processors, 3D data points based upon the scan of the surface of the structure;

adjusting, by the one or more processors, the 3D data points based upon the position and orientation of the laser tracking device relative to the 3D biodegradable fiducial marker;

constructing, by the one or more processors, a 3D model of the surface of the structure based upon the adjusted 3D data points; and

generating, by the one or more processors, an estimate of a condition of the structure based upon an analysis of the 3D model of the structure.

2 . The computer-implemented method of claim 1 , wherein the laser scanning device is configured to:

(a) transmit, via a transmitter, a plurality of laser pulses from a transmitter;

(b) receive, via a receiver, a plurality of reflected laser pulses from the surface of the structure; and

(c) measure, via a timer, a time-of-flight based on the received pulses, wherein the time-of-flight measurement is used to determine one or more distances from the laser scanning device to one or more points on the surface.

3 . The computer-implemented method of claim 1 , wherein the condition of the structure comprises at least one of a divot in a roof of the structure, an imperfection on the surface of the structure, a broken roof tile of the structure, and moisture damage to the structure.

4 . The computer-implemented method of claim 1 , wherein the laser tracking device and the laser scanning device are included in a structure scanner mounted to a flying device.

5 . The computer-implemented method of claim 4 , wherein the structure scanner is communicatively coupled to the base station via a tether.

6 . The computer-implemented method of 4 , wherein the structure scanner is configured to continuously self-calibrate.

7 . The computer-implemented method of claim 1 , wherein the structure comprises at least one of a residential structure, a commercial structure, an industrial structure, an agricultural structure, and an educational structure.

8 . A property inspection system for inspecting a structure, comprising:

a three-dimensional (3D) biodegradable fiducial marker at a location on the surface of the structure, the 3D biodegradable fiducial marker having unique 3D surface features;

a laser tracking device configured to scan the 3D biodegradable fiducial marker;

a laser scanning device configured to scan a surface of the structure; and

a base station communicatively coupled to the laser scanning device and the laser tracking device, including one or more processors configured to:

(a) receive the scan of the 3D biodegradable fiducial marker and the scan of the surface of the structure;

(b) estimate a position and orientation of the laser tracking device relative to the 3D biodegradable fiducial marker based upon the scan of the 3D biodegradable fiducial marker;

(c) generate 3D data points based upon the scan of the surface of the structure;

(d) adjust the 3D data points based upon the position and orientation of the laser tracking device relative to the 3D biodegradable fiducial marker;

(e) construct a 3D model of the surface of the structure based upon the adjusted 3D data points; and

(f) generate an estimate of a condition of the structure based upon an analysis of the 3D model of the structure.

9 . The property inspection system of claim 8 , wherein the laser scanning tracking device is further configured to:

(a) transmit, via a transmitter, a plurality of laser pulses from a transmitter;

(b) receive, via a receiver, a plurality of reflected laser pulses from the surface of the structure; and

(c) measure, via a timer, a time-of-flight based on the received pulses, wherein the time- of-flight measurement determines one or more distances from the laser scanning device to one or more points on the surface.

10 . The property inspection system of claim 8 , wherein the condition of the structure comprises at least one of a divot in a roof of the structure, an imperfection on the surface of the structure, a broken roof tile of the structure, and moisture damage to the structure.

11 . The property inspection system of claim 8 , wherein the laser tracking device and the laser scanning device are included in a structure scanner mounted to a flying device.

12 . The property inspection system of claim 11 , wherein the structure scanner is communicatively coupled to the base station via a tether.

13 . The property inspection system of claim 11 , wherein the structure scanner is configured to continuously self-calibrate.

14 . The property inspection system of claim 8 , wherein the structure comprises at least one of a residential structure, a commercial structure, an industrial structure, an agricultural structure, and an educational structure.

15 . A non-transitory computer-readable storage medium configured to store computer-readable instructions for inspecting a structure using a laser tracking device configured to scan a three dimensional (3D) biodegradable fiducial marker having unique 3D surface features located on a surface of the structure and a laser scanning device configured to scan a surface of the structure, wherein the instructions when executed by one or more processors of a base station communicatively coupled to the laser tracking device and the laser scanning device, cause the one or more processors to:

receive the scan of the 3D biodegradable fiducial marker and the scan of the surface of the structure;

estimate a position and orientation of the laser tracking device relative to the 3D biodegradable fiducial marker based upon the scan of the 3D biodegradable fiducial marker;

generate 3D data points based upon the scan of the surface of the structure;

adjust the 3D data points based upon the position and orientation of the laser tracking device relative to the 3D biodegradable fiducial marker;

construct a 3D model of the surface of the structure based upon the adjusted 3D data points; and

generate an estimate of a condition of the structure based upon an analysis of the 3D model of the structure.

16 . The computer-readable storage medium of claim 15 , wherein the laser tracking device and the laser scanning device are included in a structure scanner mounted to a flying device.

17 . The computer-readable storage medium of claim 15 , wherein the condition of the structure comprises at least one of a divot in a roof of the structure, an imperfection on the surface of the structure, a broken roof tile of the structure, and moisture damage to the structure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2023
From: TOFTE, NATHAN L.; BOYER, PATRICK H.; FREEMAN, JAMES M.
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 064043/0413 →
Continuity (3)
Continuation 16852731 · Apr 20, 2020
Continuation 15598071 · May 17, 2017
Related Publication 20230350067A1 · Nov 2, 2023
References Cited (17)
US 10311302B2 · Kottenstette et al. · 2019 [cited by applicant]
US 10366288B1 · Kottenstette et al. · 2019 [cited by applicant]
US 10643072B2 · Kottenstette et al. · 2020 [cited by applicant]
US 11151378B2 · Kottenstette et al. · 2021 [cited by applicant]
US 11210552B2 · Kossyk et al. · 2021 [cited by applicant]
US 11222426B2 · Richter et al. · 2022 [cited by applicant]
US 11232150B2 · Vianello et al. · 2022 [cited by applicant]
US 11367265B2 · Vianello et al. · 2022 [cited by applicant]
US 20090268214A1 · Lucic et al. · 2009 [cited by applicant]
US 20100079974A1 · Kruger et al. · 2010 [cited by applicant]
US 20130233964A1 · Woodworth · 2013 [cited by examiner]
US 20130249907A1 · Humphries et al. · 2013 [cited by applicant]
US 20180176483A1 · Knorr et al. · 2018 [cited by applicant]
Hirose, Mitsuhito, et al. “Implementation of UAV localization methods for a mobile post-earthquake monitoring system.” 2015 IEEE workshop on environmental, energy, and structural monitoring systems (EESMS) proceedings. … [cited by examiner]
“Low-cost 3d Laser Scanner and fast Surface Registration,” http://www.rob.cs.tu-bs.de/en/news/david, retrieved Dec. 25, 2015. [cited by applicant]
“3D Scanning 101—Desktop Engineering,” http://www.deskeng.com/de/3d-scanning-101, retrieved on Dec. 25, 2015. [cited by applicant]
Office Action for U.S. Appl. No. 16/852,731 dated Dec. 12, 2022. [cited by applicant]