IP Library › Granted Patent US 11,928,813
Granted Patent B2
US 11,928,813 · App. 17/993,908 · Granted Mar 12, 2024

Method and system for detecting change to structure by using drone

Inventors: Joo Ho Shin (Anyang-si, KR); Seung Hee Park (Seongnam-si, KR)
Assignee: SMARTINSIDE AI INC.
G06T7/001B64C39/024G06T7/73G06V10/761G06V20/17G06V20/176B64U2101/30B64U2201/10G06T2207/10032G06T2207/20081G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,928,813
App. No.
17/993,908
Granted
Mar 12, 2024
Kind
B2
Abstract

Disclosed herein is a method for an image analysis server to detect a change to a structure by using a drone. The method for an image analysis server to detect a change to a structure by using a drone includes: receiving images of a specific inspection target structure taken at different time points by a drone; detecting the difference between an image taken at a first time point and an image taken at a second time point based on the received images; and detecting a change to the inspection target structure via the detected difference, and generating a risk signal and then transmitting it to an administrator terminal.

Claims (17)

1. A method for an image analysis server to detect a change to a structure by using a drone, the method comprising:

receiving a first image of the structure taken at a first time and a second image of the structure taken at a second time by a drone;

acquiring a first feature map for the first image and a second feature map for the second image using a machine learning algorithm;

detecting a difference between a first feature of the first feature map and a second feature of the second feature map;

predicting a risk of the structure based on the detected difference using a recurrent neural network; and

measuring an area of an actual structure in which the change is detected based on the first feature map and the second feature map,

wherein detecting the difference comprises,

determining a relative size of the area of the structure in which the change is detected in the second feature map with a same angle view of the first feature map with respect to a total area of the structure in the first feature map, and

determining a risk level of the structure by comparing the area of the structure where the change is detected with a preset value,

wherein measuring the area of the actual structure comprises,

calculating a ratio between a first distance between feature points in the second feature map of the structure and a second distance between feature points in the actual structure, and

calculating the area of the actual structure by applying the ratio to a change region within the second feature map of the structure,

wherein the recurrent neural network comprises a long short-term memory algorithm generating a new image capable of predicting the change of the structure over time.

2. The method of claim 1 , wherein the second time comprises a plurality of time points, and the second image of the structure comprises a plurality of images taken corresponding to each of the plurality of the time points,

wherein the new image is generated based on the plurality of images using the long short-term memory algorithm.

3. The method of claim 2 , wherein an interval of time between the plurality of the time points is constant.

4. The method of claim 1 , wherein the risk level comprises a first risk level defined when a change region value per unit time in the area of the structure is greater than or equal to a first preset value and less than a preset second value, and a second risk level defined when the change region value per unit time in the area of the structure is greater than or equal to the preset second value and less than a third preset value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2024
From: SHIN, JOO HO; PARK, SEUNG HEE
To: SMARTINSIDE AI INC.
Reel/Frame 066087/0270 →
Continuity (2)
Continuation 17687579 · Mar 4, 2022
Related Publication 20230222647A1 · Jul 13, 2023
Cited By (1)
US 12,266,169