IP Library Granted Patent US 9,618,934
Granted Patent B2
US 9,618,934 · App. 14/853,611 · Granted Apr 11, 2017

Unmanned aerial vehicle 3D mapping system

Inventors: Bradley G. Deroos (Fairmount, WV); Kirill Speransky (Morgantown, WV); Marcela Alexandra Mera Trujillo (Popayan, CO)
Assignee: 4D TECH SOLUTIONS, INC.
G05D1/0011B64C39/024B64D47/08G01C21/02G05D1/101G08G5/0034G08G5/0069G08G5/0086B64C2201/123
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,618,934
App. No.
14/853,611
Filed
Sep 14, 2015
Granted
Apr 11, 2017
Kind
B2
Art Unit
3661
USPC
701/2
Abstract

An automatic unmanned aerial vehicle (UAV) flight control system for 3D aerial mapping includes a UAV with an onboard camera, and a controller capable of communication with a flight control module of the UAV. The controller is configured to determine an area mapping flight path based on terrain characteristics of an area to be mapped. The controller also can determine a structure mapping flight path based on the existence and location of vertical structures within the area to be mapped. The area mapping flight path can be appended with the structure mapping flight path, thus providing an integrated and optimized UAV flight path for 3D mapping and modeling.

Claims (20)

1. A method for generating an unmanned aerial vehicle (UAV) flight plan for an area to be mapped, comprising:

identifying the area to be mapped;

identifying special regions within the area to be mapped; and

applying a rule set using a controller for generating an optimized flight plan to be implemented at a later time by a UAV, wherein the flight plan is optimized for 3D mapping and modeling.

2. The method of claim 1 , further comprising integrating flight patterns from different regions of the area to be mapped to generate an optimized flight plan for the area to be mapped.

3. The method of claim 1 , wherein applying a rule set comprises integrating rule sets for different special regions to generate an optimized flight plan for the area to be mapped.

4. The method of claim 1 , wherein the special regions comprise manmade and natural structures, water, snow, fields, vegetation, forests, fields, rivers and streams, urban areas, sparsely populated areas, stationary vehicles, power towers, communications towers, satellite tracking stations, bridges and dams, oil rigs and offshore structures, wind turbines, historical sites, and avoidance areas.

5. The method of claim 1 , wherein each special region has a rule set for the region, each of which has specific patterns, and applying the rule set comprises integrating the specific patterns into an optimal flight path.

6. An automatic unmanned aerial vehicle (UAV) flight control system for 3D aerial mapping, the system comprising: a UAV with an onboard camera; a controller capable of communication with a flight control module of the UAV, the controller configured to: determine an area mapping flight path based on terrain characteristics of an area to be mapped; determine a structure mapping flight path based on the existence and location of vertical structures within the area to be mapped; and determine an optimized flight path for the UAV by integrating the area mapping flight path and the structure mapping flight path, wherein the UAV flight path is optimized for 3D mapping and modeling of an area to be mapped, and the optimized UAV flight path is implemented at a later time by a UAV.

7. The system according to claim 6 , wherein the controller is further configured to capture images of the area to be mapped.

8. The system according to claim 6 , wherein the controller is further configured to identify an area to be mapped by selecting corner points for the area and constructing a convex hull using the corner points.

9. The system according to claim 6 , wherein the controller is further configured to determine whether there are avoidance areas within the area to be mapped.

10. The system according to claim 6 , wherein the controller is further configured to identify structures to be mapped that are located within the area to be mapped.

11. The system according to claim 6 , wherein the controller is further configured to identify locations from which images are to be captured in order to prepare a 3D map of the area to be mapped.

12. The system according to claim 6 , wherein the controller is further configured to apply an optimization algorithm to determine an optimal area mapping flight path for the UAV.

13. The system according to claim 6 , wherein the controller is further configured to integrate area mapping flight path information, structure mapping flight path, and avoidance area information to generate an optimized UAV flight plan.

14. The system according to claim 6 , wherein the controller is further configured for desired flight parameters, which include one or more of a total flight time, available UAV power, a noise limitation, or a user defined restriction.

15. The system according to claim 6 , wherein the controller is part of a remote computing device and is further configured to communicate with the flight control module of the UAV via wireless means.

16. A non-transitory computer-readable storage medium with instructions stored thereon to control a flight path of an unmanned aerial vehicle (UAV) based image capture system for 3D modeling, the instructions comprising: determining an initial movement path based on an area to be mapped, the existence of vertical structures and avoidance areas within the area to be mapped; capturing images of the area and structures to be mapped; and guiding the UAV flight path, wherein the UAV flight path is optimized for 3D mapping and modeling of an area to be mapped, and the optimized UAV flight path is implemented at a later time by a UAV.

17. The non-transitory computer-readable storage medium according to claim 16 , wherein the instructions are generated by applying an optimization algorithm.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded May 20, 2024
From: JPMORGAN CHASE BANK, N.A.
To: COGNOSANTE HOLDINGS, LLC; REDTAIL LIDAR SYSTEMS, LLC; 4D TECH SOLUTIONS, LLC
Reel/Frame 067468/0609 →
SECURITY INTEREST Recorded Apr 17, 2023
From: COGNOSANTE HOLDINGS, LLC; 4D TECH SOLUTIONS, LLC; REDTAIL LIDAR SYSTEMS, LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 063349/0952 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2022
From: 4D TECH SOLUTIONS, INC.
To: REDTAIL LIDAR SYSTEMS, LLC
Reel/Frame 059795/0566 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2016
From: DEROOS, BRADLEY G.; SPERANSKY, KIRILL; MERA TRUJILLO, MARCELA ALEXANDRA
To: 4D TECH SOLUTIONS, INC.
Reel/Frame 037399/0289 →
Continuity (2)
Provisional Application 62049622 · Sep 12, 2014
Related Publication 20160202695A1 · Jul 14, 2016