IP Library Granted Patent US 12,260,513
Granted Patent B2
US 12,260,513 · App. 18/221,569 · Granted Mar 25, 2025

Voronoi cropping of images for post field generation

Inventor: Quentin Lindsey (Canoga Park, CA)
Assignee: AeroVironment, Inc.
G06T3/4038G06T5/50G06T7/11G06T7/174B64U10/20B64U2101/32B64U2101/40B64U2201/10G06T2207/10032G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,513
App. No.
18/221,569
Granted
Mar 25, 2025
Kind
B2
Abstract

A method and system including: defining a geographic area; receiving a plurality of images; determining a plurality of image points; partitioning the geographic area into a plurality of image regions based on the plurality of image points; and stitching the plurality of images into a combined image based on the plurality of image regions.

Claims (53)

1. A method comprising:

receiving a plurality of images of a geographic area, wherein a portion of each received image is within the geographic area, and wherein at least two of the received plurality of images overlap within the geographic area;

determining a set of images from the received plurality of images for further processing by selecting at least one image of the plurality of images capturing an overlapping geographic area to be used;

determining a plurality of image points, wherein each image point is a geographic location of a center field of view of each image of the determined set of images;

partitioning the geographic area into a plurality of image regions based on the determined plurality of image points; and

generating a combined image by stitching the partitioned geographic area of the determined set of images into the combined image.

2. The method of claim 1 , wherein the selecting is based on whether the image falls within a set criteria and a desired overlap remains above a set amount.

3. The method of claim 1 further comprising:

defining a geographic area, wherein the geographic area comprises an area to be imaged.

4. The method of claim 1 , wherein each received image includes geographical coordinates of the portion of the geographic area, and wherein the geographical coordinates of at least two of the received plurality of images overlap within the geographic area.

5. The method of claim 1 , wherein generating the combined image is further based on the plurality of image regions and the geographical coordinates of each image of the determined set of images.

6. The method of claim 1 , wherein partitioning the geographic area into the plurality of image regions further comprises:

generating a Voronoi diagram.

7. The method of claim 1 further comprising:

capturing the plurality of images by an aerial vehicle.

8. The method of claim 7 , wherein the aerial vehicle is a vertical takeoff and landing (VTOL) unmanned aerial vehicle (UAV).

9. The method of claim 1 further comprising:

filtering one or more images of the received plurality of images, wherein filtering the one or more images further comprises: removing the one or more images due to at least one of: overexposure, underexposure, distortion, blur, and an error with a camera taking the image.

10. The method of claim 1 further comprising:

applying one or more image enhancements to one or more images of the received plurality of images, wherein applying image enhancements to the one or more images comprises at least one of: brightening, darkening, color correcting, white balancing, sharpening, correcting lens distortion, and adjusting contrast.

11. A system comprising:

an unmanned aerial vehicle (UAV) comprising a processor having addressable memory, wherein the processor is configured to:

receive a plurality of images of a geographic area, wherein a portion of each received image is within the geographic area, and wherein at least two of the received plurality of images overlap within the geographic area;

determine a set of images from the received plurality of images for further processing by selecting at least one image of the plurality of images capturing an overlapping geographic area to be used;

determine a plurality of image points, wherein each image point is a geographic location of a center field of view of each image of the determined set of images;

partition the geographic area into a plurality of image regions based on the determined plurality of image points; and

generate a combined image by stitching the partitioned geographic area of the determined set of images into the combined image.

12. The system of claim 11 , wherein the selecting is based on whether the image falls within a set criteria and a desired overlap remains above a set amount.

13. The system of claim 11 further comprising:

a sensor in communication with the processor, the sensor configured to capture the plurality of images.

14. The system of claim 11 further comprising:

a global positioning system (GPS) in communication with the processor, wherein the processor uses the GPS to determine the geographic location of each image point of the plurality of image points.

15. The system of claim 11 further comprising:

a controller comprising:

a processor having addressable memory, wherein the processor is configured to:

define the geographic area;

send the geographic area to the UAV; and

receive the combined image from the UAV;

a computing device comprising a processor and addressable memory, wherein the processor is configured to:

receive the combined image from at least one of: the UAV and the controller; and

analyze the combined image.

16. The system of claim 15 , wherein the processor of the computing device is further configured to:

filter one or more images of the received plurality of images, wherein filtering the one or more images further comprises: removing the one or more images due to at least one of: overexposure, underexposure, distortion, blur, and an error with a camera taking the image.

17. The system of claim 15 , wherein the processor of the computing device is further configured to:

apply one or more image enhancements to one or more images of the received plurality of images, wherein applying image enhancements to the one or more images comprises at least one of: brightening, darkening, color correcting, white balancing, sharpening, correcting lens distortion, and adjusting contrast.

18. The system of claim 15 , wherein the processor of the computing device is further configured to:

receive the plurality of images; and

stitch the plurality of images into a high resolution combined image based on the plurality of image regions, wherein each pixel in the combined image is selected from its corresponding image region.

19. The system of claim 15 , wherein the processor of the computing device is further configured to smooth the combined image to account for at least one of: brightness, color, dead pixels, and lens distortion.

20. The system of claim 11 , wherein the processor is further configured to:

receive a geographic area, wherein the geographic area comprises an area to be imaged;

wherein each image of the plurality of images includes geographical coordinates of a corresponding region of the geographic area; and

wherein generating the combined image is further based on the plurality of image regions and the geographical coordinates of each image of the determined set of images.

Assignments (2)
SECURITY INTEREST Recorded Oct 4, 2024
From: AEROVIRONMENT, INC.
To: BANK OF AMERICA, N.A., AS THE ADMINISTRATIVE AGENT
Reel/Frame 069113/0683 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2023
From: LINDSEY, QUENTIN
To: AEROVIRONMENT, INC.
Reel/Frame 064244/0127 →
Continuity (4)
Continuation 17465128 · Sep 2, 2021
Continuation 16258034 · Jan 25, 2019
Provisional Application 62622654 · Jan 26, 2018
Related Publication 20230360171A1 · Nov 9, 2023
References Cited (26)
US 6392647B1 · Migdal et al. · 2002 [cited by applicant]
US 10140651B1 · Mishra · 2018 [cited by applicant]
US 11138706B2 · Lindsey · 2021 [cited by examiner]
US 11741571B2 · Lindsey · 2023 [cited by examiner]
US 20020008697A1 · Deering · 2002 [cited by applicant]
US 20050190991A1 · McCleese · 2005 [cited by applicant]
US 20070116357A1 · Dewaele · 2007 [cited by applicant]
US 20080298718A1 · Liu et al. · 2008 [cited by applicant]
US 20120050525A1 · Rinner et al. · 2012 [cited by applicant]
US 20130317667A1 · Kruglick · 2013 [cited by applicant]
US 20130335506A1 · Carter et al. · 2013 [cited by applicant]
US 20150192705A1 · Nimura · 2015 [cited by applicant]
US 20160088285A1 · Sadi et al. · 2016 [cited by applicant]
US 20160088287A1 · Sadi et al. · 2016 [cited by applicant]
US 20160217582A1 · Sasaki et al. · 2016 [cited by applicant]
US 20170032524A1 · Dickrell, III et al. · 2017 [cited by applicant]
US 20170094098A1 · Manda · 2017 [cited by applicant]
US 20170124745A1 · Christ et al. · 2017 [cited by applicant]
US 20170346993A1 · Manda · 2017 [cited by applicant]
US 20180373931A1 · Li · 2018 [cited by applicant]
US 20190102897A1 · Lewis et al. · 2019 [cited by applicant]
US 20190130228A1 · Fu et al. · 2019 [cited by applicant]
US 20190158011A1 · West et al. · 2019 [cited by applicant]
International Search Report and Written Opinion for PCT/US19/15207, mailed Apr. 29, 2019. [cited by applicant]
Laraqui A et al: “Image mosaicing using voronoi diagram”, Multimedia Tools and Applications, Kluwer Academic Publishers, Boston, US, vol. 76, No. 6, Apr. 12, 2016 (Apr. 12, 2016), pp. 8803-8829, XP036200501, ISSN: 1380-… [cited by applicant]
Song Mengxiao et al: “Mosaicking UAV orthoimages using bounded Voronoi diagrams and watersheds”, International Journal of Remote Sensing, vol. 39, No. 15-16, Jul. 25, 2017 (Jul. 25, 2017), pp. 4960-4979, XP055840811, GB… [cited by applicant]