IP Library Granted Patent US 10,977,846
Granted Patent B2
US 10,977,846 · App. 16/233,485 · Granted Apr 13, 2021

Aerial vehicle map determination

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,977,846
App. No.
16/233,485
Granted
Apr 13, 2021
Kind
B2
Abstract

A mapping system receives sensor data from an unmanned aerial vehicle. The mapping system further receives images from a camera of the unmanned aerial vehicle. The mapping system determines an altitude of the camera based on the sensor data. The mapping system calculates a footprint of the camera based on the altitude of the camera and a field of view of the camera. The mapping system constructs a localized map based on the images and the footprint of the camera.

Claims (42)

1. A method comprising:

determining information associated with a camera of an aerial vehicle, the information including a length of a footprint of the camera and a width of the footprint of the camera, the length of the footprint being based on a horizontal component of a field of view (FOV) and an altitude of the camera and the width of the footprint being based on a vertical component of the field of view (FOV) and the altitude of the camera;

determining a localized map based on the information associated with the camera; and

overlaying the localized map on a vector map.

2. The method of claim 1 , wherein the vector map includes at least one of a road network, railroad network, airport, elevation contour, coastline, boundary, or index of geographical names.

3. The method of claim 1 , wherein determining information associated with the camera of the aerial vehicle comprises:

receiving sensor data from the aerial vehicle;

determining the altitude of the camera based on the sensor data;

determining the information associated with the camera based on the altitude of the camera and the FOV of the camera; and

determining the footprint of the camera based on the information associated with the camera.

4. The method of claim 3 , wherein determining the localized map based on the information associated with the camera comprises:

receiving images from the camera; and

determining the localized map based on the images and the footprint of the camera.

5. The method of claim 4 , further comprising:

de-warping the images.

6. The method of claim 5 , wherein de-warping the images comprises at least one of distortion correction or chromatic aberration correction.

7. The method of claim 4 , further comprising:

determining a position of the camera relative to an initial position of the camera, wherein the initial position is associated with the sensor data and the images.

8. The method of claim 3 , wherein the sensor data comprises any of global positioning system (GPS) data and barometric data.

9. A system comprising:

an aerial vehicle including a camera, a processor, and a memory, the memory including instructions that when executed cause the processor to:

determine information associated with the camera, the information including a length of a footprint of the camera and a width of the footprint of the camera, the length of the footprint being based on a horizontal component of a field of view (FOV) and an altitude of the camera and the width of the footprint being based on a vertical component of the field of view (FOV) and the altitude of the camera;

determine a localized map based on the information associated with the camera; and

overlay the localized map on a vector map, the vector map including geographical information.

10. The system of claim 9 , wherein the vector map further includes at least one of a road network, railroad network, airport, elevation contour, coastline, boundary, or index of geographical name.

11. The system of claim 9 , wherein to determine information associated with the camera of the aerial vehicle comprises to:

receive sensor data from the aerial vehicle;

determine the altitude of the camera based on the sensor data;

determine the information associated with the camera based on the altitude of the camera and the FOV of the camera; and

determine the footprint of the camera based on the information associated with the camera.

12. The system of claim 11 , wherein to determine the localized map based on the information associated with the camera comprises to:

receive images from the camera; and

determine the localized map based on the images and the footprint of the camera.

13. The system of claim 12 , further causing the processor to:

de-warp the images.

14. The system of claim 13 , wherein to de-warp the images comprises at least one of distortion correction or chromatic aberration correction.

15. The system of claim 12 , further causing the processor to:

determine a position of the camera relative to an initial position of the camera, wherein the initial position is associated with the sensor data and the images.

16. A non-transitory computer-readable storage medium comprising stored instructions that, when executed, causes at least one processor to:

determine information associated with a camera of an aerial vehicle, the information including a length of a footprint of the camera and a width of the footprint of the camera, the length of the footprint being based on a horizontal component of a field of view (FOV) and an altitude of the camera and the width of the footprint being based on a vertical component of the field of view (FOV) and the altitude of the camera;

determine a localized map based on the information associated with the camera; and

overlay the localized map on a vector map, the vector map including at least one of a road network, railroad network, airport, elevation contour, coastline, boundary, or index of geographical name.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: GOPRO, INC.
To: SKYDIO, INC.
Reel/Frame 069083/0355 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2019
From: ENKE, JOSEPH ANTHONY
To: GOPRO, INC.
Reel/Frame 048556/0338 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →