IP Library Granted Patent US 10,198,841
Granted Patent B2
US 10,198,841 · App. 15/365,697 · Granted Feb 5, 2019

Map view

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,198,841
App. No.
15/365,697
Granted
Feb 5, 2019
Kind
B2
Abstract

A mapping system receives sensor data from an unmanned aerial vehicle. The mapping system further receives images from a camera of the unmanned aerial vehicle. The mapping system determines an altitude of the camera based on the sensor data. The mapping system calculates a footprint of the camera based on the altitude of the camera and a field of view of the camera. The mapping system constructs a localized map based on the images and the footprint of the camera.

Claims (34)

1. A computer implemented method comprising:

receiving sensor data from an unmanned aerial vehicle;

receiving images from a camera on the unmanned aerial vehicle;

determining an altitude of the camera based on the sensor data;

calculating a footprint of the camera based on the altitude of the camera and a field of view (FOV) of the camera;

constructing a localized map based on the images and the footprint of the camera; and

overlaying the localized map on a vector map, the vector map including any of road networks, railroad networks, airports, elevation contours, coastlines, boundaries, and index of geographical names.

2. The computer implemented method of claim 1 , wherein the sensor data comprises global positioning system data and barometric data.

3. The computer implemented method of claim 1 , wherein the altitude of the camera is a distance between the camera and a surface of earth.

4. The computer implemented method of claim 1 , wherein the FOV of the camera is an extent of the earth captured by the camera.

5. The computer implemented method of claim 1 , wherein the FOV of the camera comprises a horizontal component and a vertical component.

6. The computer implemented method of claim 5 , wherein determining the footprint of the camera comprises:

determining a length of the footprint of the camera based on the horizontal component of the FOV of the camera and the altitude of the camera; and

determining a width of the footprint of the camera based on the vertical component of the FOV of the camera and the altitude of the camera.

7. The computer implemented method of claim 1 , further comprising de-warping the images.

8. The computer implemented method of claim 7 , wherein de-warping the images comprises at least one of distortion correction and chromatic aberration correction.

9. The computer implemented method of claim 1 , further comprising determining a position of the camera relative to an initial position of the camera, wherein the initial position is associated with the sensor data used to determine the altitude of the camera and the images used to construct the localized map.

10. A non-transitory computer-readable storage medium comprising stored instructions, the instructions that, when executed, causes at least one processor to:

receive sensor data from an unmanned aerial vehicle;

receive images from a camera on the unmanned aerial vehicle;

determine an altitude of the camera based on the sensor data;

calculate a footprint of the camera based on the altitude of the camera and a field of view (FOV) of the camera;

construct a localized map based on the images and the footprint of the camera; and

overlay the localized map on a vector map, the vector map including any of road networks, railroad networks, airports, elevation contours, coastlines, boundaries, and index of geographical names.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the sensor data comprises global positioning system data and barometric data.

12. The non-transitory computer-readable storage medium of claim 10 , wherein the altitude of the camera is a distance between the camera and a surface of earth.

13. The non-transitory computer-readable storage medium of claim 10 , wherein the FOV of the camera is an extent of the earth captured by the camera.

14. The non-transitory computer-readable storage medium of claim 10 , wherein the FOV of the camera comprises a horizontal component and a vertical component.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the instructions to calculate the footprint of the camera further comprises instructions that, when executed, causes the processor to:

determine a length of the footprint of the camera based on the horizontal component of the FOV of the camera and the altitude of the camera; and

determine a width of the footprint of the camera based on the vertical component of the FOV of the camera and the altitude of the camera.

16. The non-transitory computer-readable storage medium of claim 10 , further comprising instructions that, when executed, causes the processor to de-warp the images.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions to de-warp the images further comprises instructions that, when executed, cause the processor to at least one of correct distortion and correct chromatic aberration.

18. The non-transitory computer-readable storage medium of claim 10 , further comprising instructions that, when executed, causes the processor to determine a position of the camera relative to an initial position of the camera, wherein the initial position is associated with the sensor data used to determine the altitude of the camera and the images used to construct the localized map.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2024
From: GOPRO, INC.
To: SKYDIO, INC.
Reel/Frame 069083/0355 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Jun 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 049454/0352 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2016
From: ENKE, JOSEPH ANTHONY
To: GOPRO, INC.
Reel/Frame 040776/0076 →