IP Library Granted Patent US 11,361,665
Granted Patent B2
US 11,361,665 · App. 17/008,344 · Granted Jun 14, 2022

Unmanned aerial vehicle privacy controls

Inventors: Dana Livonia Contreras (San Francisco, CA); Lucas Palage Doyle (San Francisco, CA); Justin Eugene Kuehn (San Francisco, CA); Volkan Gurel (San Francisco, CA); Eric David Johnson (Walnut Creek, CA); Edward Dale Steakley (Cupertino, CA)
Assignee: Skydio, Inc.
G08G5/006B64C39/024B64D47/08G01C21/00G05D1/0033G05D1/0061G05D1/0094G05D1/0274G06T5/002G06V20/64G08G5/0069H04B7/18506B64C2201/127B64C2201/141B64C2201/146G01S19/13G06T2207/10016G06T2207/10032G06T2207/20012G06T2207/30232G06T2207/30244G06V2201/10H04W4/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,361,665
App. No.
17/008,344
Granted
Jun 14, 2022
Kind
B2
Abstract

Disclosed in this specification are methods, systems and apparatus, including computer programs encoded on non-transitory computer storage media for unmanned aerial vehicle (UAV) flight operation and privacy controls. Based on geofence types, and UAV distance from a geofence, sensors and other devices connected to a UAV are conditionally operational. Image data collected during a UAV flight may be obfuscated by the UAV while in flight, or via a post-flight process using log data generated by the UAV.

Claims (38)

1. A method, comprising:

determining, in reference to a geospatial coordinate system onto which an image captured using a camera of an unmanned aerial vehicle (UAV) is projected, that a portion of the image depicts an object located outside of a geofence by:

determining an area of the geospatial coordinate system that is outside of the geofence and inside of the projection of the image, wherein a location of the object outside of the geofence corresponds to the area of the geospatial coordinate system; and

projecting the area of the geospatial coordinate system into a pixel coordinate system of the image, wherein the portion of the image corresponds to a location of the pixel coordinate system to which the area of the geospatial coordinate system is projected; and

obfuscating the portion of the image.

2. The method of claim 1 , further comprising:

projecting the image onto the geospatial coordinate system; and

overlaying the projection of the image on the geofence.

3. The method of claim 1 , wherein a location at which the image is captured is determined based on a flight path identified for the UAV.

4. The method of claim 3 , wherein camera parameters used by the camera of the UAV to capture the image are determined during a pre-flight simulation of the flight path.

5. The method of claim 1 , wherein the portion of the image is obfuscated while the UAV is in-flight.

6. The method of claim 5 , wherein the portion of the image is obfuscated using one or more camera parameters of the camera of the UAV.

7. The method of claim 1 , wherein the portion of the image is obfuscated via a post-flight process using log data generated by the UAV.

8. The method of claim 7 , wherein the log data includes one or more of an identification of a geospatial location at which the image was captured, a time at which the image was captured, a pose or position of the camera when the image was captured, or information indicative of or usable to determine a field of view of the camera relative to the geofence.

9. The method of claim 1 , further comprising:

delete or destroy the image responsive to a determination that a size of the portion of the image exceeds a threshold value.

10. A system, comprising:

one or more processors of an unmanned aerial vehicle (UAV) flight processing system, the one or more processors operable to:

obfuscate a portion of an image captured using a camera of the UAV responsive to a determination, in reference to a geospatial coordinate system onto which the image is projected, that a portion of the image depicts an object located outside of a geofence based on an area of the geospatial coordinate system falling outside of the geofence but inside of the projection of the image and based on a projection of the area of the geospatial coordinate system into a pixel coordinate system of the image,

wherein a location of the object outside of the geofence corresponds to the area of the geospatial coordinate system, and

wherein the portion of the image corresponds to a location of the pixel coordinate system to which the area of the geospatial coordinate system is projected.

11. The system of claim 10 , wherein the one or more processors are further operable to:

project the image onto the geospatial coordinate system; and

overlay the projection of the image on the geofence.

12. The system of claim 10 , wherein the portion of the image is obfuscated via a post-flight process using log data generated by the UAV.

13. The system of claim 10 , wherein the one or more processors are further operable to:

delete or destroy the image responsive to a determination that a size of the portion of the image exceeds a threshold value.

14. A system, comprising:

one or more processors of an unmanned aerial vehicle (UAV) ground control system, the one or more processors operable to:

obfuscate a portion of an image captured using a camera of the UAV responsive to a determination, in reference to a geospatial coordinate system onto which image is projected, that a portion of the image depicts an object located outside of a geofence based on an area of the geospatial coordinate system falling outside of the geofence but inside of the projection of the image and based on a projection of the area of the geospatial coordinate system into a pixel coordinate system of the image,

wherein a location of the object outside of the geofence corresponds to the area of the geospatial coordinate system,

wherein the portion of the image corresponds to a location of the pixel coordinate system to which the area of the geospatial coordinate system is projected, and

wherein the portion of the image is obfuscated while the UAV is in-flight.

15. The system of claim 14 , wherein the one or more processors are further operable to:

project the image onto the geospatial coordinate system; and

overlay the projection of the image on the geofence.

16. The system of claim 14 , wherein a location at which the image is captured is determined based on a flight path identified for the UAV.

17. The system of claim 16 , wherein camera parameters used by the camera of the UAV to capture the image are determined during a pre-flight simulation of the flight path.

Assignments (7)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: CONTRERAS, DANA LIVONIA; DOYLE, LUCAS PALAGE; KUEHN, JUSTIN EUGENE; GUREL, VOLKAN; JOHNSON, ERIC DAVID; STEAKLEY, EDWARD DALE
To: UNMANNED INNOVATION INC.
Reel/Frame 055242/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 055242/0714 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 055242/0589 →
Continuity (4)
Continuation 15088042 · Mar 31, 2016
Provisional Application 62298429 · Feb 22, 2016
Provisional Application 62292783 · Feb 8, 2016
Related Publication 20200402410A1 · Dec 24, 2020