IP Library Granted Patent US 10,762,795
Granted Patent B2
US 10,762,795 · App. 15/088,042 · Granted Sep 1, 2020

Unmanned aerial vehicle privacy controls

Inventors: Dana Livonia Contreras (San Francisco, CA); Lucas Palage Doyle (San Francisco, CA); Justin Eugene Kuehn (San Francisco, CA); Volkan Gurel (San Francisco, CA); Eric David Johnson (Walnut Creek, CA); Edward Dale Steakley (Cupertino, CA)
Assignee: Skydio, Inc.
G08G5/006B64C39/024B64D47/08G01C21/00G05D1/0033G05D1/0061G05D1/0094G05D1/0274G06K9/00201G06T5/002G08G5/0069B64C2201/127G01S19/13G06K2209/27G06T2207/10016G06T2207/10032G06T2207/20012G06T2207/30232G06T2207/30244H04B7/18506H04W4/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,762,795
App. No.
15/088,042
Granted
Sep 1, 2020
Kind
B2
Abstract

Disclosed in this specification are methods, systems and apparatus, including computer programs encoded on non-transitory computer storage media for unmanned aerial vehicle (UAV) flight operation and privacy controls. Based on geofence types, and UAV distance from a geofence, sensors and other devices connected to a UAV are conditionally operational. Image data collected during a UAV flight may be obfuscated by the UAV while in flight, or via a post-flight process using log data generated by the UAV.

Claims (76)

1. An unmanned aerial vehicle (UAV) flight processing system, comprising:

one or more processors operable to:

navigate the UAV within a geofence, the geofence being a geospatial boundary in which flight operations of the UAV are performed;

obtain a digital image captured with a camera of the UAV during flight operations within the geofence, wherein the digital image is a single image or a frame from a digital video;

determine that a portion of the digital image includes at least a portion of an object located outside of the geofence, the determining comprising:

projecting the digital image onto a geospatial coordinate system; and

determining in reference to the geospatial coordinate system that the portion of the digital image falls outside a geospatial boundary of the geofence; and

obfuscate the portion of the digital image located outside the geofence.

2. The system of claim 1 , wherein the portion of the digital image is obfuscated while the UAV is navigating within the geofence.

3. The system of claim 1 , wherein the portion of the digital image is obfuscated by image blurring.

4. The system of claim 1 , wherein the portion of the digital image is obfuscated by adjusting one or more camera parameters prior to capturing the digital image.

5. The system of claim 1 , wherein the portion of the digital image is obfuscated by removing pixels of the portion of the digital image.

6. The system of claim 1 , wherein the portion of the digital image is obfuscated by adjusting one or more characteristics of pixels of the portion of the digital image.

7. The system of claim 1 , wherein the one or more processors are further operable to:

determine a percentage of the digital image that comprises the portion of the digital image outside the geofence; and

delete or destroy the entire digital image if the percentage exceeds a threshold value.

8. The system of claim 1 , where obfuscating the portion of the digital image further comprises:

recognizing an object in the portion of the digital image as being private; and

obfuscating the object.

9. A method comprising:

navigating, by one or more processors of a flight processing system, an unmanned aerial vehicle (UAV) within a geofence, the geofence being a geospatial boundary in which flight operations of the UAV are performed;

capturing during flight operations within the geofence, by a camera of the UAV, a digital image, wherein the digital image is a single image or a frame from a digital video;

determining, by the one or more processors, that a portion of the digital image includes at least a portion of an object located outside the geofence, the determining comprising:

projecting the digital image onto a geospatial coordinate system; and

determining in reference to the geospatial coordinate system that the portion of the digital image falls outside a geospatial boundary of the geofence; and

obfuscating the portion of the digital image located outside the geofence.

10. The method of claim 9 , wherein the portion of the digital image is obfuscated on the UAV while the UAV is navigating within the geofence.

11. The method of claim 9 , wherein the portion of the digital image is obfuscated by image blurring.

12. The method of claim 9 , wherein the portion of the digital image is obfuscated by adjusting one or more camera parameters prior to capturing the digital image.

13. The method of claim 9 , wherein the portion of the digital image is obfuscated by removing pixels of the digital image.

14. The method of claim 9 , wherein the portion of the digital image is obfuscated by adjusting one or more characteristics of pixels in the portion of the digital image.

15. The method of claim 9 , wherein the one or more processors are further operable to:

determine a percentage of the digital image that comprises the portion of the digital image outside the geofence; and

delete or destroy the entire digital image if the percentage exceeds a threshold value.

16. The method of claim 9 , where obfuscating the portion of the digital image further comprises:

recognizing an object in the portion of the digital image as being private; and

obfuscating the object.

17. A processing system, comprising:

receiving, one or more digital images, obtained by an unmanned aerial vehicle (UAV) during flight operations of the UAV within a geofence, the geofence being a geospatial boundary in which flight operations of the UAV were performed;

receiving UAV flight log data from the UAV comprising geospatial locations of where the one or more images where taken;

determining, by the one or more processors, that a portion of a digital image includes at least a portion of an object located outside of a geofence, the determining comprising:

projecting the digital image onto a geospatial coordinate system; and

determining in reference to the geospatial coordinate system that the portion of the digital image falls outside a geospatial boundary of the geofence; and

obfuscating the portion of the digital image located outside the geofence.

18. The system of claim 17 , wherein the portion of the digital image is obfuscated by removing pixels of the digital image.

19. The system of claim 17 , wherein the one or more processors are further operable to:

determine a percentage of the digital image that comprises the portion of the digital image outside the geofence; and

delete or destroy the entire digital image if the percentage exceeds a threshold value.

20. The method of claim 17 , where obfuscating the portion of the digital image further comprises:

recognizing an object in the portion of the digital image as being private; and

obfuscating the object.

21. The system of claim 17 , wherein the portion of the digital image is obfuscated by adjusting one or more characteristics of pixels in the portion of the digital image.

22. A method implemented by a computer system comprising one or more processors, the method comprising:

receiving, one or more digital images, obtained by an unmanned aerial vehicle (UAV) during flight operations of the UAV;

receiving UAV flight log data obtained from the UAV comprising geospatial locations of where the one or more images where taken;

determining, by the one or more processors, that a portion of a digital image includes at least a portion of an object located outside of a geofence, the geofence being a geospatial boundary in which flight operations of the UAV are performed, the determining comprising:

projecting the digital image onto a geospatial coordinate system; and

determining in reference to the geospatial coordinate system that the portion of the digital image falls outside a geospatial boundary of the geofence; and

obfuscating the portion of the digital image located outside the geofence.

23. The method of claim 22 , wherein the portion of the digital image is obfuscated by removing pixels of the digital image.

24. The method of claim 22 , wherein the one or more processors are further operable to:

determine a percentage of the digital image that comprises the portion of the digital image outside the geofence; and

delete or destroy the entire digital image if the percentage exceeds a threshold value.

25. The method of claim 22 , where obfuscating the portion of the digital image further comprises:

recognizing an object in the portion of the digital image as being private; and

obfuscating the object.

26. The method of claim 22 , wherein the portion of the digital image is obfuscated by adjusting one or more characteristics of pixels in the portion of the digital image.

27. The flight processing system of claim 1 , wherein determining a portion of the object is located outside of the geofence comprises:

displaying in a user interface a representation of the geofence; and

determining that the portion includes pixels located outside of the geofence.

28. The method of claim 9 , wherein determining a portion of the object is located outside of the geofence comprises:

projecting the digital image onto a geospatial coordinate system; and

determining in reference to the geospatial coordinate system that the portion of the digital image falls outside of the geospatial boundary of the geofence.

29. The method of claim 9 , wherein determining a portion of the object is located outside of the geofence comprises:

displaying in a user interface a representation of the geofence; and

determining that the portion includes pixels located outside of the geofence.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: HERCULES CAPITAL, INC.
To: SKYDIO, INC.
Reel/Frame 072128/0698 →
RELEASE OF SECURITY INTEREST Recorded Jul 21, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: SKYDIO, INC.
Reel/Frame 072107/0066 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Nov 9, 2021
From: SKYDIO, INC.
To: HERCULES CAPITAL, INC., AS COLLATERAL AND ADMINISTRATIVE AGENT
Reel/Frame 058081/0677 →
SECURITY INTEREST Recorded Nov 8, 2021
From: SKYDIO, INC.
To: SILICON VALLEY BANK
Reel/Frame 058053/0768 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CONVEYING PARTY DATA WAS ERRONEOUSLY ENTER AS UNMMANED INNOVATIONS, INC. IT SHOULD READ UNMANNED INNOVATIONS, INC PREVIOUSLY RECORDED AT REEL: 053144 FRAME: 0591. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jul 15, 2020
From: UNMANNED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053210/0586 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: AIRWARE, LLC
To: SKYDIO, INC.
Reel/Frame 053144/0633 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: UNMMANED INNOVATION, INC.
To: AIRWARE, LLC
Reel/Frame 053144/0591 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2016
From: CONTRERAS, DANA LIVONIA; DOYLE, LUCAS PALAGE; KUEHN, JUSTIN EUGENE; GUREL, VOLKAN; JOHNSON, ERIC DAVID; STEAKLEY, EDWARD DALE
To: UNMANNED INNOVATION INC.
Reel/Frame 038166/0570 →
Cited By (3)
US 12,254,779 US 12,400,552 US 12,656,772