IP Library Granted Patent US 12,372,975
Granted Patent B2
US 12,372,975 · App. 17/983,062 · Granted Jul 29, 2025

Unlocking an autonomous drone for takeoff

Inventors: Mathias Andreas Hintermann (Playa Vista, CA); Justin Huang (Los Angeles, CA); Russell Douglas Patton (Playa Vista, CA)
Assignee: Snap Inc.
G05D1/102B64U20/87G06V10/751G06V20/17G06V40/161B64U70/80B64U2101/30B64U2201/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,372,975
App. No.
17/983,062
Granted
Jul 29, 2025
Kind
B2
Abstract

Systems, computer readable medium and methods for unlocking an autonomous drone are disclosed. Example methods include receiving an indication of a selection of a fly instruction, capturing an image using an image capturing device of the autonomous drone, processing the image to determine whether a face is present in the image, and if the face is present in the image, taking off. The face has to be within a predetermined distance of the autonomous drone. This ensures that the face is likely from the person that selected the fly instruction and ensures that the autonomous drone is far enough away from the face that the autonomous drone will not crash into the face on take-off. In some examples, the autonomous drone determines whether the autonomous drone is sitting on a hand before taking off. The autonomous drone uses a position of the face to determine an initial flight plan.

Claims (47)

1. An apparatus of an autonomous drone comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the autonomous drone to perform operations comprising:

receiving an indication of a selection of a fly instruction;

capturing an image using an image capturing device of the autonomous drone;

processing the image to determine whether a face is present in the image;

determining a distance of the face from the autonomous drone; and

in response to the face being present in the image, the distance of the face from the autonomous drone not being greater than a first threshold distance, and the distance of the face from the autonomous drone not being less than a second threshold distance, taking off.

2. The apparatus of claim 1 wherein the first threshold distance is three feet to ten feet and the second threshold distance is one inch to four feet.

3. The apparatus of claim 2 wherein the operations further comprise:

determining the second threshold distance based on a wind speed, wherein the second threshold distance is increased based on a higher wind speed.

4. The apparatus of claim 1 wherein the in response to the face being present in the image further comprises: in response to the face being present in the image and an orientation of the autonomous drone being right side up.

5. The apparatus of claim 1 wherein the indication of the selection of the fly instruction is received from a user of the autonomous drone selecting a user interface item on the autonomous drone.

6. The apparatus of claim 1 wherein determining the face is present further comprises:

determining the face is present if the face comprises at least a first threshold number of pixels of an image sensor of the image capturing device and the face comprises no more than a second threshold number of pixels of the image sensor.

7. The apparatus of claim 1 wherein determining the face is present further comprises:

determining whether an orientation of the face indicates the autonomous drone is within a field of vision of an eye of the face.

8. The apparatus of claim 1 wherein the image capturing device is a first image capturing device and the image is a first image, and wherein the operations further comprise:

capturing, using a second image capturing device of the autonomous drone, a second image, wherein the in response to the face being present in the image further comprises: in response to the face being present in the image and the second image indicating the autonomous drone is on a hand.

9. The apparatus of claim 8 wherein the first image capturing device is mounted horizontally relative to an axis of propellers of the autonomous drone and the second image capturing device is mounted vertically relative to the axis of the propellers and is directed downward.

10. The apparatus of claim 1 wherein the indication of the selection of the fly instruction is a first indication, and wherein the in response to the face being present in the image further comprises:

turning propellers on a lower setting for a period of time and taking off if a second indication is not received to cancel taking off.

11. The apparatus of claim 1 wherein the processing the image to determine whether the face is present in the image further comprises: determining whether a specific face of a user of the autonomous drone is present in the image.

12. The apparatus of claim 1 wherein taking off further comprises:

taking off based on an initial flight plan of a flight plan.

13. The apparatus of claim 12 wherein the operations further comprise:

determining the flight plan based on a position of the face relative to the autonomous drone; and

navigating the flight plan based on identifying the face in subsequent images captured by the image capturing device.

14. The apparatus of claim 12 wherein the initial flight plan takes the autonomous drone to fly upwards to a height that is higher than the face in an area between a hand of a user and the face.

15. A method performed on an apparatus of an autonomous drone, the method comprising:

receiving, by a processor, an indication of a selection of a fly instruction;

capturing an image using an image capturing device of the autonomous drone;

processing the image to determine whether a face is present in the image;

determining a distance of the face from the autonomous drone; and

in response to the face being present in the image, the distance of the face from the autonomous drone not being greater than a first threshold distance, and the distance of the face from the autonomous drone not being less than a second threshold distance, taking off.

16. The method of claim 15 , wherein the first threshold distance is three feet to ten feet and the second threshold distance is one inch to four feet.

17. The method of claim 16 , wherein the method further comprise:

determining the second threshold distance based on a wind speed, wherein the second threshold distance is increased based on a higher wind speed.

18. A non-transitory computer-readable storage medium, the non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of an apparatus of an autonomous drone, cause the at least one processor to perform operations comprising:

receiving an indication of a selection of a fly instruction;

capturing an image using an image capturing device of the autonomous drone;

processing the image to determine whether a face is present in the image;

determining a distance of the face from the autonomous drone; and

in response to the face being present in the image, the distance of the face from the autonomous drone not being greater than a first threshold distance, and the distance of the face from the autonomous drone not being less than a second threshold distance, taking off.

19. The non-transitory computer-readable storage medium of claim 18 wherein the first threshold distance is three feet to ten feet and the second threshold distance is one inch to four feet.

20. The non-transitory computer-readable storage medium of claim 19 wherein the operations further comprise:

determining the second threshold distance based on a wind speed, wherein the second threshold distance is increased based on a higher wind speed.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE THE ASSIGNEE NAME FROM SNAP, INC. TO SNAP INC. PREVIOUSLY RECORDED ON REEL 61695 FRAME 447. ASSIGNOR(S) HEREBY CONFIRMS THE THE ASSIGNMENT. Recorded Dec 8, 2025
From: HINTERMANN, MATHIAS ANDREAS; HUANG, JUSTIN; PATTON, RUSSELL DOUGLAS
To: SNAP INC.
Reel/Frame 073902/0544 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2022
From: HINTERMANN, MATHIAS ANDREAS; HUANG, JUSTIN; PATTON, RUSSELL DOUGLAS
To: SNAP, INC.
Reel/Frame 061695/0447 →
Continuity (2)
Provisional Application 63335396 · Apr 27, 2022
Related Publication 20230350433A1 · Nov 2, 2023
References Cited (149)
US 6038295A · Mattes · 2000 [cited by applicant]
US 6819982B2 · Doane · 2004 [cited by applicant]
US 6980909B2 · Root et al. · 2005 [cited by applicant]
US 7173651B1 · Knowles · 2007 [cited by applicant]
US 7411493B2 · Smith · 2008 [cited by applicant]
US 7535890B2 · Rojas · 2009 [cited by applicant]
US 7542073B2 · Li et al. · 2009 [cited by applicant]
US 7971156B2 · Albertson et al. · 2011 [cited by applicant]
US 8131597B2 · Hudetz · 2012 [cited by applicant]
US 8174562B2 · Hartman · 2012 [cited by applicant]
US 8199747B2 · Rojas et al. · 2012 [cited by applicant]
US 8274550B2 · Steuart · 2012 [cited by applicant]
US 8332475B2 · Rosen et al. · 2012 [cited by applicant]
US 8646720B2 · Shaw · 2014 [cited by applicant]
US 8718333B2 · Wolf et al. · 2014 [cited by applicant]
US 8724622B2 · Rojas · 2014 [cited by applicant]
US 8874677B2 · Rosen et al. · 2014 [cited by applicant]
US 8909679B2 · Root et al. · 2014 [cited by applicant]
US 8995433B2 · Rojas · 2015 [cited by applicant]
US 9040574B2 · Wang et al. · 2015 [cited by applicant]
US 9055416B2 · Rosen et al. · 2015 [cited by applicant]
US 9100806B2 · Rosen et al. · 2015 [cited by applicant]
US 9100807B2 · Rosen et al. · 2015 [cited by applicant]
US 9191776B2 · Root et al. · 2015 [cited by applicant]
US 9204252B2 · Root · 2015 [cited by applicant]
US 9225897B1 · Sehn et al. · 2015 [cited by applicant]
US 9276886B1 · Samaranayake · 2016 [cited by applicant]
US 9344642B2 · Niemi et al. · 2016 [cited by applicant]
US 9345711B2 · Friedhoff · 2016 [cited by applicant]
US 9443227B2 · Evans et al. · 2016 [cited by applicant]
US 9471059B1 · Wilkins · 2016 [cited by applicant]
US 9489661B2 · Evans et al. · 2016 [cited by applicant]
US 9489937B1 · Beard et al. · 2016 [cited by applicant]
US 9491134B2 · Rosen et al. · 2016 [cited by applicant]
US 9576369B2 · Venkataraman et al. · 2017 [cited by applicant]
US 9589448B1 · Schneider et al. · 2017 [cited by applicant]
US 9681046B2 · Adsumilli et al. · 2017 [cited by applicant]
US 9705831B2 · Spiegel · 2017 [cited by applicant]
US 9723272B2 · Lu et al. · 2017 [cited by applicant]
US 9742713B2 · Spiegel et al. · 2017 [cited by applicant]
US 9747901B1 · Gentry · 2017 [cited by applicant]
US 9922659B2 · Bradlow et al. · 2018 [cited by applicant]
US 9989965B2 · Cuban et al. · 2018 [cited by applicant]
US 10061328B2 · Canoy et al. · 2018 [cited by applicant]
US 10102423B2 · Shaburov et al. · 2018 [cited by applicant]
US 10109224B1 · Ratti et al. · 2018 [cited by applicant]
US 10140987B2 · Erickson et al. · 2018 [cited by applicant]
US 10168700B2 · Gordon et al. · 2019 [cited by applicant]
US 10284508B1 · Allen et al. · 2019 [cited by applicant]
US 10370118B1 · Nielsen et al. · 2019 [cited by applicant]
US 10439972B1 · Spiegel et al. · 2019 [cited by applicant]
US 10501180B2 · Yu · 2019 [cited by applicant]
US 10509466B1 · Miller et al. · 2019 [cited by applicant]
US 10514876B2 · Sehn · 2019 [cited by applicant]
US 10614855B2 · Huang · 2020 [cited by applicant]
US 10748347B1 · Li et al. · 2020 [cited by applicant]
US 10768639B1 · Meisenholder et al. · 2020 [cited by applicant]
US 10958608B1 · Allen et al. · 2021 [cited by applicant]
US 10962809B1 · Castañeda · 2021 [cited by applicant]
US 10996846B2 · Robertson et al. · 2021 [cited by applicant]
US 10997787B2 · Ge et al. · 2021 [cited by applicant]
US 11012390B1 · Al Majid et al. · 2021 [cited by applicant]
US 11030454B1 · Xiong et al. · 2021 [cited by applicant]
US 11036368B1 · Al Majid et al. · 2021 [cited by applicant]
US 11062498B1 · Voss et al. · 2021 [cited by applicant]
US 11087728B1 · Canberk et al. · 2021 [cited by applicant]
US 11092998B1 · Castañeda et al. · 2021 [cited by applicant]
US 11106342B1 · Al Majid et al. · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11143867B2 · Rodriguez, II · 2021 [cited by applicant]
US 11169600B1 · Canberk et al. · 2021 [cited by applicant]
US 11188101B2 · Zhou et al. · 2021 [cited by applicant]
US 11227626B1 · Krishnan Gorumkonda et al. · 2022 [cited by applicant]
US 11294369B2 · Lee et al. · 2022 [cited by applicant]
US 20070250526A1 · Hanna · 2007 [cited by applicant]
US 20080255842A1 · Simhi · 2008 [cited by applicant]
US 20090122133A1 · Hartman · 2009 [cited by applicant]
US 20110202598A1 · Evans et al. · 2011 [cited by applicant]
US 20120194420A1 · Osterhout et al. · 2012 [cited by applicant]
US 20120209924A1 · Evans et al. · 2012 [cited by applicant]
US 20120281885A1 · Syrdal et al. · 2012 [cited by applicant]
US 20120287274A1 · Bevirt · 2012 [cited by applicant]
US 20130056581A1 · Sparks · 2013 [cited by applicant]
US 20130238168A1 · Reyes · 2013 [cited by applicant]
US 20140254896A1 · Zhou et al. · 2014 [cited by applicant]
US 20150022432A1 · Stewart et al. · 2015 [cited by applicant]
US 20150070272A1 · Kim et al. · 2015 [cited by applicant]
US 20150175263A1 · Reyes · 2015 [cited by applicant]
US 20150199022A1 · Gottesman et al. · 2015 [cited by applicant]
US 20150287246A1 · Huston et al. · 2015 [cited by applicant]
US 20150331490A1 · Yamada · 2015 [cited by applicant]
US 20150362917A1 · Wang et al. · 2015 [cited by applicant]
US 20160063987A1 · Xu et al. · 2016 [cited by applicant]
US 20160161946A1 · Wuth Sepulveda et al. · 2016 [cited by applicant]
US 20160179096A1 · Bradlow et al. · 2016 [cited by applicant]
US 20160292886A1 · Erad et al. · 2016 [cited by applicant]
US 20160307573A1 · Wobrock · 2016 [cited by applicant]
US 20160336020A1 · Bradlow et al. · 2016 [cited by applicant]
US 20170031369A1 · Liu et al. · 2017 [cited by applicant]
US 20170094259A1 · Kouperman et al. · 2017 [cited by applicant]
US 20170099424A1 · Jones · 2017 [cited by applicant]
US 20170102699A1 · Anderson · 2017 [cited by applicant]
US 20170177925A1 · Volkart · 2017 [cited by applicant]
US 20170225796A1 · Sun et al. · 2017 [cited by applicant]
US 20170228690A1 · Kohli · 2017 [cited by applicant]
US 20170244937A1 · Meier et al. · 2017 [cited by applicant]
US 20170320564A1 · Kuzikov · 2017 [cited by applicant]
US 20170337791A1 · Gordon-Carroll · 2017 [cited by applicant]
US 20170371353A1 · Millinger, III · 2017 [cited by applicant]
US 20180082682A1 · Erickson et al. · 2018 [cited by applicant]
US 20180246529A1 · Hu et al. · 2018 [cited by applicant]
US 20190011921A1 · Wang et al. · 2019 [cited by applicant]
US 20190384298A1 · Liu · 2019 [cited by applicant]
US 20200241575A1 · Meisenholder et al. · 2020 [cited by applicant]
US 20210011612A1 · Dancie et al. · 2021 [cited by applicant]
US 20210074016A1 · Li et al. · 2021 [cited by applicant]
US 20210166732A1 · Shaburova et al. · 2021 [cited by applicant]
US 20210209954A1 · Tazume · 2021 [cited by examiner]
US 20210241529A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303077A1 · Anvaripour et al. · 2021 [cited by applicant]
US 20210303140A1 · Mourkogiannis · 2021 [cited by applicant]
US 20210362848A1 · Spencer · 2021 [cited by applicant]
US 20210382503A1 · Meisenholder et al. · 2021 [cited by applicant]
US 20210382564A1 · Blachly et al. · 2021 [cited by applicant]
US 20210397000A1 · Rodriguez, II · 2021 [cited by applicant]
CA 2887596A1 · 2015 [cited by applicant]
CN 109476372A · 2019 [cited by examiner]
CN 109901612A · 2019 [cited by examiner]
CN 112947589A · 2021 [cited by examiner]
CN 119110927A · 2024 [cited by applicant]
WO WO2018195883A1 · 2018 [cited by applicant]
WO WO2021133918A1 · 2021 [cited by applicant]
WO WO2023211695A1 · 2023 [cited by applicant]
WO WO2023211695A8 · 2024 [cited by applicant]
US 10,656,660 B1, 05/2020, Meisenholder et al. (withdrawn) [cited by applicant]
English translation for CN-112947589-A (Year: 2021). [cited by examiner]
English translation for CN-109901612-A (Year: 2019). [cited by examiner]
English translation for CN-109476372-A (Year: 2019). [cited by examiner]
Laput, Gierad, et al., “PixelTone: A Multimodal Interface for Image Editing”, ACM, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, FR, (2013), 10 pgs. [cited by applicant]
Leyden, John, “This SMS will self-destruct in 40 seconds”, [Online] Retrieved from the Internet: <URL: http://www.theregister.co.uk/2005/12/12/stealthtext/>, (Dec. 12, 2005), 1 pg. [cited by applicant]
Meisenholder, David, et al., “Remoteless Control of Drone Behavior”, U.S. Appl. No. 15/640,143, filed Jun. 30, 2017, 108 pgs. [cited by applicant]
Pourmehr, Shokoofeh, et al., “You two! Take off!': Creating, Modifying, and Commanding Groups of Robots Using Face Engagement and Indirect Speech in Voice Commands”, IEEE/RSJ International Conference on Intelligent Robo… [cited by applicant]
Yamada, Wataru, et al., “iSphere: Self-Luminous Spherical Drone Display”, Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST), Quebec City, CA, (Oct. 22-25, 2017), 635-343. [cited by applicant]
“International Application Serial No. PCT/US2023/018523, International Preliminary Report on Patentability mailed Nov. 7, 2024”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/018523, International Search Report mailed Jul. 14, 2023”, 8 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/018523, Written Opinion mailed Jul. 14, 2023”, 6 pgs. [cited by applicant]
“SPARK user manual”, User Manual V1.6, [Online]. Retrieved from the Internet: <URL: https://manuals.coolblue.nl/e1/dji-spark-wit-collectie.pdf>, (Oct. 1, 2017), 1-56. [cited by applicant]
Kesteloo, Haye, “Kivu's report on DJI's UAV Data Transmission and Storage practices—Are DJI drones really spying for China?”, [Online]. Retrieved from the Internet: <https://dronedj.com/2018/04/25/kivus-report-on-djis-u… [cited by applicant]