IP Library › Granted Patent US 12,202,603
Granted Patent B2
US 12,202,603 · App. 18/239,867 · Granted Jan 21, 2025

Unmanned aerial vehicle with biometric verification

Inventor: Mitch Volkart (Hartsburg, MO)
Assignee: Global Tel*Link Corporation
B64C39/024B60R25/25B60R25/257B64U20/87G01S13/04G01S13/06G01S13/50G05D1/0038G05D1/0094G05D1/222G05D1/227G05D1/2278G05D1/24G05D1/243G05D1/248G05D1/622G05D1/646G05D1/656G05D1/686G06F21/32G06V20/13G06V20/17G06V20/52G06V40/00G06V40/15G06V40/172G06V40/20G08B21/00G08G1/096827G08G5/0039B60R2300/00B60W2556/50B64U2101/00B64U2101/30B64U2101/55B64U2101/56B64U2101/57B64U2101/60B64U2201/00B64U2201/10B64U2201/104G01C21/1656G01S2013/468G01S13/66G01S2205/09G05D1/00G05D1/665G05D1/667G05D1/689G05D2109/20G05D2111/00G05D2111/10G05D2111/14G05D2111/58G06F2221/2111G06T2207/30201G06T2207/30252G06V10/62G06V20/58G06V40/16G06V2201/07G10L17/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,202,603
App. No.
18/239,867
Granted
Jan 21, 2025
Kind
B2
Abstract

Disclosed herein are system, method, and computer program product embodiments for locating, identifying, and tracking a known criminal, fugitive, missing person, and/or any other person of interest. An embodiment operates by deploying an unmanned aerial vehicle, determining the mode of operation of the UAV, operating the UAV in accordance with the mode of operation of the UAV, determining whether a subject has been detected, capturing a first voice sample associated with the subject, authenticating the identity of the subject, and transmitting the GPS location of the unmanned aerial vehicle to a computing device.

Claims (64)

1. An unmanned aerial vehicle performing operations, the unmanned aerial vehicle comprising:

a global positioning system receiver configured to determine a first global position of the unmanned aerial vehicle;

a communication port configured to communicate with one or more computing systems over a communication link;

a biometric sensing device; and

a processor in communication with the global positioning system receiver, the communication port, and the biometric sensing device, wherein the processor is configured to:

receive, over the communication link from a steering module implemented in the one or more computing systems, directional commands configured to cause the unmanned aerial vehicle to:

operate in an auto-pilot mode in a programmed flight path until a potential subject is detected;

interrupt the auto-pilot mode and cause the unmanned aerial vehicle to switch to a manual mode when the potential subject is detected, wherein the unmanned aerial vehicle operating in the manual mode comprises:

detecting a GPS location of the unmanned aerial vehicle upon switching to the manual mode; and

receiving additional directional commands to cause the unmanned aerial vehicle to deviate from the programmed flight path; and

return to the auto-pilot mode after completion of the manual mode, wherein returning to the auto-pilot mode comprises returning to the GPS location of the unmanned aerial vehicle and resuming the programmed flight path;

monitoring by the one or more computing systems, while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, at least one of a noise signal or a video signal for a presence of a potential target subject;

transmit by the unmanned aerial vehicle, over the communication link to a biometric module implemented in the one or more computing systems while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, a biometric signal captured by the biometric sensing device, wherein the transmitting occurs in response to the monitoring; and

receive by the unmanned aerial vehicle, over the communication link from a payload deployment module implemented in the one or more computing systems while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, a payload deployment command.

2. The unmanned aerial vehicle of claim 1 , wherein the processor is further configured to:

transmit, over the communication link to the one or more computing systems, an event signal indicative of a predetermined event, wherein the payload deployment command is received in response to transmitting the event signal.

3. The unmanned aerial vehicle of claim 1 , wherein the directional commands comprise at least one of a real-time route, a GPS coordinate, an auto-pilot travel route, one or more commands to avoid an obstacle in a path of the unmanned aerial vehicle.

4. The unmanned aerial vehicle of claim 1 , wherein the biometric signal comprises at least one of a voice signal or an image signal.

5. The unmanned aerial vehicle of claim 1 , wherein the one or more computing systems comprises a first computing system, a second computing system, and a third computing system, wherein the steering module is implemented on the first computing system, the biometric module is implemented on the second computing system, and the payload deployment module is implemented on the third computing system, and wherein the directional commands are received from the first computing system, the biometric signal is transmitted to the second computing system, and the payload deployment command is received from the third computing system.

6. The unmanned aerial vehicle of claim 1 , wherein monitoring at least one of the noise signal or the video signal for the presence of the potential target subject comprises:

capturing an audio signal of the potential target subject; and

authenticating the potential target subject based on the audio signal.

7. The unmanned aerial vehicle of claim 6 , wherein in response to authenticating the potential target subject, the processor is configured to:

estimate a GPS coordinate of the potential target subject based on a current GPS coordinate of the unmanned aerial vehicle and at least one of a camera angle, a camera direction, measured voice signal strength, and a triangulated coordinate based on the current GPS coordinate; and

transmit the estimated GPS coordinate to the one or more computing systems.

8. A method for operating an unmanned aerial vehicle in communication with one or more computing systems over a communication link, the method comprising:

receiving, over the communication link from a steering module implemented in the one or more computing systems, a directional command configured to cause the unmanned aerial vehicle to:

operate in an auto-pilot mode in a programmed flight path until a potential subject is detected;

interrupt the auto-pilot mode and cause the unmanned aerial vehicle to switch to a manual mode when the potential subject is detected, wherein the unmanned aerial vehicle operating in the manual mode comprises:

detecting a GPS location of the unmanned aerial vehicle upon switching to the manual mode; and

receiving additional directional commands to cause the unmanned aerial vehicle to deviate from the programmed flight path; and

return to the auto-pilot mode after completion of the manual mode, wherein returning to the auto-pilot mode comprises returning to the GPS location of the unmanned aerial vehicle and resuming the programmed flight path;

monitoring by the one or more computing systems, while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, at least one of a noise signal or a video signal for a presence of a potential target subject;

transmitting by the unmanned aerial vehicle, over the communication link to a biometric module implemented in the one or more computing systems while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, a biometric signal captured by a biometric sensing device of the unmanned aerial vehicle, wherein the transmitting occurs in response to the monitoring; and

receiving by the unmanned aerial vehicle, over the communication link from a payload deployment module implemented in the one or more computing systems while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, a payload deployment command.

9. The method of claim 8 , wherein the method further comprises:

transmitting, over the communication link to the one or more computing systems, an event signal indicative of a predetermined event, wherein the payload deployment command is received in response to transmitting the event signal.

10. The method of claim 8 , wherein the directional command comprises at least one of a real-time route, a GPS coordinate, an auto-pilot travel route, one or more commands to avoid an obstacle in a path of the unmanned aerial vehicle.

11. The method of claim 8 , wherein the biometric signal comprises at least one of a voice signal or an image signal.

12. The method of claim 8 , wherein the one or more computing systems comprises a first computing system, a second computing system, and a third computing system, wherein the steering module is implemented on the first computing system, the biometric module is implemented on the second computing system, and the payload deployment module is implemented on the third computing system, and wherein the directional command is received from the first computing system, the biometric signal is transmitted to the second computing system, and the payload deployment command is received from the third computing system.

13. The method of claim 8 , wherein monitoring at least one of the noise signal or the video signal for the presence of the potential target subject comprises:

capturing an audio signal of the potential target subject; and

authenticating the potential target subject based on the audio signal.

14. The method of claim 13 , wherein in response to authenticating the potential target subject, the method further comprises:

estimating a GPS coordinate of the potential target subject based on a current GPS coordinate of the unmanned aerial vehicle and at least one of a camera angle, a camera direction, measured voice signal strength, and a triangulated coordinate based on the current GPS coordinate; and

transmitting the estimated GPS coordinate to the one or more computing systems.

15. A non-transitory computer-readable medium having instructions stored therein, which when executed by a processor in an unmanned aerial vehicle in communication with one or more computing systems over a communication link cause the processor to perform operations, the operations comprising:

receiving, over the communication link from a steering module implemented in the one or more computing systems, a directional command configured to cause the unmanned aerial vehicle to:

operate in an auto-pilot mode in a programmed flight path until a potential subject is detected;

interrupt the auto-pilot mode and cause the unmanned aerial vehicle to switch to a manual mode when the potential subject is detected, wherein the unmanned aerial vehicle operating in the manual mode comprises:

detecting a GPS location of the unmanned aerial vehicle upon switching to the manual mode; and

receiving additional directional commands to cause the unmanned aerial vehicle to deviate from the programmed flight path; and

return to the auto-pilot mode after completion of the manual mode, wherein returning to the auto-pilot mode comprises returning to the GPS location of the unmanned aerial vehicle and resuming the programmed flight path;

monitoring by the one or more computing systems, while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, at least one of a noise signal or a video signal for a presence of a potential target subject;

transmitting by the unmanned aerial vehicle, over the communication link to a biometric module implemented in the one or more computing systems while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, a biometric signal captured by a biometric sensing device, wherein the transmitting occurs in response to the monitoring; and

receiving by the unmanned aerial vehicle, over the communication link from a payload deployment module implemented in the one or more computing systems while the unmanned aerial vehicle is operating in the auto-pilot mode or the manual mode, a payload deployment command.

16. The non-transitory computer-readable medium of claim 15 , wherein the operations further comprise:

transmitting, over the communication link to the one or more computing systems, an event signal indicative of a predetermined event, wherein the payload deployment command is received in response to transmitting the event signal.

17. The non-transitory computer-readable medium of claim 15 , wherein the directional command comprises at least one of a real-time route, a GPS coordinate, an auto-pilot travel route, one or more commands to avoid an obstacle in a path of the unmanned aerial vehicle.

18. The non-transitory computer-readable medium of claim 15 , wherein the biometric signal comprises at least one of a voice signal or an image signal.

19. The non-transitory computer-readable medium of claim 15 , wherein the one or more computing systems comprises a first computing system, a second computing system, and a third computing system, wherein the steering module is implemented on the first computing system, the biometric module is implemented on the second computing system, and the payload deployment module is implemented on the third computing system, and wherein the directional command is received from the first computing system, the biometric signal is transmitted to the second computing system, and the payload deployment command is received from the third computing system.

20. The non-transitory computer-readable medium of claim 15 , wherein monitoring at least one of the noise signal or the video signal for the presence of the potential target subject comprises:

capturing an audio signal of the potential target subject; and

authenticating the potential target subject based on the audio signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 5, 2024
From: VOLKART, MITCH
To: GLOBAL TEL*LINK CORPORATION
Reel/Frame 069498/0444 →
Continuity (3)
Continuation 16807634 · Mar 3, 2020
Continuation 14971891 · Dec 16, 2015
Related Publication 20240228034A1 · Jul 11, 2024
References Cited (67)
US 6130705A · Lareau · 2000 [cited by applicant]
US 7106843B1 · Gainsboro et al. · 2006 [cited by applicant]
US 7555383B2 · Siegel · 2009 [cited by applicant]
US 8229163B2 · Coleman et al. · 2012 [cited by applicant]
US 8706914B2 · Duchesneau · 2014 [cited by applicant]
US 8780195B1 · Rubin · 2014 [cited by applicant]
US 8948935B1 · Peeters et al. · 2015 [cited by applicant]
US 9387928B1 · Gentry et al. · 2016 [cited by applicant]
US 9442485B1 · McDermott et al. · 2016 [cited by applicant]
US 9471059B1 · Wilkins · 2016 [cited by applicant]
US 9529359B1 · Annan et al. · 2016 [cited by applicant]
US 9607219B2 · Greveson et al. · 2017 [cited by applicant]
US 9645582B2 · Shue · 2017 [cited by applicant]
US 9874308B2 · Saika et al. · 2018 [cited by applicant]
US 10155587B1 · Tang · 2018 [cited by applicant]
US 10387825B1 · Canavor et al. · 2019 [cited by applicant]
US 10579863B2 · Volkart · 2020 [cited by applicant]
US 20040030449A1 · Solomon · 2004 [cited by applicant]
US 20070112461A1 · Zini et al. · 2007 [cited by applicant]
US 20080043993A1 · Johnson · 2008 [cited by applicant]
US 20090076823A1 · Collins · 2009 [cited by applicant]
US 20090080715A1 · van Beek et al. · 2009 [cited by applicant]
US 20090216910A1 · Duchesneau · 2009 [cited by applicant]
US 20100034424A1 · Goossen · 2010 [cited by applicant]
US 20100299761A1 · Shapiro · 2010 [cited by applicant]
US 20110017863A1 · Goossen · 2011 [cited by applicant]
US 20110178658A1 · Kotabab et al. · 2011 [cited by applicant]
US 20120165976A1 · Cotner · 2012 [cited by applicant]
US 20130054010A1 · Holman et al. · 2013 [cited by applicant]
US 20130110281A1 · Jones et al. · 2013 [cited by applicant]
US 20130197718A1 · Lee et al. · 2013 [cited by applicant]
US 20130279668A1 · Rokosky et al. · 2013 [cited by applicant]
US 20140018979A1 · Goossen et al. · 2014 [cited by applicant]
US 20140140575A1 · Wolf · 2014 [cited by applicant]
US 20140152422A1 · Breed · 2014 [cited by applicant]
US 20140277691A1 · Jacobus et al. · 2014 [cited by applicant]
US 20150084774A1 · Wojcik et al. · 2015 [cited by applicant]
US 20150190925A1 · Hoffman et al. · 2015 [cited by applicant]
US 20150215254A1 · Bennett · 2015 [cited by applicant]
US 20150360365A1 · Fudaba et al. · 2015 [cited by applicant]
US 20160063987A1 · Xu et al. · 2016 [cited by applicant]
US 20160116912A1 · Nehmadi · 2016 [cited by examiner]
US 20160173827A1 · Dannan et al. · 2016 [cited by applicant]
US 20160225048A1 · Zoldi et al. · 2016 [cited by applicant]
US 20160236790A1 · Knapp et al. · 2016 [cited by applicant]
US 20160253889A1 · Keyton · 2016 [cited by applicant]
US 20160288905A1 · Gong et al. · 2016 [cited by applicant]
US 20170053169A1 · Cuban · 2017 [cited by applicant]
US 20170092109A1 · Trundle et al. · 2017 [cited by applicant]
US 20170126691A1 · Arcese et al. · 2017 [cited by applicant]
US 20170147976A1 · Koch et al. · 2017 [cited by applicant]
US 20170161725A1 · Hosp et al. · 2017 [cited by applicant]
US 20170177925A1 · Volkart · 2017 [cited by applicant]
US 20170225336A1 · Deyle et al. · 2017 [cited by applicant]
US 20200279100A1 · Volkart · 2020 [cited by applicant]
WO WO2013107582A1 · 2013 [cited by applicant]
International Search Report and Written Opinion directed to related International Patent Application No. PCT/US2016/067252, dated Mar. 16, 2017; 14 pages. [cited by applicant]
International Search Report and Written Opinion directed to related International Patent Application No. PCT/US2018/028354, dated Jul. 9, 2018; 16 pages. [cited by applicant]
International Search Report and Written Opinion directed to related International Patent Application No. PCT/US2018/027146, dated Jun. 28, 2018; 8 pages. [cited by applicant]
Hsu et al., Face Recognition on Drones: Issues and Limitations, May 18, 2015 (retrieved Apr. 5, 2019), DroNet '15 Proceedings of the First Workshop on Micro Aerial Vehicle Networks, Systems, and Applications for Civilia… [cited by applicant]
Boyers. An Evaluation of Detection and Recognition Algorithms to Implement Autonomous Target Tracking With a Quadrotor, Nov. 2013 (retrieved Apr. 5, 2019), Thesis, 97 total pages. Retrieved: http://www.cs.ru.ac.za/resea… [cited by applicant]
Specification of U.S. Appl. No. 62/235,045, filed Sep. 30, 2015 corresponding to US Patent App. Pub. No. US 2017/0092109 to Trundle et al. (Year: 2015). [cited by applicant]
Specification of U.S. Appl. No. 62/167,241, filed May 27, 2015 corresponding to U.S. Pat. No. 9,874,308 to Saika et al. (Year: 2015). [cited by applicant]
Foo et al., Path Planning of Unmanned Aerial Vehicles using B-Splines and Particle Swarm Optimization, Apr. 2009, May 23, 2012: Online [retrieved May 18, 2023], Journal of Aerospace Computing, Information, and Communica… [cited by applicant]
Hrabar et al., Combined Optic-Flow and Stereo-Based Navigation of Urban Canyons for a UAV, Aug. 2-6, 2005 [retrieved May 18, 2023], 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, 8 pages. Retr… [cited by applicant]
U.S. Appl. No. 62/262,895, Emergency response system using unmanned aerial vehicle (UAV), of Tang (U.S. Pat. No. 10,155,587), Dec. 3, 2015 [retrieved Apr. 4, 2022], 18 pages. (Year: 2015). [cited by applicant]
Drawings of U.S. Appl. No. 62/262,895, Emergency response system using unmanned aerial vehicle (UAV), of Tang (U.S. Pat. No. 10,155,587), Dec. 3, 2015 [retrieved Apr. 4, 2022], 7 pages. (Year: 2015). [cited by applicant]