IP Library › Granted Patent US 12,518,544
Granted Patent B2
US 12,518,544 · App. 18/489,287 · Granted Jan 6, 2026

Identifying suspicious entities using autonomous vehicles

Inventors: Gil Golov (Backnang, DE); Zoltan Szubbocsev (Haimhausen, DE)
G06V20/56G05D1/0088G05D1/0291G06N3/04G06V20/58G06V20/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,518,544
App. No.
18/489,287
Filed
Oct 18, 2023
Granted
Jan 6, 2026
Kind
B2
Art Unit
3662
USPC
701/26
Abstract

Systems and methods for identifying suspicious entities using autonomous vehicles are disclosed. In one embodiment, a method is disclosed comprising identifying a suspect vehicle using at least one digital camera equipped on an autonomous vehicle; identifying a set of candidate autonomous vehicles; enabling, on each of the candidate autonomous vehicles, a search routine, the search routine instructing each respective autonomous vehicle to coordinate tracking of the suspect vehicle; recording, while tracking the suspect vehicle, a plurality of images of the suspect vehicle; periodically re-calibrating the search routines executed by the autonomous vehicles based on the plurality of images; and re-routing the autonomous vehicles based on the re-calibrated search routines.

Claims (36)

1 . An apparatus comprising:

a processor; and

a storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:

logic, executed by the processor, for receiving suspect vehicle data (SVD) associated with a suspect vehicle, wherein the SVD comprises identification data of the suspect vehicle obtained from an external source;

logic, executed by the processor, for receiving a set of images, the set of images captured by a plurality of sensors installed on a plurality of autonomous vehicles coordinating to track the suspect vehicle;

logic, executed by the processor, for inputting the set of images into a deep neural network (DNN), the DNN configured to output a set of vehicle features extracted from the images;

logic, executed by the processor, for determining that at least one feature in the set of vehicle features matches the SVD; and

logic, executed by the processor, for instructing at least one autonomous vehicle to navigate to a location of the suspect vehicle.

2 . The apparatus of claim 1 , wherein the SVD comprises one or more of a license plate number, make, model, or color of the suspect vehicle.

3 . The apparatus of claim 2 , wherein the set of vehicle features comprises one or more of a license plate number, make, model, or color of vehicles appearing in the set of images.

4 . The apparatus of claim 1 , wherein the plurality of sensors comprises a plurality of cameras.

5 . The apparatus of claim 1 , wherein the set of images comprises a set of three-dimensional images.

6 . The apparatus of claim 1 , wherein the program logic further comprises logic, executed by the processor, for receiving the SVD comprises inputting images of vehicles into a second DNN, the second DNN trained to classify an image as including a suspect vehicle and selecting an output of the second DNN as the SVD.

7 . A method comprising:

receiving, by a processor, suspect vehicle data (SVD) associated with a suspect vehicle, wherein the SVD comprises identification data of the suspect vehicle obtained from an external source;

receiving, by the processor, a set of images, the set of images captured by a plurality of sensors installed on a plurality of autonomous vehicles coordinating to track the suspect vehicle;

inputting, by the processor, the set of images into a deep neural network (DNN), the DNN configured to output a set of vehicle features extracted from the images;

determining, by the processor, that at least one feature in the set of vehicle features matches the SVD; and

instructing, by the processor, at least one autonomous vehicle to navigate to a location of the suspect vehicle.

8 . The method of claim 7 , wherein the SVD comprises one or more of a license plate number, make, model, or color of the suspect vehicle.

9 . The method of claim 8 , wherein the set of vehicle features comprises one or more of a license plate number, make, model, or color of vehicles appearing in the set of images.

10 . The method of claim 7 , wherein the plurality of sensors comprises a plurality of cameras.

11 . The method of claim 7 , wherein the set of images comprises a set of three-dimensional images.

12 . The method of claim 7 , wherein receiving the SVD comprises inputting images of vehicles into a second DNN, the second DNN trained to classify an image as including a suspect vehicle and selecting an output of the second DNN as the SVD.

13 . A non-transitory computer-readable storage medium for tangibly storing computer program instructions capable of being executed by a computer processor, the computer program instructions defining steps of:

receiving, by a processor, suspect vehicle data (SVD) associated with a suspect vehicle, wherein the SVD comprises identification data of the suspect vehicle obtained from an external source;

receiving, by the processor, a set of images, the set of images captured by a plurality of sensors installed on a plurality of autonomous vehicles coordinating to track the suspect vehicle;

inputting, by the processor, the set of images into a deep neural network (DNN), the DNN configured to output a set of vehicle features extracted from the images;

determining, by the processor, that at least one feature in the set of vehicle features matches the SVD; and

instructing, by the processor, at least one autonomous vehicle to navigate to a location of the suspect vehicle.

14 . The non-transitory computer-readable storage medium of claim 13 , wherein the SVD comprises one or more of a license plate number, make, model, or color of the suspect vehicle.

15 . The non-transitory computer-readable storage medium of claim 14 , wherein the set of vehicle features comprises one or more of a license plate number, make, model, or color of vehicles appearing in the set of images.

16 . The non-transitory computer-readable storage medium of claim 13 , wherein the plurality of sensors comprises a plurality of cameras.

17 . The non-transitory computer-readable storage medium of claim 13 , wherein the set of images comprises a set of three-dimensional images.

18 . The non-transitory computer-readable storage medium of claim 13 , wherein receiving the SVD comprises inputting images of vehicles into a second DNN, the second DNN trained to classify an image as including a suspect vehicle and selecting an output of the second DNN as the SVD.

19 . The non-transitory computer-readable storage medium of claim 13 , the steps further comprising generating a suspect vehicle identification file including the at least one feature and transmitting the suspect vehicle identification file to a central server for confirmation.

Continuity (3)
Continuation 17001546 · Aug 24, 2020
Continuation 15882168 · Jan 29, 2018
Related Publication 20240046653A1 · Feb 8, 2024
References Cited (78)
US 8185296B2 · Yokoyama et al. · 2012 [cited by applicant]
US 8442791B2 · Stahlin · 2013 [cited by applicant]
US 8543320B2 · Zheng et al. · 2013 [cited by applicant]
US 8688369B2 · Denaro · 2014 [cited by applicant]
US 8825371B2 · Prokhorov et al. · 2014 [cited by applicant]
US 9043127B2 · Denaro · 2015 [cited by applicant]
US 9062977B2 · Prokhorov et al. · 2015 [cited by applicant]
US 9221461B2 · Ferguson et al. · 2015 [cited by applicant]
US 9279688B2 · Denaro · 2016 [cited by applicant]
US 9296299B2 · Ricci · 2016 [cited by applicant]
US 9754501B2 · Stenneth · 2017 [cited by applicant]
US 9786172B2 · Takahara et al. · 2017 [cited by applicant]
US 9797735B2 · Denaro · 2017 [cited by applicant]
US 9805601B1 · Fields et al. · 2017 [cited by applicant]
US 9961551B2 · Scholl et al. · 2018 [cited by applicant]
US 10031523B2 · Ricci et al. · 2018 [cited by applicant]
US 10049328B2 · Jiang et al. · 2018 [cited by applicant]
US 10068477B2 · Miller et al. · 2018 [cited by applicant]
US 10099697B2 · Tatourian et al. · 2018 [cited by applicant]
US 10139831B2 · Yan · 2018 [cited by applicant]
US 10179586B2 · Johnson · 2019 [cited by applicant]
US 10215571B2 · Ghadiok et al. · 2019 [cited by applicant]
US 10223380B2 · Giurgiu et al. · 2019 [cited by applicant]
US 10257270B2 · Cohn et al. · 2019 [cited by applicant]
US 10269242B2 · Ahmad et al. · 2019 [cited by applicant]
US 10298741B2 · Goren et al. · 2019 [cited by applicant]
US 10311728B2 · Stenneth et al. · 2019 [cited by applicant]
US 10331141B2 · Grimm et al. · 2019 [cited by applicant]
US 10345110B2 · Westover et al. · 2019 [cited by applicant]
US 10460394B2 · Perl et al. · 2019 [cited by applicant]
US 10518720B2 · Haque · 2019 [cited by applicant]
US 10529231B2 · Scofield · 2020 [cited by applicant]
US 10543853B2 · Toyoda et al. · 2020 [cited by applicant]
US 10648818B2 · Denaro · 2020 [cited by applicant]
US 10755111B2 · Golov et al. · 2020 [cited by applicant]
US 11836985B2 · Golov et al. · 2023 [cited by applicant]
US 20080189040A1 · Nasu et al. · 2008 [cited by applicant]
US 20110302214A1 · Frye et al. · 2011 [cited by applicant]
US 20120296560A1 · Zheng et al. · 2012 [cited by applicant]
US 20140067187A1 · Ferguson et al. · 2014 [cited by applicant]
US 20140172290A1 · Prokhorov et al. · 2014 [cited by applicant]
US 20150039365A1 · Haque · 2015 [cited by applicant]
US 20150057838A1 · Scholl et al. · 2015 [cited by applicant]
US 20160150070A1 · Goren et al. · 2016 [cited by applicant]
US 20160176440A1 · Witte et al. · 2016 [cited by applicant]
US 20160251081A1 · Staskevich · 2016 [cited by examiner]
US 20160280224A1 · Tatourian et al. · 2016 [cited by applicant]
US 20160351050A1 · Takahara et al. · 2016 [cited by applicant]
US 20160363935A1 · Shuster et al. · 2016 [cited by applicant]
US 20170015318A1 · Scofield et al. · 2017 [cited by applicant]
US 20170277716A1 · Giurgiu et al. · 2017 [cited by applicant]
US 20170301220A1 · Jarrell · 2017 [cited by examiner]
US 20170310747A1 · Cohn et al. · 2017 [cited by applicant]
US 20170316691A1 · Miller et al. · 2017 [cited by applicant]
US 20170372431A1 · Perl et al. · 2017 [cited by applicant]
US 20180004223A1 · Baldwin · 2018 [cited by applicant]
US 20180018869A1 · Ahmad et al. · 2018 [cited by applicant]
US 20180038698A1 · Denaro · 2018 [cited by applicant]
US 20180047285A1 · Johnson · 2018 [cited by applicant]
US 20180050800A1 · Boykin et al. · 2018 [cited by applicant]
US 20190009794A1 · Toyoda et al. · 2019 [cited by applicant]
US 20190047584A1 · Donnelly · 2019 [cited by applicant]
US 20190049257A1 · Westover et al. · 2019 [cited by applicant]
US 20190051172A1 · Stenneth et al. · 2019 [cited by applicant]
US 20190064843A1 · Matsui et al. · 2019 [cited by applicant]
US 20190077413A1 · Kondo et al. · 2019 [cited by applicant]
US 20190147252A1 · Sawada et al. · 2019 [cited by applicant]
US 20190236379A1 · Golov et al. · 2019 [cited by applicant]
US 20190286133A1 · Bielby · 2019 [cited by applicant]
US 20190287392A1 · Bielby · 2019 [cited by applicant]
US 20190300017A1 · Glaser et al. · 2019 [cited by applicant]
US 20190316913A1 · Golov · 2019 [cited by applicant]
US 20190382029A1 · Golov · 2019 [cited by applicant]
US 20190391576A1 · Zhang · 2019 [cited by examiner]
US 20200039508A1 · Onishi · 2020 [cited by applicant]
US 20200342241A1 · Tiziani · 2020 [cited by examiner]
US 20200387722A1 · Golov et al. · 2020 [cited by applicant]
International Search Report and Written Opinion, PCT/US2019/025112, mailed Jul. 19, 2019. [cited by applicant]