IP Library Granted Patent US 12,273,660
Granted Patent B2
US 12,273,660 · App. 18/449,119 · Granted Apr 8, 2025

Video identification and analytical recognition system

Inventor: James Carey (Commack, NY)
H04N7/181G06F18/251G06T7/20G06T7/246G06V20/52G06V20/53G06V40/10G06V40/161G06V40/23G08B13/19608G08B13/19613H04N7/185H04N23/45H04W8/005G06T2207/10016G06T2207/30232G06V40/172G06V40/25G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,273,660
App. No.
18/449,119
Granted
Apr 8, 2025
Kind
B2
Abstract

An analytical recognition system includes a video camera configured to capture video data of a subject and an antenna configured to capture mobile communication device data relating to the subject's mobile device. The system further includes a data analytics module configured to: analyze the video data to determine one of a physical attribute or a movement attribute of the subject and generate a first certainty match value based on this attribute perform facial recognition analysis of the subject to obtain facial recognition data and generate a second certainty match value based on the facial recognition data; generate a third certainty match value based on the mobile device data; and combine the first, second, and third certainty match values to produce a combined certainty match value, which enhances the accuracy of identifying the subject by integrating multiple data sources, including physical attributes, facial features, and mobile device information.

Claims (48)

1. An analytical recognition system, comprising:

a device configured to capture video data of a person;

an antenna configured to capture mobile communication device data relating to a mobile communication device of the person; and

a computing device configured to:

analyze the video data to determine at least one attribute of the person; and

generate a certainty match value based on the at least one attribute of the person, facial recognition data of the person, and the mobile communication device data, wherein generating the certainty match value includes:

assigning a weight factor to each of the at least one attribute, the facial recognition data, and the mobile communication device data based on a reliability metric; and

combining the weighted factors using a weighted sum algorithm to produce the certainty match value.

2. The analytical recognition system according to claim 1 , wherein the device is at least one of a traffic camera or an aerial drone camera.

3. The analytical recognition system of claim 1 , wherein the at least one attribute of the person includes at least one of a physical attribute or a movement attribute of the person.

4. The analytical recognition system of claim 1 , wherein the computing device is further configured to perform a facial recognition analysis of the person to obtain the facial recognition data.

5. The analytical recognition system of claim 4 , wherein the facial recognition analysis of the person is performed using biometric artificial intelligence.

6. The analytical recognition system according to claim 1 , wherein the computing device is further configured to access:

an attributes database storing a plurality of person identities and corresponding attributes;

a facial database storing a plurality of person identities and corresponding facial recognition datasets; and

a device database storing a plurality of person identities and corresponding mobile communication devices.

7. The analytical recognition system according to claim 1 , wherein the computing device is further configured to compare the certainty match value to a certainty threshold and to output a positive match in response to the certainty match value exceeding the certainty threshold.

8. The analytical recognition system of claim 1 , wherein the captured video data includes at least one of a captured still image or video footage.

9. The analytical recognition system of claim 1 , wherein the mobile communication device data includes at least one of a WiFi identifier, a media access control (MAC) identifier, a Bluetooth identifier, a cellular identifier, a near field communication identifier, or a radio frequency identifier associated with a mobile communication device in communication with the antenna.

10. A method for analytical recognition of persons, the method comprising:

capturing video data of a person from a video camera;

capturing mobile communication device data relating to a mobile communication device of the person from an antenna;

analyzing the video data to determine at least one attribute of the person; and

generating a certainty match value based on the at least one attribute of the person, facial recognition data of the person, and the mobile communication device data, wherein generating the certainty match value includes:

assigning a weight factor to each of the at least one attribute, the facial recognition data, and the mobile communication device data based on a reliability metric; and

combining the weighted factors using a weighted sum algorithm to produce the certainty match value.

11. The method according to claim 10 , wherein the device is at least one of a traffic camera or an aerial drone camera.

12. The method according to claim 10 , wherein the at least one attribute of the person includes at least one of a physical attribute or a movement attribute of the person.

13. The method according to claim 10 , further comprising:

performing a facial recognition analysis of the person to obtain the facial recognition data.

14. The method according to claim 13 , wherein the facial recognition analysis of the person is performed using biometric artificial intelligence.

15. The method according to claim 10 , further comprising:

accessing an attributes database storing a plurality of person identities and corresponding attributes;

accessing a facial database storing a plurality of person identities and corresponding facial recognition datasets; and

accessing a device database storing a plurality of person identities and corresponding mobile communication devices.

16. The method according to claim 10 , further comprising:

comparing the certainty match value to a certainty threshold and to output a positive match in response to the certainty match value exceeding the certainty threshold.

17. The method according to claim 10 , wherein the captured video data includes at least one of a captured still image and video footage.

18. The method according to claim 10 , wherein the mobile communication device data includes at least one of a WiFi identifier, a media access control (MAC) identifier, a Bluetooth identifier, a cellular identifier, a near field communication identifier, or a radio frequency identifier associated with a mobile communication device in communication with the antenna.

19. A non-transitory computer-readable storage medium storing a program for causing a computer to perform a method for analytical recognition of persons, the method comprising:

capturing video data of a person from a video camera;

capturing mobile communication device data relating to a mobile communication device of the person from an antenna;

analyzing the video data to determine at least one attribute of the person; and

generating a certainty match value based on the at least one attribute of the person, facial recognition data of the person, and the mobile communication device data, wherein generating the certainty match value includes:

assigning a weight factor to each of the at least one attribute, the facial recognition data, and the mobile communication device data based on a reliability metric; and

combining the weighted factors using a weighted sum algorithm to produce the certainty match value.

20. The medium of claim 19 , further comprising:

performing a facial recognition analysis of the person to obtain the facial recognition data, wherein the facial recognition analysis of the person is performed using biometric artificial intelligence.

Continuity (10)
Continuation 16823710 · Mar 19, 2020
Continuation In Part 16599674 · Oct 11, 2019
Continuation In Part 16571522 · Sep 16, 2019
Continuation 15469885 · Mar 27, 2017
Continuation 14817871 · Aug 4, 2015
Continuation In Part 14256385 · Apr 18, 2014
Continuation In Part 14213548 · Mar 14, 2014
Provisional Application 61813942 · Apr 19, 2013
Provisional Application 61798740 · Mar 15, 2013
Related Publication 20230388457A1 · Nov 30, 2023
References Cited (171)
US 6975346B2 · Kumhyr · 2005 [cited by applicant]
US 7308487B1 · Dansie et al. · 2007 [cited by applicant]
US 7769221B1 · Shakes · 2010 [cited by applicant]
US 7965312B2 · Chung · 2011 [cited by applicant]
US 8195598B2 · Hua et al. · 2012 [cited by applicant]
US 8271336B2 · Mikurak · 2012 [cited by examiner]
US 8615254B2 · Jamtgaard et al. · 2013 [cited by applicant]
US 8879831B2 · Kohli · 2014 [cited by examiner]
US 9406336B2 · Bose · 2016 [cited by examiner]
US 9762865B2 · Carey · 2017 [cited by examiner]
US 9773163B2 · Carey · 2017 [cited by applicant]
US 9786113B2 · Carey · 2017 [cited by examiner]
US 10078787B2 · Carey · 2018 [cited by applicant]
US 10432897B2 · Carey · 2019 [cited by examiner]
US 10972704B2 · Carey · 2021 [cited by examiner]
US 11039108B2 · Carey · 2021 [cited by examiner]
US 11100334B2 · Carey · 2021 [cited by examiner]
US 11743431B2 · Carey · 2023 [cited by examiner]
US 20010010541A1 · Fernandez · 2001 [cited by applicant]
US 20030067542A1 · Monroe · 2003 [cited by applicant]
US 20030197612A1 · Tanaka et al. · 2003 [cited by applicant]
US 20040117638A1 · Monroe · 2004 [cited by applicant]
US 20040143602A1 · Ruiz · 2004 [cited by applicant]
US 20040161133A1 · Elazar et al. · 2004 [cited by applicant]
US 20060064384A1 · Mehrotra · 2006 [cited by applicant]
US 20060244826A1 · Chew · 2006 [cited by applicant]
US 20070003141A1 · Rittscher et al. · 2007 [cited by applicant]
US 20070057049A9 · Kundu et al. · 2007 [cited by applicant]
US 20070127774A1 · Zhang et al. · 2007 [cited by applicant]
US 20070297607A1 · Ogura et al. · 2007 [cited by applicant]
US 20080015013A1 · Gelman · 2008 [cited by examiner]
US 20080018738A1 · Lipton · 2008 [cited by examiner]
US 20080106599A1 · Liu et al. · 2008 [cited by applicant]
US 20080198231A1 · Ozdemir et al. · 2008 [cited by applicant]
US 20090033745A1 · Yeredor et al. · 2009 [cited by applicant]
US 20090052747A1 · Kamiyama et al. · 2009 [cited by applicant]
US 20090141939A1 · Chambers · 2009 [cited by examiner]
US 20090189981A1 · Siann et al. · 2009 [cited by applicant]
US 20090222388A1 · Hua · 2009 [cited by examiner]
US 20090268030A1 · Markham · 2009 [cited by applicant]
US 20100026802A1 · Titus et al. · 2010 [cited by applicant]
US 20100079594A1 · Voglewede et al. · 2010 [cited by applicant]
US 20100111377A1 · Monroe · 2010 [cited by applicant]
US 20100135643A1 · Fleming · 2010 [cited by applicant]
US 20100141786A1 · Bigioi · 2010 [cited by examiner]
US 20100182428A1 · Lu et al. · 2010 [cited by applicant]
US 20100234986A1 · Clopton · 2010 [cited by applicant]
US 20100260426A1 · Huang · 2010 [cited by examiner]
US 20100311347A1 · Le Thierry D'Ennequin · 2010 [cited by examiner]
US 20100318566A1 · Yoshio et al. · 2010 [cited by applicant]
US 20100321183A1 · Donovan et al. · 2010 [cited by applicant]
US 20100329513A1 · Klefenz · 2010 [cited by applicant]
US 20110022661A1 · Alsina · 2011 [cited by examiner]
US 20110128374A1 · Shellshear et al. · 2011 [cited by applicant]
US 20110134240A1 · Anderson · 2011 [cited by examiner]
US 20110211070A1 · Shu et al. · 2011 [cited by applicant]
US 20110273309A1 · Zhang · 2011 [cited by examiner]
US 20120008836A1 · Bobbitt et al. · 2012 [cited by applicant]
US 20120076356A1 · Li · 2012 [cited by examiner]
US 20120114198A1 · Yang · 2012 [cited by examiner]
US 20120127314A1 · Clements · 2012 [cited by applicant]
US 20120147169A1 · Harper · 2012 [cited by examiner]
US 20120190380A1 · Dupray · 2012 [cited by examiner]
US 20120208592A1 · Davis et al. · 2012 [cited by applicant]
US 20120218412A1 · Dellantoni · 2012 [cited by examiner]
US 20120229647A1 · Calman et al. · 2012 [cited by applicant]
US 20120233032A1 · Calman et al. · 2012 [cited by applicant]
US 20120233033A1 · Calman et al. · 2012 [cited by applicant]
US 20120262575A1 · Champagne et al. · 2012 [cited by applicant]
US 20120311564A1 · Khalid · 2012 [cited by applicant]
US 20120324061A1 · Parsons et al. · 2012 [cited by applicant]
US 20120327241A1 · Howe · 2012 [cited by applicant]
US 20130015946A1 · Lau · 2013 [cited by examiner]
US 20130027561A1 · Lee · 2013 [cited by examiner]
US 20130030875A1 · Lee · 2013 [cited by examiner]
US 20130041961A1 · Thrower, III et al. · 2013 [cited by applicant]
US 20130063550A1 · Ritchey · 2013 [cited by applicant]
US 20130073366A1 · Heath · 2013 [cited by applicant]
US 20130101159A1 · Chao · 2013 [cited by examiner]
US 20130155229A1 · Thornton · 2013 [cited by examiner]
US 20130271598A1 · Mariadoss · 2013 [cited by applicant]
US 20140018059A1 · Noonan · 2014 [cited by applicant]
US 20140052680A1 · Nitz · 2014 [cited by examiner]
US 20140052681A1 · Nitz · 2014 [cited by examiner]
US 20140132767A1 · Sonnabend · 2014 [cited by examiner]
US 20140201126A1 · Zadeh · 2014 [cited by examiner]
US 20140285660A1 · Jamtgaard et al. · 2014 [cited by applicant]
US 20140309863A1 · Ricci · 2014 [cited by examiner]
US 20140316616A1 · Kugelmass · 2014 [cited by examiner]
US 20140357312A1 · Davis · 2014 [cited by examiner]
US 20150054639A1 · Rosen · 2015 [cited by examiner]
US 20150106628A1 · Holman · 2015 [cited by examiner]
US 20150163345A1 · Cornaby · 2015 [cited by examiner]
US 20150189240A1 · Shmueli · 2015 [cited by applicant]
US 20150223731A1 · Sahin · 2015 [cited by examiner]
US 20150317801A1 · Bentley · 2015 [cited by examiner]
US 20150318015A1 · Bose · 2015 [cited by examiner]
US 20150341599A1 · Carey · 2015 [cited by applicant]
US 20160292881A1 · Bose · 2016 [cited by examiner]
US 20160322078A1 · Bose · 2016 [cited by examiner]
US 20170200052A1 · Carey · 2017 [cited by applicant]
US 20190172293A1 · Carey · 2019 [cited by applicant]
US 20200014885A1 · Carey · 2020 [cited by examiner]
US 20200045267A1 · Carey · 2020 [cited by applicant]
US 20200221054A1 · Carey · 2020 [cited by examiner]
JP 2004005511A · 2004 [cited by applicant]
JP 2008204079A · 2008 [cited by applicant]
JP 201351336A · 2013 [cited by applicant]
RU 83675U1 · 2009 [cited by applicant]
RU 2382408C2 · 2010 [cited by applicant]
RU 2459267C2 · 2012 [cited by applicant]
WO 2007139994A2 · 2007 [cited by applicant]
WO 2009111498A2 · 2009 [cited by applicant]
WO 2011001180A1 · 2011 [cited by applicant]
WO 2011071720A1 · 2011 [cited by applicant]
WO 2012102909A1 · 2012 [cited by applicant]
WO 2012170551A2 · 2012 [cited by applicant]
WO 2013030296A1 · 2013 [cited by applicant]
WO 2014155958A1 · 2014 [cited by applicant]
Canadian Office Action issued in corresponding application CA 3056190 dated Sep. 27, 2023. [cited by applicant]
Thailand Office Action dated May 25, 2020 issued in corresponding Thailand Appln. No. 1501006385. [cited by applicant]
Extended European Search Report dated May 14, 2020 issued in corresponding EP Appln. No. 20153816.2. [cited by applicant]
Brazilian Office Action dated Feb. 27, 2020 corresponding to counterpart Patent Application BR 112015026374. [cited by applicant]
Extended European Search Report dated Nov. 22, 2016, in connection with EP Application No. 16193237, 7 pages. [cited by applicant]
“Real-time Monitoring for Crowd Counting using Video Surveillance and GIS,” H. Song et al., IEEE, 2nd International Conference on Remote Sensing, Environment and Transportation Engineering (RSETE), Jun. 1, 2012, 4 pages. [cited by applicant]
International Search Report and Written Opinion dated Sep. 1, 2016, in connection with International Application No. PCT/US16/45371 (12 pages). [cited by applicant]
Daniel A. Vaquero et al., “Attribute-Based People Search,” Chapter 14, Intellegent Video Surveillance: Systems and Technology, published Dec. 7, 2009, pp. 387-405. [cited by applicant]
Extended European Search Report issued in European Patent Application No. 14723302.7 dated Mar. 2, 2016, 11 pages. [cited by applicant]
International Search Report for PCT/US14/28940 dated Aug. 27, 2014. [cited by applicant]
International Search Report for PCT Application Serial No. PCT/US2014/034633, dated Dec. 2, 2014. [cited by applicant]
Extended European Search Report for corresponding application No. EP 14 76 4242 dated Aug. 26, 2015. [cited by applicant]
International Preliminary Search Report for PCT Application Serial No. PCT/US2014/034633, dated Oct. 29, 2015, 7 bages. [cited by applicant]
International Preliminary Search Report for PCT Application Serial No. PCT/US2013/070067, dated Sep. 15, 2015, 6 pages. [cited by applicant]
“Configuration Backup Restore”, Jun. 30, 2010, XP055127450, retrieved from the Internet: URL: https:\\downloads.avaya.com/css/P8/documents/100088380. [cited by applicant]
Russian Office Action dated May 2, 2017 in corresponding Russian Patent Application No. 2015147449 with English translation, 8 pages. [cited by applicant]
Russian Office Action dated Oct. 23, 2017 in corresponding Russian Patent Application No. 2015147449, together with English translation, 12 pages. [cited by applicant]
Canadian Office Action issued in Appl. No. CA 2,851,732 dated Dec. 12, 2017 (4 pages). [cited by applicant]
International Preliminary Report on Patentability and Written Opinion of the International Searching Authority Issed in Int'l Appl. No. PCT/US2016/045371 dated Feb. 15, 2018 (10 pages). [cited by applicant]
European Examination Report issued in Appl. No. EP 14723302.7 dated Mar. 2, 2018 (5 pages). [cited by applicant]
https://www.nytimes.com/2013/07/15/business/attention-shopper-stores-are-t-racking-your-cell.html?_r=1& [retrieved on Aug. 2, 2018]. [cited by applicant]
Supplementary European Search Report dated Jul. 6, 2018 issued in corresponding EP Appln. No. 16833814.3. [cited by applicant]
Canadian Office Action dated May 25, 2018 issued in corresponding CA Appln. No. 2,973,866. [cited by applicant]
European Office Action dated Jul. 9, 2019 issued in corresponding EP Appln. No. 16 833 814.3. [cited by applicant]
International Search Report for corresponding application No. EP 14 76 4242 dated Aug. 26, 2015. [cited by applicant]
Daniel A. Vaquero et al., “Attribute-Based People Search,” Chapter 14, Intellegent Video Surveillance: Systems and Technology, published Dec. 16, 2009, pp. 387-405. [cited by applicant]
Supplementary European Search Report issued in corresponding European Patent Application No. 14723302.7 dated Mar. 2, 2016, 11 pages. [cited by applicant]
Russian Office Action dated Jan. 18, 2017 in corresponding Russian Patent Application No. 2015147449 together with English translation, 12 pages. [cited by applicant]
Smith, K., et al. “Detecting Abandoned Luggage Items in a Public Space,” IEEE Performance Evaluation of Tracking and Surveillance Workshop (PETS), IDIAP Research Report, Jun. 2006, pp. 1-14. [cited by applicant]
International Preliminary Search Report for corresponding PCT Application Serial No. PCT/US2014/034633, dated Oct. 29, 2015, 7 pages. [cited by applicant]
https://www.nytimes.com/2013/07/15/business/attention-shopper-stores-are-t-racking-your-cell.html?_r=1& [retrieved on Aug. 1, 2018]. [cited by applicant]
Russian Office Action dated Oct. 14, 2019 corresponding to counterpart Patent Application RU 2018104654/07 (006960). [cited by applicant]
European Office Action dated Dec. 2, 2019 corresponding to counterpart Patent Application EP 14723302.7. [cited by applicant]
Russian Search Report completed Sep. 11, 2019 corresponding to counterpart Patent Application RU 2018104654/07 (006960). [cited by applicant]
Japanese Office Action dated Jul. 20, 2020 issued in corresponding JP Appln. No. 2018-526490. [cited by applicant]
Brazilian Office Action dated Aug. 17, 2020 issued in corresponding BR Appln. No. BR112018002281-0. [cited by applicant]
European Examination Report dated Sep. 24, 2020 issued in corresponding EP Appln. No. 16 193 237.1. [cited by applicant]
Canadian Office Action dated Nov. 25, 2020 issued in corresponding CA Appln. No. 3,056,190. [cited by applicant]
Extended European Search Report dated Dec. 11, 2020 issued in corresponding EP Appln. No. 20201200.1. [cited by applicant]
Russian Office Action dated Oct. 14, 2019 corresponding to counterpart Patent Application RU 2018104654/07. [cited by applicant]
Clifford et al.: “Attention, Shoppers: Store is Tracking Your Cell,” The New York Times, available at https://www.nytimes.com/2013/07/15/business/attention-shopper-stores-are-tracking-your-cell.html?_r=1& [retrieved on … [cited by applicant]
Russian Search Report completed Sep. 11, 2019 corresponding to counterpart Patent Application RU 2018104654/07. [cited by applicant]
European Decision dated Dec. 2, 2019 corresponding to counterpart Patent Application EP 14723302.7. [cited by applicant]
Canadian Office Action dated Oct. 26, 2021 issued in corresponding CA Appln. No. 3,056,190. [cited by applicant]
Canadian Office Action issued in corresponding application CA 3,056,190 dated Oct. 26, 2021 (4 pages). [cited by applicant]
European Examination Report dated Mar. 11, 2022 issued in corresponding EP Appln. No. 20 153 816.2. [cited by applicant]
Canadian Office Action issued in corresponding application CA 2,994,712 dated Jan. 17, 2023 (4 pages). [cited by applicant]
Canadian Office Action issued in corresponding application CA 3,056,190 dated Jan. 19, 2023 (4 pages). [cited by applicant]
Canadian Office Action issued in corresponding application 3,095,814 dated Jun. 27, 2023 (4 pages). [cited by applicant]
Office Action issued in corresponding Canadian Application No. 2,994,712 dated Dec. 6, 2023 (4 pages). [cited by applicant]
Office Action issued in corresponding Brazilian Application BR 11 2018 002281 0 published Apr. 24, 2024, together with English language machine translation prepared by DeepL (8 pages). [cited by applicant]
Office Action issued in corresponding Brazilian Application No. BR112018002281-0 dated Oct. 21, 2024, together with English language translation (7 pages). [cited by applicant]
Cited By (1)
US 12,431,978