IP Library › Granted Patent US 12,283,168
Granted Patent B2
US 12,283,168 · App. 18/407,855 · Granted Apr 22, 2025

Video identification and analytical recognition system

Inventor: James Carey (Commack, NY)
G08B15/004G06T7/20G06T7/246G06V20/13G06V20/52G06V20/53G06V40/10G06V40/161G06V40/20G06V40/23G08B13/19608G08B13/19613H04N7/181H04N7/185H04N23/45H04W8/005G06T2207/10016G06T2207/30232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,283,168
App. No.
18/407,855
Filed
Jan 9, 2024
Granted
Apr 22, 2025
Kind
B2
Art Unit
2485
USPC
348/150
Abstract

An analytical recognition system includes a video camera, an antenna, and a data analytics module. The video camera is configured to capture video data. The antenna is configured to capture mobile communication device data. The data analytics module is configured to correlate the video data and the mobile communication device data to generate a profile of a person associated with the video data and the mobile communication device data. The profile has profile data including any one or a combination of the captured video data and the captured mobile communication data.

Claims (23)

1. A method for analytical recognition comprising:

capturing by one or more video cameras video data including a video frame having a person;

capturing mobile communication device data by one or more antennae, the mobile communication device data including an identifier of a mobile communication device associated with the person;

correlating portions of the video data to respective portions of the captured mobile communication device data based on one or more keys included within the video data and the mobile communication device data; and

generating a profile of the person associated with the correlated portions of video data and the mobile communication device data, wherein the profile includes profile data including at least one of the video data, the mobile communication device data, and additional data, the additional data including sales data or user-inputted data such as name, date of birth, other phone data, email address, or residential address,

wherein the attributes include at least one of whether the person is a return shopper, a first-time shopper, an employee, a passerby, whether the person shops at other locations of a particular retailer, or whether the person was engaged by an employee while located at a store.

2. The method of claim 1 , wherein the key included within the portion of video data is a facial image of the person.

3. The method of claim 1 , wherein the key included within the mobile communication device data is at least one of an IP address of the mobile communication device, an identifier of the one or more antennae, signal strength of the mobile communication device data, or location of the one or more antennae.

4. The method of claim 1 , further comprising normalizing the profile data based on one or more normalization criteria.

5. The method of claim 4 , wherein the normalization criteria include at least one of number of visits the person has made to a particular location, duration of time the person has remained at a particular location, or a frequency or repetition rate of visits the person has made to a particular location.

6. The method of claim 1 , further comprising updating the profile data to include one or more attributes generated based on data aggregated for each profile over time.

7. A system for analytical recognition comprising:

one or more video cameras configured to capture video data including a video frame having a person;

one or more antennae configured to capture mobile communication device data, which includes an identifier of a mobile communication device associated with the person; and

a processor configured to:

correlate portions of the captured video data to respective portions of the captured mobile communication device data based on one or more keys included within the captured video data and the mobile communication device data; and

generate a profile of the person associated with the correlated portions of video data and the mobile communication device data, wherein the profile includes profile data having at least one of the captured video data, the mobile communication device data, or additional data, the additional data including sales data or user-inputted data such as name, date of birth, other phone data, email address, or residential address,

wherein the attributes include at least one of whether the person is a return shopper, a first-time shopper, an employee, a passerby, whether the person shops at other locations of a particular retailer, or whether the person was engaged by an employee while located at a store.

8. The system of claim 7 , wherein the key included within the portion of video data is a facial image of the person.

9. The system of claim 7 , wherein the key included within the mobile communication device data is at least one of an IP address of the mobile communication device, an identifier of the one or more antennae, signal strength of the mobile communication device data, or location of the one or more antennae.

10. The system of claim 7 , wherein the processor is further configured to normalize the profile data based on one or more normalization criteria.

11. The system of claim 10 , wherein the normalization criteria include at least one of number of visits the person has made to a particular location, duration of time the person has remained at a particular location, or a frequency or repetition rate of visits the person has made to a particular location.

12. The system of claim 7 , wherein the processor is further configured to update the profile data to include one or more attributes generated based on data aggregated for each profile over time.

Continuity (9)
Continuation 17348477 · Jun 15, 2021
Continuation 16571522 · Sep 16, 2019
Continuation 15469885 · Mar 27, 2017
Continuation 14817871 · Aug 4, 2015
Continuation In Part 14256385 · Apr 18, 2014
Continuation In Part 14213548 · Mar 14, 2014
Provisional Application 61813942 · Apr 19, 2013
Provisional Application 61798740 · Mar 15, 2013
Related Publication 20240144799A1 · May 2, 2024
References Cited (188)
US 6975346B2 · Kumhyr · 2005 [cited by applicant]
US 7308487B1 · Dansie et al. · 2007 [cited by applicant]
US 7619508B2 · Lynam · 2009 [cited by examiner]
US 7683929B2 · Elazar · 2010 [cited by examiner]
US 7769221B1 · Shakes · 2010 [cited by applicant]
US 7965312B2 · Chung · 2011 [cited by applicant]
US 8072318B2 · Lynam · 2011 [cited by examiner]
US 8195598B2 · Hua et al. · 2012 [cited by applicant]
US 8271336B2 · Mikurak · 2012 [cited by applicant]
US 8615254B2 · Jamtgaard · 2013 [cited by examiner]
US 8653959B2 · Lynam · 2014 [cited by examiner]
US 9101279B2 · Ritchey · 2015 [cited by examiner]
US 9352623B2 · Lynam · 2016 [cited by examiner]
US 9406336B2 · Bose et al. · 2016 [cited by applicant]
US 9451899B2 · Ritchey · 2016 [cited by examiner]
US 9694749B2 · Lynam · 2017 [cited by examiner]
US 9762865B2 · Carey · 2017 [cited by examiner]
US 9773163B2 · Carey · 2017 [cited by examiner]
US 9786113B2 · Carey · 2017 [cited by examiner]
US 10078787B2 · Carey · 2018 [cited by applicant]
US 10272839B2 · Lynam · 2019 [cited by examiner]
US 10432897B2 · Carey · 2019 [cited by examiner]
US 10972704B2 · Carey · 2021 [cited by applicant]
US 11039108B2 · Carey · 2021 [cited by examiner]
US 11055356B2 · Ritchey · 2021 [cited by examiner]
US 11100334B2 · Carey · 2021 [cited by applicant]
US 11743431B2 · Carey · 2023 [cited by applicant]
US 11869325B2 · Carey · 2024 [cited by examiner]
US 20010010541A1 · Fernandez · 2001 [cited by applicant]
US 20030067542A1 · Monroe · 2003 [cited by applicant]
US 20030197612A1 · Tanaka et al. · 2003 [cited by applicant]
US 20040117638A1 · Monroe · 2004 [cited by applicant]
US 20040143602A1 · Ruiz · 2004 [cited by applicant]
US 20040161133A1 · Elazar · 2004 [cited by examiner]
US 20060064384A1 · Mehrotra · 2006 [cited by applicant]
US 20060244826A1 · Chew · 2006 [cited by applicant]
US 20070003141A1 · Rittscher et al. · 2007 [cited by applicant]
US 20070057049A9 · Kundu et al. · 2007 [cited by applicant]
US 20070127774A1 · Zhang et al. · 2007 [cited by applicant]
US 20070297607A1 · Ogura et al. · 2007 [cited by applicant]
US 20080015013A1 · Gelman et al. · 2008 [cited by applicant]
US 20080018738A1 · Lipton et al. · 2008 [cited by applicant]
US 20080106599A1 · Liu et al. · 2008 [cited by applicant]
US 20080198231A1 · Ozdemir et al. · 2008 [cited by applicant]
US 20090033745A1 · Yeredor et al. · 2009 [cited by applicant]
US 20090052747A1 · Kamiyama et al. · 2009 [cited by applicant]
US 20090141939A1 · Chambers · 2009 [cited by applicant]
US 20090189981A1 · Siann et al. · 2009 [cited by applicant]
US 20090222388A1 · Hua et al. · 2009 [cited by applicant]
US 20090268030A1 · Markham · 2009 [cited by applicant]
US 20100026802A1 · Titus et al. · 2010 [cited by applicant]
US 20100079594A1 · Voglewede et al. · 2010 [cited by applicant]
US 20100111377A1 · Monroe · 2010 [cited by applicant]
US 20100135643A1 · Fleming · 2010 [cited by applicant]
US 20100141786A1 · Bigioi · 2010 [cited by applicant]
US 20100182428A1 · Lu et al. · 2010 [cited by applicant]
US 20100234986A1 · Clopton · 2010 [cited by applicant]
US 20100260426A1 · Huang et al. · 2010 [cited by applicant]
US 20100311347A1 · Le Thierry D'Ennequin et al. · 2010 [cited by applicant]
US 20100318566A1 · Yoshio et al. · 2010 [cited by applicant]
US 20100321183A1 · Donovan et al. · 2010 [cited by applicant]
US 20100329513A1 · Klefenz · 2010 [cited by applicant]
US 20110128374A1 · Shellshear et al. · 2011 [cited by applicant]
US 20110134240A1 · Anderson · 2011 [cited by examiner]
US 20110211070A1 · Shu et al. · 2011 [cited by applicant]
US 20110273309A1 · Zhang et al. · 2011 [cited by applicant]
US 20120008836A1 · Bobbitt et al. · 2012 [cited by applicant]
US 20120069131A1 · Abelow · 2012 [cited by examiner]
US 20120076356A1 · Li et al. · 2012 [cited by applicant]
US 20120127314A1 · Clements · 2012 [cited by applicant]
US 20120147169A1 · Harper et al. · 2012 [cited by applicant]
US 20120190380A1 · Dupray et al. · 2012 [cited by applicant]
US 20120206592A1 · Gerst, III · 2012 [cited by examiner]
US 20120208592A1 · Davis et al. · 2012 [cited by applicant]
US 20120218412A1 · Dellantoni · 2012 [cited by examiner]
US 20120229647A1 · Calman et al. · 2012 [cited by applicant]
US 20120233032A1 · Calman et al. · 2012 [cited by applicant]
US 20120233033A1 · Calman et al. · 2012 [cited by applicant]
US 20120262575A1 · Champagne · 2012 [cited by examiner]
US 20120311564A1 · Khalid · 2012 [cited by applicant]
US 20120320195A1 · Tener · 2012 [cited by examiner]
US 20120324061A1 · Parsons et al. · 2012 [cited by applicant]
US 20120327241A1 · Howe · 2012 [cited by examiner]
US 20130027561A1 · Lee et al. · 2013 [cited by applicant]
US 20130030875A1 · Lee · 2013 [cited by applicant]
US 20130041961A1 · Thrower, III et al. · 2013 [cited by applicant]
US 20130063550A1 · Ritchey · 2013 [cited by examiner]
US 20130073366A1 · Heath · 2013 [cited by applicant]
US 20130101159A1 · Chao et al. · 2013 [cited by applicant]
US 20130155229A1 · Thornton · 2013 [cited by examiner]
US 20130201333A1 · Yoon · 2013 [cited by examiner]
US 20130271598A1 · Mariadoss · 2013 [cited by examiner]
US 20140018059A1 · Noonan · 2014 [cited by applicant]
US 20140052680A1 · Nitz et al. · 2014 [cited by applicant]
US 20140052681A1 · Nitz et al. · 2014 [cited by applicant]
US 20140132767A1 · Sonnabend · 2014 [cited by applicant]
US 20140201126A1 · Zadeh · 2014 [cited by applicant]
US 20140214676A1 · Bukai · 2014 [cited by examiner]
US 20140253727A1 · Sadrieh · 2014 [cited by examiner]
US 20140277902A1 · Koch · 2014 [cited by examiner]
US 20140285660A1 · Jamtgaard et al. · 2014 [cited by applicant]
US 20140309863A1 · Ricci · 2014 [cited by applicant]
US 20140316616A1 · Kugelmass · 2014 [cited by applicant]
US 20140357312A1 · Davis · 2014 [cited by examiner]
US 20150054639A1 · Rosen · 2015 [cited by applicant]
US 20150106628A1 · Holman · 2015 [cited by applicant]
US 20150163345A1 · Cornaby · 2015 [cited by applicant]
US 20150189240A1 · Shmueli · 2015 [cited by applicant]
US 20150223731A1 · Sahin · 2015 [cited by applicant]
US 20150317801A1 · Bentley et al. · 2015 [cited by applicant]
US 20150318015A1 · Bose et al. · 2015 [cited by applicant]
US 20150324692A1 · Ritchey · 2015 [cited by examiner]
US 20150341599A1 · Carey · 2015 [cited by applicant]
US 20160292881A1 · Bose et al. · 2016 [cited by applicant]
US 20160322078A1 · Bose et al. · 2016 [cited by applicant]
US 20170061034A1 · Ritchey · 2017 [cited by examiner]
US 20170200052A1 · Carey · 2017 [cited by applicant]
US 20190172293A1 · Carey · 2019 [cited by applicant]
US 20200014885A1 · Carey · 2020 [cited by applicant]
US 20200045267A1 · Carey · 2020 [cited by applicant]
US 20200221054A1 · Carey · 2020 [cited by applicant]
JP 2004005511A · 2004 [cited by applicant]
JP 2007142527A · 2007 [cited by examiner]
JP 2008204079A · 2008 [cited by applicant]
JP 2013513336A · 2013 [cited by applicant]
RU 83675U1 · 2009 [cited by applicant]
RU 2382408C2 · 2010 [cited by applicant]
RU 2459267C2 · 2012 [cited by applicant]
WO 2007139994A2 · 2007 [cited by applicant]
WO 2009111498A2 · 2009 [cited by applicant]
WO 2011001180A1 · 2011 [cited by applicant]
WO 2011071720A1 · 2011 [cited by applicant]
WO 2012102909A1 · 2012 [cited by applicant]
WO 2012170551A2 · 2012 [cited by applicant]
WO 2013030296A1 · 2013 [cited by applicant]
WO 2014155958A1 · 2014 [cited by applicant]
Extended European Search Report for corresponding application No. EP 14 76 4242 dated Aug. 26, 2015. [cited by applicant]
International Search Report for PCT/US14/28940 dated Aug. 27, 2014. [cited by applicant]
Daniel A. Vaquero et al., “Attribute-Based People Search,” Chapter 14, Intellegent Video Surveillance: Systems and Technology, published Dec. 7, 2009, pp. 387-405. [cited by applicant]
Smith, K., et al. “Detecting Abandoned Luggage Items in a Public Space,” IEEE Performance Evaluation of Tracking and Surveillance Workshop (PETS), IDIAP Research Report, Jun. 2006, pp. 1-14. [cited by applicant]
International Search Report for corresponding application No. EP 14 76 4242 dated Aug. 26, 2015. [cited by applicant]
Thailand Office Action dated May 25, 2020 issued in corresponding Thailand Appln. No. 1501006385. [cited by applicant]
Extended European Search Report dated May 14, 2020 issued in corresponding EP Appln. No. 20153816.2. [cited by applicant]
Brazilian Office Action dated Feb. 27, 2020 corresponding to counterpart Patent Application BR 112015026374. [cited by applicant]
Extended European Search Report dated Nov. 22, 2016, in connection with EP Application No. 16193237, 7 pages. [cited by applicant]
“Real-time Monitoring for Crowd Counting using Video Surveillance and GIS,” H. Song et al., IEEE, 2nd International Conference on Remote Sensing, Environment and Transportation Engineering (RSETE), Jun. 1, 2012, 4 pages. [cited by applicant]
International Search Report and Written Opinion dated Sep. 1, 2016, in connection with International Application No. PCT/US16/45371 (12 pages). [cited by applicant]
Extended European Search Report issued in European Patent Application No. 14723302.7 dated Mar. 2, 2016, 11 pages. [cited by applicant]
International Search Report for PCT Application Serial No. PCT/US2014/034633, dated Dec. 2, 2014. [cited by applicant]
International Preliminary Search Report for PCT Application Serial No. PCT/US2014/034633, dated Oct. 29, 2015, 7 pages. [cited by applicant]
International Preliminary Search Report for PCT Application Serial No. PCT/US2013/070067, dated Sep. 15, 2015, 6 pages. [cited by applicant]
“Configuration Backup Restore”, Jun. 30, 2010, XP055127450, retrieved from the Internet: URL: https:\\downloads.avaya.com/css/P8/documents/100088380. [cited by applicant]
Russian Office Action dated May 2, 2017 in corresponding Russian Patent Application No. 2015147449 with English translation, 8 pages. [cited by applicant]
Russian Office Action dated Oct. 23, 2017 in corresponding Russian Patent Application No. 2015147449, together with English translation, 12 pages. [cited by applicant]
Canadian Office Action issued in Appl. No. CA 2,851,732 dated Dec. 12, 2017 (4 pages). [cited by applicant]
International Preliminary Report on Patentability and Written Opinion of the International Searching Authority Issed in Int'l Appl. No. PCT/US2016/045371 dated Feb. 15, 2018 (10 pages). [cited by applicant]
European Examination Report issued in Appl. No. EP 14723302.7 dated Mar. 2, 2018 (5 pages). [cited by applicant]
https://www.nytimes.com/2013/07/15/business/attention-shopper-stores-are-t- racking-your-cell.html?_r=1& [retrieved on Aug. 2, 2018]. [cited by applicant]
Supplementary European Search Report dated Jul. 6, 2018 issued in corresponding EP Appln. No. 16833814.3. [cited by applicant]
Canadian Office Action dated May 25, 2018 issued in corresponding CA Appln. No. 2,973,866. [cited by applicant]
European Office Action dated Jul. 9, 2019 issued in corresponding EP Appln. No. 16 833 814.3. [cited by applicant]
Daniel A. Vaquero et al., “Attribute-Based People Search,” Chapter 14, Intellegent Video Surveillance: Systems and Technology, published Dec. 16, 2009, pp. 387-405. [cited by applicant]
Supplementary European Search Report issued in corresponding European Patent Application No. 14723302.7 dated Mar. 2, 2016, 11 pages. [cited by applicant]
Russian Office Action dated Jan. 18, 2017 in corresponding Russian Patent Application No. 2015147449 together with English translation, 12 pages. [cited by applicant]
International Preliminary Search Report for corresponding PCT Application Serial No. PCT/US2014/034633, dated Oct. 29, 2015, 7 pages. [cited by applicant]
https://www.nytimes.com/2013/07/15/business/attention-shopper-stores-are-t- racking-your-cell.html ?_r=1& [retrieved on Aug. 1, 2018]. [cited by applicant]
Russian Office Action dated Oct. 14, 2019 corresponding to counterpart Patent Application RU 2018104654/07 (006960). [cited by applicant]
European Office Action dated Dec. 2, 2019 corresponding to counterpart Patent Application EP 14723302.7. [cited by applicant]
Russian Search Report completed Sep. 11, 2019 corresponding to counterpart Patent Application RU 2018104654/07 (006960). [cited by applicant]
Japanese Office Action dated Jul. 20, 2020 issued in corresponding JP Appln. No. 2018-526490. [cited by applicant]
Brazilian Office Action dated Aug. 17, 2020 issued in corresponding BR Appln. No. BR112018002281-0. [cited by applicant]
European Examination Report dated Sep. 24, 2020 issued in corresponding EP Appln. No. 16 193 237.1. [cited by applicant]
Canadian Office Action dated Nov. 25, 2020 issued in corresponding CA Appln. No. 3,056, 190. [cited by applicant]
Extended European Search Report dated Dec. 11, 2020 issued in corresponding EP Appln. No. 20201200.1. [cited by applicant]
Russian Office Action dated Oct. 14, 2019 corresponding to counterpart Patent Application RU 2018104654/07. [cited by applicant]
Clifford et al.: “Attention, Shoppers: Store is Tracking Your Cell,” The New York Times, available at https://www.nytimes.com/2013/07/15/business/attention-shopper-stores-are-- tracking-your-cell.html?_r=1& [retrieved o… [cited by applicant]
Russian Search Report completed Sep. 11, 2019 corresponding to counterpart Patent Application RU 2018104654/07. [cited by applicant]
European Decision dated Dec. 2, 2019 corresponding to counterpart Patent Application EP 14723302.7. [cited by applicant]
Canadian Office Action dated Oct. 26, 2021 issued in corresponding CA Appln. No. 3,056,190. [cited by applicant]
Canadian Office Action issued in corresponding application CA 3,056,190 dated Oct. 26, 2021 (4 pages). [cited by applicant]
European Examination Report dated Mar. 11, 2022 issued in corresponding EP Appln. No. 20 153 816.2. [cited by applicant]
Canadian Office Action issued in corresponding application CA 2,994,712 dated Jan. 17, 2023 (4 pages). [cited by applicant]
Canadian Office Action issued in corresponding application CA 3,056,190 dated Jan. 19, 2023 (4 pages). [cited by applicant]
Canadian Office Action issued in corresponding application 3,095,814 dated Jun. 27, 2023 (4 pages). [cited by applicant]
Canadian Office Action issued in corresponding application CA 3056190 dated Sep. 27, 2023. [cited by applicant]
Office Action issued in corresponding Canadian Application No. 2,994,712 dated Dec. 6, 2023 (4 pages). [cited by applicant]
Office Action issued in corresponding Brazilian Application BR 11 2018 002281 0 published Apr. 24, 2024, together with English language machine translation prepared by DeepL (8 pages). [cited by applicant]
Office Action issued in corresponding Brazilian Application No. BR112018002281-0 dated Oct. 21, 2024, together with English language translation (7 pages). [cited by applicant]