IP Library Granted Patent US 12,505,188
Granted Patent B2
US 12,505,188 · App. 18/427,370 · Granted Dec 23, 2025

Reference image enrollment and evolution for security systems

Inventors: Krishna Khadloya (San Jose, CA); Manuel Gonzalez (San Jose, CA)
Assignee: Nice North America LLC
G06F21/32G06F18/22G06N3/08G06V20/56G06V40/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,505,188
App. No.
18/427,370
Granted
Dec 23, 2025
Kind
B2
Abstract

Person or object authentication can be performed using artificial intelligence-enabled systems. Reference information, such as for use in comparisons or assessments for authentication, can be updated over time to accommodate changes in an individual's appearance, voice, or behavior. In an example, reference information can be updated automatically with test data, or reference information can be updated conditionally, based on instructions from a system administrator. Various types of media can be used for authentication, including image information, audio information, or biometric information. In an example, authentication can be performed wholly or partially at an edge device such as a security panel in an installed security system.

Claims (51)

1 . A method for authenticating, the method comprising:

receiving reference image information about a face of a first person, wherein the reference image information about the face of the first person includes information about the face of the first person when the face of the first person is fully visible without the first person wearing a face mask;

receiving a test image including information about a face of an unknown person when the face of the unknown person is partially obscured by the unknown person wearing a partial face mask; and

determining a relatedness metric indicating at least a numerical value of similarity between the first person and the unknown person by comparing a plurality of features of the face of the first person and the face of the unknown person, and based on the relatedness metric at least one of:

generating updated reference image information using the test image; and

providing a validation request to an administrator, wherein the validation request includes the relatedness metric.

2 . The method of claim 1 , wherein the partial face mask covers less than all of the face of the unknown person.

3 . The method of claim 1 , wherein determining the relatedness metric includes applying the information about the test image to a neural network-based classifier to determine a likelihood that the unknown person in the test image is the first person.

4 . The method of claim 1 , wherein the reference image information about the face of the first person is received at a first time when the first person has first facial characteristics, and wherein the test image includes information about the face of the first person at a second time when the first person has different second facial characteristics.

5 . The method of claim 1 , comprising receiving reference image information about a first vehicle from a reference image of the first vehicle, wherein the test image includes information about the first vehicle or a different vehicle.

6 . The method of claim 5 , wherein receiving the reference image information about the first vehicle includes receiving information about one or more reference attributes of the first vehicle, wherein the one or more reference attributes of the first vehicle are determined using the reference image of the first vehicle, and the method further comprising:

identifying a second vehicle in the test image; and

identifying candidate attributes of the second vehicle using the test image;

wherein determining the relatedness metric includes comparing the one or more reference attributes of the first vehicle and the candidate attributes of the second vehicle.

7 . The method of claim 1 , further comprising:

receiving a validation result from the administrator; and

updating the reference image information using the test image based on the validation result, wherein updating the reference image information includes providing the test image to a machine learning system.

8 . The method of claim 7 , wherein the machine learning system is configured to recognize an evolutionary characteristic between the test image and the reference image information and to apply the evolutionary characteristic to enable recognition of other candidate objects in other test images.

9 . A method for authenticating, the method comprising:

receiving reference image information about a first object;

receiving a test image including information about a second object;

determining an elapsed time between receiving the reference image information and receiving the test image; and

responsive to the elapsed time exceeding a specified threshold elapsed time limit,

providing a validation request to an administrator, wherein the validation request includes one or more of a relatedness metric, information about the first object, or information about the second object, wherein the relatedness metric indicates a magnitude of relatedness of the first object to the second object.

10 . The method of claim 9 , comprising determining the relatedness metric using a neural network-based classifier to determine a likelihood that the second object is the same object as the first object.

11 . The method of claim 9 , wherein the information about the second object includes information from a sensor, wherein the sensor includes one or more of an image sensor, an audio sensor, a biometric sensor, or an environmental condition sensor.

12 . The method of claim 11 , comprising determining the relatedness metric including transmitting at least one of the information about the second object or the information from the sensor to a neural network-based classifier to determine a likelihood that the second object in the test image is the first object.

13 . The method of claim 9 , further comprising:

receiving a validation result from the administrator; and

updating the reference image information using the test image based on the validation result, wherein updating the reference image information includes providing the test image to a machine learning system, and wherein the machine learning system is configured to recognize an evolutionary characteristic between the test image and the reference image information and to apply the evolutionary characteristic to enable recognition of other candidate objects in other test images.

14 . A system for remote authentication, the system comprising:

an authorization device to maintain reference information about one or more objects; and

at least one edge device, remote from and communicatively coupled to the authorization device, wherein the at least one edge device includes processing circuitry to:

receive reference information about a target object from at least one of a local database or the authorization device, wherein the reference information includes information about a face of a first person when the face of the first person is fully visible without the first person wearing a face mask;

receive a test image including information about a candidate object, wherein the test image includes information about the face of the first person when the face of the first person is partially obscured by the unknown person wearing a partial face mask;

determine an elapsed time between acquisition of the reference information and the test image; and

determine a relatedness metric indicating at least a numerical value of similarity between the target object and the candidate object by comparing a plurality of features of the face of the first person and the face of the unknown person, and based on the relatedness metric, at least one of:

generate updated reference information using the test image; and

provide a validation request to the authorization device, wherein the validation request includes the relatedness metric, and is provided to the authorization device when the elapsed time exceeds a specified threshold elapsed time limit.

15 . The system of claim 14 , wherein the authorization device is configured to receive the validation request from the at least one edge device and update the reference information based on the information about the candidate object.

16 . The system of claim 15 , wherein the authorization device is further configured to provide an access control instruction to the at least one edge device in response to receiving the validation request, and wherein the at least one edge device is configured to use the access control instruction to control operation of a physical barrier or generate an alert.

17 . The system of claim 14 , wherein the processing circuitry is further to:

generate updated reference information using information about the candidate object when the relatedness metric as-determined, meets or exceeds a specified relatedness threshold.

18 . The system of claim 14 , wherein the authorization device is configured to update the reference information about the target object using data received from at least one of a system administrator or one or more sensors communicatively couple to the authorization device.

19 . A method for authenticating, the method comprising:

receiving reference image information about a face of a first person, wherein the reference image information about the face of the first person includes information about the face of the first person when the face of the first person is fully visible without the first person wearing a face mask;

receiving a test image including information about a face of an unknown person when the face of the unknown person is partially obscured by the unknown person wearing a partial face mask; and

determining a relatedness metric indicating a numerical value of similarity of the faces of the first person and the unknown person by comparing a plurality of features of the face of the first person and the face of the unknown person, and based on the relatedness metric at least one of:

generating updated reference image information using the test image; and

providing a validation request to an administrator, wherein the validation request includes one or more of the relatedness metric, information about the first person, or information about the unknown person,

wherein the information about the face of the first person when the face of the first person is fully visible includes information about the face of the first person when the first person is without a face mask, and wherein the information about the face of the first person when the face of the first person is partially obscured includes information about a face of the first person when the first person is wearing a partial face mask.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 7, 2024
From: INTELLIVISION TECHNOLOGIES CORP.
To: NICE NORTH AMERICA LLC
Reel/Frame 068815/0671 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2024
From: KHADLOYA,, KRISHNA; GONZALEZ, MANUEL
To: INTELLIVISION TECHNOLOGIES CORP
Reel/Frame 066419/0551 →
Continuity (2)
Continuation 17200584 · Mar 12, 2021
Related Publication 20240184868A1 · Jun 6, 2024
References Cited (106)
US 5835616A · Lobo et al. · 1998 [cited by applicant]
US 6111517A · Atick et al. · 2000 [cited by applicant]
US 7130454B1 · Berube et al. · 2006 [cited by applicant]
US 7178025B2 · Scheidt et al. · 2007 [cited by applicant]
US 7634662B2 · Monroe · 2009 [cited by applicant]
US 7784680B1 · Mason · 2010 [cited by examiner]
US 7817013B2 · Bazakos et al. · 2010 [cited by applicant]
US 8090160B2 · Kakadiaris et al. · 2012 [cited by applicant]
US 8311293B2 · Okada · 2012 [cited by applicant]
US 8559684B1 · Nechyba · 2013 [cited by applicant]
US 8614673B2 · Binder · 2013 [cited by applicant]
US 8730029B2 · Petricoin, Jr. · 2014 [cited by applicant]
US 8842889B1 · Konoplev et al. · 2014 [cited by applicant]
US 8913798B2 · Kim et al. · 2014 [cited by applicant]
US 9014514B2 · Boncyk · 2015 [cited by examiner]
US 9030562B2 · Petricoin, Jr. · 2015 [cited by applicant]
US 9542390B2 · Shankaranarayana · 2017 [cited by applicant]
US 9959694B2 · Lindsay · 2018 [cited by applicant]
US 10074024B2 · El Kaliouby et al. · 2018 [cited by applicant]
US 10157537B1 · Coxwell · 2018 [cited by applicant]
US 10210381B1 · Mostafa et al. · 2019 [cited by applicant]
US 10331941B2 · Rhee et al. · 2019 [cited by applicant]
US 10387739B2 · Han et al. · 2019 [cited by applicant]
US 10482345B2 · Jouhikainen · 2019 [cited by examiner]
US 10699169B2 · Kang · 2020 [cited by examiner]
US 11159560B1 · Limb · 2021 [cited by examiner]
US 11210502B2 · Zheng · 2021 [cited by applicant]
US 11502841B2 · Streit · 2022 [cited by examiner]
US 11527089B2 · Desai · 2022 [cited by examiner]
US 20020097145A1 · Tumey et al. · 2002 [cited by applicant]
US 20030004881A1 · Shinzaki · 2003 [cited by examiner]
US 20030138135A1 · Chung · 2003 [cited by examiner]
US 20040151347A1 · Wisniewski · 2004 [cited by applicant]
US 20040239481A1 · Beenau et al. · 2004 [cited by applicant]
US 20050220326A1 · Sim · 2005 [cited by examiner]
US 20060158307A1 · Lee et al. · 2006 [cited by applicant]
US 20060222210A1 · Sundaram · 2006 [cited by examiner]
US 20080209545A1 · Asano · 2008 [cited by examiner]
US 20080317298A1 · Shah · 2008 [cited by examiner]
US 20100017389A1 · Ogunbona et al. · 2010 [cited by applicant]
US 20100201498A1 · Griffin · 2010 [cited by examiner]
US 20100316293A1 · Claussen · 2010 [cited by examiner]
US 20110150278A1 · Shimizu · 2011 [cited by applicant]
US 20130070976A1 · Myers · 2013 [cited by examiner]
US 20130223696A1 · Azar et al. · 2013 [cited by applicant]
US 20140016837A1 · Nechyba et al. · 2014 [cited by applicant]
US 20140055553A1 · Lee · 2014 [cited by examiner]
US 20140247963A1 · Lin et al. · 2014 [cited by applicant]
US 20160191995A1 · El Kaliouby et al. · 2016 [cited by applicant]
US 20160335861A1 · Shimura · 2016 [cited by examiner]
US 20170206272A1 · Neela · 2017 [cited by examiner]
US 20170289144A1 · Ionita · 2017 [cited by examiner]
US 20180004924A1 · Tieu · 2018 [cited by applicant]
US 20180232902A1 · Albadawi · 2018 [cited by examiner]
US 20180285629A1 · Son · 2018 [cited by examiner]
US 20180293429A1 · Wechsler et al. · 2018 [cited by applicant]
US 20190122024A1 · Schwartz et al. · 2019 [cited by applicant]
US 20190147156A1 · Burri et al. · 2019 [cited by applicant]
US 20190147676A1 · Madzhunkov et al. · 2019 [cited by applicant]
US 20190197247A1 · Anderson · 2019 [cited by examiner]
US 20190272415A1 · Miao · 2019 [cited by examiner]
US 20190295267A1 · Cheng et al. · 2019 [cited by applicant]
US 20190332884A1 · Siddiqui · 2019 [cited by applicant]
US 20200128004A1 · Shattuck et al. · 2020 [cited by applicant]
US 20200193201A1 · Liu et al. · 2020 [cited by applicant]
US 20200364479A1 · Tseng · 2020 [cited by examiner]
US 20210319212A1 · Debnath · 2021 [cited by examiner]
US 20210326616A1 · Lee · 2021 [cited by examiner]
US 20220292170A1 · Khadloya et al. · 2022 [cited by applicant]
US 20230063229A1 · Vemulapalli · 2023 [cited by examiner]
US 20230126806A1 · Kim et al. · 2023 [cited by applicant]
US 20250078567A1 · Schillen · 2025 [cited by examiner]
CN 108304827A · 2018 [cited by applicant]
KR 20090018440A · 2009 [cited by applicant]
KR 101998112B1 · 2019 [cited by applicant]
KR 102067947B1 · 2020 [cited by applicant]
WO WO2015122789A1 · 2015 [cited by applicant]
WO WO2016011204A1 · 2016 [cited by applicant]
U.S. Appl. No. 17/200,584, filed Mar. 12, 2021, Enrollment System with Continuous Learning and Confirmation. [cited by applicant]
“7th World Machine Learning and Deep Learning Congress Brochure”, Conference Series LLC Ltd, [Online] Retrieved from the Internet: <URL: https://machinelearning.conferenceseries.com/conference-brochure.php>, (Retrieved … [cited by applicant]
“Access Control Through Face Recognition”, FaceFirst, [Online] Retrieved from the Internet: <URL: https://www.facefirst.com/solutions/access-control-through-face-recognition-2/>, (Retrieved on Jun. 3, 2020), 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/200,584, Non Final Office Action mailed Jul. 28, 2023”, 35 pgs. [cited by applicant]
“U.S. Appl. No. 17/200,584, Notice of Allowance mailed Oct. 30, 2023”, 16 pgs. [cited by applicant]
“U.S. Appl. No. 17/200,584, Response filed Oct. 12, 2023 to Non Final Office Action mailed Jul. 28, 2023”, 11 pgs. [cited by applicant]
“European Application Serial No. 22161159.3, Extended European Search Report mailed Jul. 22, 2022”, 9 pgs. [cited by applicant]
“European Application Serial No. 22161159.3, Response filed Mar. 7, 20023 to Extended European Search Report mailed Jul. 22, 2022”, 23 pgs. [cited by applicant]
“Face Authentication HIDL”, Android Open Source Project, [Online] Retrieved from the Internet: <URL: https://source.android.com/security/biometric/face-authentication>, (May 4, 2020), 6 pgs. [cited by applicant]
“Face Recognition System”, Agrex Technologies Private Limited, [Online] Retrieved from the Internet: <URL: https://agrexai.com/face-recognition-system/>, (Retrieved on Jun. 3, 2020), 4 pgs. [cited by applicant]
“Facial Recognition Access Management”, Findface by NTech Lab, [Online] Retrieved from the Internet: <URL: https://findface.pro/en_in/cases/access-management/>, (Retrieved on Jun. 3, 2020), 4 pgs. [cited by applicant]
“Facial Recognition can secure Commercial Facilities in 5 Great Ways”, Umbrella Technologies, [Online] Retrieved from the Internet: <URL: https://umbrellatech.co/5-ways-facial-recognition-can-secure-commercial-facilitie… [cited by applicant]
“Facial recognition: top 7 trends (tech, vendors, markets, use cases and latest news)”, Thales Group, [Online] Retrieved from the Internet: <URL: https://www.thalesgroup.com/en/markets/digital-identity-and-security/gove… [cited by applicant]
“Find X Face and Passcode Features”, OPPO Global, [Online] Retrieved from the Internet: <URL: https://oppo.custhelp.com/app/answers/detail/a_id/2541/˜/find-x-face-and-passcode>, (Retrieved on Jun. 3, 2020), 15 pgs. [cited by applicant]
“How to use Face Recognition?”, Huawei Support UK, [Online] Retrieved from the Internet: <URL: https://consumer.huawei.com/uk/support/faq/how-to-use-face-recognition/>, (Retrieved on Jun. 3, 2020), 6 pgs. [cited by applicant]
“Opinion Feb. 2012 on facial recognition in online and mobile services”, European Commission, Article 29 of Directive 95/46/EC—Data Protection Working Party, [Online] Retrieved from the Internet: <URL: https://ec.europa… [cited by applicant]
“Sentinel-IQ Face Recognition Platform”, FaceFirst, [Online] Retrieved from the Internet: <URL: https://www.facefirst.com/solutions/surveillance-face-recognition/>, (Retrieved on Jun. 3, 2020), 10 pgs. [cited by applicant]
Aleluya, Earl Ryan M, et al., “Faceture ID: face and hand gesture multi-factor authentication using deep learning”, Procedia Computer Science 135, (2018), 147-154. [cited by applicant]
Choi, Hyunsoek, et al., “A Multimodal User Authentication System Using Faces and Gestures”, Hindawi Publishing Corp., BioMed Research International vol. 2015, Article ID 343475, (2015), 8 pgs. [cited by applicant]
Delac, Kresimir, Ed., et al., “Face Recognition”, I-TECH Education and Publishing, (2007), 570 pgs. [cited by applicant]
Farag, Mostafa A, “Face recognition in the wild”, U. of Louisville, Electronic Theses and Dissertations, Paper 2278, [Online] Retrieved from the Internet: <URL: https://ir.library.louisville.edu/cgi/viewcontent.cgi?arti… [cited by applicant]
Mahdi, Fahad Parvez, et al., “Face recognition-based real-time system for surveillance”, Intelligent Decision Technologies 11, (2017), 79-92. [cited by applicant]
Pantic, Maja, et al., “Automatic Analysis of Facial Expressions: The State of the Art”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12), (Dec. 2000), 1424-1445. [cited by applicant]
Roux, Melissa, “How Biometric Facial Recognition is improving security”, SightCorp, [Online] Retrieved from the Internet: <URL: https://sightcorp.com/blog/how-biometric-facial-recognition-is-improving-security/>, (Mar. … [cited by applicant]
Rovai, Marcelo J, “Real-time Face Recognition: an End-to-end Project”, Instructables, [Online] Retrieved from the Internet: <URL: https://www.instructables.com/id/Real-time-Face-Recognition-an-End-to-end-Project/>, (Ret… [cited by applicant]
Sato, Atsushi, et al., “Advances in Face Detection and Recognition Technologies”, NEC J. of Adv. Tech., 2(1), (2005), 28-34. [cited by applicant]
Singh, D Narendar, et al., “IOT Based Automated Attendance with Face Recognition System”, Intl. Journal of Innovative Technology and Exploring Engineering (IJITEE), 8(6S4), (Apr. 2019), 450-456. [cited by applicant]
Vance, Mike, “How Facial Recognition Can Provide Secure Access for K-12 Schools”, Campus Security and Life Safety, [Online] Retrieved from the Internet: <URL: https://campuslifesecurity.com/articles/2019/04/01/how-facia… [cited by applicant]