IP Library Granted Patent US 12,373,540
Granted Patent B2
US 12,373,540 · App. 18/670,263 · Granted Jul 29, 2025

Facial recognition by a security / automation system control panel

Inventors: Ross Werner (San Francisco, CA); Anand Sastry (Los Altos Hills, CA); Padmabushan Reddy Patlola (Hyderabad, IN); Bala Kishore Garre (Hyderabad, IN); Amarnath Vundhyala (Milwaukee, WI)
Assignee: Tyco Fire & Security GmbH
G06F21/40G06F21/32G06V20/40G07C9/00309G07C9/25G08B13/19636H04N23/61H04W4/80G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,373,540
App. No.
18/670,263
Granted
Jul 29, 2025
Kind
B2
Abstract

Example implementations include a method, apparatus, and computer-readable medium comprising determining, by a processor of a control panel, that a security event has happened, wherein the security event is associated with a user identification or authentication; capturing one or more still images or videos by at least one camera in the control panel subsequent and in response to determining that the security event has happened; and using the one or more still images or videos to perform facial recognition.

Claims (40)

1. A method comprising:

detecting, by one or more processors of a control panel, one or more short range communication devices being in range of the control panel;

capturing one or more still images or videos by at least one camera in the control panel subsequent and in response to detecting the one or more short range communication devices in range of the control panel;

using the one or more still images or videos to perform facial recognition; and

determining, based on the facial recognition, whether one or more individuals associated with the one or more short range communication devices are authorized to be present at a premises.

2. The method of claim 1 , wherein the at least one camera comprises a forward-facing camera in the control panel.

3. The method of claim 1 , further comprising performing a multi-factor authentication based on the facial recognition and at least one other form of authentication.

4. The method of claim 1 , wherein detecting the one or more short range communication devices comprises using a Bluetooth radio in the control panel.

5. The method of claim 1 , further comprising:

recording an ambient noise by one or more microphones in the control panel;

using the ambient noise to perform voice recognition; and

determining, based on the facial recognition and the voice recognition, whether the one or more individuals associated with the one or more short range communication devices are authorized to be present at the premises.

6. The method of claim 5 , wherein determining whether the one or more individuals are authorized to be present at the premises comprises determining, based on the facial recognition and the voice recognition, how many individuals are present at the premises.

7. The method of claim 6 , further comprising determining, based on the facial recognition and the voice recognition, whether a number of individuals that are determined to be present at the premises are authorized to be present at the premises.

8. The method of claim 6 , further comprising generating an alarm in response to determining that a quantity of individuals that are present at the premises is greater than a threshold.

9. An apparatus comprising a control panel, the control panel including:

one or more memories; and

one or more processors communicatively coupled with the one or more memories and configured to:

detect, by the one or more processors of the control panel, one or more short range communication devices being in range of the control panel;

capture one or more still images or videos by at least one camera in the control panel subsequent and in response to detecting the one or more short range communication devices in range of the control panel;

use the one or more still images or videos to perform facial recognition; and

determine, based on the facial recognition, whether one or more individuals associated with the one or more short range communication devices are authorized to be present at a premises.

10. The apparatus of claim 9 , wherein the at least one camera comprises a forward-facing camera in the control panel.

11. The apparatus of claim 9 , wherein the one or more processors are further configured to perform a multi-factor authentication based on the facial recognition and at least one other form of authentication.

12. The apparatus of claim 9 , wherein the one or more processors are further configured to detect the one or more short range communication devices by using a Bluetooth radio in the control panel.

13. The apparatus of claim 9 , wherein the one or more processors are further configured to:

record an ambient noise by one or more microphones in the control panel;

use the ambient noise to perform voice recognition; and

determine, based on the facial recognition and the voice recognition, whether the one or more individuals associated with the one or more short range communication devices are authorized to be present at the premises.

14. The apparatus of claim 13 , wherein the one or more processors are configured to determine whether the one or more individuals are authorized to be present at the premises by determining, based on the facial recognition and the voice recognition, how many individuals are present at the premises.

15. The apparatus of claim 14 , wherein the one or more processors are further configured to determine, based on the facial recognition and the voice recognition, whether a number of individuals that are determined to be present at the premises are authorized to be present at the premises.

16. The apparatus of claim 14 , wherein the one or more processors are further configured to generate an alarm in response to determining that a quantity of individuals that are present at the premises is greater than a threshold.

17. One or more non-transitory computer-readable media storing instructions executable by one or more processors of a control panel, wherein the instructions, when executed, cause the one or more processors to:

detect, by the one or more processors of the control panel, one or more short range communication devices being in range of the control panel;

capture one or more still images or videos by at least one camera in the control panel subsequent and in response to detecting the one or more short range communication devices in range of;

use the one or more still images or videos to perform facial recognition; and

determine, based on the facial recognition, whether one or more individuals associated with the one or more short range communication devices are authorized to be present at a premises.

18. The one or more non-transitory computer-readable media of claim 17 , wherein the at least one camera comprises a forward-facing camera in the control panel.

19. The one or more non-transitory computer-readable media of claim 17 , wherein the instructions, when executed, further cause the one or more processors to perform a multi-factor authentication based on the facial recognition and at least one other form of authentication.

20. The one or more non-transitory computer-readable media of claim 17 , wherein the instructions, when executed, cause the one or more processors to detect the one or more short range communication devices by using a Bluetooth radio in the control panel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2024
From: WERNER, ROSS; SASTRY, ANAND; PATLOLA, PADMABUSHAN REDDY; GARRE, BALA KISHORE; VUNDHYALA, AMARNATH
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 067502/0635 →
Continuity (3)
Continuation 17459391 · Aug 27, 2021
Provisional Application 63151363 · Feb 19, 2021
Related Publication 20240303315A1 · Sep 12, 2024
References Cited (88)
US 7015807B2 · Roby et al. · 2006 [cited by applicant]
US 9030562B2 · Petricoin, Jr. · 2015 [cited by applicant]
US 9124783B2 · Maslan · 2015 [cited by applicant]
US 9484768B2 · Park et al. · 2016 [cited by applicant]
US 9497202B1 · Calo et al. · 2016 [cited by applicant]
US 9940801B2 · Phillips · 2018 [cited by applicant]
US 9997054B2 · Sweeney et al. · 2018 [cited by applicant]
US 10296040B2 · Park et al. · 2019 [cited by applicant]
US 10663321B1 · Martin et al. · 2020 [cited by applicant]
US 10832665B2 · Barnett, Jr. · 2020 [cited by applicant]
US 10861265B1 · Merkley et al. · 2020 [cited by applicant]
US 10978050B2 · Khadloya et al. · 2021 [cited by applicant]
US 11200786B1 · Madden · 2021 [cited by applicant]
US 11961377B2 · Werner · 2024 [cited by examiner]
US 12026243B2 · Werner · 2024 [cited by examiner]
US 12046121B2 · Wallach · 2024 [cited by applicant]
US 12106646B2 · Werner · 2024 [cited by examiner]
US 20060104312A1 · Friar · 2006 [cited by applicant]
US 20060107298A1 · Friar · 2006 [cited by applicant]
US 20060177071A1 · Eskildsen · 2006 [cited by applicant]
US 20060250260A1 · Albert et al. · 2006 [cited by applicant]
US 20070024443A1 · Babich et al. · 2007 [cited by applicant]
US 20070223745A1 · Feng et al. · 2007 [cited by applicant]
US 20070262858A1 · Smith · 2007 [cited by applicant]
US 20090135010A1 · Fosty et al. · 2009 [cited by applicant]
US 20120257615A1 · Eskildsen et al. · 2012 [cited by applicant]
US 20130187664A1 · Deumal Herraiz et al. · 2013 [cited by applicant]
US 20130278410A1 · Smith et al. · 2013 [cited by applicant]
US 20140062466A1 · Thibault et al. · 2014 [cited by applicant]
US 20140066046A1 · Keshavdas et al. · 2014 [cited by applicant]
US 20140076072A1 · Gore et al. · 2014 [cited by applicant]
US 20140267716A1 · Child et al. · 2014 [cited by applicant]
US 20140302795A1 · Chacon et al. · 2014 [cited by applicant]
US 20150156031A1 · Fadell et al. · 2015 [cited by applicant]
US 20150188725A1 · Coles · 2015 [cited by applicant]
US 20150235539A1 · Orvis et al. · 2015 [cited by applicant]
US 20150356859A1 · Hwang et al. · 2015 [cited by applicant]
US 20150358790A1 · Nasserbakht · 2015 [cited by applicant]
US 20160018799A1 · Gettings et al. · 2016 [cited by applicant]
US 20160173568A1 · Penilla et al. · 2016 [cited by applicant]
US 20160335865A1 · Sayavong et al. · 2016 [cited by applicant]
US 20170032660A1 · El-Mankabady et al. · 2017 [cited by applicant]
US 20170084143A1 · Acera et al. · 2017 [cited by applicant]
US 20170109983A1 · Flint et al. · 2017 [cited by applicant]
US 20170195130A1 · Landow et al. · 2017 [cited by applicant]
US 20170213447A1 · Horrocks et al. · 2017 [cited by applicant]
US 20170309142A1 · Phillips · 2017 [cited by applicant]
US 20170315675A1 · Lewis et al. · 2017 [cited by applicant]
US 20170345420A1 · Barnett, Jr. · 2017 [cited by applicant]
US 20180067593A1 · Tiwari et al. · 2018 [cited by applicant]
US 20180101149A1 · Moss et al. · 2018 [cited by applicant]
US 20180144615A1 · Kinney et al. · 2018 [cited by applicant]
US 20180204431A1 · Meyer · 2018 [cited by applicant]
US 20180261060A1 · Siminoff et al. · 2018 [cited by applicant]
US 20180351789A1 · Ohmae et al. · 2018 [cited by applicant]
US 20180369039A1 · Bhimavarapu et al. · 2018 [cited by applicant]
US 20190114060A1 · Resudek · 2019 [cited by applicant]
US 20190259378A1 · Khadloya et al. · 2019 [cited by applicant]
US 20190272691A1 · Nye · 2019 [cited by applicant]
US 20190352930A1 · Beck · 2019 [cited by applicant]
US 20200026977A1 · Lee et al. · 2020 [cited by applicant]
US 20200193534A1 · Vick et al. · 2020 [cited by applicant]
US 20200280446A1 · Matsumoto · 2020 [cited by applicant]
US 20200312121A1 · Shiner · 2020 [cited by applicant]
US 20200349781A1 · Warrier et al. · 2020 [cited by applicant]
US 20200402378A1 · Connell et al. · 2020 [cited by applicant]
US 20210027597A1 · Nagel · 2021 [cited by applicant]
US 20210029298A1 · Mysore et al. · 2021 [cited by applicant]
US 20210049879A1 · Connell et al. · 2021 [cited by applicant]
US 20210150637A1 · Jia et al. · 2021 [cited by applicant]
US 20210160675A1 · Perry · 2021 [cited by applicant]
US 20210329165A1 · Liu et al. · 2021 [cited by applicant]
US 20210334521A1 · Padmanabhan et al. · 2021 [cited by applicant]
US 20220207972A1 · Madden et al. · 2022 [cited by applicant]
US 20220222688A1 · Wang et al. · 2022 [cited by applicant]
US 20220269388A1 · Sastry et al. · 2022 [cited by applicant]
US 20220269768A1 · Werner et al. · 2022 [cited by applicant]
US 20220303395A1 · Kerzner · 2022 [cited by applicant]
CN 1469099A · 2004 [cited by applicant]
CN 105812990A · 2016 [cited by applicant]
CN 108711248A · 2018 [cited by applicant]
CN 212302696U · 2021 [cited by applicant]
EP 3270361A1 · 2018 [cited by applicant]
WO 2020096969A1 · 2020 [cited by applicant]
WO 2020142179A1 · 2020 [cited by applicant]
Extended European Search Report and Search Opinion received for European Application No. 22156553.4, mailed on Jul. 4, 2022, 9 pages. [cited by applicant]
Extended European Search Report and Search Opinion received for European U.S. Appl. No. 22/156,554, mailed on Jul. 15, 2022, 8 pages. [cited by applicant]
Extended European Search Report and Search Opinion received for European Application No. 22156556, mailed on Jul. 19, 2022, 10 pages. [cited by applicant]