IP Library Granted Patent US 12,026,243
Granted Patent B2
US 12,026,243 · App. 17/459,391 · Granted Jul 2, 2024

Facial recognition by a security / automation system control panel

Inventors: Ross Werner (San Francisco, CA); Anand Sastry (Los Altos Hills, CA); Padmabushan Reddy Patlola (Hyderabad, IN); Bala Kishore Garre (Hyderabad, IN); Amarnath Vundhyala (Milwaukee, WI)
Assignee: Johnson Controls Tyco IP Holdings LLP
G06F21/40G06F21/32G06V20/40G07C9/00309G07C9/25G08B13/19636H04N23/61H04W4/80G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,026,243
App. No.
17/459,391
Granted
Jul 2, 2024
Kind
B2
Abstract

Example implementations include a method, apparatus, and computer-readable medium comprising determining, by a processor of a control panel, that a security event has happened, wherein the security event is associated with a user identification or authentication; capturing one or more still images or videos by at least one camera in the control panel subsequent and in response to determining that the security event has happened; and using the one or more still images or videos to perform facial recognition.

Claims (42)

1. A method comprising:

detecting, by a processor of a control panel, a user interaction with a user interface (UI) of the control panel for arming or disarming the control panel, wherein the user interaction is associated with a user identification or authentication for arming or disarming the control panel;

capturing one or more still images or videos by at least one camera in the control panel subsequent and in response to detecting the user interaction with the UI of the control panel for arming or disarming the control panel; and

using the one or more still images or videos to perform facial recognition for the user identification or authentication for arming or disarming the control panel.

2. The method of claim 1 , wherein the at least one camera comprises a forward-facing camera in the control panel.

3. The method of claim 1 , further comprising performing a multi-factor authentication based on the facial recognition and at least one other form of authentication.

4. The method of claim 3 , further comprising, in response to the user identification or authentication being successful, controlling one or more devices to operate according to a desired user setting associated with an identified or authenticated user.

5. The method of claim 1 , further comprising:

detecting a security event associated with activation of a door switch of a door located next to the control panel;

capturing one or more second images or videos by the at least one camera in the control panel subsequent and in response to the security event; and

using the one or more second images or videos to perform facial recognition.

6. The method of claim 1 , further comprising:

detecting a security event associated with one or more Bluetooth devices being in range, including using a Bluetooth radio in the control panel to detect the one or more Bluetooth devices;

capturing one or more second images or videos by the at least one camera in the control panel subsequent and in response to the security event; and

using the one or more second images or videos to perform facial recognition.

7. The method of claim 6 , further comprising determining, based on the facial recognition, whether one or more individuals associated with the one or more Bluetooth devices are present at a premises.

8. The method of claim 6 , further comprising:

recording an ambient noise by one or more microphones in the control panel;

using the ambient noise to perform voice recognition; and

determining, based on the facial recognition and the voice recognition, whether one or more individuals associated with the one or more Bluetooth devices are present at a premises.

9. An apparatus comprising a control panel, the control panel including:

a memory; and

a processor communicatively coupled with the memory and configured to:

detect, by the processor of the control panel, a user interaction with a user interface (UI) of the control panel for arming or disarming the control panel, wherein the security event user interaction is associated with a user identification or authentication for arming or disarming the control panel;

capture one or more still images or videos by at least one camera in the control panel subsequent and in response to detecting the user interaction with the UI of the control panel for arming or disarming the control panel; and

use the one or more still images or videos to perform facial recognition for the user identification or authentication for arming or disarming the control panel.

10. The apparatus of claim 9 , wherein the at least one camera comprises a forward-facing camera in the control panel.

11. The apparatus of claim 9 , wherein the processor is further configured to perform a multi-factor authentication based on the facial recognition and at least one other form of authentication.

12. The apparatus of claim 11 , wherein the processor is further configured to, in response to the user identification or authentication being successful, control one or more devices to operate according to a desired user setting associated with an identified or authenticated user.

13. The apparatus of claim 9 , wherein the processor is further configured to:

detect a security event associated with activation of a door switch of a door located next to the control panel;

capture one or more second images or videos by the at least one camera in the control panel subsequent and in response to the security event; and

use the one or more second images or videos to perform facial recognition.

14. The apparatus of claim 9 , wherein the processor is further configured to:

detect a security event associated with one or more Bluetooth devices being in range, including using a Bluetooth radio in the control panel to detect the one or more Bluetooth devices;

capture one or more second images or videos by the at least one camera in the control panel subsequent and in response to the security event; and

use the one or more second images or videos to perform facial recognition.

15. The apparatus of claim 14 , wherein the processor is further configured to determine, based on the facial recognition, whether one or more individuals associated with the one or more Bluetooth devices are present at a premises.

16. A non-transitory computer-readable medium storing instructions executable by a processor of a control panel, wherein the instructions, when executed, cause to the processor to:

detect, by the processor of the control panel, a user interaction with a user interface (UI) of the control panel for arming or disarming the control panel, wherein the user interaction is associated with a user identification or authentication for arming or disarming the control panel;

capture one or more still images or videos by at least one camera in the control panel subsequent and in response to detecting the user interaction with the UI of the control panel for arming or disarming the control panel; and

use the one or more still images or videos to perform facial recognition for the user identification or authentication for arming or disarming the control panel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 28, 2023
From: WERNER, ROSS; SASTRY, ANAND; PATLOLA, PADMABUSHAN REDDY; GARRE, BALA KISHORE; VUNDHYALA, AMARNATH
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 064717/0531 →
Continuity (2)
Provisional Application 63151363 · Feb 19, 2021
Related Publication 20220269768A1 · Aug 25, 2022
Cited By (4)
US 12,347,291 US 12,361,807 US 12,373,540 US 12,387,591