IP Library Granted Patent US 12,361,807
Granted Patent B2
US 12,361,807 · App. 17/411,802 · Granted Jul 15, 2025

Security / automation system control panel graphical user interface

Inventors: Anand Sastry (Los Altos Hills, CA); Karthik Challa (San Jose, CA); Padmabushan Reddy Patlola (Telangana, IN); Bala Kishore Garre (Telangana, IN)
Assignee: Tyco Fire & Security GmbH
G08B13/19682G01D5/24G01D18/00G05B19/042G06F3/0487G06F3/16G06F21/629G08B3/10G08B17/117G08B19/00G08B25/10G08B29/10H04B17/318H04B17/364H04B17/382H04B17/391H04M1/64H04N7/183H04N7/188H04N23/57H04R29/00H04W72/30H04W84/02H04W84/18G05B2219/25257G06V40/172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,361,807
App. No.
17/411,802
Granted
Jul 15, 2025
Kind
B2
Abstract

Example implementations include a method, apparatus, and computer-readable medium comprising capturing visual or audio data using at least one camera or microphone in a control panel; performing, by a processor of the control panel, at least one of a voice recognition or a facial recognition, based on the visual or audio data captured by the at least one camera or microphone in the control panel; recognizing an individual according to at least one of the voice recognition or the facial recognition; and presenting, on a display of the control panel, a graphical user interface that includes features associated with the individual.

Claims (39)

1. A method comprising:

tracking, over a period of time, one or more applications or functions that an individual invokes for ambient temperature information and heating, ventilation, and/or air conditioning (HVAC) status/settings/controls on a control panel configured to control one or more security or automation devices of a security or automation system of a premises;

capturing visual or audio data using at least one camera or microphone in the control panel of the security or automation system of the premises;

performing, by a processor of the control panel of the security or automation system of the premises, at least one of a voice recognition or a facial recognition, based on the visual or audio data captured by the at least one camera or microphone in the control panel of the security or automation system of the premises;

recognizing the individual according to at least one of the voice recognition or the facial recognition; and

presenting, on a display of the control panel of the security or automation system of the premises, a personalized graphical user interface (GUI) including a plurality of GUIs and/or GUI features/components corresponding to the one or more applications or functions that the individual has invoked for the ambient temperature information and the HVAC status/settings/controls on the control panel over the period of time, responsive to recognizing the individual according to at least one of the voice recognition or the facial recognition.

2. The method of claim 1 , wherein the at least one camera or microphone comprises a forward-facing camera in the control panel.

3. The method of claim 1 , wherein performing at least one of the voice recognition or the facial recognition comprises executing an artificial intelligence module locally at the control panel.

4. The method of claim 1 , wherein performing at least one of the voice recognition or the facial recognition comprises:

sending, by the control panel, to a cloud system, the visual or audio data captured by the at least one camera or microphone; and

receiving, by the control panel, from the cloud system, an outcome of the voice recognition or the facial recognition, responsive to sending the visual or audio data.

5. The method of claim 1 , further comprising determining one or more second applications or functions that are restricted for access by the individual.

6. The method of claim 5 , wherein presenting the personalized GUI comprises preventing display of one or more features associated with the second one or more applications or functions that are restricted for access by the individual.

7. A control panel comprising:

a memory; and

a processor communicatively coupled with the memory and configured to:

track, over a period of time, one or more applications or functions that an individual invokes for ambient temperature information and heating, ventilation, and/or air conditioning (HVAC) status/settings/controls on the control panel configured to control one or more security or automation devices of a security or automation system of a premises;

capture visual or audio data using at least one camera or microphone in the control panel of the security or automation system of the premises;

perform, by the processor of the control panel of the security or automation system of the premises, at least one of a voice recognition or a facial recognition, based on the visual or audio data captured by the at least one camera or microphone in the control panel;

recognize the individual according to at least one of the voice recognition or the facial recognition; and

present, on a display of the control panel of the security or automation system of the premises, a personalized graphical user interface (GUI) including a plurality of GUIs and/or GUI features/components corresponding to the one or more applications or functions that the individual has invoked for the ambient temperature information and the HVAC status/settings/controls on the control panel over the period of time, responsive to recognizing the individual according to at least one of the voice recognition or the facial recognition.

8. The control panel of claim 7 , wherein the at least one camera or microphone comprises a forward-facing camera in the control panel.

9. The control panel of claim 7 , wherein, in order to perform at least one of the voice recognition or the facial recognition, the processor is configured to execute an artificial intelligence module locally at the control panel.

10. The control panel of claim 7 , wherein, in order to perform at least one of the voice recognition or the facial recognition, the processor is configured to:

send, by the control panel, to a cloud system, the visual or audio data captured by the at least one camera or microphone; and

receive, by the control panel, from the cloud system, an outcome of the voice recognition or the facial recognition, responsive to sending the visual or audio data.

11. The control panel of claim 7 , wherein the processor is further configured to determine one or more second applications or functions that are restricted for access by the individual.

12. The control panel of claim 11 , wherein, in order to present the personalized GUI, the processor is configured to prevent display of one or more features associated with the one or more second applications or functions that are restricted for access by the individual.

13. A non-transitory computer-readable medium storing instructions executable by a processor of a control panel, wherein the instructions, when executed, cause to the processor to:

track, over a period of time, one or more applications or functions that an individual invokes for ambient temperature information and heating, ventilation, and/or air conditioning (HVAC) status/settings/controls on a control panel configured to control one or more security or automation devices of a security or automation system of a premises;

capture visual or audio data using at least one camera or microphone in the control panel of the security or automation system of the premises;

perform, by the processor of the control panel, at least one of a voice recognition or a facial recognition, based on the visual or audio data captured by the at least one camera or microphone in the control panel of the security or automation system of the premises;

recognize the individual according to at least one of the voice recognition or the facial recognition; and

present, on a display of the control panel of the security or automation system of the premises, a personalized graphical user interface (GUI) including a plurality of GUIs and/or GUI features/components corresponding to the one or more applications or functions that the individual has invoked for the ambient temperature information and the HVAC status/settings/controls on the control panel over the period of time, responsive to recognizing the individual according to at least one of the voice recognition or the facial recognition.

14. The non-transitory computer-readable medium of claim 13 , wherein the at least one camera or microphone comprises a forward-facing camera in the control panel.

15. The non-transitory computer-readable medium of claim 13 , wherein, in order to perform at least one of the voice recognition or the facial recognition, the instructions, when executed, further cause the processor to execute an artificial intelligence module locally at the control panel.

16. The non-transitory computer-readable medium of claim 13 , wherein in order to perform at least one of the voice recognition or the facial recognition, the instructions, when executed, further cause the processor to:

send, by the control panel, to a cloud system, the visual or audio data captured by the at least one camera or microphone; and

receive, by the control panel, from the cloud system, an outcome of the voice recognition or the facial recognition, responsive to sending the visual or audio data.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2025
From: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
To: TYCO FIRE & SECURITY GMBH
Reel/Frame 071690/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2023
From: SASTRY, ANAND; CHALLA, KARTHIK; PATLOLA, PADMABUSHAN REDDY; GARRE, BALA KISHORE
To: JOHNSON CONTROLS TYCO IP HOLDINGS, LLP
Reel/Frame 062718/0441 →
Continuity (2)
Provisional Application 63151363 · Feb 19, 2021
Related Publication 20220269388A1 · Aug 25, 2022
References Cited (87)
US 7015807B2 · Roby et al. · 2006 [cited by applicant]
US 9030562B2 · Petricoin, Jr. · 2015 [cited by applicant]
US 9124783B2 · Maslan · 2015 [cited by applicant]
US 9484768B2 · Park et al. · 2016 [cited by applicant]
US 9497202B1 · Calo · 2016 [cited by examiner]
US 9940801B2 · Phillips · 2018 [cited by applicant]
US 9997054B2 · Sweeney et al. · 2018 [cited by applicant]
US 10663321B1 · Martin et al. · 2020 [cited by applicant]
US 10832665B2 · Barnett, Jr. · 2020 [cited by applicant]
US 10861265B1 · Merkley et al. · 2020 [cited by applicant]
US 10978050B2 · Khadloya et al. · 2021 [cited by applicant]
US 11200786B1 · Madden · 2021 [cited by applicant]
US 11783686B2 · Werner · 2023 [cited by applicant]
US 11961377B2 · Werner · 2024 [cited by applicant]
US 12026243B2 · Werner · 2024 [cited by applicant]
US 12106646B2 · Werner · 2024 [cited by applicant]
US 20040260427A1 · Wimsatt · 2004 [cited by examiner]
US 20060104312A1 · Friar · 2006 [cited by applicant]
US 20060107298A1 · Friar · 2006 [cited by applicant]
US 20060177071A1 · Eskildsen · 2006 [cited by applicant]
US 20070024443A1 · Babich et al. · 2007 [cited by applicant]
US 20070223745A1 · Feng et al. · 2007 [cited by applicant]
US 20070262858A1 · Smith · 2007 [cited by applicant]
US 20090135010A1 · Fosty et al. · 2009 [cited by applicant]
US 20130187664A1 · Deumal et al. · 2013 [cited by applicant]
US 20140062466A1 · Thibault et al. · 2014 [cited by applicant]
US 20140066046A1 · Keshavdas et al. · 2014 [cited by applicant]
US 20140076072A1 · Gore et al. · 2014 [cited by applicant]
US 20140302795A1 · Chacon et al. · 2014 [cited by applicant]
US 20150156031A1 · Fadell et al. · 2015 [cited by applicant]
US 20150188725A1 · Coles · 2015 [cited by applicant]
US 20150358790A1 · Nasserbakht · 2015 [cited by applicant]
US 20160018799A1 · Gettings et al. · 2016 [cited by applicant]
US 20160173568A1 · Penilla · 2016 [cited by examiner]
US 20170026763A1 · Pratt et al. · 2017 [cited by applicant]
US 20170032660A1 · El-Mankabady et al. · 2017 [cited by applicant]
US 20170084143A1 · Acera et al. · 2017 [cited by applicant]
US 20170109983A1 · Flint et al. · 2017 [cited by applicant]
US 20170195130A1 · Landow · 2017 [cited by examiner]
US 20170213447A1 · Horrocks et al. · 2017 [cited by applicant]
US 20170309142A1 · Philips · 2017 [cited by applicant]
US 20170315675A1 · Lewis et al. · 2017 [cited by applicant]
US 20170345420A1 · Barnett, Jr. · 2017 [cited by applicant]
US 20180067593A1 · Tiwari et al. · 2018 [cited by applicant]
US 20180101149A1 · Moss et al. · 2018 [cited by applicant]
US 20180144615A1 · Kinney et al. · 2018 [cited by applicant]
US 20180204431A1 · Meyer · 2018 [cited by applicant]
US 20180261060A1 · Siminoff et al. · 2018 [cited by applicant]
US 20180267701A1 · Rigg · 2018 [cited by examiner]
US 20180351789A1 · Ohmae et al. · 2018 [cited by applicant]
US 20180369039A1 · Bhimavarapu · 2018 [cited by examiner]
US 20190114060A1 · Resudek · 2019 [cited by examiner]
US 20190259259A1 · Mullins · 2019 [cited by applicant]
US 20190259378A1 · Khadloya et al. · 2019 [cited by applicant]
US 20190272691A1 · Nye · 2019 [cited by examiner]
US 20190352930A1 · Beck · 2019 [cited by applicant]
US 20200026977A1 · Lee et al. · 2020 [cited by applicant]
US 20200193534A1 · Vick · 2020 [cited by examiner]
US 20200280446A1 · Matsumoto · 2020 [cited by applicant]
US 20200312121A1 · Shiner · 2020 [cited by applicant]
US 20200349781A1 · Warrier et al. · 2020 [cited by applicant]
US 20200402378A1 · Connell, II et al. · 2020 [cited by applicant]
US 20210029298A1 · Mysore et al. · 2021 [cited by applicant]
US 20210049879A1 · Connell, II et al. · 2021 [cited by applicant]
US 20210094582A1 · Lee et al. · 2021 [cited by applicant]
US 20210150637A1 · Jia et al. · 2021 [cited by applicant]
US 20210160675A1 · Perry et al. · 2021 [cited by applicant]
US 20210329165A1 · Liu · 2021 [cited by examiner]
US 20210334521A1 · Padmanabhan · 2021 [cited by examiner]
US 20220028249A1 · Saldin · 2022 [cited by examiner]
US 20220207972A1 · Madden et al. · 2022 [cited by applicant]
US 20220222688A1 · Wang et al. · 2022 [cited by applicant]
US 20220269388A1 · Sastry et al. · 2022 [cited by applicant]
US 20220269768A1 · Werner et al. · 2022 [cited by applicant]
US 20220303395A1 · Kerzner · 2022 [cited by applicant]
CN 1469099A · 2004 [cited by applicant]
CN 105812990A · 2016 [cited by applicant]
CN 108711248A · 2018 [cited by applicant]
CN 212302696U · 2021 [cited by applicant]
EP 3270361A1 · 2019 [cited by applicant]
WO 2020096969A1 · 2020 [cited by applicant]
WO 2020142179A1 · 2020 [cited by applicant]
European Search Report issued in corresponding European Application No. 22156553.4-1205 dated Jul. 4, 2022. [cited by applicant]
European Examination Report issued in corresponding European Application No. 22156553.4-1201 dated Sep. 6, 2024. [cited by applicant]
European Examination Report issued in corresponding European Application No. 22156554.4-1201 dated Sep. 9, 2024. [cited by applicant]
European Examination Report issued in corresponding European Application No. 22156556.7-1201 dated Sep. 6, 2024. [cited by applicant]
European Examination Report issued in corresponding European Application No. 22156555.9-1201 dated Sep. 6, 2024. [cited by applicant]