IP Library Granted Patent US 12,444,041
Granted Patent B2
US 12,444,041 · App. 17/593,934 · Granted Oct 14, 2025

Building management system using video analytics

Inventors: Petr Stluka (Morris Plains, NJ); Chunfu Li (Morris Plains, NJ); Hao Chen (Morris Plains, NJ)
Assignee: HONEYWELL INTERNATIONAL INC.
G06T7/001G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,444,041
App. No.
17/593,934
Granted
Oct 14, 2025
Kind
B2
Abstract

Methods and systems for identifying maintenance tasks in a building. An illustrative method may include capturing a plurality of images over time of a component of a building using an image capture device, comparing at least some of the plurality of images to a baseline image of the component to identify a physical change in the component, determining when the physical change in the component exceeds a threshold physical change, and sending a maintenance request to service the component when the physical change in the component exceeds the threshold physical change.

Claims (46)

1. A method for identifying maintenance tasks in a building that includes a Building Management System (BMS), wherein the BMS system of the building includes one or more of an HVAC system, a security system, a lighting system, a fire system and an access control system, the method comprising:

retrieving an ontology model of the BMS, wherein the ontology models defines contextual information for one or more BMS components of the BMS including a particular BMS component, the contextual information including a plurality of properties and one or more relationships defined between two or more of the properties;

retrieving one or more system configuration parameters of the BMS, wherein the system configuration parameters include one or more system algorithm settings and one or more system operational parameters;

sensing one or more environmental conditions in the building;

capturing a plurality of images over time of the particular BMS component of the BMS system using an image capture device, wherein the particular BMS component includes one of an HVAC system component, a security system component, a lighting system component, a fire system component and an access control system component;

determining when the particular BMS component needs maintenance based at least in part on:

one or more of the environmental conditions in the building;

one or more of the plurality of images of the particular BMS component;

the ontology model; and

one or more of the system configuration parameters;

sending a maintenance request to service the particular BMS component when the particular BMS component is determined to need maintenance.

2. The method of claim 1 , wherein determining when the particular BMS component needs maintenance comprises:

comparing at least some of the plurality of images of the particular BMS component to a baseline image of the particular BMS component to identify a physical change in the particular BMS component; and

determining when the physical change in the particular BMS component exceeds a threshold physical change.

3. The method of claim 2 , wherein the physical change includes a physical change in the cleanliness of the particular BMS component.

4. The method of claim 2 , wherein the particular BMS component comprises a filter.

5. The method of claim 2 , wherein the particular BMS component comprises an air conditioning coil.

6. A system for identifying maintenance tasks in a building that includes a Building Management System (BMS), wherein the BMS system of the building includes one or more of an HVAC system, a security system, a lighting system, a fire system and an access control system, the system comprising:

an input for receiving:

a plurality of images from an image capture device that is configured to have a field of view that includes a particular BMS component of the BMS system of the building, wherein the particular BMS component includes one of an HVAC system component, a security system component, a lighting system component, a fire system component and an access control system component;

one or more environmental conditions in the building;

an output;

a memory for storing:

an ontology model of the BMS, wherein the ontology models defines contextual information for one or more BMS components of the BMS including the particular BMS component, the contextual information including a plurality of properties and one or more relationships defined between two or more of the properties;

one or more system configuration parameters of the BMS, wherein the system configuration parameters include one or more system algorithm settings and one or more system operational parameters;

a controller operatively coupled to the image capture device via the input, the memory and the output, the controller configured to:

determining when the particular BMS component needs maintenance based at least in part on:

one or more of the environmental conditions in the building received via the input;

one or more of the plurality of images of the particular BMS component received via the input;

the ontology model stored in the memory; and

one or more of the system configuration parameters stored in the memory;

sending via the output a maintenance request to service the particular BMS component when the particular BMS component is determined to need maintenance.

7. The system of claim 6 , wherein the input, output, memory and controller are part of a server.

8. The system of claim 6 , wherein the maintenance request is a work order with a description of the maintenance required.

9. A method for identifying maintenance tasks of a building that includes a Building Management System (BMS), wherein the BMS system of the building includes one or more of an HVAC system, a security system, a lighting system, a fire system and an access control system, the method comprising:

retrieving an ontology model of the BMS, wherein the ontology models defines contextual information for one or more BMS components of the BMS including a particular BMS component, the contextual information including a plurality of properties and one or more relationships defined between two or more of the properties;

retrieving one or more system configuration parameters of the BMS, wherein the system configuration parameters include one or more system algorithm settings and one or more system operational parameters;

retrieving a plurality of images captured over time of the particular BMS component;

sensing one or more environmental conditions in the building;

determining when the particular BMS component needs maintenance based at least in part on:

one or more of the environmental conditions in the building;

one or more of the plurality of images of the particular BMS component;

the ontology model; and

one or more of the system configuration parameters;

sending a maintenance request to service the particular BMS component when the particular BMS component is determined to need maintenance.

10. The method of claim 9 , wherein the one or more environmental conditions in the building include one or more of a temperature, a pressure, a flow rate and a humidity.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2021
From: STLUKA, PETR; LI, CHUNGFU; CHEN, HAO
To: HONEYWELL INTERNATIONAL INC.
Reel/Frame 058501/0706 →
Continuity (1)
Related Publication 20220189004A1 · Jun 16, 2022
References Cited (14)
US 20100324962A1 · Nesler · 2010 [cited by examiner]
US 20170234562A1 · Ribbich · 2017 [cited by examiner]
US 20180029842A1 · Li · 2018 [cited by examiner]
US 20180283716A1 · Ribbich · 2018 [cited by examiner]
US 20180372355A1 · Mosamkar · 2018 [cited by examiner]
US 20180373234A1 · Khalate et al. · 2018 [cited by applicant]
CN 103177391A · 2013 [cited by applicant]
CN 104247396A · 2014 [cited by applicant]
CN 106970578A · 2017 [cited by applicant]
CN 109443812A · 2019 [cited by applicant]
JP 2011204029A · 2011 [cited by applicant]
CN109443812 Xu et al—WIPO translated (Year: 2019). [cited by examiner]
Examination Report under Section 18(3), Intellectual Property Office, Application No. GB2113599.1, Sep. 11, 2023 (3 pgs). [cited by applicant]
First Office Action, CN Patent Office, CN Application No. 201980095439.8, Jul. 2, 2023 (27 pages). [cited by applicant]