IP Library Granted Patent US 12,680,715
Granted Patent B2
US 12,680,715 · App. 17/991,438 · Granted Jul 14, 2026

HVAC control system with model driven deep learning

Inventors: Robert D. Turney (Watertown, WI); Henry O. Marcy, V (Milwaukee, WI)
Assignee: Tyco Fire & Security GmbH
F24F11/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,680,715
App. No.
17/991,438
Filed
Nov 21, 2022
Granted
Jul 14, 2026
Kind
B2
Art Unit
2117
USPC
700/48
Abstract

A method includes operating equipment to affect a variable state or condition of a space and training weights of a neural network by outputting control dispatches from the neural network based on simulated inputs, simulating costs associated with operating the equipment in accordance with control dispatches, and adjusting the weights to reduce the costs. The method also includes generating a control dispatch for the equipment by applying an actual measurement relating to the space as an input to the neural network, and controlling the equipment in accordance with the control dispatch.

Claims (33)

1 . A method for controlling equipment to affect a variable state or condition of a space, comprising:

training weights of a neural network by performing a training process comprising outputting simulated control dispatches from the neural network based on simulated inputs to the neural network, simulating costs predicted to result from operating the equipment in accordance with the simulated control dispatches, and using the simulated costs as input to adjust the weights to reduce the simulated costs;

generating a control dispatch for the equipment by applying a measurement relating to the space as an input to the neural network; and

controlling the equipment in accordance with the control dispatch.

2 . The method of claim 1 , wherein the training of the weights is performed by a first computing system and the generating of the control dispatch is performed by a second computing system.

3 . The method of claim 2 , wherein the first computing system is a cloud computing system and wherein the second computing system is a building edge controller.

4 . The method of claim 2 , further comprising communicating the weights from the first computing system to the second computing system.

5 . The method of claim 1 , wherein the simulating of the costs comprises modeling equipment performance predicted to result from the simulated control dispatches using a model distinct from the neural network.

6 . The method of claim 1 , wherein the simulated inputs comprise simulated values of the variable state or condition of the space and simulated utility rate information.

7 . The method of claim 1 , wherein the simulating of the costs comprises:

identifying a state-space thermal model for the space;

defining a cost function using the state-space thermal model; and

calculating, using the cost function, the costs predicted to result from operating the equipment over a simulated time period in accordance with the simulated control dispatches from the neural network.

8 . The method of claim 1 , wherein the control dispatch comprises one or more of a temperature setpoint, temperature schedule, humidity setpoint, airflow setpoint, power level, on/off setting, damper position, fan speed, compressor frequency, or resource consumption allocation.

9 . A system for controlling building equipment, comprising:

a first computing system programmed to train weights of a neural network by performing a training process comprising outputting simulated control dispatches for the building equipment from the neural network, generating simulated costs predicted to result from operating the building equipment in accordance with the simulated control dispatches, and using the simulated costs as input to adjust the weights to reduce the simulated costs; and

a second computing system programmed to receive the weights from the first computing system, generate an online control dispatch for the building equipment using the neural network, and control the building equipment in accordance with the online control dispatch.

10 . The system of claim 9 , wherein the first computing system is remote from the second computing system and the second computing system is co-located with the building equipment.

11 . The system of claim 9 , wherein the first computing system is a cloud computing system and the second computing system is a building edge controller.

12 . The system of claim 9 , wherein the second computing system is configured to receive a stream of measurements relating to the building equipment, preprocess the stream of measurements to generate inputs for the neural network, and generate the online control dispatch for the equipment by applying the inputs to the neural network.

13 . The system of claim 9 , further comprising a sensor communicable with the second computing system, wherein the second computing system is configured use a measurement from the sensor as an input to the neural network, and wherein the first computing system is configured to train the weights of the neural network without using the measurement from the sensor.

14 . The system of claim 9 , wherein the first computing system is configured to generate the simulated costs predicted to result from operating the building equipment in accordance with the simulated control dispatches by applying the simulated control dispatches as inputs to a model other than the neural network.

15 . A building system, comprising:

building equipment comprising a local controller configured to control the building equipment to affect a variable state or condition of a building by generating control dispatches for the building equipment using a neural network; and

a computing system separate from the local controller and configured to train the neural network by:

providing simulated inputs to the neural network to obtain simulated control dispatches;

modeling simulated costs predicted to result from the simulated control dispatches; and

using the simulated costs as input to adjust the neural network in a manner that reduces the simulated costs.

16 . The building system of claim 15 , wherein the computing system is configured to reformat the neural network for execution on the local controller and provide the reformatted neural network to the local controller.

17 . The building system of claim 15 , wherein the computing system separate from the local controller is remote from the building equipment and the local controller.

18 . The building system of claim 15 , wherein the computing system separate from the local controller has more processing power and memory than the local controller.

19 . The building system of claim 15 , wherein the building equipment is heating, ventilation, or air conditioning equipment.

20 . The building system of claim 15 , wherein the modeling of the simulated costs comprises using a model other than the neural network to predict the simulated costs based on the simulated control dispatches.

Assignments (2)
NUNC PRO TUNC ASSIGNMENT Recorded Oct 14, 2025
From: TURNEY, ROBERT D.; MARCY, HENRY O., 5TH
To: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
Reel/Frame 072569/0270 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2024
From: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
To: TYCO FIRE & SECURITY GMBH
Reel/Frame 066957/0796 →
Continuity (4)
Continuation In Part 16413946 · May 16, 2019
Provisional Application 62673479 · May 18, 2018
Provisional Application 62673496 · May 18, 2018
Related Publication 20230085072A1 · Mar 16, 2023
References Cited (103)
US 7716147B2 · Kelly et al. · 2010 [cited by applicant]
US 10089204B2 · Hare · 2018 [cited by examiner]
US 10718542B2 · Alanqar et al. · 2020 [cited by applicant]
US 11847007B2 · Magcale · 2023 [cited by examiner]
US 20030055798A1 · Hittle et al. · 2003 [cited by applicant]
US 20070094171A1 · Burges et al. · 2007 [cited by applicant]
US 20100076607A1 · Ahmed · 2010 [cited by examiner]
US 20110231320A1 · Irving · 2011 [cited by examiner]
US 20150170024A1 · Chatterjee et al. · 2015 [cited by applicant]
US 20180224814A1 · Elbsat et al. · 2018 [cited by applicant]
US 20180246478A1 · Takakura · 2018 [cited by examiner]
US 20180306459A1 · Turney · 2018 [cited by applicant]
US 20180372363A1 · Park et al. · 2018 [cited by applicant]
US 20190041811A1 · Drees · 2019 [cited by applicant]
US 20190236446A1 · Qin · 2019 [cited by examiner]
US 20190338973A1 · Turney et al. · 2019 [cited by applicant]
US 20190338974A1 · Turney et al. · 2019 [cited by applicant]
US 20190338977A1 · Turney et al. · 2019 [cited by applicant]
US 20190353378A1 · Ramamurti et al. · 2019 [cited by applicant]
US 20190354071A1 · Turney et al. · 2019 [cited by applicant]
US 20190378020A1 · Camilus et al. · 2019 [cited by applicant]
US 20190383510A1 · Murugesan et al. · 2019 [cited by applicant]
US 20190384239A1 · Murugesan et al. · 2019 [cited by applicant]
US 20190385070A1 · Lee et al. · 2019 [cited by applicant]
US 20200073342A1 · Lee et al. · 2020 [cited by applicant]
US 20200076196A1 · Lee et al. · 2020 [cited by applicant]
US 20200355391A1 · Wenzel et al. · 2020 [cited by applicant]
US 20200356857A1 · Lee et al. · 2020 [cited by applicant]
US 20200363794A1 · Schuster et al. · 2020 [cited by applicant]
US 20210003308A1 · Venne · 2021 [cited by examiner]
US 20210018211A1 · Ellis et al. · 2021 [cited by applicant]
US 20210048785A1 · Drees · 2021 [cited by applicant]
US 20210055016A1 · Turney · 2021 [cited by applicant]
US 20210173360A1 · Drees · 2021 [cited by applicant]
US 20210190364A1 · Lee et al. · 2021 [cited by applicant]
US 20210191342A1 · Lee et al. · 2021 [cited by applicant]
US 20210191343A1 · Lee et al. · 2021 [cited by applicant]
US 20210191348A1 · Lee et al. · 2021 [cited by applicant]
US 20210270490A1 · Turney et al. · 2021 [cited by applicant]
US 20210285671A1 · Du et al. · 2021 [cited by applicant]
US 20210383276A1 · Ramamurti et al. · 2021 [cited by applicant]
US 20220026864A1 · Murugesan et al. · 2022 [cited by applicant]
US 20220244682A1 · Walczyk et al. · 2022 [cited by applicant]
US 20220299233A1 · Risbeck · 2022 [cited by applicant]
US 20230085072A1 · Turney · 2023 [cited by examiner]
US 20230400823A1 · Hummon · 2023 [cited by examiner]
EP 1156286A2 · 2001 [cited by applicant]
JP H09159284 · 1997 [cited by applicant]
JP 2003084805A · 2003 [cited by applicant]
JP 2017067427A · 2017 [cited by applicant]
JP 2017142595A · 2017 [cited by applicant]
WO WO2012161804A1 · 2012 [cited by applicant]
WO WO2013130956A1 · 2013 [cited by applicant]
Afram, A., Janabi-Sharifi, F., Fung, A.S. and Raahemifar, K., 2017. Artificial neural network (ANN) based model predictive control (MPC) and optimization of HVAC systems: A state of the art review and case study of a re… [cited by examiner]
Javed, A., Larijani, H., Ahmadinia, A. and Gibson, D., 2016. Smart random neural network controller for HVAC using cloud computing technology. IEEE Transactions on Industrial Informatics, 13(1), pp. 351-360. (Year: 2016… [cited by examiner]
Zhang, C., Kuppannagari, S.R., Kannan, R. and Prasanna, V.K., Nov. 2019, Building HVAC scheduling using reinforcement learning via neural network based model approximation. In Proceedings of the 6th ACM international co… [cited by examiner]
JP Office Action for JP Appl. Ser. No. 2021-118668 dated Jan. 14, 2025 (81 pages). [cited by applicant]
JP Office Action on JP Appl. Ser. No. 2021-118668 dated Apr. 11, 2023 (6 pages). [cited by applicant]
JP Office Action for JP Appl. Ser. No. 2023-125392 dated Jun. 4, 2024 (11 pages). [cited by applicant]
Afram et al., “Theory and Application of HVAC Control Systems—A review of Model Predictive Control (MPC),” Building and Environment, Feb. 2014, vol. 72 (pp. 343-355). [cited by applicant]
Ahn et al., “Optimal Control Development for Chilled Water Plants Using a Quadratic Representation,” Energy and Buildings, Apr. 2001, vol. 33, No. 4 (pp. 371-378). [cited by applicant]
Burer et al., “Non-convex Mixed-Integer Nonlinear Programming: A Survey,” Surveys in Operations Research and Management Science, Jul. 2012, vol. 17, No. 2 (pp. 97-106). [cited by applicant]
Cantoni, A., “Optimal Curve Fitting with Piecewise Linear Functions,” IEEE Transactions on Computers, Jan. 1971, vol. 20, No. (pp. 59-67). [cited by applicant]
Corbin et al., “A Model Predictive Control Optimization Environment for Real-Time Commercial Building Application,” Journal of Building Performance Simulation, 2013, (Published online: Jan. 11, 2012) vol. 6, No. 3 (pp. … [cited by applicant]
Drgona et al., “All you Need to Know about Model Predictive Control for Buildings,” Annual Reviews in Control, 2020, vol. 50 (pp. 190-232). [cited by applicant]
EPO Notice of Opposition to a European Patent issued in Appl. Ser. No. EP 16165681.4 dated May 2, 2023 (48 pages). [cited by applicant]
EPO Notice of Opposition to a European Patent issued in Appl. Ser. No. EP 16165681.4 dated May 2, 2023 (51 pages). [cited by applicant]
EPO Notice of Opposition to a European Patent with Consolidated List issued in EP Appl. Ser. No. 16165681.4 dated May 2, 2023 (4 pages). [cited by applicant]
EPO Office Action on EP Appl. Ser. No. 16165681.4 dated Apr. 6, 2021 (7 pages). [cited by applicant]
EPO Search Opinion EP Appl. Ser. No. EP 22177772.5 dated Sep. 26, 2022 (6 pages). [cited by applicant]
Extended European Search Report on EP Appl. Ser. No. 16165681.4 dated Oct. 20, 2016 (5 pages). [cited by applicant]
Extended European Search Report on EP Appl. Ser. No. 22177772.5 dated Sep. 26, 2022 (11 pages). [cited by applicant]
Hackner, J.R., “HVAC system dynamics and energy use in existing buildings,” Doctoral Dissertation, University of Madison, Wisconsin, 1984 (174 pages). [cited by applicant]
Haves et al., “Model Predictive Control of HVAC Systems: Implementation and Testing at the University of California, Merced,” Technical Report, U.S. Department of Energy Office of Scientific and Technical Information, J… [cited by applicant]
Huang et al., “A New Model Predictive Control Scheme for Energy and Cost Savings in Commercial Buildings: An Airport Terminal Building Case Study,” Building and Environment, Jul. 2015, vol. 89 (pp. 203-216). [cited by applicant]
Kelman et al., “Analysis of Local Optima in Predictive Control for Energy Efficient Buildings,” Journal of Building Performance Simulation, Apr. 16, 2012, vol. 6, No. 3 (pp. 236-255). [cited by applicant]
Koehler et al., “Building Temperature Distributed Control via Explicit MPC and ‘Trim and Respond’ Methods,” European Control Conference (ECC), Jul. 17-19, 2013, Zurich, Switzerland (pp. 4334-4339). [cited by applicant]
Kwadzogah et al., “Model Predictive Control for HVAC Systems—A Review,” 2013 IEEE International Conference on Automation Science and Engineering, Model Predictive Control for HVAC Systems—A Review, 2013 IEEE Internation… [cited by applicant]
Mckenna et al., “A TRNSYS model of a building HVAC system with GSHP and PCM thermal energy storage—component modelling and validation,” Proceedings of BS2013: 13th Conference of International Building Performance Simula… [cited by applicant]
Mossolly et al., “Optimal Control Strategy for a Multizone Air Conditioning System Using a Genetic Algorithm,” Energy, Jan. 2009, vol. 34, No. 1 (pp. 58-66). [cited by applicant]
Nassif et al., “Optimization of HVAC Control System Strategy Using Two-Objective genetic Algorithm,” International Journal of HVA C&R Research, vol. 11, No. 3 (pp. 459-486). [cited by applicant]
Sourbon et al., “Dynamic Thermal Behaviour of Buildings with Concrete Core Activation,” Dissertation, Arenberg Doctoral School of Science, Engineering & Technology, Katholieke Universiteit Leuven—Faculty of Engineering … [cited by applicant]
Stluka et al., “Energy Management for Buildings and Microgrids,” 2011 50th IEEE Conference on Decision and Control and European Control Conference (CDCECC) Orlando, FL, USA, Dec. 12-15, 2011 (pp. 5150-5157). [cited by applicant]
Strurznegger, D., “Model Predictive Building Climate Control, Steps Towards Practice,” Doctoral Thesis, Automatic Control Laboratory, Zurich, Switzerland, 2014 (176 pages). [cited by applicant]
Sun et al., Optimal Control of Building HVAC&R Systems Using Complete Simulation-Based Sequential Quadratic Programming (CSB-SQP)', Building and Environment, May 2005, vol. 40, No. 5 (pp. 657-669). [cited by applicant]
Third Party Observation Report on EP Appl. Ser. No. 16165681.4 dated Jan. 15, 2020 (8 pages). [cited by applicant]
Third Party Observation Report on EP Appl. Ser. No. 16165681.4 dated Oct. 5, 2018 (6 pages). [cited by applicant]
Verhelst et al., “Study of the Optimal Control Problem Formulation for Modulating Air-to-Water Heat Pumps Connected to a Residential Floor Heating System,” Energy and Buildings, Feb. 2012, vol. 45 (pp. 43-53). [cited by applicant]
Verhelst, C., “Model Predictive Control of Ground Coupled Heat Pump Systems in Office Buildings,” Dissertation, Arenberg Doctoral School of Science, Engineering & Technology, Katholieke Universiteit Leuven—Faculty of En… [cited by applicant]
Wang et al., “Model-Based Optimal Control of VAV Air-Conditioning System Using Genetic Algorithm,” Building and Environment, Aug. 2000, vol. 35, No. 6 (pp. 471-487). [cited by applicant]
Wang et al., “Supervisory and Optimal Control of Building HVAC Systems: A Review,” HVAC&R Research, Jan. 2008, vol. 14, No. 1 (pp. 3-32). [cited by applicant]
Xi et al., “Support Vector Regression Model Predictive Control on a HVAC Plant,” Control Engineering Practice, Aug. 2007, vol. 15, No. 8 (pp. 897-908). [cited by applicant]
Yao et al., “Global Optimization of a Central Air-Conditioning System Using Decomposition-Coordination Method,” Energy and Buildings, May 2010, vol. 42, No. 5 (pp. 570-583). [cited by applicant]
U.S. Appl. No. 17/710,443, filed Mar. 31, 2022, Johnson Controls Tyco IP Holdings LLP. [cited by applicant]
U.S. Appl. No. 17/710,597, filed Mar. 31, 2022, Johnson Controls Tyco IP Holdings LLP. [cited by applicant]
U.S. Appl. No. 17/710,603, filed May 9, 2022, Johnson Controls Tyco IP Holdings LLP. [cited by applicant]
U.S. Appl. No. 17/710,706, filed Mar. 31, 2022, Johnson Controls Tyco IP Holdings LLP. [cited by applicant]
U.S. Appl. No. 17/733,786, filed Apr. 29, 2022, Johnson Controls Tyco IP Holdings LLP. [cited by applicant]
U.S. Appl. No. 17/900,141, filed Aug. 31, 2022, Johnson Controls Tyco IP Holdings LLP. [cited by applicant]
U.S. Appl. No. 63/279,759, filed Nov. 16, 2021, Ramanasankaran, Rajiv et al. [cited by applicant]
JP Office Action on JP 2019-091950, dated Aug. 4, 2020, with English language translation (8 pages). [cited by applicant]
JP Office Action on JP 2019-091950, dated Mar. 30, 2021, including English language translation (6 pages). [cited by applicant]
JP Office Action on JP Appl. Ser. No. 2021-118668 dated Sep. 13, 2022, with translation (8 pages). [cited by applicant]