IP Library Granted Patent US 12,361,291
Granted Patent B2
US 12,361,291 · App. 18/467,627 · Granted Jul 15, 2025

Control sequence generation system and methods

Inventors: Troy Aaron Harvey (Brighton, UT); Jeremy David Fillingim (Salt Lake City, UT)
Assignee: PassiveLogic, Inc.
G06N3/084B60H1/00285F24F11/64F24F11/65G05B13/027G05B13/04G05B19/042G06F17/16G06F30/18G06F30/27G06N3/04G06N3/047G06N3/048G06N3/063G06N3/08G06Q10/067G06Q50/163F24F2120/10F24F2120/20F24F2140/50G05B2219/2614G06F2119/06G06F2119/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,361,291
App. No.
18/467,627
Granted
Jul 15, 2025
Kind
B2
Abstract

Various embodiments described herein relate to a method, device, and non-transitory machine-readable storage medium for controlling a system having a plurality of devices including one or more of the following: calculating a demand curve for a controlled space representing at least one target amount of state for delivery to the controlled space; creating a cost function that compares the demand curve to simulated state curves produced by a model of the controlled system based on respective sets of control actions issuable to the plurality of controlled devices; performing an optimization method that tunes a candidate set of control actions to reduce a cost output by the cost function based on the candidate set of control actions; and issuing control actions of the candidate set of control actions to respective ones of the plurality of controlled devices to cause the controlled system to deliver state to the controlled space.

Claims (54)

1. A method for controlling a controlled system having a plurality of controlled devices, the method comprising:

calculating a demand value representing at least one target outcome from the controlled system using a first neural network, the first neural network having a plurality of nodes, wherein at least two nodes represent at least two corresponding controlled devices in the controlled system;

creating a cost function that compares the demand value to simulated outcome values produced by the first neural network, and which takes as input respective sets of control actions issuable to the plurality of controlled devices;

performing an optimization method that tunes a candidate set of control actions to reduce a cost output by the cost function based on the candidate set of control actions; and

issuing control actions of the candidate set of control actions to the respective ones of the plurality of controlled devices to cause the controlled system to adjust an environmental state of an area associated with the controlled system.

2. The method of claim 1 , wherein performing the optimization method comprises:

computing partial derivatives using the first neural network; and

using the partial derivatives to perform gradient descent to tune the candidate set of control actions.

3. The method of claim 2 , wherein performing gradient descent comprises:

randomly generating the candidate set of control actions; and

iteratively tuning the candidate set of control actions according to the partial derivatives to reduce a cost indicated by the cost function.

4. The method of claim 1 , wherein the demand value is a demand curve representing variance in the at least one target outcome over a period of time.

5. The method of claim 1 , wherein:

calculating a demand value comprises calculating a plurality of demand values corresponding to a plurality of desired outcomes, respectively; and

in comparing the demand value to simulated outcome values produced by the first neural network, the cost function compares the plurality of demand values to a plurality of simulated outcome values produced by the first neural network, respectively.

6. The method of claim 1 , wherein the optimization method that tunes a candidate set of control actions to reduce a cost output by the cost function based on the candidate set of control actions comprises a method that runs a neural network, the neural network comprising nodes that correlate to controlled devices.

7. A device for controlling a controlled system having a plurality of controlled devices, comprising:

a communication interface configured to communicate with the plurality of controlled devices;

a memory comprising a model of the controlled system; and

a processor configured to:

calculate a demand curve for a controlled space representing at least one target amount of state for delivery to the controlled space using a first neural network, the first neural network having a plurality of nodes, wherein at least two nodes represent at least two corresponding controlled devices,

create a cost function that compares the demand curve to simulated state curves produced by the first neural network, and which takes as input respective sets of control actions issuable to the plurality of controlled devices,

perform an optimization method that tunes a candidate set of control actions to reduce a cost output by the cost function based on the candidate set of control actions, and

issue control actions of the candidate set of control actions to respective ones of the plurality of controlled devices to cause the controlled system to deliver an environmental state to the controlled space.

8. The device of claim 7 , wherein, in performing the optimization method, the processor is configured to:

compute partial derivatives using the model; and

use the partial derivatives to perform gradient descent to tune the candidate set of control actions.

9. The device of claim 8 , wherein, in performing gradient descent, the processor is configured to:

randomly generate the candidate set of control actions; and

iteratively tune the candidate set of control actions according to the partial derivatives to reduce a cost indicated by the cost function.

10. The device of claim 7 , wherein, in calculating a demand curve, the processor is configured to calculate the demand curve as at least one target amount of state for delivery to the controlled space to achieve a comfort curve representing a desired state for the controlled space.

11. The device of claim 7 , wherein:

the controlled space comprises a plurality of zones;

in calculating a demand curve, the processor is configured to calculate a plurality of demand curves corresponding to the plurality of zones, respectively; and

in comparing the demand curve to simulated state curves produced by the model, the cost function compares the plurality of demand curves to a plurality of simulated state curves produced by the model corresponding to the plurality of zones, respectively.

12. A non-transitory computer-readable storage medium configured with instructions executable by a processor for controlling a controlled system having a plurality of controlled devices, the non-transitory computer-readable storage medium comprising:

instructions for calculating a demand value representing at least one target outcome from the controlled system using a first neural network, the first neural network having a plurality of nodes, wherein at least two nodes represent at least two corresponding controlled devices;

instructions for creating a cost function that compares the demand value to simulated outcome values produced by the first neural network, which takes as input respective sets of control actions issuable to the plurality of controlled devices;

instructions for performing an optimization method that tunes a candidate set of control actions to reduce a cost output by the cost function based on the candidate set of control actions; and

instructions for issuing control actions of the candidate set of control actions to respective ones of the plurality of controlled devices to cause the controlled system to adjust an environmental state of an area associated with the controlled system.

13. The non-transitory computer-readable storage medium of claim 12 , wherein performing the optimization method comprises:

instructions for computing partial derivatives using the first neural network; and

instructions for using the partial derivatives to perform gradient descent to tune the candidate set of control actions.

14. The non-transitory computer-readable storage medium of claim 13 , wherein performing gradient descent comprises:

instructions for randomly generating the candidate set of control actions; and

instructions for iteratively tuning the candidate set of control actions according to the partial derivatives to reduce a cost indicated by the cost function.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the demand value is a demand curve representing variance in the at least one target outcome over a period of time.

16. The non-transitory computer-readable storage medium of claim 12 , wherein:

instructions for calculating a demand value comprises instructions for calculating a plurality of demand values corresponding to a plurality of desired outcomes, respectively; and

in comparing the demand value to simulated outcome values produced by the first neural network, the cost function compares the plurality of demand values to a plurality of simulated outcome values produced by the first neural network, respectively.

17. The non-transitory computer-readable storage medium of claim 12 , wherein the optimization method that tunes a candidate set of control actions to reduce a cost output by the cost function based on the candidate set of control actions comprises a method that runs a neural network.

18. The non-transitory computer-readable storage medium of claim 17 , wherein the neural network comprises nodes that represent the plurality of controlled devices such that each device is represented by a node.

19. The non-transitory computer-readable storage medium of claim 18 , wherein at least two of the nodes are arranged in the neural network corresponding to their equivalent controlled device.

20. The non-transitory computer-readable storage medium of claim 19 , wherein at least two nodes have different activation functions, and wherein at least one activation function has multiple variables.

Assignments (3)
SECURITY INTEREST Recorded Nov 19, 2025
From: PASSIVELOGIC, INC.; QUANTUM ALLIANCE LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 073605/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 9, 2023
From: HARVEY, TROY AARON; FILLINGIM, JEREMY DAVID
To: PASSIVELOGIC, INC.
Reel/Frame 065158/0097 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2023
From: HARVEY, TROY AARON; FILLINGIM, JEREMY DAVID
To: PASSIVELOGIC, INC.
Reel/Frame 064912/0209 →
Continuity (3)
Continuation 17193179 · Mar 5, 2021
Provisional Application 62704976 · Jun 5, 2020
Related Publication 20240005168A1 · Jan 4, 2024
References Cited (75)
US 5224648A · Simon et al. · 1993 [cited by applicant]
US 5581659A · Takatori · 1996 [cited by applicant]
US 6119125A · Gloudeman et al. · 2000 [cited by applicant]
US 6128609A · Rose · 2000 [cited by examiner]
US 6967565B2 · Lingemann · 2005 [cited by applicant]
US 7447664B2 · Pado · 2008 [cited by applicant]
US 7756804B2 · Bloom et al. · 2010 [cited by applicant]
US 9020647B2 · Johnson et al. · 2015 [cited by applicant]
US 9258201B2 · McCoy et al. · 2016 [cited by applicant]
US 9298197B2 · Matsuoka et al. · 2016 [cited by applicant]
US 9557750B2 · Gust et al. · 2017 [cited by applicant]
US 9664400B2 · Wroblewski et al. · 2017 [cited by applicant]
US 9857238B2 · Malhotra et al. · 2018 [cited by applicant]
US 10013644B2 · Takahashi · 2018 [cited by applicant]
US 10094586B2 · Pavlovski et al. · 2018 [cited by applicant]
US 10140544B1 · Zhao et al. · 2018 [cited by applicant]
US 10845815B2 · Palanisamy et al. · 2020 [cited by applicant]
US 11908573B1 · Forehand · 2024 [cited by examiner]
US 20020152298A1 · Kikta et al. · 2002 [cited by applicant]
US 20080082183A1 · Judge · 2008 [cited by applicant]
US 20080277486A1 · Seem et al. · 2008 [cited by applicant]
US 20100025483A1 · Hoeynck et al. · 2010 [cited by applicant]
US 20120084231A1 · McNaught et al. · 2012 [cited by applicant]
US 20140277757A1 · Wang et al. · 2014 [cited by applicant]
US 20150300892A1 · Malhotra et al. · 2015 [cited by applicant]
US 20160201934A1 · Hester · 2016 [cited by examiner]
US 20160313752A1 · Przybylski · 2016 [cited by applicant]
US 20170091615A1 · Liu et al. · 2017 [cited by applicant]
US 20170322579A1 · Goparaju et al. · 2017 [cited by applicant]
US 20180202678A1 · Ahuja et al. · 2018 [cited by applicant]
US 20180266716A1 · Bender et al. · 2018 [cited by applicant]
US 20180365558A1 · Sekiyama et al. · 2018 [cited by applicant]
US 20190018067A1 · Kong et al. · 2019 [cited by applicant]
US 20190219293A1 · Wenzel et al. · 2019 [cited by applicant]
US 20190360711A1 · Sohn et al. · 2019 [cited by applicant]
US 20190377306A1 · Harvey · 2019 [cited by examiner]
US 20200196973A1 · Zhou et al. · 2020 [cited by applicant]
US 20200355391A1 · Wenzel et al. · 2020 [cited by applicant]
US 20210081761A1 · Baker · 2021 [cited by examiner]
US 20210182660A1 · Amirguliyev et al. · 2021 [cited by applicant]
US 20210191342A1 · Lee et al. · 2021 [cited by applicant]
US 20210285671A1 · Du · 2021 [cited by examiner]
US 20210286688A1 · Liu · 2021 [cited by examiner]
US 20230034809A1 · Lee et al. · 2023 [cited by applicant]
An et al., “IC neuron: An efficient unit to construct neural netoworks”. (Year:2020). [cited by applicant]
Huang, et al., (Reachnn: Reachability analysis of neural-network controlled systems. ACM Transactions on Embedded Computing Systems (TECS) 18.5s (2019): 1-22) (Year:2019). [cited by applicant]
Biswas et a.l (“Prediction of residential building energy consumption: A neural network approach” Energy 17 (2016) 84-92.) (Year: 2016). [cited by applicant]
Afroz, Zakia, et al. “Real-time prediction model for indoor temperature ni a commercial building.” Applied energy 231 (2018): 29-53. (Year: 2018). [cited by applicant]
Elsheikh AH, Sharshir SW, Abd Elaziz M, Kabeel AE, Guilan W, Haiou Z. Modeling of solar energy systems using artificial neural network: Acomprehensive review. Solar Energy. Mar. 1, 2019;180:622-39. (Year: 2019). [cited by applicant]
ANSI/ASHRAE Standard 55-2013: Thermal Environmental Conditions for Human Occupancy, ASHRAE, 2013. [cited by applicant]
De Dear, et at., “Developing an Adaptive Model of Thermal Comfort and Preference,” ASHRAE Transactions 1998, vol. 104, Part 1. [cited by applicant]
Ferguson and Green, Deeply Learning Derivatives, arXiv:1809.02233, Oct. 14, 2018. [cited by applicant]
Gagge, et al., A Standard Predictive index of Human Response to the Thermal Environment, ASHRAE Transactions 1986, Part 2B. [cited by applicant]
Guo, BackPropagation Through Time, 2013. [cited by applicant]
Hatcher, John, “Smart Buildings get hyperaware”, Smart Buildings Magazine, Aug. 24, 2020. [cited by applicant]
Jang et al., Deep neural networks with a set of node-wise varying activation functions, Neural Networks 126 (2020) 118-131. [cited by applicant]
Medhi, et al., Jan. 2011, “Model-Based Hierarchical Optimal Control Design for HVAC Systems,” ASME 2011 Dynamic Systems and Control Conference and Bath/ASME Symposium on Fluid Power and Motion Control. [cited by applicant]
Mostafa et al., A Continuous-Time Recurrent Neural Network for Joint Equalization and Decoding—Analog Hardware Implementation Aspects, 2015, Ottawa University. [cited by applicant]
Nakahara, “Study and Practice on HVAC System Commissioning,” The 4th international Symposium on HVAC, Beijing, China, Oct. 9-11, 2003. [cited by applicant]
Nassif et al., “Self-tuning dynamic models of HVAC system components,” 2008, Elsiever, Energy and Buildings 40, 1709-1720. [cited by applicant]
Nassif, Nabil, (2005), Optimization of HVAC control system strategy using two-objective genetic algorithm [microform]. [cited by applicant]
Perra, et al., “Monitoring Indoor People Presence in Buildings Using Low-Cost Infrared Sensor Array in Doorways,” Sensors (Basel). Jun. 2021; 21(12): 4062. [cited by applicant]
Qin et al., “Commissioning and Diagnosis of VAV Air-Conditioning Systems,” Proceedings of the Sixth International Conference for Enhanced Building Operations, Shenzhen, China, Nov. 6-9, 2006. [cited by applicant]
Zhang et al., “Building HVAC Scheduling Using Reinforcement Learning via Neural Network Based Model Approximation”, BuildSys '19, pp. 287-296 (Year: 2019). [cited by applicant]
Rao, C++ Neural Networks and Fuzzy Logic, Jun. 1, 1995, MT Books, IDG Books Worldwide, Ind. [cited by applicant]
Rios, at al., “Derivative-free optimization: a review of algorithms and comparison of software implementations”, J Glob Optimizers (2013) 56;1247-1293. [cited by applicant]
Sabor, et al., “Dynamic Routing Between Capsules,” NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems, Dec. 2017, pp. 3859-3869. [cited by applicant]
Salsbury et al., “Automated Testing of HVAC Systems for Commissioning,” Laurence Livermore National Laboratory, 1999, LBNL-43639. [cited by applicant]
Serale G., et al., Model Predictive Control (MPC) for Enhancing Building and HVAC System Energy Efficiency: Problem Formulation, Applications and Opportunities, Energies 2018, 11, 631; doi:10.3390, Mar. 12, 2018. [cited by applicant]
Sharma et al., Activation Functions in Neural Networks, Intentional Journal of Engineering Applied Sciences and Technology, 2020. [cited by applicant]
Sibi P., Analysis of Different Activation Functions Using Back-Propagation Neural Networks, Journal of Theoretical and Applied Information Technology, vol. 47. No. 3., Jan. 31, 2013. [cited by applicant]
Vaezi-Nejad, H.; Salsbury, T.; Choiniere, D. (2004). Using Building Control System for Commissioning. Energy Systems Laboratory (http://esl.tamu.edu); Texas A&M University (http://www.tamu.edu). Available electronically… [cited by applicant]
Vanus et al., The design of an indirect method for the human presence monitoring in the intelligent building, Human-centric Computing and Information Sciences 8, Article No. 28 (2018). [cited by applicant]
Xiao et al., “Automatic Continuous Commissioning of Measurement Instruments in Air Handling Units,” Building Commissioning for Energy Efficiency and Comfort, 2006, vol. VI-1-3, Shenzhen, China. [cited by applicant]
Welsh, “Ongoing Commissioning (OCx) with BAS and Data Loggers,” National Conference on Building Commissioning: Jun. 3-5, 2009. [cited by applicant]