IP Library Granted Patent US 12,499,462
Granted Patent B2
US 12,499,462 · App. 18/019,022 · Granted Dec 16, 2025

Methods, systems, and computer readable media for model-free privacy preserving thermal load management

Inventors: Sivaranjani Seetharaman (College Station, TX); Panganamala R. Kumar (College Station, TX); Le Xie (College Station, TX)
Assignee: THE TEXAS A&M UNIVERSITY SYSTEM
G06Q30/0206H02J3/003H02J3/14H02J2310/64
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,499,462
App. No.
18/019,022
Filed
Jan 31, 2023
Granted
Dec 16, 2025
Kind
B2
Art Unit
3628
USPC
705/7.35
Abstract

Methods, systems, and computer readable media for thermal load management of a collection of power consumers managed by an electric power aggregator. In some examples, a system includes a scheduling subsystem, implemented on one or more processors, configured for determining a plurality of cooling or heating control schedules for the collection of power consumers by forecasting one or more wholesale electricity price peaks. The system includes a control system implemented on one or more processors. The control system is configured for carrying out the cooling or heating control schedules at the individual consumer-level. The control system is configured for guaranteeing, for each power consumer of the collection of power consumers, a comfort constraint specified by a bilevel thermostat for the power consumer, wherein the comfort constraint comprises a lower level bound temperature and an upper bound temperature that the power consumer is willing to tolerate.

Claims (15)

1 . A system for thermal load management of a collection of power consumers managed by an electric power aggregator, the system comprising:

a scheduling subsystem, implemented on one or more processors, configured for determining a plurality of cooling or heating control schedules for the collection of power consumers by forecasting one or more wholesale electricity price peaks, wherein forecasting the one or more wholesale electricity price peaks incudes using a long-short term memory (LSTM) based recurrent neural network architecture to forecast hourly electric prices from historical price data and weather forecasts and wherein determining the heating or cooling control schedules includes solving, using a heuristic relaxation, an optimization problem that, given the forecast hourly electric prices, minimizes a total cost of procuring electricity by an electric power load serving entity (LSE); and

a control subsystem, implemented on one or more processors, configured for:

carrying out the cooling or heating control schedules at the individual consumer-level, wherein carrying out the heating or cooling control schedules at the individual consumer level includes broadcasting, from the electric power LSE to smart bilevel thermostats, control commands for switching heating or cooling equipment on or off in accordance with distributed open loop control laws determined from results of the optimization problem; and

guaranteeing, for each power consumer of the collection of power consumers, a comfort constraint specified by a bilevel thermostat for the power consumer, wherein the comfort constraint comprises a lower bound temperature and an upper bound temperature that the power consumer is willing to tolerate.

2 . The system of claim 1 , wherein the scheduling subsystem is configured for determining the cooling or heating control schedules without sensing or modeling of a plurality of buildings of the collection of power consumers.

3 . The system of claim 1 , wherein the scheduling subsystem is configured for solving the optimization problem using the relaxation heuristic by approximating that a function that characterizes the forecast hourly electric prices is unimodal.

4 . The system of claim 1 , wherein forecasting the one or more wholesale electricity price peaks comprises forecasting day-ahead or real-time wholesale electricity price peaks.

5 . The system of claim 1 , wherein forecasting the one or more wholesale electricity price peaks comprises forecasting based on one or more outdoor temperature forecasts.

6 . The system of claim 1 , wherein the control subsystem is configured for carrying out the cooling or heating control schedules without sharing temperature or power consumption measurements from the collection of power consumers with the electric power aggregator.

7 . The system of claim 1 , wherein the control subsystem is configured for carrying out the cooling or heating control schedules without using thermal models of buildings of the power consumers.

8 . A method for thermal load management of a collection of power consumers managed by an electric power aggregator, the method comprising:

determining, at a scheduling subsystem implemented on one or more processors, a plurality of cooling or heating control schedules for the collection of power consumers by forecasting one or more wholesale electricity price peaks, wherein forecasting the one or more wholesale electricity price peaks incudes using a long-short term memory (LSTM) based recurrent neural network architecture to forecast hourly electric prices from historical price data and weather forecasts and wherein determining the heating or cooling control schedules includes solving, using a heuristic relaxation, an optimization problem that, given the forecast hourly electric prices, minimizes a total cost of procuring electricity by an electric power load serving entity (LSE);

carrying out the cooling or heating control schedules at the individual consumer-level using a control subsystem implemented on one or more processors, wherein carrying out the heating or cooling control schedules at the individual consumer level includes broadcasting, from the electric power LSE to smart bilevel thermostats, control commands for switching heating or cooling equipment on or off in accordance with distributed open loop control laws determined from results of the optimization problem; and

guaranteeing, for each power consumer of the collection of power consumers, a comfort constraint specified by a bilevel thermostat for the power consumer, wherein the comfort constraint comprises a lower bound temperature and an upper bound temperature that the power consumer is willing to tolerate.

Assignments (2)
CONFIRMATORY LICENSE Recorded Feb 19, 2025
From: TEXAS ENGINEERING EXPERIMENT STATION
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 070254/0367 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2023
From: SEETHARAMAN, SIVARANJANI; KUMAR, PANGANAMALA R.; XIE, LE
To: THE TEXAS A&M UNIVERSITY SYSTEM
Reel/Frame 065507/0775 →
Continuity (2)
Provisional Application 63067282 · Aug 18, 2020
Related Publication 20230298060A1 · Sep 21, 2023
References Cited (129)
US 7274975B2 · Miller · 2007 [cited by examiner]
US 8019697B2 · Ozog · 2011 [cited by examiner]
US 8091795B1 · McLellan · 2012 [cited by examiner]
US 8942857B2 · Anderson et al. · 2015 [cited by applicant]
US 9817375B2 · Li · 2017 [cited by examiner]
US 9946235B2 · Holub · 2018 [cited by examiner]
US 10077915B2 · Lu et al. · 2018 [cited by applicant]
US 10146237B2 · Turney · 2018 [cited by examiner]
US 10389116B2 · Tani · 2019 [cited by examiner]
US 10443873B1 · Johnson · 2019 [cited by examiner]
US 11525594B1 · Hinson · 2022 [cited by examiner]
US 20030182250A1 · Shihidehpour · 2003 [cited by examiner]
US 20040215529A1 · Foster · 2004 [cited by examiner]
US 20050137959A1 · Yan · 2005 [cited by examiner]
US 20070288403A1 · Subramanian · 2007 [cited by examiner]
US 20090210081A1 · Sustaeta · 2009 [cited by examiner]
US 20100076835A1 · Silverman · 2010 [cited by examiner]
US 20100138363A1 · Batterberry · 2010 [cited by examiner]
US 20100179704A1 · Ozog · 2010 [cited by examiner]
US 20100324962A1 · Nesler · 2010 [cited by examiner]
US 20110055287A1 · Sun · 2011 [cited by examiner]
US 20110184562A1 · Amundson · 2011 [cited by examiner]
US 20110184565A1 · Peterson · 2011 [cited by examiner]
US 20110191773A1 · Pavel · 2011 [cited by examiner]
US 20110231028A1 · Ozog · 2011 [cited by examiner]
US 20110231320A1 · Irving · 2011 [cited by examiner]
US 20110238224A1 · Schnell · 2011 [cited by examiner]
US 20110270453A1 · Kalogridis · 2011 [cited by examiner]
US 20110282500A1 · Long · 2011 [cited by examiner]
US 20120083930A1 · Ilic · 2012 [cited by examiner]
US 20120330465A1 · O'Neill · 2012 [cited by examiner]
US 20130268126A1 · Iwami · 2013 [cited by examiner]
US 20140039709A1 · Steven · 2014 [cited by examiner]
US 20140214219A1 · Katayama · 2014 [cited by examiner]
US 20140222225A1 · Rouse · 2014 [cited by examiner]
US 20140242898A1 · Richards · 2014 [cited by examiner]
US 20140297206A1 · Silverman · 2014 [cited by examiner]
US 20140316973A1 · Steven · 2014 [cited by examiner]
US 20150018985A1 · Koch · 2015 [cited by examiner]
US 20150295410A1 · Hooshmand · 2015 [cited by examiner]
US 20150310461A1 · Lee · 2015 [cited by examiner]
US 20160092978A1 · Lian · 2016 [cited by examiner]
US 20160109895A1 · Schindler · 2016 [cited by examiner]
US 20160204607A1 · Rogers, Jr. · 2016 [cited by examiner]
US 20170074539A1 · Bentz · 2017 [cited by examiner]
US 20170329291A1 · Kopp · 2017 [cited by examiner]
US 20170357224A1 · Berrien · 2017 [cited by examiner]
US 20170364105A1 · Greene · 2017 [cited by examiner]
US 20180026445A1 · Kalsi · 2018 [cited by examiner]
US 20180087795A1 · Okita et al. · 2018 [cited by applicant]
US 20180150045A1 · Burke · 2018 [cited by examiner]
US 20180172309A1 · Niikura · 2018 [cited by examiner]
US 20180209675A1 · Ridder · 2018 [cited by examiner]
US 20180285989A1 · Dong · 2018 [cited by examiner]
US 20180313557A1 · Turney et al. · 2018 [cited by applicant]
US 20190093914A1 · Ristimäki · 2019 [cited by examiner]
US 20190353377A1 · Mao · 2019 [cited by examiner]
US 20200025402A1 · Bell · 2020 [cited by examiner]
US 20200073342A1 · Lee · 2020 [cited by examiner]
US 20200074274A1 · Fan · 2020 [cited by examiner]
US 20200076196A1 · Lee · 2020 [cited by examiner]
US 20200132324A1 · Rigg · 2020 [cited by examiner]
US 20200175534A1 · Aggarwala · 2020 [cited by examiner]
US 20200274389A1 · Islam · 2020 [cited by examiner]
US 20200279340A1 · Guan · 2020 [cited by examiner]
US 20210296897A1 · Cruickshank, III · 2021 [cited by examiner]
US 20210325069A1 · Cotton · 2021 [cited by examiner]
US 20210341164A1 · Johnson · 2021 [cited by examiner]
US 20220026864A1 · Murugesan · 2022 [cited by examiner]
US 20220122163A1 · Obata · 2022 [cited by examiner]
US 20220156828A1 · Aisu · 2022 [cited by examiner]
US 20220244076A1 · Karlgaard · 2022 [cited by examiner]
US 20240405603A1 · Nelson · 2024 [cited by examiner]
CN 106022548A · 2016 [cited by examiner]
CN 107112752A · 2017 [cited by examiner]
CN 111466063A · 2020 [cited by examiner]
CN 112348283A · 2021 [cited by examiner]
CN 113325701A · 2021 [cited by examiner]
WO WO2013126800A1 · 2013 [cited by examiner]
WO WO2013166511A2 · 2013 [cited by examiner]
WO WO2016168503A1 · 2016 [cited by examiner]
WO WO2016186081A1 · 2016 [cited by examiner]
WO WO2017162910A1 · 2017 [cited by examiner]
WO WO2018213630A1 · 2018 [cited by examiner]
WO WO2022040255A1 · 2022 [cited by examiner]
WO WO2024118794A2 · 2024 [cited by examiner]
Xinxin, Fang, “Revisit the Electricity price formulation: A formal definition, proofs, and examples”, published by Elsevier in Apr. 2020 (Year: 2020). [cited by examiner]
Bethany Frew, “Impacts of price formation efforts considering high renewable penetration high renewable penetration levels and system resource adequacy targets”, published by NREL in May 2020 (Year: 2020). [cited by examiner]
Severin Borenstein, “the long run efficiency of real time electricity pricing”, published by the Energy Journal, in 2005 (Year: 2005). [cited by examiner]
Wollenberg, “monitoring and optimization for power Grids: a signal processing perspective”, published by IEEE in Aug. 2013 (Year: 2013). [cited by examiner]
Siyu Zhou, “an optimized heterogeneous structure LSTM network for electricity price forecasting”, published by IEEE in 2019 (Year: 2019). [cited by examiner]
Oktay Tas, “Electricity Price Forecasting Using Recurrent neural Networks”, published by MDPI in 2018 (Year: 2018). [cited by examiner]
Avci et al., “Residential hvac load control strategy in real-time electricity pricing environment,” in 2012 IEEE Energytech. IEEE, 2012, pp. 1-6. [cited by applicant]
Baldi et al., “Joint energy demand and thermal comfort optimization in photovoltaic-equipped interconnected microgrids,” Energy Conversion and Management, vol. 101, pp. 352-363, 2015. [cited by applicant]
Bashash et al., “Modeling and control insights into demand-side energy management through setpoint control of thermostatic loads,” in Proceedings of the 2011 American Control Conference. IEEE, 2011, pp. 4546-4553. [cited by applicant]
Bhattacharya et al., “Economic operation of thermostatic loads under time varying prices: An optimal control approach,” IEEE Transactions on Sustainable Energy, vol. 10, No. 4, pp. 1960-1970, 2018. [cited by applicant]
Bhattacharyya et al., “A fuzzy logic based approach to direct load control,” IEEE Transactions on Power Systems, vol. 11, No. 2, pp. 708-714, 1996. [cited by applicant]
Callaway et al., “Achieving controllability of electric loads,” Proceedings of the IEEE, vol. 99, No. 1, pp. 184-199, 2010. [cited by applicant]
Callaway et al., “Tapping the energy storage potential in electric loads to deliver load following and regulation, with application to wind energy,” Energy Conversion and Management, vol. 50, No. 5, pp. 1389-1400, 2009. [cited by applicant]
Carreiro et al., “Energy management systems aggregators: A literature survey,” Renewable and Sustainable Energy Reviews, vol. 73, pp. 1160-1172, 2017. [cited by applicant]
Claessens et al., “Modelfree control of thermostatically controlled loads connected to a district heating network,” Energy and Buildings, vol. 159, pp. 1-10, 2018. [cited by applicant]
Docimo et al., “Demand response using heterogeneous thermostatically controlled loads: Characterization of aggregate power dynamics,” Journal of Dynamic Systems, Measurement, and Control, vol. 139, No. 10, 2017. [cited by applicant]
Fontes et al., “Optimal control of thermostatic loads for planning aggregate consumption: Characterization of solution and explicit strategies,” IEEE Control Systems Letters, vol. 3, No. 4, pp. 877-882, 2019. [cited by applicant]
Halder et al., “Architecture and algorithms for privacy preserving thermal inertial load management by a load serving entity,” IEEE Transactions on Power Systems, vol. 32, No. 4, pp. 3275-3286, 2016. [cited by applicant]
Halder et al., “Optimal power consumption for demand response of thermostatically controlled loads,” Optimal Control Applications and Methods, vol. 40, No. 1, pp. 68-84, 2019. [cited by applicant]
Hao et al., “Ancillary service to the grid through control of fans in commercial building hvac systems,” IEEE Transactions on smart grid, vol. 5, No. 4, pp. 2066-2074, 2014. [cited by applicant]
Heffner et al., “Loads providing ancillary services: Review of international experience,” 2008. [cited by applicant]
Notification of Transmittal of the International Search Report and the Written Opinion of the International Searching Authority, or the Declaration for International Patent Application Serial No. PCT/US2021/046414 dated… [cited by applicant]
Kalsi et al., “Development and validation of aggregated models for thermostatic controlled loads with demand response,” in 2012 45th Hawaii International Conference on System Sciences. IEEE, 2012, pp. 1959-1966. [cited by applicant]
Kazmi et al., “Multi-agent reinforcement learning for modeling and control of thermostatically controlled loads,” Applied energy, vol. 238, pp. 1022-1035, 2019. [cited by applicant]
Kirschen et al., “Demand-side view of electricity markets,” IEEE Transactions on power systems, vol. 18, No. 2, pp. 520-527, 2003. [cited by applicant]
Koch et al., “Modeling and control of aggregated heterogeneous thermostatically controlled loads for ancillary services,” in Proc. PSCC. Citeseer, 2011, pp. 1-7. [cited by applicant]
Kurucz et al., “A linear programming model for reducing system peak through customer load control programs,” IEEE Transactions on Power Systems, vol. 11, No. 4, pp. 1817-1824, 1996. [cited by applicant]
Lee et al., “Optimization and implementation of a load control scheduler using relaxed dynamic programming for large air conditioner loads,” IEEE Transactions on Power Systems, vol. 23, No. 2, pp. 691-702, 2008. [cited by applicant]
Liu et al., “Optimal privacy-preserving load scheduling in smart grid,” in 2016 IEEE Power and Energy Society General Meeting (PESGM). IEEE, 2016, pp. 1-5. [cited by applicant]
Malhame et al., “Electric load model synthesis by diffusion approximation of a high-order hybrid-state stochastic system,” IEEE Transactions on Automatic Control, vol. 30, No. 9, pp. 854-860, 1985. [cited by applicant]
Mathieu et al., “Arbitraging intraday wholesale energy market prices with aggregations of thermostatic loads,” IEEE Transactions on Power Systems, vol. 30, No. 2, pp. 763-772, 2014. [cited by applicant]
Mathieu et al., “State estimation and control of electric loads to manage real-time energy imbalance,” IEEE Transactions on Power Systems, vol. 28, No. 1, pp. 430-440, 2012. [cited by applicant]
Mathieu et al., “Using residential electric loads for fast demand response: The potential resource and revenues, the costs, and policy recommendations,” in ACEEE Summer Study on Energy Efficiency in Buildings. Citeseer,… [cited by applicant]
Meyn et al., “Ancillary service to the grid using intelligent deferrable loads,” IEEE Transactions on Automatic Control, vol. 60, No. 11, pp. 2847-2862, 2015. [cited by applicant]
Nguyen et al., “Energy management for households with solar assisted thermal load considering renewable energy and price uncertainty,” IEEE Transactions on Smart Grid, vol. 6, No. 1, pp. 301-314, 2014. [cited by applicant]
Ramanathan et al., “A framework for evaluation of advanced direct load control with minimum disruption,” IEEE Transactions on Power Systems, vol. 23, No. 4, pp. 1681-1688, 2008. [cited by applicant]
Ruelens et al., “Residential demand response of thermostatically controlled loads using batch reinforcement learning,” IEEE Transactions on Smart Grid, vol. 8, No. 5, pp. 2149-2159, 2016. [cited by applicant]
Schweppe et al., “Homeostatic utility control,” IEEE Transactions on Power Apparatus and Systems, No. 3, pp. 1151-1163, 1980. [cited by applicant]
Strbac et al., “Demand side management: Benefits and challenges,” Energy policy, vol. 36, No. 12, pp. 4419-4426, 2008. [cited by applicant]
Turner et al., “Peak load reductions: Electric load shifting with mechanical pre-cooling of residential buildings with low thermal mass,” Energy, vol. 82, pp. 1057-1067, 2015. [cited by applicant]
U. E. I. Administration. (2015) Residential energy consumption survey. [Online]. Available: http://www.eia.gov/consumption/residential/ index.cfm. [cited by applicant]
Wei et al., “Air conditioner direct load control by multipass dynamic programming,” IEEE Transactions on Power Systems, vol. 10, No. 1, pp. 307-313, 1995. [cited by applicant]
Zhang et al., “Aggregated modeling and control of air conditioning loads for demand response,” IEEE transactions on power systems, vol. 28, No. 4, pp. 4655-4664, 2013. [cited by applicant]