IP Library Granted Patent US 12,259,696
Granted Patent B2
US 12,259,696 · App. 18/229,905 · Granted Mar 25, 2025

Environment controller and method for inferring one or more commands for controlling an appliance taking into account room characteristics

Inventor: Francois Gervais (Lachine, CA)
Assignee: DISTECH CONTROLS INC.
G05B13/027F24F11/54G05B13/0265G05D22/02G05D23/1917G06N3/02G06N5/04H04L12/282H04L12/2823H04L12/2829
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,259,696
App. No.
18/229,905
Granted
Mar 25, 2025
Kind
B2
Abstract

Method and environment controller for inferring via a neural network one or more commands for controlling an appliance. A predictive model generated by a neural network training engine is stored by the environment controller. The environment controller determines at least one room characteristic. The environment controller receives at least one environmental characteristic value and at least one set point. The environment controller executes a neural network inference engine, which uses the predictive model for inferring the one or more commands for controlling the appliance. The inference is based on the at least one environmental characteristic value, the at least one set point and the at least one room characteristic. The environment controller transmits the one or more commands to the controlled appliance.

Claims (44)

1. An environment controller, comprising:

a communication interface;

memory for storing a predictive model generated by a neural network training engine, the predictive model comprising weights of a neural network determined by the neural network training engine; and

a processing unit comprising at least one processor for:

receiving at least one room characteristic via one of the communication interface and a user interface of the environment controller, and storing the at least one room characteristic in the memory;

receiving via the communication interface a current room occupancy;

receiving via one of the communication interface and the user interface a target temperature;

executing a neural network inference engine, the neural network inference engine implementing a neural network using the predictive model for inferring an output based on inputs, the output comprising one or more command for controlling an appliance, the inputs comprising the at least one room characteristic, the current room occupancy and the target temperature; and

transmitting the one or more command to the controlled appliance via the communication interface;

wherein the at least one room characteristic used as input of the neural network comprises at least one of the following: a room type identifier selected among a plurality of room type identifiers, one or more geometric characteristics of the room, and a human activity in the room.

2. The environment controller of claim 1 , wherein the at least one room characteristic comprises one or more geometric characteristics of the room, the one or more geometric characteristics of the room comprising at least one of the following: a volume of the room, a surface of the room, a height of the room, a length of the room, and a width of the room.

3. The environment controller of claim 1 , wherein the at least one room characteristic comprises a human activity in the room, the human activity in the room comprising at least one of the following: periods of time when the room is occupied by humans, and a type of activity performed by humans occupying the room.

4. The environment controller of claim 1 , wherein the processing unit further receives via the communication interface at least one additional environmental characteristic value; and wherein the inputs of the neural network inference engine further comprise the at least one additional environmental characteristic value.

5. The environment controller of claim 4 , wherein the at least one additional environmental characteristic value comprises at least one of the following: a current temperature, a current humidity level, and a current carbon dioxide (CO2) level.

6. The environment controller of claim 1 , wherein the current room occupancy consists of a determination whether the room is occupied or not, or the current room occupancy consists of a number of persons present in the room.

7. The environment controller of claim 1 , wherein the processing unit further receives via one of the communication interface and the user interface at least one additional set point; and wherein the inputs of the neural network inference engine further comprise the at least one additional set point.

8. The environment controller of claim 7 , wherein the at least one additional set point comprises at least one of the following: a target CO2 level, and a target humidity level.

9. The environment controller of claim 1 , wherein the one or more command for controlling the appliance includes at least one of the following: a command for controlling a speed of a fan, a command for controlling a pressure generated by a compressor, and a command for controlling a rate of an airflow through a valve.

10. The environment controller of claim 1 , wherein the controlled appliance consists of a heating, ventilation, and air-conditioning (HVAC) appliance.

11. A method for inferring via a neural network one or more command for controlling an appliance for a room, the method comprising:

storing a predictive model generated by a neural network training engine in a memory of an environment controller, the predictive model comprising weights of a neural network determined by the neural network training engine;

determining by a processing unit of the environment controller at least one room characteristic;

receiving by the processing unit via a communication interface of the environment controller a current room occupancy;

receiving by the processing unit via one of the communication interface and a user interface of the environment controller a target temperature;

executing by the processing unit a neural network inference engine, the neural network inference engine implementing a neural network using the predictive model for inferring an output based on inputs, the output comprising the one or more command for controlling the appliance, the inputs comprising the at least one room characteristic, the current room occupancy and the target temperature; and

transmitting by the processing unit the one or more command to the controlled appliance via the communication interface;

wherein the at least one room characteristic used as input of the neural network comprises at least one of the following: a room type identifier selected among a plurality of room type identifiers, one or more geometric characteristics of the room, and a human activity in the room.

12. The method of claim 11 , wherein the at least one room characteristic comprises one or more geometric characteristics of the room, the one or more geometric characteristics of the room comprising at least one of the following: a volume of the room, a surface of the room, a height of the room, a length of the room, and a width of the room.

13. The method of claim 11 , wherein the at least one room characteristic comprises a human activity in the room, the human activity in the room comprising at least one of the following: periods of time when the room is occupied by humans, and a type of activity performed by humans occupying the room.

14. The method of claim 11 , further comprising receiving by the processing unit via the communication interface at least one additional environmental characteristic value; and wherein the inputs of the neural network inference engine further comprise the at least one additional environmental characteristic value.

15. The method of claim 14 , wherein the at least one additional environmental characteristic value comprises at least one of the following: a current temperature, a current humidity level, and a current carbon dioxide (CO2) level.

16. The method of claim 11 , wherein the current room occupancy consists of a determination whether the room is occupied or not, or the current room occupancy consists of a number of persons present in the room.

17. The method of claim 11 , further comprising receiving by the processing unit via one of the communication interface and the user interface at least one additional set point; and wherein the inputs of the neural network inference engine further comprise the at least one additional set point.

18. The method of claim 17 , wherein the at least one additional set point comprises at least one of the following: a target CO2 level, and a target humidity level.

19. The method of claim 11 , wherein the one or more command for controlling the appliance includes at least one of the following: a command for controlling a speed of a fan, a command for controlling a pressure generated by a compressor, and a command for controlling a rate of an airflow through a valve.

20. The method of claim 11 , wherein the controlled appliance consists of a heating, ventilation, and air-conditioning (HVAC) appliance.

21. A non-transitory computer program product comprising instructions executable by a processing unit of an environment controller, the execution of the instructions by the processing unit of the environment controller providing for inferring via a neural network one or more command for controlling an appliance for a room by:

storing a predictive model generated by a neural network training engine in a memory of the environment controller, the predictive model comprising weights of a neural network determined by the neural network training engine;

determining by the processing unit at least one room characteristic;

receiving by the processing unit via a communication interface of the environment controller a current room occupancy;

receiving by the processing unit via one of the communication interface and a user interface of the environment controller a target temperature;

executing by the processing unit a neural network inference engine, the neural network inference engine implementing a neural network using the predictive model for inferring an output based on inputs, the output comprising the one or more command for controlling the appliance, the inputs comprising the at least one room characteristic, the current room occupancy and the target temperature; and

transmitting by the processing unit the one or more command to the controlled appliance via the communication interface;

wherein the at least one room characteristic used as input of the neural network comprises at least one of the following: a room type identifier selected among a plurality of room type identifiers, one or more geometric characteristics of the room, and a human activity in the room.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2023
From: GERVAIS, FRANCOIS
To: DISTECH CONTROLS INC.
Reel/Frame 064552/0783 →
Continuity (3)
Continuation 17117928 · Dec 10, 2020
Continuation 15839108 · Dec 12, 2017
Related Publication 20240069502A1 · Feb 29, 2024
References Cited (85)
US 5257735A · Takahashi et al. · 1993 [cited by applicant]
US 7156316B2 · Kates · 2007 [cited by applicant]
US 7839275B2 · Spalink et al. · 2010 [cited by applicant]
US 7840310B2 · Orfield · 2010 [cited by applicant]
US 7904209B2 · Podgorny et al. · 2011 [cited by applicant]
US 8010237B2 · Cheung et al. · 2011 [cited by applicant]
US 8412654B2 · Montalvo · 2013 [cited by applicant]
US 8457796B2 · Thind · 2013 [cited by applicant]
US 9002761B2 · Montalvo · 2015 [cited by applicant]
US 9046896B1 · Brunelle · 2015 [cited by applicant]
US 9477239B2 · Bergman et al. · 2016 [cited by applicant]
US 9536421B2 · Singhar et al. · 2017 [cited by applicant]
US 9594384B2 · Bergman et al. · 2017 [cited by applicant]
US 9661121B2 · Singhar et al. · 2017 [cited by applicant]
US 9905122B2 · Sloo et al. · 2018 [cited by applicant]
US 10523449B2 · Motalvo · 2019 [cited by applicant]
US 10616121B2 · Gervais · 2020 [cited by applicant]
US 10838375B2 · Gervais et al. · 2020 [cited by applicant]
US 10845768B2 · Gervais et al. · 2020 [cited by applicant]
US 10895853B2 · Gervais · 2021 [cited by applicant]
US 10897374B2 · Choi et al. · 2021 [cited by applicant]
US 10908561B2 · Gervais · 2021 [cited by applicant]
US 11526138B2 · Gervais · 2022 [cited by examiner]
US 11543786B2 · Gervais · 2023 [cited by examiner]
US 11747771B2 · Gervais · 2023 [cited by examiner]
US 11754983B2 · Gervais · 2023 [cited by examiner]
US 20020144537A1 · Sharp et al. · 2002 [cited by applicant]
US 20030160103A1 · Guo · 2003 [cited by applicant]
US 20070114292A1 · Breed et al. · 2007 [cited by applicant]
US 20070119958A1 · Kates · 2007 [cited by applicant]
US 20080001712A1 · Agarwal et al. · 2008 [cited by applicant]
US 20080281472A1 · Podgorny et al. · 2008 [cited by applicant]
US 20100088261A1 · Montalvo · 2010 [cited by applicant]
US 20110113360A1 · Johnson et al. · 2011 [cited by applicant]
US 20110295430A1 · Kouninski · 2011 [cited by applicant]
US 20120144057A1 · Meredith et al. · 2012 [cited by applicant]
US 20120245740A1 · Raestik et al. · 2012 [cited by applicant]
US 20140277757A1 · Wang et al. · 2014 [cited by applicant]
US 20140321839A1 · Armstrong · 2014 [cited by applicant]
US 20150248118A1 · Li et al. · 2015 [cited by applicant]
US 20150276253A1 · Montalvo · 2015 [cited by applicant]
US 20150293504A1 · Blum et al. · 2015 [cited by applicant]
US 20150296594A1 · Blum et al. · 2015 [cited by applicant]
US 20160223218A1 · Barrett · 2016 [cited by applicant]
US 20160358459A1 · Singhar et al. · 2016 [cited by applicant]
US 20170108236A1 · Guan et al. · 2017 [cited by applicant]
US 20170227950A1 · Kinoshita et al. · 2017 [cited by applicant]
US 20170364829A1 · Fyffe · 2017 [cited by applicant]
US 20180100662A1 · Farahmand et al. · 2018 [cited by applicant]
US 20180195911A1 · Kakade et al. · 2018 [cited by applicant]
US 20180268220A1 · Lee et al. · 2018 [cited by applicant]
US 20180299153A1 · Ajax et al. · 2018 [cited by applicant]
US 20180306459A1 · Turney · 2018 [cited by applicant]
US 20180364654A1 · Locke et al. · 2018 [cited by applicant]
US 20180367320A1 · Montalvo · 2018 [cited by applicant]
US 20180367483A1 · Rodriguez et al. · 2018 [cited by applicant]
US 20180375444A1 · Gamroth · 2018 [cited by applicant]
US 20190017719A1 · Sinha et al. · 2019 [cited by applicant]
US 20190126472A1 · Tunyasuvunakool et al. · 2019 [cited by applicant]
US 20190182069A1 · Gervais · 2019 [cited by applicant]
US 20190309978A1 · Song · 2019 [cited by applicant]
US 20190316802A1 · Alanquar et al. · 2019 [cited by applicant]
US 20200025401A1 · Cheon et al. · 2020 [cited by applicant]
US 20200050178A1 · Gao et al. · 2020 [cited by applicant]
US 20210088987A1 · Gervais · 2021 [cited by applicant]
US 20210096519A1 · Gervais · 2021 [cited by applicant]
CN 114811833A · 2022 [cited by applicant]
WO 2017076433A1 · 2017 [cited by applicant]
WO 2018200225A1 · 2018 [cited by applicant]
Chen et al., “Modeling and optimization of complex building energy systems with deep neural networks”, 51st Asilomar Conference on Signals, Systems, and Computers, IEEE, 2017, pp. 1368-1373. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/914,610, mailed Apr. 6, 2022, 24 pages. [cited by applicant]
Hafner et al., “Reinforcement Learning in Feedback Control Challenges and Benchmarks from Technical Process Control”, Mach. Learn., 2011, vol. 84, pp. 137-169. [cited by applicant]
Kalogirou, S.A., “Applications of artificial neural-networks for energy systems”, Applied Energy, 2000, 67(1-2), pp. 17-35. [cited by applicant]
Non Final Office Action for U.S. Appl. No. 15/914,610, mailed Dec. 13, 2021, 28 pages. [cited by applicant]
Non Final Office Action for U.S. Appl. No. 15/914,610, mailed Oct. 27, 2022, 40 pages. [cited by applicant]
Non Final Office Action for U.S. Appl. No. 17/067,060, mailed Mar. 30, 2022, 17 pages. [cited by applicant]
Non Final Office Action for U.S. Appl. No. 17/069,233, mailed Mar. 28, 2022, 16 pages. [cited by applicant]
Non Final Office Action for U.S. Appl. No. 17/116,514, mailed Oct. 13, 2022, 30 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/067,060, mailed Aug. 31, 2022, 14 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/069,233, mailed Aug. 18, 2022, 17 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/116,514, mailed Apr. 19, 2023, 13 pages. [cited by applicant]
Ryu et al., “Development of an Occupancy Prediction Model Using Indoor Environmental Data Based on Machine Learning Techniques”, Building and Environment, 2016, vol. 197, pp. 1-9. [cited by applicant]
Wang et al., “A long-short term memory recurrent neural network based reinforcement learning controller for office heating ventilation and air conditioning systems”, Processes, 2017, 5(3), 18 pages. [cited by applicant]
Wei et al., “Deep Reinforcement Learning for Building HVAC Control”, Proceedings of the 54th Annual Design Automation Conference 2017, pp. 1-6. [cited by applicant]
Non-final Office Action for U.S. Appl. No. 15/914,610, mailed Nov. 9, 2023, 27 pages. [cited by applicant]