Building system with brokering architecture and tiered storage for realtime applications
A brokering system used in distributed building controls provides multiple tiers of storage. Data can be requested at any time during the processing of new data received from a building device. Complex event processors, low latency control, and/or display interfaces may request and be provided data from memory (e.g., tier one storage) of a message broker. Digital twins and/or optimization algorithms may wait until data is stored to local disk before information is obtained. Other applications may wait until data is saved in the remote database before using the data to perform calculations. Data may be compressed and stored in timeseries that are accessed by a single requested to the message broker.
1 . One or more memory devices having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
operating a first isolated compute environment comprising a message broker and a first tier of storage, wherein the first tier of storage is configured to respond faster than a second tier of storage in a second isolated compute environment; and
operating the second isolated compute environment comprising the second tier of storage,
wherein the message broker is configured to:
receive measurements relating to a building system;
store a current measurement of the measurements in the first tier of storage; and
send, after storing the current measurement into the first tier of storage, a message to the second isolated compute environment to store a difference between the current measurement and a previous measurement of the measurements in the second tier of storage.
2 . The one or more memory devices of claim 1 , wherein the first tier of storage comprises at least one of:
RAM;
a solid-state drive; or
an embedded multi-media card.
3 . The one or more memory devices of claim 1 , wherein the second tier of storage comprises at least one of:
a solid-state drive;
a magnetic disk drive; or
an embedded multi-media card.
4 . The one or more memory devices of claim 1 , wherein the message broker is further configured to:
store a first portion of a timeseries representing a variable in the measurements in the first tier of storage; and
cause a second portion of the timeseries representing the variable to be stored in the second tier of storage.
5 . The one or more memory devices of claim 4 , wherein the message broker is further configured to:
encode the timeseries by subtracting time adjacent values of the timeseries to form an encoded timeseries; and
bit-pack the encoded timeseries to form a compressed timeseries.
6 . The one or more memory devices of claim 4 , the operations further comprising operating a third isolated compute environment comprising an algorithm calculator configured to request the timeseries from the message broker,
wherein the message broker is configured to:
request the second portion of the timeseries;
generate a combined timeseries comprising the first portion of the timeseries and the second portion of the timeseries; and
send the combined timeseries to the algorithm calculator.
7 . The one or more memory devices of claim 4 , the operations further comprising operating a third isolated compute environment comprising a digital twin of at least a portion of the building system, the digital twin configured to:
receive the current measurement from the first tier of storage before the difference is stored in the second tier of storage;
display a state of the portion of the building system;
request the timeseries from the message broker; and
simulate the portion of the building system using the timeseries.
8 . The one or more memory devices of claim 1 , the operations further comprising operating a third isolated compute environment comprising a complex event processor configured to:
receive the current measurement from the first tier of storage before the difference is stored in the second tier of storage; and
perform a fault detection operation with the current measurement.
9 . The one or more memory devices of claim 1 , the operations further comprising operating a third isolated compute environment comprising a control application configured to:
select the first tier of storage or the second tier of storage based on a speed of a system controlled by the control application; and
request the current measurement from the selected tier of storage.
10 . A method for providing real-time data and historical data from a building system, the method comprising:
storing a current measurement relating to the building system in a first tier of storage operating in a first isolated compute environment; and
storing a difference between the current measurement and a previous measurement in a second tier of storage operating in a second isolated compute environment after processing requests for the current measurement in the first tier of storage, wherein the first tier of storage is configured to respond faster than the second tier of storage.
11 . The method of claim 10 , wherein the first tier of storage comprises at least one of:
RAM;
a solid-state drive; or
an embedded multi-media card.
12 . The method of claim 10 , wherein the second tier of storage comprises at least one of:
a solid-state drive;
a magnetic disk drive; or
an embedded multi-media card.
13 . The method of claim 10 , wherein the current measurement is stored in a timeseries, wherein a first portion of the timeseries is stored in the first tier of storage and a second portion of the timeseries is stored in the second tier of storage.
14 . The method of claim 13 , wherein the timeseries is stored in a compressed form, the method further comprising:
encoding the timeseries by subtracting time adjacent values of the timeseries to form an encoded timeseries; and
bit-packing the encoded timeseries to form a compressed timeseries,
wherein a most recent stored value in the timeseries is not encoded.
15 . The method of claim 13 , further comprising performing calculations of an algorithm using the first portion of the timeseries and the second portion of the timeseries.
16 . The method of claim 13 , the method further comprising displaying in real-time a state of a part of the building system using the current measurement from the first tier of storage and performing a simulation of the building system using the timeseries.
17 . The method of claim 10 , further comprising performing a fault detection operation using a response to a request for the current measurement from the first tier of storage.
18 . The method of claim 10 , further comprising selecting the first tier of storage or the second tier of storage based on a speed of a system controlled by a control application and performing a calculation of the control application using the current measurement from the selected tier of storage.
19 . One or more non-transitory computer-readable storage media having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
receiving a current measurement of a building system;
storing the current measurement in a first tier of storage;
providing the current measurement in the first tier of storage to a digital twin before storing the current measurement in a timeseries in a second tier of storage;
providing the timeseries from the second tier of storage to the digital twin after storing the current measurement in the timeseries in the second tier, wherein the digital twin is configured to display the current measurement and perform a simulation or replay using the timeseries.
20 . The one or more non-transitory computer-readable storage media of claim 19 , wherein the current measurement is stored in a timeseries,
the operations further comprising:
encoding the timeseries by subtracting the current measurement from a most recent stored value in the timeseries to obtain a difference, replacing the most recent stored value in the timeseries with the difference, and appending the current measurement to the timeseries; and
bit-packing the encoded timeseries to form a compressed timeseries.