System and method for validating streaming sensor data in a utility monitoring system
A computer-implemented system for validating meter data in a utility monitoring system based on streamed sensor data is described. The system includes a metering analytics system configured to receive a stream of meter data received from sensors in or in proximity with utility meters, the meter sensor data being generated by the sensors and a central event management system for validating meter sensor data in the streamed sensor data based on a plurality of sequential sensor reads in the streamed sensor data. The central event management system is configured to receive an invalidation event definition defining a sensor value usage invalidation threshold, apply the invalidation event definition to read messages received through the streamed sensor data, monitor read messages in the streamed sensor data to identify a first read message for a watched meter, and identify an invalid meter satisfying the invalidation event definition based upon receipt of at least a second read message for the violating meter indicating that the meter sensor data is outside of a defined range for the sensor value usage invalidation threshold range.
1 . A computer-implemented system for validating meter data in a utility monitoring system based on streamed sensor data, comprising:
a metering analytics system configured to receive a stream of meter data received from sensors in or in proximity with utility meters, the meter sensor data being generated by the sensors; and
a central event management system for validating meter sensor data in the streamed sensor data as it arrives in the stream of meter data from the sensors and prior to provision of the streamed sensor data to the metering analytics system based on a plurality of sequential sensor reads in the streamed sensor data, the central event management system validating meter sensor data by being configured to
receive an invalidation event definition defining a sensor value usage invalidation threshold,
apply the invalidation event definition to read messages received through the streamed sensor data,
monitor read messages in the streamed sensor data to identify a first read message for a watched meter upon receipt of the first read message,
identify an invalid meter satisfying the invalidation event definition based upon receipt of at least a second read message for the violating meter indicating that the meter sensor data is outside of a defined range for the sensor value usage invalidation threshold range, and
output a processed data stream including a modified streamed sensor data that has been modified based on the identification.
2 . The computer-implemented system of claim 1 , wherein the first read message is replaced by the second read message wherein there is no indication that the invalid meter is inside of the defined range based on the at least second read message.
3 . The computer-implemented system of claim 1 , further including identifying a subset of meters to which the invalidation event definition is to be applied based on historical readings for the meters in the subset of meters and monitoring read messages in the streamed sensor data to identify a first read message for each meter in the subset of meters.
4 . The computer-implemented system of claim 3 , further including modifying the defined range based on the historical readings for the meter or sensor.
5 . The computer-implemented system of claim 1 , further including providing a notification to a utility associated with the invalid meter.
6 . The computer-implemented system of claim 5 , wherein the notification to the utility customer associated with the invalid meter is transmitted upon receipt of the at least second read message.
7 . A computer-implemented method for validating meter data in a utility monitoring system based on streamed sensor data, comprising:
receiving a stream of meter data received from sensors in or in proximity with utility meters, the meter sensor data being generated by the sensors; and
validating meter sensor data in the streamed sensor data based on a plurality of sequential meter reads in the streamed sensor data as it arrives in the stream of meter data from the sensors and prior to provision of the streamed sensor data to a metering analytics system, wherein validating the meter sensor data includes
receiving an invalidation event definition defining a sensor value usage invalidation threshold,
applying the invalidation event definition to read messages received through the streamed sensor data,
monitoring read messages in the streamed sensor data to identify a first read message for a watched meter upon receipt of the first read message,
identifying an invalid meter satisfying the invalidation event definition based upon receipt of at least a second read message for the violating meter indicating that the meter sensor data is outside of a defined range for the sensor value usage invalidation threshold range, and
output a processed data stream including a modified streamed sensor data that has been modified based on the identification.
8 . The computer-implemented method of claim 7 , wherein the first read message is replaced by the second read message wherein there is no indication that the invalid meter is inside of the defined range based on the at least second read message.
9 . The computer-implemented method of claim 7 , further including identifying a subset of meters to which the invalidation event definition is to be applied based on historical readings for the meters in the subset of meters and monitoring read messages in the streamed sensor data to identify a first read message for each meter in the subset of meters.
10 . The computer-implemented method of claim 9 , further including modifying the defined range based on the historical readings for the meter or sensor.
11 . The computer-implemented method of claim 7 , further including providing a notification to a utility associated with the invalid meter.
12 . The computer-implemented method of claim 11 , wherein the notification to the utility customer associated with the invalid meter is transmitted upon receipt of the at least second read message.