Data management policies for internet of things components
Techniques are provided for implementing data management policies for various components of an Internet of Things (IoT) system. An exemplary method performed by an IoT component comprises: obtaining sensor data; obtaining a data management policy that specifies a data transmission policy, a data retention policy, a data retirement policy and/or a data processing policy for a processing of the sensor data by a plurality of IoT components; and processing the sensor data based on the obtained data management policy. Data policy operators are optionally provided to (i) adjust a resolution of the sensor data; (ii) aggregate the sensor data; and/or (iii) apply a learning algorithm to the sensor data, based on the data management policy.
1. A method performed by a first Internet of Things component, comprising:
obtaining sensor data;
obtaining, by the first Internet of Things component, a data management policy that specifies one or more of a data transmission policy, a data retention policy, a data retirement policy and a data processing policy for a processing of the sensor data by a plurality of Internet of Things components comprising the first Internet of Things component and one or more additional Internet of Things components;
providing a plurality of data policy operators as part of the data management policy to apply to the sensor data based on the data management policy, wherein one or more of the data policy operators apply at least one data reduction operation to the sensor data to generate reduced sensor data and provide metadata with the reduced sensor data describing the at least one data reduction operation; and
processing, by the first Internet of Things component, the sensor data based on the obtained data management policy, wherein the plurality of Internet of Things components that apply the data management policy to the sensor data comprises at least one gateway device that aggregates, according to the data management policy, at least a portion of the sensor data from a plurality of sensor devices and at least one backend storage device that stores data according to the data management policy, wherein the at least one gateway device and the at least one backend storage device are distinct devices with respect to one another and wherein the at least one gateway device provides the aggregated sensor data to the at least one backend storage device.
2. The method of claim 1 , wherein the data transmission policy specifies how to manipulate the sensor data before the sensor data is one or more of transmitted and stored by a given Internet of Things component.
3. The method of claim 1 , wherein the data retention policy specifies a duration that the sensor data is maintained in storage.
4. The method of claim 1 , wherein the data retirement policy specifies a processing of the sensor data when one or more predefined storage criteria are satisfied.
5. The method of claim 1 , wherein the data management policy further specifies a predefined handling of the sensor data when communications are disrupted.
6. The method of claim 1 , wherein the data processing policy specifies a central processing unit limitation for processing the sensor data.
7. The method of claim 1 , wherein the data management policy applies to substantially all of the Internet of Things components of a given Internet of Things system.
8. The method of claim 1 , wherein the data policy operators are applied to the sensor data to one or more of (i) adjust a resolution of the sensor data; (ii) aggregate the sensor data; and (iii) apply a learning algorithm to the sensor data, based on the data management policy.
9. The method of claim 1 , further comprising the step of applying at least a portion of the data management policy to one or more of the Internet of Things components based on one or more of a device type, a device class, a geographical region, a hierarchical location in an Internet of Things system, and a device identifier.
10. The method of claim 1 , further comprising the step of processing a query of the data management policy.
11. A first Internet of Things component, comprising:
a memory; and
at least one processing device, coupled to the memory, operative to implement the following steps:
obtaining sensor data;
obtaining, by the first Internet of Things component, a data management policy that specifies one or more of a data transmission policy, a data retention policy, a data retirement policy and a data processing policy for a processing of the sensor data by a plurality of Internet of Things components comprising the first Internet of Things component and one or more additional Internet of Things components;
providing a plurality of data policy operators as part of the data management policy to apply to the sensor data based on the data management policy, wherein one or more of the data policy operators apply at least one data reduction operation to the sensor data to generate reduced sensor data and provide metadata with the reduced sensor data describing the at least one data reduction operation; and
processing, by the first Internet of Things component, the sensor data based on the obtained data management policy, wherein the plurality of Internet of Things components that apply the data management policy to the sensor data comprises at least one edge gateway device that aggregates, according to the data management policy, at least a portion of the sensor data from a plurality of sensor devices and at least one backend storage device that stores data according to the data management policy, wherein the at least one gateway device and the at least one backend storage device are distinct devices with respect to one another and wherein the at least one gateway device provides the aggregated sensor data to the at least one backend storage device.
12. The Internet of Things component of claim 11 , wherein the data transmission policy specifies how to manipulate the sensor data before the sensor data is one or more of transmitted and stored by a given Internet of Things component.
13. The Internet of Things component of claim 11 , wherein the data retention policy specifies a duration that the sensor data is maintained in storage.
14. The Internet of Things component of claim 11 , wherein the data retirement policy specifies a processing of the sensor data when one or more predefined storage criteria are satisfied.
15. The Internet of Things component of claim 11 , wherein the data management policy further specifies a predefined handling of the sensor data when communications are disrupted.
16. The Internet of Things component of claim 11 , wherein the data processing policy specifies a central processing unit limitation for processing the sensor data.
17. The Internet of Things component of claim 11 , further comprising the step of applying at least a portion of the data management policy to one or more of the Internet of Things components based on one or more of a device type, a device class, a geographical region, a hierarchical location in an Internet of Things system, and a device identifier.
18. The Internet of Things component of claim 11 , wherein the data policy operators are applied to the sensor data to one or more of (i) adjust a resolution of the sensor data; (ii) aggregate the sensor data; and (iii) apply a learning algorithm to the sensor data, based on the data management policy.
19. A computer program product, comprising a non-transitory machine-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by at least one processing device perform the following steps:
obtaining sensor data;
obtaining, by a first Internet of Things component, a data management policy that specifies one or more of a data transmission policy, a data retention policy, a data retirement policy and a data processing policy for a processing of the sensor data by a plurality of Internet of Things components comprising the first Internet of Things component and one or more additional Internet of Things components;
providing a plurality of data policy operators as part of the data management policy to apply to the sensor data based on the data management policy, wherein one or more of the data policy operators apply at least one data reduction operation to the sensor data to generate reduced sensor data and provide metadata with the reduced sensor data describing the at least one data reduction operation; and
processing, by the first Internet of Things component, the sensor data based on the obtained data management policy, wherein the plurality of Internet of Things components that apply the data management policy to the sensor data comprises at least one gateway device that aggregates, according to the data management policy, at least a portion of the sensor data from a plurality of sensor devices and at least one backend storage device that stores data according to the data management policy, wherein the at least one gateway device and the at least one backend storage device are distinct devices with respect to one another and wherein the at least one gateway device provides the aggregated sensor data to the at least one backend storage device.
20. The computer program product of claim 19 , wherein the data policy operators are applied to the sensor data to one or more of (i) adjust a resolution of the sensor data; (ii) aggregate the sensor data; and (iii) apply a learning algorithm to the sensor data, based on the data management policy.