Network-based dynamic data management

1. A method, comprising:

operating a router in a hierarchically routed computer network;

receiving collected data at the router from one or more hierarchically lower devices in the network;

applying a data reduction technique on the collected data to provide aggregated metadata according to a dynamic schema associated with the router, wherein the collected data is reduced to meaningful information for the router based on the dynamic schema associated with the router;

storing the aggregated metadata at the router;

transmitting the aggregated metadata to one or more hierarchically higher routers in the network, wherein as the aggregated meta data travels from one hierarchical layer to a next higher hierarchical layer, the aggregated metadata becomes more filtered and less data is stored;

receiving one or more queries to be served based on the aggregated metadata; and

serving the one or more queries by the router based on the aggregated metadata,

wherein the dynamic schema is continuously updated by the router based on new data types being discovered by the router, wherein updating the dynamic schema includes:

detecting a particular behavior based on the collected data,

in response, updating the dynamic schema for hierarchically lower routers based on the detected behavior, and

transmitting the updated dynamic schema to the hierarchically lower routers.

2. The method as in claim 1 , wherein the collected data is hierarchically lower aggregated metadata from one or more hierarchically lower routers in the network.

3. The method as in claim 2 , wherein the data reduction technique is at least one of statistical models, regression models, fusion models, Complex Event processing (CEP) models, or statistical filters.

4. The method as in claim 1 , wherein the collected data is hierarchically lower raw sensor data from one or more hierarchically lower sensors in the network.

5. The method as in claim 1 , further comprising:

determining the dynamic schema based on receiving a new collected data type at the router.

6. The method as in claim 1 , further comprising:

determining the dynamic schema based on receiving a new query type at the router.

7. The method as in claim 1 , wherein the dynamic schema is time-limited.

8. The method as in claim 1 , further comprising:

determining that the dynamic schema does not define a conversion for particular collected data; and, in response,

storing the particular collected data as raw data.

9. The method as in claim 8 , further comprising:

transmitting the raw data to one or more hierarchically higher routers in the network; and

receiving an updated dynamic schema in response to the raw data.

10. The method as in claim 1 , further comprising:

receiving a registration request from a plurality of hierarchically lower sensors; and

activating a subset of the hierarchically lower sensors.

11. The method as in claim 10 , further comprising:

determining which hierarchically lower sensors to activate based on specific capability of the sensors.

12. The method as in claim 1 , further comprising:

providing an interface into the router, the interface configured to receive user-defined queries and user-defined schema.

13. The method as in claim 1 , wherein the contents of the collected data differ from the contents of the aggregated data.

14. An apparatus, comprising:

one or more network interfaces to communicate within a hierarchically routed computer network;

a processor coupled to the network interfaces and adapted to execute one or more processes; and

a memory configured to store a process executable by the processor, the process when executed operable to:

receive collected data from one or more hierarchically lower devices in the network;

apply a data reduction technique on the collected data to provide aggregated metadata according to a dynamic schema associated with the apparatus, wherein the collected data is reduced to meaningful information for the router based on the dynamic schema associated with the apparatus;

store the aggregated metadata;

transmit the aggregated metadata to one or more hierarchically higher routers in the network, wherein as the aggregated meta data travels from one hierarchical layer to a next higher hierarchical layer, the aggregated metadata becomes more filtered and less data is stored;

receive one or more queries to be served based on the aggregated metadata; and

serve the one or more queries based on the aggregated metadata,

wherein the dynamic schema is continuously updated based on new data types being discovered by the apparatus, wherein updating the dynamic schema includes:

detecting a particular behavior based on the collected data,

in response, updating the dynamic schema for hierarchically lower routers based on the detected behavior, and

transmitting the updated dynamic schema to the hierarchically lower routers.

15. The apparatus as in claim 14 , wherein the collected data is one of either hierarchically lower aggregated metadata from one or more hierarchically lower routers in the network or hierarchically lower raw sensor data from one or more hierarchically lower sensors in the network.

16. The apparatus as in claim 14 , wherein the process when executed is further operable to:

determine the dynamic schema based on receiving a new collected data type.

17. The apparatus as in claim 14 , wherein the process when executed is further operable to:

determine the dynamic schema based on receiving a new query type.

18. The apparatus as in claim 14 , wherein the process when executed is further operable to:

determine that the dynamic schema does not define a conversion for particular collected data; and, in response,

store the particular collected data as raw data.

19. The apparatus as in claim 18 , wherein the process when executed is further operable to:

transmit the raw data to one or more hierarchically higher routers in the network; and

receive an updated dynamic schema in response to the raw data.

20. The apparatus as in claim 14 , wherein the process when executed is further operable to:

receive a registration request from a plurality of hierarchically lower sensors; and

activate a subset of the hierarchically lower sensors.

21. A tangible, non-transitory, computer-readable media having software encoded thereon, the software when executed by a processor operable to:

operate a router in a hierarchically routed computer network;

receive collected data at the router from one or more hierarchically lower devices in the network;

apply a data reduction technique on the collected data to provide aggregated metadata according to a dynamic schema associated with the router, wherein the collected data is reduced to meaningful information for the router based on the dynamic schema, associated with the router;

store the aggregated metadata at the router;

transmit the aggregated metadata to one or more hierarchically higher routers in the network, wherein as the aggregated meta data travels from one hierarchical layer to a next higher hierarchical layer, the aggregated metadata becomes more filtered and less data is stored;

receive one or more queries to be served based on the aggregated metadata; and

serve the one or more queries by the router based on the aggregated metadata,

wherein the dynamic schema is continuously updated by the router based on new data types being discovered by the router, wherein updating the dynamic schema includes:

detecting a particular behavior based on the collected data,

in response, updating the dynamic schema for hierarchically lower routers based on the detected behavior, and

transmitting the updated dynamic schema to the hierarchically lower routers.