Dynamic-ledger-enabled edge-device query processing
A method for processing a query for data stored in a distributed database includes receiving, at an edge device, the query for data stored in the distributed database from a query device. The method includes causing, by the edge device, the query to be stored on a dynamic ledger maintained by the distributed database. The method includes detecting, by the edge device, that summary data has been stored on the dynamic ledger. The method includes generating, by the edge device, an approximate response to the query based on the summary data stored on the dynamic ledger. The method includes transmitting, to the query device, the approximate response.
1. A method for processing a query for data stored in a distributed database, the method comprising:
receiving, at an edge device, the query for the data stored in the distributed database from a query device;
causing, by the edge device, the query to be stored on a dynamic ledger maintained by the distributed database;
detecting, by the edge device, that summary data has been stored on the dynamic ledger;
generating, by the edge device, an approximate response to the query based on the summary data stored on the dynamic ledger, by:
generating, using the summary data, a probability distribution model for data corresponding to the query, and
generating, using the probability distribution model, the approximate response; and
transmitting, to the query device, the approximate response.
2. The method of claim 1 wherein the query is an edge query language (EDQL) query.
3. The method of claim 1 wherein:
the query specifies a shard algorithm; and
the shard algorithm specifies a location of the data stored in the distributed database.
4. The method of claim 1 wherein the dynamic ledger is a blockchain.
5. The method of claim 1 wherein the causing the query to be stored on the dynamic ledger includes transmitting, by the edge device, the query to an aggregator.
6. The method of claim 5 wherein the aggregator is a blockchain node.
7. The method of claim 1 further comprising:
receiving a second query for data stored in the distributed database; and
generating an approximate response to the second query using the probability distribution model without causing the second query to be stored on the dynamic ledger.
8. The method of claim 1 wherein:
the probability distribution model is implemented using a neural network, and
the generating the probability distribution model includes training the neural network.
9. The method of claim 1 further comprising:
generating a query plan in response to the receiving the query,
wherein the query plan includes at least one of: transmitting of the query to other edge devices or transmitting of the query to an aggregator.
10. The method of claim 1 further comprising executing the query against an edge storage connected to the edge device to obtain partial query results.
11. The method of claim 10 wherein the approximate response to the query is further based on the partial query results.
12. The method of claim 1 wherein the summary data includes at least one of statistical data or outlier data.
13. The method of claim 1 wherein at least a portion of the data stored in the distributed database is sensor data.
14. The method of claim 1 wherein the approximate response to the query is associated with a response that exceeds a statistical confidence threshold.
15. An edge device system comprising:
at least one processor that executes a set of computer-readable instructions, wherein, by executing the set of computer-readable instructions, the at least one processor collectively:
receives a query for data stored in a distributed database from a query device;
causes the query to be stored on a dynamic ledger maintained by the distributed database;
detects, by an edge device, that summary data has been stored on the dynamic ledger;
generates, by the edge device, an approximate response to the query based on the summary data stored on the dynamic ledger, by:
generating, using the summary data, a probability distribution model for data corresponding to the query, and
generating, using the probability distribution model, the approximate response; and
transmits, to the query device, the approximate response.
16. The edge device system of claim 15 wherein the query is an edge query language (EDQL) query.
17. The edge device system of claim 15 wherein the dynamic ledger is a blockchain.
18. The edge device system of claim 15 wherein the summary data includes at least one of statistical data or outlier data.
19. The edge device system of claim 15 wherein at least a portion of the data stored in the distributed database is sensor data.
20. A method for processing a query for data stored in a distributed database, the method comprising:
receiving, at an edge device, the query for the data stored in the distributed database from a query device;
causing, by the edge device, the query to be stored on a dynamic ledger maintained by the distributed database;
detecting, by the edge device, that summary data has been stored on the dynamic ledger, including detecting that a threshold percentage of edge devices have caused the summary data to be stored on the dynamic ledger;
generating, by the edge device, an approximate response to the query based on the summary data stored on the dynamic ledger; and
transmitting, to the query device, the approximate response.