Content addressable caching and federation in linked data projects in a data-driven collaborative dataset platform using disparate database architectures
Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to interface among repositories of disparate datasets and computing machine-based entities configured to access datasets, and, more specifically, to a computing and data storage platform to implement computerized tools to facilitate expedited queries based on query results generated by disparate computing and database architectures, according to at least some examples. For example, a method may include generating multiple results of queries, storing the multiple results of queries in a memory, and linking each of the multiple results of queries to a portion of data stored in a graph. The method can include receiving data representing a query and accessing data representing quiescent data values to form a query result.
1. A method comprising:
generating a representation of a query tabular representation of a graph data arrangement associated with a query editor;
generating data representing multiple results of queries associated with the query editor;
storing the data representing the multiple results of queries to form stored results of queries;
linking each of the multiple results of queries to a portion of data stored in a graph;
receiving data representing a query;
determining a subset of results of queries associated with quiescent data values;
accessing data representing the quiescent data values; and
forming results for the query to form a query result;
determining another subset of results of queries associated with transient data values;
detecting the transient data values include a change in data values in at least one portion of the another subset of results of queries: and
regenerating the data values associated with the at least one portion of the another subset of results of queries.
2. The method of claim 1 wherein forming the results for the query comprises:
accessing the data representing the quiescent data values in memory.
3. The method of claim 1 wherein the quiescent data values comprises:
static data.
4. The method of claim 1 further comprising:
determining the query is content addressable.
5. The method of claim 4 further comprising:
determining whether at least a portion of the query is stored in a cache memory; and
accessing the data representing the quiescent data values in the cache memory to form at least a portion of the query result.
6. The method of claim 4 further comprising:
determining a content addressable query based on identifying data representing one or more of a composition of the query, a dataset identifier, and a version identifier.
7. The method of claim 4 further comprising:
determining the subset of results of queries are addressable.
8. The method of claim 1 further comprising:
determining another subset of results of queries associated with transient data values.
9. The method of claim 8 further comprising:
detecting the transient data values include a change in data values in at least one portion of the another subset of results of queries.
10. The method of claim 9 further comprising:
regenerating data values associated with the at least one portion of the another subset of results of queries.
11. The method of claim 10 further comprising:
executing a query to form an updated subset of data to substitute into the at least one portion of the another subset of results of queries.
12. The method of claim 1 wherein storing the data representing the multiple results of queries comprises:
storing data representing the stored results of queries in cache memory.
13. The method of claim 1 further comprising:
receiving data representing a permission to implement a result of a query as a dataset.
14. The method of claim 13 further comprising:
generating data representing a user input to present in a user interface, the user input configured to specify activation of the permission to implement the result of a query as the dataset.
15. An apparatus comprising:
a memory including executable instructions; and
a processor, responsive to executing the instructions, is configured to:
generate a representation of a query tabular representation of a graph data arrangement associated with a query editor;
generate data representing multiple results of queries associated with the query editor;
store the data representing the multiple results of queries to form stored results of queries;
link each of the multiple results of queries to a portion of data stored in a graph;
receive data representing a query;
determine a subset of results of queries associated with quiescent data values;
access data representing the quiescent data values; and
form results for the query to form a query result;
determine another subset of results of queries associated with transient data values;
detect the transient data values include a change in data values in at least one portion of the another subset of results of queries: and
regenerate the data values associated with the at least one portion of the another subset of results of queries.
16. The apparatus of claim 15 wherein a subset of the instructions to cause the processor to form results for the query comprises further instructions to cause the processor to:
access the data representing the quiescent data values in memory.
17. The apparatus of claim 15 wherein the processor is further configured to:
determine whether at least a portion of the query is stored in a cache memory; and
access the data representing the quiescent data values in the cache memory to form at least a portion of the query result.
18. The apparatus of claim 17 wherein the processor is further configured to:
determine another subset of results of queries associated with transient data values.