Transmuting data associations among data arrangements to facilitate data operations in a system of networked collaborative datasets
Various embodiments relate generally to data science and data analysis and computer software and systems to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform configured to transmute associations between data arrangements of different formats or different data models to facilitate data operations, such as queries, configured to enhance, for example, an ingested dataset via transmuted associations as, for example, interrelations among a system of networked collaborative datasets. For example, a method may include identifying a referential indicator, determining an association with a value representative of the referential indicator to an equivalent value representative of another referential indicator associated with a different dataset, transmuting the association to form a transmuted association as a link between the value and the equivalent value, and integrating the link into an ingested data arrangement.
1. A method comprising:
ingesting data representing a dataset into a dataset consolidation system including a processor and memory, the dataset including a tabular data arrangement associated with a first data format;
formatting the dataset into a second data arrangement having a second format, the second data arrangement being a graph data arrangement generated using linked data and the dataset being converted from the first format into the second format;
identifying one or more referential indicators for a first set of the dataset formatted in either the first data arrangement or second data arrangement, or both;
analyzing a second set of multiple different datasets to determine a subset of equivalent referential indicators in the second set that are equivalent to the one or more referential indicators for the first set;
transmuting one or more associations between equivalent referential indicators in the subset of equivalent referential indicators and the one or more referential indicators for the first set;
forming one or more transmuted associations based on the equivalent referential indicators to generate a merged dataset of linked data; and
receiving a query to access data in the merged dataset, the query implementing either a relational-based query language or a graph-based query language, or both.
2. The method of claim 1 wherein the second format comprises an atomized data format.
3. The method of claim 2 wherein the atomized data format comprises one or more triples.
4. The method of claim 1 further comprises:
performing one or more auxiliary queries.
5. The method of claim 4 wherein performing the one or more auxiliary queries comprises:
implementing at least one auxiliary query as a link-formative query configured to invoke formation an additional link.
6. The method of claim 5 wherein formation of the additional link is formed as a created triple.
7. The method of claim 5 further comprising:
generating results to integrate into the merged dataset to form an enhanced dataset.
8. The method of claim 1 wherein at least one of the one or more referential indicators includes a data value as a unit of data associated with a cell at a row and column, and the subset of equivalent referential indicators includes the data value as the unit of data associated with a node in a graph of the linked data.
9. The method of claim 8 wherein the unit of data is associated with a layer data specifying a column node and a row node that are linked to the data value in the node.
10. The method of claim 1 wherein receiving the query includes implementing either an SQL-equivalent query language or a SPARQL-equivalent query language, or both.
11. A system comprising:
a memory including executable instructions; and
a processor, responsive to executing the instructions, is configured to:
ingest data representing a dataset into a dataset consolidation system including a processor and memory, the dataset including a tabular data arrangement associated with a first data format;
format the dataset into a second data arrangement having a second format, the second data arrangement being a graph data arrangement generated using linked data and the dataset being converted from the first format into the second format;
identify one or more referential indicators for a first set of the dataset formatted in either the first data arrangement or second data arrangement, or both;
analyze a second set of multiple different datasets to determine a subset of equivalent referential indicators in the second set that are equivalent to the one or more referential indicators for the first set;
transmute one or more associations between equivalent referential indicators in the subset of equivalent referential indicators and the one or more referential indicators for the first set;
form one or more transmuted associations based on the equivalent referential indicators to generate a merged dataset of linked data; and
receive a query to access data in the merged dataset, the query implementing either a relational-based query language or a graph-based query language, or both.
12. The system of claim 11 wherein the second format comprises an atomized data format.
13. The system of claim 12 wherein the atomized data format comprises one or more triples.
14. The system of claim 11 wherein the processor is further configured to:
perform one or more auxiliary queries.
15. The system of claim 14 wherein a subset of the instructions to cause the processor to perform the one or more auxiliary queries further causes the processor to:
implement at least one auxiliary query as a link-formative query configured to invoke formation an additional link.
16. The system of claim 15 wherein formation of the additional link is formed as a created triple.
17. The system of claim 11 , wherein the processor is further configured to: generate results to integrate into the merged dataset to form an enhanced dataset.
18. The system of claim 11 wherein at least one of the one or more referential indicators includes a data value as a unit of data associated with a cell at a row and column, and the subset of equivalent referential indicators includes the data value as the unit of data associated with a node in a graph of the linked data.
19. The system of claim 18 wherein the unit of data is associated with a layer data specifying a column node and a row node that are linked to the data value in the node.
20. The system of claim 11 wherein a subset of the instructions to cause the processor to receive the query further causes the processor to implement either an SQL-equivalent query language or a SPARQL-equivalent query language, or both.