Management of collaborative datasets via distributed computer networks
Various embodiments relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform that facilitates consolidation of one or more datasets, whereby a collaborative data layer and associated logic facilitate, for example, efficient access to, and implementation of, collaborative datasets. In some examples, a method may include receiving a dataset and dataset attributes and identifying a first version of the dataset. The method may include identifying data that varies from a first version of the dataset, and generating a second version of the dataset to include a first subset and a second subset of atomized data. The method may include storing subsets of atomized data points as an atomized dataset.
1. A method comprising:
receiving via a network data representing a dataset having a data format into a collaborative dataset consolidation system, the collaborative dataset consolidation system including one or more processors and one or more repositories configured to convert differently-formatted datasets into atomized datasets as data arrangements to facilitate interoperability among converted datasets;
receiving data representing attributes associated with the dataset, the attributes including data representing an account identifier, one or more other account identifiers, and one or more data-related activities;
identifying a first version of the dataset associated with a first subset of atomized data points, at least one atomized data point being a triple associated with non-protected data;
identifying a subset of data that varies from the first version of the dataset;
accessing the subset of data as a protected data, access to which is authorized as a function of data representing a level of authorization for the account identifier;
converting the subset of data including a non-atomized data point to a second subset of atomized data points having a specific format similar to the first subset;
generating a second version of the dataset to include the first subset of atomized data points and the second subset of atomized data points;
monitoring updates to the attributes to detect an update;
disseminating the update to a community of networked users; and
storing the first subset of atomized data points and the second subset of atomized data points as an atomized dataset in the one or more repositories.
2. The method of claim 1 wherein disseminating the update to the community of networked users comprises:
generating data representing a notification to a user associated with the one or more other account identifiers.
3. The method of claim 2 wherein generating data representing the notification comprises:
causing presentation of the notification in an activity feed portion of a user interface of a computing device.
4. The method of claim 1 wherein monitoring the updates comprises:
detecting discovery of modified data associated with a data-related activity.
5. The method of claim 4 wherein detecting discovery of the modified data associated with the data-related activity comprises:
determining an activity of querying the dataset.
6. The method of claim 4 wherein detecting discovery of the modified data associated with the data-related activity comprises:
determining an activity of modifying the dataset.
7. The method of claim 4 further comprising:
generating data representing a recommendation.
8. The method of claim 1 wherein each of the atomized data point is data representing an addressable data unit.
9. The method of claim 1 wherein storing the first subset of atomized data points and the second subset of atomized data points as the atomized dataset comprises:
storing atomized data points as triples.
10. The method of claim 9 wherein at least one triple of the triples are formatted to comply with a Resource Description Framework (“RDF”) data model.
11. The method of claim 1 wherein generating the second version of the dataset to include the first subset of atomized data points comprises:
generating a data pointer to a memory location at which the first subset of atomized data points is stored.
12. The method of claim 11 wherein storing the first subset of atomized data points comprises:
storing the data pointer as the first subset of atomized data points.
13. The method of claim 1 further comprising:
identifying that the subset of data is associated with a protected dataset;
determining access to the protected dataset is authorized in association with the account identifier; and
forming the second version of the dataset.
14. The method of claim 1 further comprising:
receiving a request in association with another account identifier to access the atomized dataset;
determining access to the subset of data is not authorized; and
denying access to the atomized dataset in association with the another account identifier.
15. The method of claim 1 further comprising
managing dataset attributes associated with the atomized dataset.
16. The method of claim 15 wherein managing the dataset attributes comprises:
analyzing atomized datasets associated with the collaborative dataset consolidation system; and
identifying a number of queries associated with the atomized dataset.
17. The method of claim 15 wherein managing the dataset attributes comprises:
analyzing atomized datasets associated with the collaborative dataset consolidation system; and
identifying a subset of other account identifiers that include descriptive data that correlate to the atomized dataset.
18. The method of claim 17 further comprising:
generating a data signal specifying information for at least one of the account identifiers that accessed the descriptive data; and
causing presentation of the information in an activity feed portion of a user interface.
19. The method of claim 18 wherein managing the dataset attributes comprises:
analyzing atomized datasets associated with the collaborative dataset consolidation system;
identifying a subset of other atomized datasets including similar classification types;
generating a data signal specifying information for at least one of the other atomized datasets; and
causing presentation of the information in a recommendation portion of a user interface.
20. An apparatus comprising:
a memory including executable instructions; and
a processor, responsive to executing the instructions, is configured to:
receive via a network data representing a dataset having a data format into a collaborative dataset consolidation system, the collaborative dataset consolidation system including one or more processors and one or more repositories configured to convert differently-formatted datasets into atomized datasets as data arrangements to facilitate interoperability among converted datasets;
receive data representing attributes associated with the dataset, the attributes including data representing an account identifier, one or more other account identifiers, and one or more data-related activities;
identify a first version of the dataset associated with a first subset of atomized data points, at least one atomized data point being a triple associated with non-protected data;
identify a subset of data that varies from the first version of the dataset;
accessing the subset of data as a protected data, access to which is authorized as a function of data representing a level of authorization for the account identifier;
convert the subset of data including a non-atomized data point to a second subset of atomized data points having a specific format similar to the first subset;
generate a second version of the dataset to include the first subset of atomized data points and the second subset of atomized data points;
monitor updates to the attributes to detect an update;
disseminate the update to a community of networked users; and
store the first subset of atomized data points and the second subset of atomized data points as an atomized dataset in the one or more repositories.