Platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization
Techniques are described for platform management of integrated access of public and privately-accessible datasets utilizing federated query generation and query schema rewriting optimization, including receiving a query at a dataset access platform, generating a copy of the query, parsing the query to determine a format associated with the dataset and to identify whether an access control condition is required, rewriting, using a proxy server, the copy of the query using data formatted in a triples-based format into an optimized query having the access control condition in the triples-based format, configuring the optimized query to be transmitted to a location at which the dataset is stored, the optimized query being configured to pass the access control condition to gain authorization to retrieve the dataset, converting the dataset to the triples-based format, and rendering the dataset on an interface.
1. A method, comprising:
receiving a query at a dataset access platform, the query being formatted in a structured relational format and configured to request to access to a dataset;
generating a copy of the query, the copy being identified as a master and configured to be stored in a datastore;
parsing the query to determine a format associated with the dataset and to identify whether an access control condition is required to access the dataset;
rewriting, using a proxy server, the copy of the query using data formatted in a triples-based format into an optimized query having at least the access control condition formatted in the triples-based format;
configuring the optimized query to be transmitted to a location at which the dataset is stored, the optimized query being configured to pass the access control condition to gain authorization to retrieve the dataset;
converting the dataset to the triples-based format; and
rendering the dataset to display on an interface configured to present the dataset in response to the query, the dataset being further converted from the triples-based format to a format associated with the interface.
2. The method of claim 1 , wherein the rewriting the copy of the query is configured to be performed using a framework.
3. The method of claim 1 , wherein the configuring the optimized query is configured to be performed using a conversion module.
4. The method of claim 1 , wherein the configuring the optimized query is configured to be performed by the query engine.
5. The method of claim 1 , wherein the rewriting is configured to be performed using a query engine.
6. The method of claim 1 , further comprising identifying a path from an endpoint configured to initiate the query to a database engine configured to retrieve the dataset identified by evaluating the query rewritten in a triples-based format to identify a location and a graph associated with the dataset.
7. The method of claim 1 , referencing a graph to determine whether one or more paths associated with the dataset were previously referenced by a database engine.
8. The method of claim 1 , wherein the copy of the query rewritten in a triples-based format has one or more attributes that are used to generate a graph comprising a plurality of nodes, at least one of the plurality of nodes being associated with a location of the dataset.
9. The method of claim 1 , wherein the copy of the query rewritten in a triples-based format has one or more attributes that are used to generate a graph comprising a plurality of nodes, at least one of the plurality of nodes being associated with a database engine configured to access the dataset.
10. The method of claim 1 , wherein the query has one or more attributes that are used to generate a graph comprising a plurality of nodes, at least one of the plurality of nodes being associated with a database engine configured to access the dataset, the dataset, and an endpoint associated with initiating the query.
11. A non-transitory computer readable medium having one or more computer program instructions configured to perform a method, the method comprising:
receiving a query at a dataset access platform, the query being formatted in a structured relational format and configured to request to access to a dataset;
generating a copy of the query, the copy being identified as a master and configured to be stored in a datastore;
parsing the query to determine a format associated with the dataset and to identify whether an access control condition is required to access the dataset;
rewriting, using a proxy server, the copy of the query using data formatted in a triples-based format into an optimized query having at least the access control condition formatted in the triples-based format;
configuring the optimized query to be transmitted to a location at which the dataset is stored, the optimized query being configured to pass the access control condition to gain authorization to retrieve the dataset;
converting the dataset to the triples-based format; and
rendering the dataset to display on an interface configured to present the dataset in response to the query, the dataset being further converted from the triples-based format to a format associated with the interface.