Customized code configurations for a multiple application service environment
Disclosed herein provides enhancements for operating a data access system for large data processing environments. In one implementation, a method provides for maintaining a data structure comprising a plurality of customized code configurations each associated with a data request rule for each of the multiple application services. A code configuration query from a user is then received indicating a data request rule. The code configuration query requests code configurations for data retrieval from at least one of the multiple storage services over the data access system. The data structure is queried for one or more customized code configurations for each of the multiple application services associated with the indicated data request rule. The user is then provided with the one or more customized code configurations for each of the multiple application services associated with the indicated data request rule.
1. A method of operating a data access service, wherein the data access service provides an interface layer between multiple application services and multiple storage services, the method comprising:
maintaining, in the data access service, a data structure comprising a plurality of code configurations corresponding to a plurality of application services, wherein the plurality of code configurations are associated with a plurality of data request rules for retrieving data from a storage service that stores one or more datasets associated with a user,
wherein for each data request rule of the plurality of data request rules, the data structure comprises at least one customized code configuration for each of the multiple application services, wherein the plurality of code configurations includes at least a first code configuration for a first type of application service including a block of program code that when run by the respective application service of the first type retrieves data stored in the storage service, and a second code configuration for a second type of application service including a block of program code in a different language that when run by the application service of the second type retrieves data stored in the same storage service;
receiving, in the data access service, a code configuration query from an application service running on a user device, wherein the code configuration query is associated with at least one data request rule, wherein the at least one data request rule comprises at least one of a type of data search, dataset search initiated by the user, and whether the user has access to the plurality of code configurations based on a user's access level;
in response to receiving the code configuration query, retrieving, in the data access service, the plurality of code configurations corresponding to the plurality of application services from the data structure based on the at least one data request rule;
generating, in the data access service, one or more customized code configurations from the plurality of code configurations corresponding to the application services, wherein the one or more customized code configurations are generated based on determining that the user has access to the one or more customized code configurations based on the user's access level in the at least one data request rule;
displaying, on a user interface running on a user device, options corresponding to the plurality of application services; and
in response to receiving a selection of an option from the user interface, displaying on the user interface running on the user device, the generated custom code configuration corresponding to the option selected by the user.
2. The method of claim 1 further comprising suggesting, in the data access service, an additional code configuration query from the application service running on the user device indicating one or more additional data request rules.
3. The method of claim 1 wherein:
the code configuration query from the application service further indicates a user type; and
the one or more customized code configurations provided to the application service running on the user device are provided based on the indicated user type.
4. The method of claim 1 wherein:
the code configuration query from the application service further indicates a dataset type; and
the one or more customized code configurations provided to the application service running on the user device are provided based on the indicated dataset type.
5. The method of claim 1 wherein providing the one or more customized code configurations to the application service running on the user device comprises one or more of exporting and saving a file including each of the one or more customized code configurations.
6. The method of claim 1 wherein providing the one or more customized code configurations to the application service running on the user device comprises surfacing a view of each of the one or more customized code configurations.
7. The method of claim 1 wherein providing the one or more customized code configurations to the application service running on the user device further comprises displaying a preview of data retrieved by executing the one or more customized code configurations.
8. The method of claim 1 wherein the at least one of the multiple application services comprises one or more of a distributed application, an Open Database Connectivity (ODBC) service, and a Representational State Transfer (REST) service.
9. The method of claim 1 wherein the at least one of the multiple storage services comprises one or more of a file system, a Relational Database Management System (RDBMS), and a stream.
10. A computing apparatus comprising:
one or more computer readable storage media;
one or more processors operatively coupled with the one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media to operate a data access service that provides an interface layer between multiple application services and multiple storage services, wherein the program instructions, when read and executed by the one or more processors, direct the one or more processors to at least:
maintain, in the data access service, a data structure comprising a plurality of code configurations corresponding to a plurality of application services, wherein the plurality of code configurations are associated with a plurality of data request rules for retrieving data from a storage service that stores one or more datasets associated with a user,
wherein for each data request rule of the plurality of data request rules, the data structure comprises at least one customized code configuration for each of the multiple application services, wherein the plurality of code configurations includes at least a first code configuration for a first type of application service including a block of program code that when run by the respective application service of the first type retrieves data stored in the storage service, and a second code configuration for a second type of application service including a block of program code in a different language that when run by the application service of the second type retrieves data stored in the same storage service;
receive, in the data access service, a code configuration query from an application service running on a user device, wherein the code configuration query is associated with at least one data request rule, wherein the at least one data request rule comprises at least one of a type of data search, dataset search initiated by the user, and whether the user has access to the plurality of code configurations based on a user's access level;
in response to receiving the code configuration query, retrieve, in the data access service, the plurality of code configurations corresponding to the plurality of application services from the data structure based on the at least one data request rule;
generate, in the data access service, one or more customized code configurations from the plurality of code configurations corresponding to the application service, wherein the one or more customized code configurations are generated based on determining that the user has access to the one or more customized code configurations based on the user's access level in the at least one data request rule;
display, on a user interface running on a user device, options corresponding to the plurality of application services; and
in response to receiving a selection of an option from the user interface, display on the user interface running on the user device, the generated custom code configuration corresponding to the option selected by the user.
11. The computing apparatus of claim 10 , wherein the program instructions, when read and executed by the one or more processors, further direct the one or more processors to suggest, in the data access service, an additional code configuration query from the application service running on the user device indicating one or more additional data request rules.
12. The computing apparatus of claim 10 wherein:
the code configuration query from the application service further indicates a user type; and
the one or more customized code configurations provided to the application service running on the user device are provided based on the indicated user type.
13. The computing apparatus of claim 10 wherein:
the code configuration query from the application service further indicates a dataset type; and
the one or more customized code configurations provided to the application service running on the user device are provided based on the indicated dataset type.
14. The computing apparatus of claim 10 wherein to provide the one or more customized code configurations to the application service running on the user device, the program instructions, when read and executed by the one or more processors, direct the one or more processors to export or save a file including each of the one or more customized code configurations.
15. The computing apparatus of claim 10 wherein to provide the one or more customized code configurations the application service running on the user device the program instructions, when read and executed by the one or more processors, direct the one or more processors to surface a view of each of the one or more customized code configurations.
16. The computing apparatus of claim 10 wherein to provide the one or more customized code configurations to the application service running on the user device the program instructions, when read and executed by the one or more processors, further direct the one or more processors to display a preview of data retrieved by executing the one or more customized code configurations.
17. The computing apparatus of claim 10 wherein the at least one of the multiple application services comprises one or more of a distributed application, an Open Database Connectivity (ODBC) service, and a Representational State Transfer (REST) service.
18. One or more computer-readable storage media having program instructions stored thereon to operate a data access service that provides an interface layer between multiple application services and multiple storage services, wherein the program instructions, that, when read and executed by a processing system, direct the processing system to at least:
maintain, in the data access service, a data structure comprising a plurality of code configurations corresponding to a plurality of application services, wherein the plurality of code configurations are associated with a plurality of data request rules for retrieving data from a storage service that stores one or more datasets associated with a user,
wherein for each data request rule of the plurality of data request rules, the data structure comprises at least one customized code configuration for each of the multiple application services, wherein the plurality of code configurations includes at least a first code configuration for a first type of application service including a block of program code that when run by the respective application service of the first type retrieves data stored in the storage service, and a second code configuration for a second type of application service including a block of program code in a different language that when run by the application service of the second type retrieves data stored in the same storage service;
receive, in the data access service, a code configuration query from an application service running on a user device, wherein the code configuration query is associated with at least one data request rule, wherein the at least one data request rule comprises at least one of a type of data search, dataset search initiated by the user, and whether the user has access to the plurality of code configurations based on a user's access level;
in response to receiving the code configuration query, retrieve, in the data access service, the plurality of code configurations corresponding to the plurality of application services from the data structure based on the at least one data request rule;
generate, in the data access service, one or more customized code configurations from the plurality of code configurations corresponding to the application service, wherein the one or more customized code configurations are generated based on determining that the user has access to the one or more customized code configuration based on the user's access level in the at least one data request rule;
display, on a user interface running on a user device, options corresponding to the plurality of application services; and
in response to receiving a selection of an option from the user interface, display on the user interface running on the user device, the generated custom code configuration corresponding to the option selected by the user.