Querying in big data storage formats
A system may receive a request for access to a first variable. The request may include a requested action and a variable identifier for the first variable. The request may also have a syntax that is incompatible with first data storage format. The system may parse the request to capture the variable identifier from the request. The system may also look up a location of the first variable in a catalog using the variable identifier. The location of the first variable may include the first data storage format. The system may generate a query to access the first variable. The syntax of the query may be compatible with the first data storage format. The system may then submit the query to access the first data storage format. The query may be configured to complete the requested action.
1. A method comprising:
receiving, by a processor, a request having a first syntax at an access point for access to a first variable;
parsing, by the processor, the request to capture a variable identifier for the first variable from the request;
looking up, by the processor, the first variable in a catalog using the variable identifier, wherein the first variable includes a location of the first variable and a first data storage format;
generating, by the processor, a query to access the first variable, wherein the query comprises a second syntax compatible with the first data storage format; and
submitting, by the processor, the query in the first data storage format to complete the request.
2. The method of claim 1 , wherein the request comprises a requested action and the variable identifier for the first variable.
3. The method of claim 1 , wherein the first data storage format is incompatible with the first syntax of the request.
4. The method of claim 1 , wherein the access point is a single, centralized access point.
5. The method of claim 1 , wherein the access point is created by an access interface.
6. The method of claim 1 , wherein the access to the first variable is in a single logical data structure as viewed from an application side.
7. The method of claim 1 , wherein the first data storage format maintains the first variable and the variable identifier within the first data storage format.
8. The method of claim 1 , further including checking, by the processor, an access permission for the first variable in the catalog.
9. The method of claim 1 , further including checking, by the processor, an access permission for the first variable in the catalog, wherein the access permission includes at least one of read access, write access or authorization to view information contained in the first variable.
10. The method of claim 1 , wherein the variable identifier includes at least one of a variable name, a preferred data storage format, a time, a requester username, a requester user group, or an application ID.
11. The method of claim 1 , further comprising formatting, by the processor, a result of the request into a requested result format.
12. The method of claim 1 , further comprising formatting, by the processor, a result of the request into a requested result format, wherein the result comprises data from the first data storage format.
13. The method of claim 1 , further comprising generating, by the processor, a log entry corresponding to the request.
14. The method of claim 1 , further comprising generating, by the processor, a log entry corresponding to the request, wherein the log entry comprises at least one of a user identifier or an application identifier.
15. The method of claim 1 , further comprising:
receiving, by the processor, the request for access to a second variable stored in a second data storage format, wherein the second data storage format is different from the first data storage format; and
returning, by the processor, a result of the request comprising the first variable from the first data storage format and the second variable from the second data storage format.
16. The method of claim 1 , further comprising writing, by the processor, data to the first variable in the first data storage format in response to the request.
17. A computer-based system, comprising:
a processor; and
a tangible, non-transitory memory configured to communicate with the processor, the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:
receiving, by the processor, a request having a first syntax at an access point for access to a first variable;
parsing, by the processor, the request to capture a variable identifier for the first variable from the request;
looking up, by the processor, the first variable in a catalog using the variable identifier, wherein the first variable includes a location of the first variable and a first data storage format;
generating, by the processor, a query to access the first variable, wherein the query comprises a second syntax compatible with the first data storage format; and
submitting, by the processor, the query in the first data storage format to complete the request.
18. The system of claim 17 , wherein the request comprises a requested action and the variable identifier for the first variable.
19. The system of claim 17 , wherein the first data storage format is incompatible with the first syntax of the request.
20. An article of manufacture including a non-transitory, tangible computer readable storage medium having instructions stored thereon that, in response to execution by a processor, cause the processor to perform operations comprising:
receiving, by the processor, a request having a first syntax at an access point for access to a first variable;
parsing, by the processor, the request to capture a variable identifier for the first variable from the request;
looking up, by the processor, the first variable in a catalog using the variable identifier, wherein the first variable includes a location of the first variable and a first data storage format;
generating, by the processor, a query to access the first variable, wherein the query comprises a second syntax compatible with the first data storage format; and
submitting, by the processor, the query in the first data storage format to complete the request.