Apparatuses, methods and systems for a universal data librarian
View Patent ↗The System, Apparatus and Method for a Universal Data Librarian (“UDL”) implements an efficient and scalable monitoring, regulation, and allocation of the computational processing, data, labor, and other enterprise resources and enterprise rules. UDL utilizes a plurality of universal variables linked to tables or fields across multiple, otherwise disparate database systems, and provides efficient and uniform access to the different database systems, types and formats for enterprise data. The universal variables allow efficient access and connection to a vast swath of enterprise data types and types of organizations, and may be organized in accordance with a hierarchical business and decision-making schema and enterprise rules. Universal variables are also used to facilitate a variety of data transactions, integration of disparate data repositories, visualization of data categories and efficient interface access.
1. A processor-implemented method for data mapping and access, comprising:
receiving a data transaction request;
extracting from the transaction request a request attribute;
querying a database using the extracted request attribute to obtain a data-structure-tracking syntax-configured string associated with the request attribute, wherein the syntax-configured string consists of a plurality of component parts, delimited by syntax separators, and wherein each part of the string tracks a separate data structure;
utilizing the obtained data-structure tracking syntax-configured string and at least one universal data variable to generate a request to at least one rule database, wherein the universal data variables comprise intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
evaluating at least one business grammar rule for the enterprise extracted based on the generated request;
querying a mapping record based on another universal data variable and said evaluation result of the at least one business grammar rule for the enterprise;
retrieving a plurality of table field identifiers correlated with the at least one universal data variable based on the querying, each table field identifier identifying a table field in a database;
building a database command based on at least one table field of the plurality of table fields, said evaluation result of the at least one business grammar rule for the enterprise and the data transaction request; and
transacting data with at least one table field in the database based on the database command.
2. A processor-implemented method for universal data cataloging, comprising:
receiving associations between a plurality of universal variables and a plurality of table fields in at least one database, wherein at least one of said universal data variables comprises intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
storing the associations as mapping records of a mapping table;
receiving a data transaction request
extracting from the transaction request a request attribute;
querying a database using the extracted request attribute to obtain a data-structure-tracking syntax-configured string associated with the request attribute, wherein the syntax-configured string consists of a plurality of component parts, delimited by syntax separators, and wherein each part of the string tracks a separate data structure;
utilizing the obtained data-structure tracking syntax-configures string and at least one universal data variable to generate a request to at least one rule database, wherein the universal data variables comprise intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
evaluating at least one business grammar rule for the enterprise extracted based on the generated request;
querying mapping records associated with another universal data variable and said evaluation result of the at least one business grammar rule for the enterprise;
retrieving a subset of the plurality of table fields corresponding to the subset of the plurality of universal variables based on the querying and said evaluation result of the at least one business grammar rule for the enterprise; and
performing a data transaction with data values stored in the subset of the plurality of table fields based on the data transaction request.
3. The method of claim 2 , wherein the plurality of universal variables are organized in accordance with a hierarchical schema.
4. The method of claim 3 , wherein the hierarchical schema comprises, in order of decreasing hierarchical rank: a family level, a subfamily level and a field name level.
5. The method of claim 4 , wherein family level designations comprise:
consumer, account, payment, product, employee, plans, forms, supplier, program and entity designations.
6. The method of claim 5 , wherein family level designations further comprise: a letter, call, consumer credit, candidate, employee, government and an investor designation.
7. The method of claim 2 , wherein the at least one database comprises a plurality of databases.
8. The method of claim 7 , wherein a first association is received between one universal variable of the plurality of universal variables and a first table field in a first database of the plurality of databases, and a second association is received between the one universal variable and a second table field in a second database of the plurality of databases.
9. The method of claim 7 , wherein a first database of the plurality of databases is a local database and a second database of the plurality of databases is a remote database accessed via a communications network.
10. The method of claim 2 , wherein at least one of the associations includes a data reformatting instruction.
11. The method of claim 2 , wherein at least one of the associations includes an instruction for combining data values in at least two of the table fields before association with a universal variable of the plurality of universal variables.
12. The method of claim 2 , wherein each of the plurality of universal variables has an associated display name.
13. The method of claim 2 , wherein each of the plurality of universal variables has an assigned variable type.
14. The method of claim 13 , wherein the variable type is selected from a group consisting of: static, dynamic and restricted text.
15. The method of claim 2 , further comprising:
providing a selectable listing of the plurality of universal variables via a user interface; wherein the data transaction request is received via inputs to the user interface.
16. The method of claim 15 , wherein the inputs to the user interface comprise dragging and dropping universal variable identifiers from the selectable listing of the plurality of universal variables to a data transaction request building area of the user interface.
17. The method of claim 2 , wherein the data transaction comprises:
querying the data values.
18. The method of claim 2 , wherein the data transaction comprises:
updating the data values.
19. The method of claim 2 , wherein the data transaction comprises:
generating a report.
20. The method of claim 2 , wherein each mapping record further includes a database identifier for each database containing at least one table field of the plurality of table fields corresponding to the association.
21. The method of claim 2 , wherein the plurality of universal variables are business objects.
22. The method of claim 2 , wherein performing a data transaction further comprises:
building a database command statement based on the data transaction request and the subset of the plurality of table fields.
23. The method of claim 22 , wherein the database command statement comprises a Select statement.
24. The method of claim 22 , wherein the database command statement comprises an Input statement.
25. The method of claim 22 , wherein building a database command statement further comprises:
determining a linkage relationship between at least two table fields of the plurality of table fields in the at least one database;
generating a table joining clause based on the determined linkage relationship; and wherein the database command statement includes the generated table joining clause.
26. The method of claim 25 , wherein determining a linkage relationship further comprises:
determining a first table containing a first table field of the at least two table fields;
querying at least one key field in the first table connecting to at least one linked table;
determining if the at least one linked table contains a second table field of the at least two table fields;
recording the first table, the at least one linked table, and the at least one key field as the linkage relationship if the linked table contains the second table field; and
repeating the querying, determining and recording for the at least one linked table and tables linked to it until a table containing the second table field is found or a maximum number of linking steps has been reached.
27. A universal data cataloging apparatus, comprising:
a non-transitory, processor-readable memory;
a processor disposed in communication with said memory and configured to issue a plurality of processing instructions stored in the memory, wherein the processor issues instructions to:
receive associations between a plurality of universal variables and a plurality of table fields in at least one database, wherein at least one of said universal data variables comprises intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
store the associations as mapping records of a mapping table;
receive a data transaction request
extract from the transaction request a request attribute;
query a database using the extracted request attribute to obtain a data-structure-tracking syntax-configured string associated with the request attribute, wherein the syntax-configured string consists of a plurality of component parts, delimited by syntax separators, and wherein each part of the string tracks a separate data structure;
utilize the obtained data-structure tracking syntax-configured string and at least one universal data variable to generate a request to at least one rule database, wherein the universal data variables comprise intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
evaluate at least one business grammar rule for the enterprise extracted based on the generated request;
query mapping records associated with another universal data variable and said evaluation result of the at least one business grammar rule for the enterprise;
retrieve a subset of the plurality of table fields corresponding to the subset of the plurality of universal variables based on the querying and said evaluation result of the at least one business grammar rule for the enterprise; and
perform a data transaction with data values stored in the subset of the plurality of table fields based on the data transaction request.
28. A universal non-transitory, processor-readable storage medium for data cataloging, comprising:
a plurality of processing instructions stored in the non-transitory processor-readable storage medium and issuable by a processor to:
receive associations between a plurality of universal variables and a plurality of table fields in at least one database, wherein at least one of said universal data variables comprises intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
store the associations as mapping records of a mapping table;
receive a data transaction request
extract from the transaction request a request attribute;
query a database using the extracted request attribute to obtain a data-structure-tracking syntax-configured string associated with the request attribute, wherein the syntax-configured string consists of a plurality of component parts, delimited by syntax separators, and wherein each part of the string tracks a separate data structure;
utilize the obtained data-structure tracking syntax-configured string and at least one universal data variable to generate a request to at least one rule database, wherein the universal data variables comprise intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business mar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
evaluate at least one business grammar rule for the enterprise extracted based on the generated request;
query mapping records associated with another universal data variable and said evaluation result of the at least one business grammar rule for the enterprise;
retrieve a subset of the plurality of table fields corresponding to the subset of the plurality of universal variables based on the querying and said evaluation result of the at least one business grammar rule for the enterprise; and
perform a data transaction with data values stored in the subset of the plurality of table fields based on the data transaction request.
29. A universal non-transitory, processor-readable storage medium for data cataloging, comprising:
means to receive associations between a plurality of universal variables and a plurality of table fields in at least one database, wherein at least one of said universal data variables comprises intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules, and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
means to store the associations as mapping records of a mapping table;
means to receive a data transaction request
means to extract from the transaction request a request attribute;
means to query a database using the extracted request attribute to obtain a data-structure-tracking syntax-configured string associated with the request attribute, wherein the syntax-configured string consists of a plurality of component parts, delimited by syntax separators, and wherein each part of the string tracks a separate data structure;
means to utilize the obtained data-structure tracking syntax-configured string and at least one universal data variable to generate a request to at least one rule database, wherein the universal data variables comprise intermediate data objects that provide access to a plurality of disparate databases and different software application systems containing data and applicable classification rules and wherein the universal variables are organized into a business grammar hierarchy, each segment of the hierarchy following a plurality of business grammar rules for an enterprise;
means to evaluate at least one business grammar rule for the enterprise extracted based on the generated request;
means to query mapping records associated with another universal data variable and said evaluation result of the at least one business grammar rule for the enterprise;
means to retrieve a subset of the plurality of table fields corresponding to the subset of the plurality of universal variables based on the querying and said evaluation result of the at least one business grammar rule for the enterprise; and
means to perform a data transaction with data values stored in the subset of the plurality of table fields based on the data transaction request.