Method, apparatus, and computer-readable medium for data asset ranking
Systems, methods, and related techniques and apparatus containing instructions which when executed by one or more computing devices for determining dataset rankings by determining, from the lineage order requirement, one or more first lineage level datasets from the collection of datasets, generating one or more first lineage level asset ranks respectively for each one of the one or more first lineage level datasets, determining at least one second lineage level dataset having an outflow to the one or more first lineage level datasets, and generating a first dataset rank for the at least one second lineage level dataset as a first function of the outflow and at least one of the one or more first lineage level asset ranks.
1. A method executed by one or more computing devices for searching using dataset rankings, the method comprising:
receiving a search criteria;
generating one or more results corresponding to one or more datasets by searching for data within a collection of datasets, the collection of datasets being divided into a plurality of lineage levels based at least in part on a lineage order requirement, wherein each dataset in each lineage level after a first lineage level has an outflow to at least one prior lineage level dataset;
ranking the one or more results according to dataset ranks of the one or more datasets, the dataset ranks being generated for each dataset in each lineage level after the first lineage level as a first function of the outflow and least one of one or more first lineage level asset ranks corresponding to one or more first lineage level datasets; and
providing the one or more results according to the ranking of the one or more datasets.
2. The method of claim 1 , wherein the lineage order requirement is a data user and the one or more first lineage level datasets are data tables accessed directly by the data user.
3. The method of claim 1 , wherein the lineage order requirement is an information processing system and the one or more first lineage level datasets are one or more human consumable reports generated by the information processing system.
4. The method of claim 1 , wherein the data search criteria includes a data use case associated with the lineage ordering requirement.
5. The method of claim 1 , wherein the collection of datasets includes a plurality of datasets residing in a plurality of physically separate data stores, the physically separate data stores interconnected by a network.
6. The method of claim 1 , wherein the results comprise first data from a second lineage level dataset and second data from at a third lineage level dataset, wherein the third lineage level dataset has a second dataset rank that is greater than a first dataset rank corresponding to the second lineage level dataset, and wherein the second data is provided prior to the first data in the search results.
7. An apparatus for searching using dataset rankings, the apparatus comprising:
one or more processors; and
one or more memories operatively coupled to at least one of the one or more processors and having instructions stored thereon that, when executed by at least one of the one or more processors, cause at least one of the one or more processors to:
receive a search criteria;
generate one or more results corresponding to one or more datasets by searching for data within a collection of datasets, the collection of datasets being divided into a plurality of lineage levels based at least in part on a lineage order requirement, wherein each dataset in each lineage level after a first lineage level has an outflow to at least one prior lineage level dataset;
rank the one or more results according to dataset ranks of the one or more datasets, the dataset ranks being generated for each dataset in each lineage level after the first lineage level as a first function of the outflow and least one of one or more first lineage level asset ranks corresponding to one or more first lineage level datasets; and
provide the one or more results according to the ranking of the one or more datasets.
8. The apparatus of claim 7 , wherein the lineage order requirement is a data user and the one or more first lineage level datasets are data tables accessed directly by the data user.
9. The apparatus of claim 7 , wherein the lineage order requirement is an information processing system and the one or more first lineage level datasets are one or more human consumable reports generated by the information processing system.
10. The apparatus of claim 7 , wherein the data search criteria includes a data use case associated with the lineage ordering requirement.
11. The apparatus of claim 7 , wherein the collection of datasets includes a plurality of datasets residing in a plurality of physically separate data stores, the physically separate data stores interconnected by a network.
12. The apparatus of claim 7 , wherein the results comprise first data from a second lineage level dataset and second data from at a third lineage level dataset, wherein the third lineage level dataset has a second dataset rank that is greater than a first dataset rank corresponding to the second lineage level dataset, and wherein the second data is provided prior to the first data in the search results.
13. At least one non-transitory computer-readable medium storing computer-readable instructions that, when executed by one or more computing devices, cause at least one of the one or more computing devices to:
receive a search criteria;
generate one or more results corresponding to one or more datasets by searching for data within a collection of datasets, the collection of datasets being divided into a plurality of lineage levels based at least in part on a lineage order requirement, wherein each dataset in each lineage level after a first lineage level has an outflow to at least one prior lineage level dataset;
rank the one or more results according to dataset ranks of the one or more datasets, the dataset ranks being generated for each dataset in each lineage level after the first lineage level as a first function of the outflow and least one of one or more first lineage level asset ranks corresponding to one or more first lineage level datasets; and
provide the one or more results according to the ranking of the one or more datasets.
14. The at least one non-transitory computer-readable medium of claim 13 , wherein the lineage order requirement is a data user and the one or more first lineage level datasets are data tables accessed directly by the data user.
15. The at least one non-transitory computer-readable medium of claim 13 , wherein the lineage order requirement is an information processing system and the one or more first lineage level datasets are one or more human consumable reports generated by the information processing system.
16. The at least one non-transitory computer-readable medium of claim 13 , wherein the data search criteria includes a data use case associated with the lineage ordering requirement.
17. The at least one non-transitory computer-readable medium of claim 13 , wherein the collection of datasets includes a plurality of datasets residing in a plurality of physically separate data stores, the physically separate data stores interconnected by a network.
18. The at least one non-transitory computer-readable medium of claim 13 , wherein the results comprise first data from a second lineage level dataset and second data from at a third lineage level dataset, wherein the third lineage level dataset has a second dataset rank that is greater than a first dataset rank corresponding to the second lineage level dataset, and wherein the second data is provided prior to the first data in the search results.