Semantic versioning calculator for data products
A computer-implemented method for receiving evaluation criteria comprising rules for evaluating changes to a data file, where the data file comprises a plurality of assets. The method may further include detecting at least one change to one or more assets of the plurality of assets and identifying a category for the at least one change, based on the received evaluation criteria. In response to identifying a category for a plurality of changes, the method may aggregate the identified category of each of the plurality of changes of each asset of the data file. In response to the aggregated categories exceeding one or more predetermined thresholds, the method may further include generating a new semantic version for each changed asset of the plurality of assets and a new semantic version for the data file overall. The method may also push the new semantic version to at least one client computer.
1 . A computer-implemented method, comprising:
receiving, by a processor set, evaluation criteria comprising rules for evaluating changes to a data file, wherein the data file comprises a plurality of assets;
detecting, by the processor set over time, at least one change to one or more assets of the plurality of assets;
identifying, by the processor set, a category for the at least one change, based on the received evaluation criteria;
in response to identifying a category for a plurality of changes, aggregating, by the processor set, the identified category of each of the plurality of changes of each asset of the data file;
in response to the aggregated categories exceeding one or more predetermined thresholds, generating, by the processor set, a new semantic version for each changed asset of the plurality of assets and a new semantic version for the data file overall; and
pushing the new semantic version for each changed asset to at least one client computer having an outdated version of at least one changed asset, such that the at least one client computer uses the new semantic version for downstream tasks.
2 . The computer-implemented method of claim 1 , wherein the received evaluation criteria further comprises rules for defining a major change, a minor change, and a patch change.
3 . The computer-implemented method of claim 1 , wherein the data file comprises a plurality of asset types.
4 . The computer-implemented method of claim 3 , wherein the data file comprises structured data and unstructured data.
5 . The computer-implemented method of claim 1 , wherein identifying the category for the at least one change is performed using a machine learning algorithm.
6 . The computer-implemented method of claim 5 , further comprising training the machine learning algorithm to identify categories for the at least one change to structured data or to unstructured data.
7 . The computer-implemented method of claim 1 , further comprising calculating a weight for each asset of a plurality of assets, wherein identifying the category for the at least one change is further based on the calculated weight for each asset.
8 . The computer-implemented method of claim 1 , wherein the processor set and the at least one client computer are controlled by the same entity.
9 . The computer-implemented method of claim 1 , further comprising notifying the at least one client computer that the new semantic version has been generated.
10 . A computer program product comprising one or more computer readable storage media having program instructions collectively stored on the one or more computer readable storage media, the program instructions executable to:
receive evaluation criteria comprising rules for evaluating changes to a data file, wherein the data file comprises a plurality of assets;
detect at least one change to one or more assets of the plurality of assets;
identify a category for the at least one change, based on the received evaluation criteria;
in response to identifying a category for a plurality of changes, aggregate the identified category of each of the plurality of changes of each asset of the data file;
in response to the aggregated categories exceeding one or more predetermined thresholds, generating a new semantic version for each changed asset of the plurality of assets and a new semantic version for the data file overall; and
push the new semantic version for each changed asset to at least one client computer having an outdated version of at least one changed asset, such that the at least one client computer uses the new semantic version for downstream tasks.
11 . The computer program product of claim 10 , wherein the data file comprises a plurality of data types comprising structured and unstructured data.
12 . The computer program product of claim 10 , wherein the program instructions are further executable to identify the category for the at least one change is performed using a machine learning algorithm.
13 . The computer program product of claim 12 , wherein the program instructions are further executable to train the machine learning algorithm to identify categories for the at least one change to structured data or to unstructured data.
14 . The computer program product of claim 10 , wherein the program instructions are further executable to notify clients having an outdated version that the new semantic version has been generated.
15 . A system comprising:
a processor set, one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable to:
receive evaluation criteria comprising rules for evaluating changes to a data file, wherein the data file comprises a plurality of assets;
detect at least one change to one or more assets of the plurality of assets;
identify a category for the at least one change, based on the received evaluation criteria;
in response to identifying a category for a plurality of changes, aggregate the identified category of each of the plurality of changes of each asset of the data file;
in response to the aggregated categories exceeding one or more predetermined thresholds, generating a new semantic version for each changed asset of the plurality of assets and a new semantic version for the data file overall; and
push the new semantic version for each changed asset to at least one client computer having an outdated version of at least one changed asset, such that the at least one client computer uses the new semantic version for downstream tasks.
16 . The system of claim 15 , wherein the received evaluation criteria further comprises rules for defining a major change, a minor change, and a patch change.
17 . The system of claim 15 , wherein the data file comprises a plurality of asset types.
18 . The system of claim 15 , wherein the program instructions are further executable to identify the category for the at least one change is performed using a machine learning algorithm.
19 . The system of claim 15 , wherein the program instructions are further executable to train the machine learning algorithm to identify categories for the at least one change to structured data or to unstructured data.
20 . The system of claim 15 , wherein the program instructions are further executable to notify clients having an outdated version that the new semantic version has been generated.