METHOD AND SYSTEM FOR FEDERATED DATA PROCUREMENT USING PROBABILISTIC INFORMATION MATCHING VIA DOMAIN SPECIFIC HEURISTICS
In one aspect, a computerized method for federated data procurement using probabilistic information matching via domain specific heuristics. The method includes implementing procurement of the data from a plurality of online data sources. Each online data source comprises a plurality of measures. The method includes matching and validating the data. The method includes associating a plurality of weights with the plurality of set of domain specific heuristics that are optimized on an ongoing basis as newer data sources are identified. The method includes detecting that new information is collected and adding a plurality of additional heuristics to the domain specific heuristic frameworks.
1 . A computerized method for federated data procurement using probabilistic information matching via domain specific heuristics, comprising:
implementing procurement of the data from a plurality of online data sources, wherein each online data source comprises a plurality of measures;
matching and validating the data by:
identifying the data to be stored,
identifying a data source of the data,
matching a procured data with the data that is currently present in a database and validating data efficacy of the data; and
identifying a set of domain specific heuristics that make up an overall heuristic framework;
associating a plurality of weights with the plurality of set of domain specific heuristics that are optimized on an ongoing basis as newer data sources are identified; and
detecting that new information is collected and adding a plurality of additional heuristics to the domain specific heuristic frameworks.
2 . The computerized method of claim 1 , wherein the data comprises IIoT data.
3 . The computerized method of claim 2 , wherein the plurality of measures ensures that an experience is optimized for a specified site.
4 . The computerized method of claim 3 , wherein the plurality of measures deters an external bot entity from using a site in a manner that impairs a user experience on the site.
5 . The computerized method of claim 1 further comprising:
assigning one or more appropriate weights while the plurality of heuristics are deprecated.
6 . The computerized method of claim 1 further comprising:
assigning one or more appropriate weights while the plurality of heuristics are reassigned a plurality of new weights.
7 . The computerized method of claim 1 further comprising:
assessing a quality of the data based on an ongoing usage of the data.
8 . The computerized method of claim 1 further comprising:
choosing each of the key attributes that make a device object and assign them weights.
9 . The computerized method of claim 8 , wherein the weights represent a probabilistic significance that is accorded to a certain match.
10 . The computerized method of claim 1 further comprising:
intelligently throttling a set of scans that are performed on the data source.
11 . The computerized method of claim 10 wherein the data source remains within one or more bounds of normal site usage while still working concurrently.