Self-learning data lenses for conversion of information from a source form to a target form
A semantic conversion system ( 1900 ) includes a self-learning tool ( 1902 ). The self-learning tool ( 1902 ) receives input files from legacy data systems ( 1904 ). The self-learning tool ( 1902 ) includes a conversion processor ( 1914 ) that can calculate probabilities associated with candidate conversion terms so as to select an appropriate conversion term. The self-learning tool ( 1902 ) provides a fully attributed and normalized data set ( 1908 ).
1. A method for use in converting semantic information from a source form to a target form, comprising the steps of:
providing a computer-based analysis tool for automatically executing a conversion analysis having at least one conversion logic that is independent of any particular conversion environment associated with semantic information to be converted, wherein said at least one conversion logic is operative for analyzing at least one structural element of said semantic information without regard to any particular conversion environment associated with the semantic data;
obtaining a first set of data reflecting a first conversion environment associated with first semantic information, wherein at least a portion of said first set of data is standardized;
identifying the portion of said first set of data that is standardized;
first operating said analysis tool on said standardized portion of said first set of data to automatically develop a first semantic metadata conversion model specific to said first conversion environment associated with said first semantic information utilizing said at least one conversion logic; and
second operating said analysis tool to automatically convert a second set of data belonging to said first conversion environment associated with said first semantic information from said source form to said target form by applying said first developed semantic metadata conversion model to said second set of data, wherein said second set of data has at least a portion of data that is unstandardized.
2. The method as set forth in claim 1 , wherein said first set of data includes structured data having structural elements defining attributes of the data and content elements defining attribute values of specific items of data, and said step of first operating comprises obtaining a set of attributes by analyzing said structural elements and obtaining at least one definition of acceptable attribute values by analyzing said content elements.
3. The method as set forth in claim 2 , wherein said first set of data is provided in table form and at least some of said structural elements define said table structure and at least some of said content elements populate addresses of said table.
4. The method as set forth in claim 2 , wherein said first set of data includes logged data having content elements defining attribute values of specific items of data and tag elements describing said content elements, and said step of first operating comprises obtaining a set of attributes by analyzing said tag elements and obtaining at least one definition of acceptable attribute values by analyzing said content elements.
5. The method as set forth in claim 1 , wherein said step of first operating comprises performing a statistical analysis on said first set of data to identify attributes and attribute values and to associate probability information with said attributes and attribute values.
6. The method as set forth in claim 5 , wherein said statistical analysis is applied with respect to said unstructured semantic data.
7. The method as set forth in claim 1 , wherein said portion of said first set of data that is standardized includes data that has undergone at least one process to standardize the data.
8. The method as set forth in claim 1 , further comprising:
obtaining a third set of data reflecting a second conversion environment associated with second semantic information, wherein at least a portion of the third set of data is standardized;
identifying the portion of said third set of data that is standardized;
third operating said analysis tool on said standardized portion of said third set of data to develop a second semantic metadata conversion model specific to said second conversion environment associated with said second semantic information; and
fourth operating said analysis tool to convert a fourth set of data belonging to said second conversion environment associated with said second semantic information from said source form to said target form by applying said developed second semantic metadata conversion model to said fourth set of data, wherein said fourth set of data has at least a portion of data that is unstandardized.
9. The method as set forth in claim 8 , wherein said first semantic metadata conversion model is different than said second semantic metadata conversion model.