Rule encoding for generic data parsing of data technology transfer documents
A digital technology transfer system transforms technology transfer documents to a set of digitized manufacturing procedures and operations documentation. The system can transform a technology transfer document to a hierarchical structured model representing a package, or product to be manufactured, and the process for manufacturing the product. The resulting package model can be integrated into a larger model representing an ecosystem of manufacturing entities and plant facilities by assigning steps of the manufacturing process to one or more selected production lines. To reduce dependency on custom-built parsers for each type of document format, the system integrating both custom and general parsing mechanisms into a scalable parser orchestration engine.
1 . A system, comprising:
a processor, operatively coupled to a memory, that executes executable components stored on the memory, the executable components comprising:
a user interface component configured to receive, from a technology owner, a technology transfer document containing information about a product to be manufactured and describing a manufacturing process for manufacturing the product; and
a conversion component configured to
extract a table contained in the technology transfer document,
select a set of semantic rules, from multiple sets of semantic rules defined for respective different technology owners, corresponding to the technology owner,
extract table data from the table in accordance with custom parsing instructions defined by the set of semantic rules, and
generate at least a portion of a package model comprising a hierarchically structured organization of the table data organized based in part on the custom parsing instructions,
wherein
the custom parsing instructions are coded in a semantic rules file using a syntax that represents elements of the custom parsing instructions using codes of four characters or less, and
the conversion component is configured to translate a string of the codes into a custom parsing instruction of the custom parsing instructions.
2 . The system of claim 1 , wherein the codes comprise at least one of codes for logical operators; codes for identifying rows, columns, or cells of the table; codes for translation actions to be applied to the table or selected elements of the table; codes that indicate parent-child relationships between elements of the table data to be recorded in the package model; or codes for specifying a vertically merged cell or a horizontally merged cell within the table.
3 . The system of claim 1 , wherein
the codes comprise at least codes for translation actions to be applied to the table or selected elements of the table, and
the translation actions comprise at least one of changing content of a cell of the table, copying content of a first cell of the table to a second cell of the table, deleting content of a cell of the table, dropping a row or column of the table, merging content of two cells into a single cell, moving a column or row of the table, renaming a column or row of the table, skipping a column or row of the table, or duplicating content of a merged cell into two component cells.
4 . The system of claim 1 , wherein the string of the codes of the custom parsing instruction delineates an IF statement and a THEN statement using a delineation character.
5 . The system of claim 1 , wherein the custom parsing instruction comprises one or more variables inserted between two of the codes.
6 . The system of claim 5 , wherein the one or more variables comprise at least one of a text string to be located within the table or a text string to be written to a cell of the table.
7 . The system of claim 1 , wherein the codes comprise at least codes for identifying a row number or a column number within the table comprising a row identifier or a column identifier appended with a number.
8 . The system of claim 1 , wherein the conversion component is further configured to
extract content from the technology transfer document as content modules based on general parsing instructions defined in a content indexer and applicable to technology transfer documents from multiple different technology owners, and
generate another portion of the package model comprising a hierarchically structured organization of the content modules representing content sections of the technology transfer document.
9 . The system of claim 1 , wherein the executable components further comprise an export component configured to translate information about the manufacturing process contained in the package model to control configuration data and to export the control configuration data to an industrial device or system, wherein the control configuration data configures the industrial device or system to execute a portion of the manufacturing process.
10 . The system of claim 1 , wherein the general parsing instructions define hierarchical levels in which respective content modules, of the content modules, are to be organized in the package model, keywords to be associated with respective items of content to be extracted to the content modules, and instructions for locating the respective items of content within the technology transfer documents.
11 . A method, comprising:
receiving, by a system comprising a processor, a technology transfer document from a technology owner, the technology transfer document containing information about a product to be manufactured and describing a manufacturing process for manufacturing the product;
extracting, by the system, a table contained in the technology transfer document;
selecting, by the system, a set of semantic rules, from multiple sets of semantic rules defined for respective different technology owners, corresponding to the technology owner;
extracting, by the system, table data from the table in accordance with custom parsing instructions defined by the set of semantic rules; and
generating, by the system, at least a portion of a package model comprising a hierarchically structured organization of the table data organized based in part on the custom parsing instructions;
translating, by the system, information about the manufacturing process contained in the package model to control configuration data; and
exporting, by the system, the control configuration data to an industrial device or system, wherein the exporting of the control configuration data configures the industrial device or system to execute a portion of the manufacturing process,
wherein
the custom parsing instructions are coded using a syntax in which elements of the custom parsing instructions are represented by codes comprising four characters or less, and
the extracting of the table data comprises translating a string of the codes into a custom parsing instruction and applying the custom parsing instruction to the table.
12 . The method of claim 11 , wherein the codes comprise at least one of codes for logical operators; codes for identifying rows, columns, or cells of the table; codes for translation actions to be applied to the table or selected elements of the table; codes that indicate parent-child relationships between elements of the table data to be recorded in the package model; or codes for specifying a vertically merged cell or a horizontally merged cell within the table.
13 . The method of claim 11 , wherein
the codes comprise at least codes for translation actions to be applied to the table or selected elements of the table, and
the translation actions comprise at least one of changing content of a cell of the table, copying content of a first cell of the table to a second cell of the table, deleting content of a cell of the table, dropping a row or column of the table, merging content of two cells into a single cell, moving a column or row of the table, renaming a column or row of the table, skipping a column or row of the table, or duplicating content of a merged cell into two component cells.
14 . The method of claim 11 , wherein the string of the codes of the custom parsing instruction delineates an IF statement and a THEN statement using a delineation character.
15 . The method of claim 11 , wherein the custom parsing instruction comprises one or more variables inserted between two of the codes.
16 . The method of claim 15 , wherein the one or more variables comprise at least one of a text string to be located within the table or a text string to be written to a cell of the table.
17 . The method of claim 11 , further comprising:
extracting, by the system, content from the technology transfer document as content modules based on general parsing instructions defined in a content indexer and applicable to technology transfer documents from multiple different technology owners; and
generating, by the system, another portion of the package model comprising a hierarchically structured organization of the content modules representing content sections of the technology transfer document.
18 . A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a technology transfer system comprising a processor to perform operations, the operations comprising:
importing a technology transfer document associated with a technology owner, the technology transfer document comprising information describing a product to be manufactured and a manufacturing process for manufacturing the product;
extracting a table contained in the technology transfer document;
selecting a set of semantic rules, from multiple sets of semantic rules defined for respective different technology owners, corresponding to the technology owner;
extracting table data from the table in accordance with custom parsing instructions defined by the set of semantic rules; and
generating at least a portion of a package model comprising a hierarchically structured organization of the table data organized based in part on the custom parsing instructions;
translating information about the manufacturing process contained in the package model to control configuration data; and
exporting the control configuration data to an industrial device or system, wherein the exporting of the control configuration data configures the industrial device or system to execute a portion of the manufacturing process,
wherein
the custom parsing instructions are coded in a semantic rules file using a syntax that represents elements of the custom parsing instructions using codes of four characters or less, and
the conversion component is configured to translate a string of the codes into a custom parsing instruction.
19 . The non-transitory computer-readable medium of claim 18 , wherein the codes comprise at least one of codes for logical operators; codes for identifying rows, columns, or cells of the table; codes for translation actions to be applied to the table or selected elements of the table; codes that indicate parent-child relationships between elements of the table data to be recorded in the package model; or codes for specifying a vertically merged cell or a horizontally merged cell within the table.
20 . The non-transitory computer-readable medium of claim 18 , wherein
the codes comprise at least codes for translation actions to be applied to the table or selected elements of the table, and
the translation actions comprise at least one of changing content of a cell of the table, copying content of a first cell of the table to a second cell of the table, deleting content of a cell of the table, dropping a row or column of the table, merging content of two cells into a single cell, moving a column or row of the table, renaming a column or row of the table, skipping a column or row of the table, or duplicating content of a merged cell into two component cells.