Methods and apparatus for character set control, verification and reporting
Systems and methods for character set control, verification and reporting are provided. In an example embodiment, a data evaluation system comprises at least one module, executing on one or more computer processors, to implement a language and character set phase in which an authorized character set comprising authorized characters is defined; a document phase including receipt of an input document, the input document comprising document characters; a detection phase including a comparison of the document characters against the authorized characters in the authorized character set to detect unauthorized characters in the input document not forming part of the authorized character set; and a reporting phase including display of the unauthorized characters to a user.
1. A data evaluation system comprising:
at least one module, executing on one or more computer processors, to implement:
a language and character set phase, to receive from a client device an authorized character set comprising some authorized characters from among one or more libraries of characters;
a document phase including receipt of an input document, the input document comprising document characters;
a detection phase including a comparison of the document characters against the authorized characters in the authorized character set to detect unauthorized characters in the input document not forming part of the authorized character set; and
a reporting phase to receive from the client device a report configuration, and based on the report configuration cause display of the unauthorized characters to a user within a report.
2. The system of claim 1 , wherein the reporting phase further comprises:
an identification of a location of the unauthorized characters in the input document.
3. The system of claim 1 , wherein the language and character set phase further comprises:
producing a text-only version of the input document; and
producing a string of unique, un-duplicated characters found uniquely within the text-only version of the input document.
4. The system of claim 1 , wherein the character set includes a group of one or more alpha, numeric, punctuation and symbols for a specific language, and wherein the specific language is a predefined or standardized language, or a custom configured language.
5. The system of claim 4 , wherein the at least one module is further to implement defining a plurality of authorized character sets wherein the authorized characters of the character sets are defined by Unicode standards and are pre-grouped by the specific language.
6. The system of claim 1 , wherein the document phase further comprises:
providing an adapter allowing receipt of different forms of input document.
7. A data translation method comprising:
a language and character set phase, to receive from a client device an authorized character set comprising some authorized characters from among one or more libraries of characters;
a document phase including receipt of an input document, the input document comprising document characters;
a detection phase including a comparison of the document characters against the authorized characters in the authorized character set to detect unauthorized characters in the input document not forming part of the authorized character set; and
a reporting phase to receive from the client device a report configuration, and based on the report configuration cause display of the unauthorized characters to a user within a report.
8. The method of claim 7 , wherein the reporting phase further comprises:
an identification of a location of the unauthorized characters in the input document.
9. The method of claim 7 , wherein the language and character set phase further comprises:
producing a text-only version of the input document; and
producing a string of unique, un-duplicated characters found uniquely within the text-only version of the input document.
10. The method of claim 7 , wherein the character set includes a group of one or more alpha, numeric, punctuation and symbols for a specific language, and wherein the specific language is a predefined or standardized language, or a custom configured language.
11. The method of claim 10 , further comprising:
defining a plurality of authorized character sets wherein the authorized characters of the character sets are defined by Unicode standards and are pre-grouped by the specific language.
12. The method of claim 7 , wherein the document phase further comprises:
providing an adapter allowing receipt of different forms of input document.
13. A non-transitory machine readable medium, including instructions, which when read by a machine, causes the machine to perform:
a language and character set phase, to receive from a client device an authorized character set comprising some authorized characters from among one or more libraries of characters;
a document phase including receipt of an input document, the input document comprising document characters;
a detection phase including a comparison of the document characters against the authorized characters in the authorized character set to detect unauthorized characters in the input document not forming part of the character set; and
a reporting phase to receive from the client device a report configuration, and based on the report configuration cause display of the unauthorized characters to a user within a report.
14. The non-transitory machine readable medium of claim 13 , wherein the reporting phase further comprises:
an identification of a location of the unauthorized characters in the input document.
15. The non-transitory machine readable medium of claim 13 , wherein the language and character set phase further comprises:
producing a text-only version of the input document; and
producing a string of unique, un-duplicated characters found uniquely within the text-only version of the input document.
16. The non-transitory machine readable medium of claim 13 , wherein the character set includes a group of one or more alpha, numeric, punctuation and symbols for a specific language, wherein the specific language is a predefined or standardized language, or a custom configured language.
17. The non-transitory machine readable medium of claim 16 , wherein the machine is further caused to implement a definition of a plurality of authorized character sets wherein the authorized characters of the character sets are defined by Unicode standards and are pre-grouped by the specific language.
18. The non-transitory machine readable medium of claim 13 , wherein the document phase further comprises:
providing an adapter allowing receipt of different forms of input document.