Using domain specific vocabularies to spellcheck input strings
Provided are a computer program product, system, and method for using domain specific vocabularies to spellcheck input strings. A determination is made of a determining a domain specific vocabulary comprising domain specific tokens for a user. The input strings in the input text from the user are processed to determine whether the input strings match the domain specific tokens in the domain specific vocabulary. Indication is made that input strings that are determined to match the domain specific tokens in the domain specific vocabulary are not to be spellchecked by a global vocabulary available to users across domains.
1. A computer program product for spell checking text, wherein the computer program product comprises a computer readable storage medium having computer readable program instructions executed by a processor to perform operations, the operations comprising:
spellchecking input strings in text with a domain specific vocabulary comprising domain specific tokens to output corrected input strings;
caching a pre-corrected input string before an input string is corrected by spellchecking to produce a corrected input string;
providing the pre-corrected input string to a domain specific natural language processor (NLP) annotator to process to produce output on the pre-corrected input string;
determining whether the domain specific NLP annotator outputted NLP annotations indicating the pre-corrected input string is correct within the domain specific vocabulary; and
replacing the corrected input string with the pre-corrected input string in spellchecked strings in response to determining that the domain specific NLP annotator outputted NLP annotations for the pre-corrected input string indicating the pre-corrected input string is correct.
2. The computer program product of claim 1 , wherein the replaced corrected input string is not provided to the domain specific NLP annotator for NLP processing.
3. The computer program product of claim 1 , wherein the operations further comprise:
retaining the corrected input string in the spellchecked strings in response to determining that the domain specific NLP annotator did not output meaningful NLP annotations for the pre-corrected input string.
4. The computer program product of claim 1 , wherein the operations further comprise:
determining whether the domain specific vocabulary is in a white box format or a black box format;
extracting the domain specific tokens from the domain specific vocabulary to use to spellcheck the input strings in response to determining that the domain specific vocabulary is in the white box format; and
in response to determining that the domain specific vocabulary is in the black box format, spellchecking the input strings using the domain specific vocabulary, wherein the operations of the caching the pre-corrected input string, providing the pre-corrected input string to the domain specific NLP annotator, the determining whether the domain specific NLP annotator outputted NLP annotations, the replacing the corrected input string, and the providing the pre-corrected input string to the domain specific NLP annotator are performed after the spellchecking using the domain specific vocabulary in the black box format.
5. The computer program product of claim 4 , wherein the domain specific vocabulary is in the white box format when the domain specific vocabulary is in a plain text format allowing the domain specific tokens to be extracted, and wherein the domain specific vocabulary is in the black box format when the domain specific vocabulary is in a binary format.
6. The computer program product of claim 1 , wherein the operations further comprise:
extracting the domain specific tokens from the domain specific vocabulary to use to spellcheck the input strings; and
wherein the operations of the caching the pre-corrected input string, the providing the pre-corrected input string to the domain specific NLP annotator, the determining whether the domain specific NLP annotator outputted NLP annotations, the replacing the corrected input string, and the providing the pre-corrected input string to the domain specific NLP annotator are performed after the spellchecking using the extracted domain specific tokens.
7. The computer program product of claim 1 , wherein the providing the pre-corrected input string to the domain specific NLP annotator to process comprises inputting the pre-corrected input string to a plurality of domain specific NLP annotators to produce output on the pre-corrected input string, wherein the corrected input string is replaced with the pre-corrected input string in spellchecked strings in response to determining that one of the domain specific NLP annotators outputted NLP annotations for the pre-corrected input string.
8. A system for spell checking text, comprising:
a processor, and
a computer readable storage medium having computer readable program instructions executed by the processor to perform operations, the operations comprising:
spellchecking input strings in text with a domain specific vocabulary comprising domain specific tokens to output corrected input strings;
caching a pre-corrected input string before an input string is corrected by spellchecking to produce a corrected input string;
providing the pre-corrected input string to a domain specific natural language processor (NLP) annotator to process to produce output on the pre-corrected input string;
determining whether the domain specific NLP annotator outputted NLP annotations indicating the pre-corrected input string is correct within the domain specific vocabulary; and
replacing the corrected input string with the pre-corrected input string in spellchecked strings in response to determining that the domain specific NLP annotator outputted NLP annotations for the pre-corrected input string indicating the pre-corrected input string is correct.
9. The system of claim 8 , wherein the operations further comprise:
retaining the corrected input string in the spellchecked strings in response to determining that the domain specific NLP annotator did not output meaningful NLP annotations for the pre-corrected input string.
10. The system of claim 8 , wherein the operations further comprise:
determining whether the domain specific vocabulary is in a white box format or a black box format;
extracting the domain specific tokens from the domain specific vocabulary to use to spellcheck the input strings in response to determining that the domain specific vocabulary is in the white box format; and
in response to determining that the domain specific vocabulary is in the black box format, spellchecking the input strings using the domain specific vocabulary, wherein the operations of the caching the pre-corrected input string, providing the pre-corrected input string to the domain specific NLP annotator, the determining whether the domain specific NLP annotator outputted NLP annotations, the replacing the corrected input string, and the providing the pre-corrected input string to the domain specific NLP annotator are performed after the spellchecking using the domain specific vocabulary in the black box format.
11. The system of claim 8 , wherein the operations further comprise:
extracting the domain specific tokens from the domain specific vocabulary to use to spellcheck the input strings; and
wherein the operations of the caching the pre-corrected input string, the providing the pre-corrected input string to the domain specific NLP annotator, the determining whether the domain specific NLP annotator outputted NLP annotations, the replacing the corrected input string, and the providing the pre-corrected input string to the domain specific NLP annotator are performed after the spellchecking using the extracted domain specific tokens.
12. The system of claim 8 , wherein the providing the pre-corrected input string to the domain specific NLP annotator to process comprises inputting the pre-corrected input string to a plurality of domain specific NLP annotators to produce output on the pre-corrected input string, wherein the corrected input string is replaced with the pre-corrected input string in spellchecked strings in response to determining that one of the domain specific NLP annotators outputted NLP annotations for the pre-corrected input string.
13. A computer implemented method for spell checking text, comprising:
spellchecking input strings in text with a domain specific vocabulary comprising domain specific tokens to output corrected input strings;
caching a pre-corrected input string before an input string is corrected by spellchecking to produce a corrected input string;
providing the pre-corrected input string to a domain specific natural language processor (NLP) annotator to process to produce output on the pre-corrected input string;
determining whether the domain specific NLP annotator outputted NLP annotations indicating the pre-corrected input string is correct within the domain specific vocabulary; and
replacing the corrected input string with the pre-corrected input string in spellchecked strings in response to determining that the domain specific NLP annotator outputted NLP annotations for the pre-corrected input string indicating the pre-corrected input string is correct.
14. The method of claim 13 , further comprising:
retaining the corrected input string in the spellchecked strings in response to determining that the domain specific NLP annotator did not output meaningful NLP annotations for the pre-corrected input string.
15. The method of claim 13 , further comprising:
determining whether the domain specific vocabulary is in a white box format or a black box format;
extracting the domain specific tokens from the domain specific vocabulary to use to spellcheck the input strings in response to determining that the domain specific vocabulary is in the white box format; and
in response to determining that the domain specific vocabulary is in the black box format, spellchecking the input strings using the domain specific vocabulary, wherein the caching the pre-corrected input string, the providing the pre-corrected input string to the domain specific NLP annotator, the determining whether the domain specific NLP annotator outputted NLP annotations, the replacing the corrected input string, and the providing the pre-corrected input string to the domain specific NLP annotator are performed after the spellchecking using the domain specific vocabulary in the black box format.
16. The method of claim 13 , further comprising:
extracting the domain specific tokens from the domain specific vocabulary to use to spellcheck the input strings; and
wherein the caching the pre-corrected input string, the providing the pre-corrected input string to the domain specific NLP annotator, the determining whether the domain specific NLP annotator outputted NLP annotations, the replacing the corrected input string, and the providing the pre-corrected input string to the domain specific NLP annotator are performed after the spellchecking using the extracted domain specific tokens.
17. The method of claim 13 , wherein the providing the pre-corrected input string to the domain specific NLP annotator to process comprises inputting the pre-corrected input string to a plurality of domain specific NLP annotators to produce output on the pre-corrected input string, wherein the corrected input string is replaced with the pre-corrected input string in spellchecked strings in response to determining that one of the domain specific NLP annotators outputted NLP annotations for the pre-corrected input string.