Natural language generation pattern enhancement

1. A computer-implemented method for improving a natural language generation knowledge base, comprising:

detecting user input comprising a natural language expression;

generating an erroneous natural language response based on the user input and the knowledge base;

determining user feedback corresponding to the erroneous natural language response, wherein the user feedback comprises an indication of an end-user reaction to the erroneous natural language response;

determining an improvable performance metric with respect to the knowledge base, wherein the improvable performance metric is based on a scoring of the erroneous natural language response, and wherein the scoring identifies a contextual defect of the knowledge base and identifies an extent to which the knowledge base is incorrectly applied, and wherein the contextual defect is selected from the group consisting of errors and defects related to syntax, semantics, morphology, and orthography, and wherein an incorrect application of the knowledge base comprises an incorrect application of grammar, language patterns, or language templates, or a combination thereof; and

updating the knowledge base based on the improvable performance metric, wherein the knowledge base comprises an explicit model of language corresponding to the erroneous natural language response, and wherein updating the knowledge base comprises updating the explicit model of language based on the user input, the erroneous natural language response, and the user feedback.

2. The computer-implemented method of claim 1 , wherein the erroneous natural language response violates one or more rules of syntax, semantics, morphology, and orthography of the natural language.

3. The computer-implemented method of claim 1 , wherein determining the user feedback comprises prompting the end-user for the user feedback.

4. The computer-implemented method of claim 1 , wherein determining the user feedback comprises performing end-user attention monitoring.

5. The computer-implemented method of claim 4 , wherein the end-user attention monitoring comprises eye-tracking of the end-user with respect to a display instance of NLG-generated texts of the erroneous natural language response.

6. The computer-implemented method of claim 1 , wherein the improvable performance metric is determined based on the user input, the erroneous natural language response, and the user feedback.

7. A computer system for improving a natural language generation knowledge base, the computer system comprising:

one or more computer processors, one or more computer-readable storage media, and program instructions stored on one or more of the computer-readable storage media for execution by at least one of the one or more computer processors, the program instructions, when executed by the at least one of the one or more computer processors, causing the computer system to perform a method comprising:

detecting user input comprising a natural language expression;

generating an erroneous natural language response based on the user input and the knowledge base;

determining user feedback corresponding to the erroneous natural language response, wherein the user feedback comprises an indication of an end-user reaction to the erroneous natural language response;

determining an improvable performance metric with respect to the knowledge base, wherein the improvable performance metric is based on a scoring of the erroneous natural language response, and wherein the scoring identifies a contextual defect of the knowledge base and identifies an extent to which the knowledge base is incorrectly applied, and wherein the contextual defect is selected from the group consisting of errors and defects related to syntax, semantics, morphology, and orthography, and wherein an incorrect application of the knowledge base comprises an incorrect application of grammar, language patterns, or language templates, or a combination thereof; and

updating the knowledge base based on the improvable performance metric, wherein the knowledge base comprises an explicit model of language corresponding to the erroneous natural language response, and wherein updating the knowledge base comprises updating the explicit model of language based on the user input, the erroneous natural language response, and the user feedback.

8. The computer system of claim 7 , wherein the erroneous natural language response violates one or more rules of syntax, semantics, morphology, and orthography of the natural language.

9. The computer system of claim 7 , wherein determining the user feedback comprises prompting the end-user for the user feedback.

10. The computer system of claim 7 , wherein determining the user feedback comprises performing end-user attention monitoring.

11. The computer system of claim 10 , wherein the end-user attention monitoring comprises eye-tracking of the end-user with respect to a display instance of NLG-generated texts of the erroneous natural language response.

12. The computer system of claim 7 , wherein the improvable performance metric is determined based on the user input, the erroneous natural language response, and the user feedback.

13. A computer program product for improving a natural language generation knowledge base, the computer program product comprising:

one or more computer-readable storage devices and program instructions stored on at least one of the one or more computer-readable storage devices for execution by at least one or more computer processors of a computer system, the program instructions, when executed by the at least one of the one or more computer processors, causing the computer system to perform a method comprising:

detecting user input comprising a natural language expression;

generating an erroneous natural language response based on the user input and the knowledge base;

determining user feedback corresponding to the erroneous natural language response, wherein the user feedback comprises an indication of an end-user reaction to the erroneous natural language response;

determining an improvable performance metric with respect to the knowledge base, wherein the improvable performance metric is based on a scoring of the erroneous natural language response, and wherein the scoring identifies a contextual defect of the knowledge base and identifies an extent to which the knowledge base is incorrectly applied, and wherein the contextual defect is selected from the group consisting of errors and defects related to syntax, semantics, morphology, and orthography, and wherein an incorrect application of the knowledge base comprises an incorrect application of grammar, language patterns, it language templates, or a combination thereof; and

updating the knowledge base based on the improvable performance metric, wherein the knowledge base comprises an explicit model of language corresponding to the erroneous natural language response, and wherein updating the knowledge base comprises updating the explicit model of language based on the user input, the erroneous natural language response, and the user feedback.

14. The computer program product of claim 13 , wherein the erroneous natural language response violates one or more rules of syntax, semantics, morphology, and orthography of the natural language.

15. The computer program product of claim 13 , wherein determining the user feedback comprises prompting the end-user for the user feedback.

16. The computer program product of claim 13 , wherein determining the user feedback comprises performing end-user attention monitoring.

17. The computer program product of claim 16 , wherein the end-user attention monitoring comprises eye-tracking of the end-user with respect to a display instance of NLG-generated texts of the erroneous natural language response.

18. The computer program product of claim 13 , wherein the improvable performance metric is determined based on the user input, the erroneous natural language response, and the user feedback.