IP Library › Granted Patent US 11,194,964
Granted Patent B2
US 11,194,964 · App. 16/361,701 · Granted Dec 7, 2021

Real-time assessment of text consistency

Inventors: Abhijit Mishra (Bangalore, IN); Anirban Laha (Chinsurah, IN); Parag Jain (Jabalpur, IN); Karthik Sankaranarayanan (Bangalore, IN)
Assignee: International Business Machines Corporation
G06F40/253G06F16/3322G06F40/166G06F40/242G06F40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,194,964
App. No.
16/361,701
Granted
Dec 7, 2021
Kind
B2
Abstract

Text suggestions are generated. A document is received, and a portion score for at least one portion of the document is generated. A global assessment score for at least two portions of the document is also generated. A variation between the portion score and the global assessment score is calculated. It is determined that the variation is above a threshold variation, and at least one text change suggestion is generated.

Claims (60)

1. A method of generating text change suggestions, comprising:

receiving a document comprising portions, wherein each of the portions includes at least two words;

generating portion scores corresponding to the portions;

generating a global assessment score for the document;

determining, for the portion scores, variations from the global assessment score;

determining that the variations include at least two variations below a threshold variation and a variation above the threshold variation;

selecting consistent portions from the portions based on the variations, wherein the consistent portions correspond to portion scores with variations from the at least two variations below the threshold variation;

generating a language model for the document based on the consistent portions;

selecting an inconsistent portion from the portions based on the variations, wherein the inconsistent portion corresponds to a portion score with the variation above the threshold variation; and

generating, based on the language model, at least one text change suggestion for the inconsistent portion.

2. The method of claim 1 , wherein the global assessment score and the portion scores are based on semantic artifacts.

3. The method of claim 2 , wherein the semantic artifacts include at least one semantic artifact selected from the group consisting of bias-based semantic artifacts, correctness-based semantic artifacts, and coherence-based semantic artifacts.

4. The method of claim 1 , wherein the global assessment score and the portion scores are based on semantic artifacts and contributor scores.

5. The method of claim 1 , wherein the at least one text change suggestion is generated using style-based transformers.

6. The method of claim 1 , further comprising:

identifying at least one leader from at least two contributors to the document; and

generating the global assessment score based on portion scores for portions of the document contributed by the at least one leader.

7. The method of claim 1 , wherein the at least one text change suggestion indicates that the inconsistent portion contains information that contradicts information in the consistent portions.

8. A system, comprising:

at least one processing component;

at least one memory component;

a display screen configured to display a document;

a dictionary; and

an editing module, comprising:

an assessment module configured to:

receive a document comprising portions, wherein each of the portions includes at least two words;

generate portion scores corresponding to the portions;

generate a global assessment score for the document;

determine, for the portion scores, variations from the global assessment score;

determine that the variations include at least two variations below a threshold variation and a variation above the threshold variation;

select consistent portions from the portions based on the variations, wherein the consistent portions correspond to portion scores with variations from the at least two variations below the threshold variation; and

select an inconsistent portion from the portions based on the variations, wherein the inconsistent portion corresponds to a portion score with the variation above the threshold variation; and

a suggestion module configured to:

generate a language model for the document based on the consistent portions; and

generate, based on the language model, at least one text change suggestion for the inconsistent portion.

9. The system of claim 8 , wherein the global assessment scores and the portion scores are based on semantic artifacts.

10. The system of claim 9 , wherein the semantic artifacts include at least one semantic artifact selected from the group consisting of bias-based semantic artifacts, correctness-based semantic artifacts, and coherence-based semantic artifacts.

11. The system of claim 8 , global assessment score and the portion scores are based on semantic artifacts and contributor scores.

12. The system of claim 8 , wherein the assessment module is further configured to:

identify at least one leader from at least two contributors to the document; and

generate the global assessment score based on portion scores for portions of the document contributed by the at least one leader.

13. The system of claim 8 , wherein the at least one text change suggestion indicates that the inconsistent portion contains information that contradicts information in the consistent portions.

14. The system of claim 8 , further comprising a set of contributor profiles.

15. A computer program product for generating text change suggestions, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the device to perform a method, the method comprising:

receiving a document comprising portions, wherein each of the portions includes at least two words;

generating portion scores corresponding to the portions;

generating a global assessment score for the document;

determining, for the portion scores, variations from the global assessment score;

determining that the variations include at least two variations below a threshold variation and a variation above the threshold variation;

selecting consistent portions from the portions based on the variations, wherein the consistent portions correspond to portion scores with variations from the at least two variations below the threshold variation;

generating a language model for the document based on the consistent portions;

selecting an inconsistent portion from the portions based on the variations, wherein the inconsistent portion corresponds to a portion score with the variation above the threshold variation; and

generating, based on the language model, at least one text change suggestion for the inconsistent portion.

16. The computer program product of claim 15 , wherein the global assessment score and the portion scores are based on semantic artifacts.

17. The computer program product of claim 16 , wherein the semantic artifacts include at least one semantic artifact selected from the group consisting of bias-based semantic artifacts, correctness-based semantic artifacts, and coherence-based semantic artifacts.

18. The computer program product of claim 15 , wherein the global assessment score and the portion scores are based on semantic artifacts and contributor scores.

19. The computer program product of claim 15 , wherein the at least one text change suggestion is generated using style-based transformers.

20. The computer program product of claim 15 , further comprising:

identifying at least one leader from at least two contributors to the document; and

generating the global assessment score based on portion scores for portions of the document contributed by the at least one leader.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2019
From: MISHRA, ABHIJIT; LAHA, ANIRBAN; JAIN, PARAG; SANKARANARAYANAN, KARTHIK
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 048671/0969 →
Continuity (1)
Related Publication 20200302011A1 · Sep 24, 2020
Cited By (1)
US 12,242,802