Verification of extracted data
View Patent ↗Facts are extracted from speech and recorded in a document using codings. Each coding represents an extracted fact and includes a code and a datum. The code may represent a type of the extracted fact and the datum may represent a value of the extracted fact. The datum in a coding is rendered based on a specified feature of the coding. For example, the datum may be rendered as boldface text to indicate that the coding has been designated as an “allergy.” In this way, the specified feature of the coding (e.g., “allergy”-ness) is used to modify the manner in which the datum is rendered. A user inspects the rendering and provides, based on the rendering, an indication of whether the coding was accurately designated as having the specified feature. A record of the user's indication may be stored, such as within the coding itself.
1. A method performed by at least one computer processor executing computer program instructions tangibly stored on at least one non-transitory computer-readable medium, the method comprising:
(A) identifying a document including a first coding having a first feature encoding a first concept, the first coding being associated with a first code;
(B) associating first data with the first coding, the first data representing information that does not have a correspondence with the document;
(C) rendering the first coding and the first data on an output device to have a visual characteristic that is based on the first feature, without rendering the first code;
(D) receiving, via an input device, a first indication from a user of whether the rendering is accurate;
(E) identifying, by the at least one computer processor, based on the first indication received from the user, a verification status of the first coding, wherein the verification status of the first coding indicates whether the first code represents the first concept, comprising:
(E)(1) if the first indication indicates that the rendering is accurate, then identifying a verification status of the first coding indicating that the first coding is accurate; and
(E)(2) otherwise, identifying a verification status of the first coding indicating that the first coding is inaccurate; and
(F) if the verification status of the first coding indicates that the first coding is inaccurate, then modifying at least one of the first feature of the first coding and the first data.
2. The method of claim 1 , wherein the document further comprises first text.
3. The method of claim 2 , wherein (B) further comprises associating first data with the first coding, the first data representing information that does not have a correspondence with the first text of the document.
4. The method of claim 2 , further comprising:
(G) before (A), using an automatic speech recognizer to recognize an audio stream representing speech and thereby to produce the first text.
5. The method of claim 4 , wherein (B) further comprises associating first data with the first coding, the first data representing information that does not have a correspondence with the audio stream.
6. The method of claim 2 , wherein the document further includes second text not included in the first coding.
7. The method of claim 1 , wherein the first feature comprises a specified relationship between the first coding and a second coding, and wherein (F) comprises modifying the relationship between the first coding and the second coding.
8. The method of claim 7 , wherein the second coding includes the first coding, wherein the first feature comprises inclusion of the first coding in the second coding, and wherein (F) comprises removing the first coding from the second coding.
9. The method of claim 7 , wherein (F) comprises severing the specified relationship.
10. The method of claim 1 , wherein the first data comprises first text, and wherein (E) comprises identifying a verification status of the first coding, wherein the verification status of the first coding indicates whether the first text describes the first concept.
11. The method of claim 1 , further comprising:
(G) storing, in the document, a record of the verification status of the first coding.
12. The method of claim 1 , wherein (E) comprises determining whether the first code represents a concept having the first feature.
13. The method of claim 1 , wherein the visual characteristic comprises a text-formatting characteristic.
14. A non-transitory computer readable medium comprising computer program instructions tangibly stored on the computer readable medium, wherein the computer program instructions are executable by at least one computer processor to perform a method, the method comprising:
(A) identifying a document including a first coding having a first feature encoding a first concept, the first coding being associated with a first code;
(B) associating first data with the first coding, the first data representing information that does not have a correspondence with the document;
(C) rendering the first coding and the first data on an output device to have a visual characteristic that is based on the first feature, without rendering the first code;
(D) receiving, via an input device, a first indication from a user of whether the rendering is accurate;
(E) identifying, based on the first indication received from the user, a verification status of the first coding, wherein the verification status of the first coding indicates whether the first code represents the first concept, comprising:
(E)(1) if the first indication indicates that the rendering is accurate, then identifying a verification status of the first coding indicating that the first coding is accurate; and
(E)(2) otherwise, identifying a verification status of the first coding indicating that the first coding is inaccurate; and
(F) if the verification status of the first coding indicates that the first coding is inaccurate, then modifying at least one of the first feature of the first coding and the first data.
15. The computer readable medium of claim 14 , wherein the document further comprises first text.
16. The computer readable medium of claim 15 , wherein (B) further comprises associating first data with the first coding, the first data representing information that does not have a correspondence with the first text of the document.
17. The computer readable medium of claim 15 , further comprising:
(G) before (A), using an automatic speech recognizer to recognize an audio stream representing speech and thereby to produce the first text.
18. The computer readable medium of claim 17 , wherein (B) further comprises associating first data with the first coding, the first data representing information that does not have a correspondence with the audio stream.