Overlay Of Findings On Image Data

1 . One or more non-transitory computer readable media embodying a program of instructions executable by machine to perform operations for processing image data, the operations comprising:

extracting one or more findings from a radiology report by performing a Natural Language Processing technique, wherein the one or more extracted findings are represented as one or more tuples;

detecting one or more anatomical landmarks in image data corresponding to the radiology report;

correlating the one or more tuples to the one or more anatomical landmarks; and

overlaying the one or more extracted findings with the correlated one or more anatomical landmarks on the image data.

2 . The one or more non-transitory computer readable media of claim 1 , wherein performing the Natural Language Processing technique comprises performing machine learning.

3 . The one or more non-transitory computer readable media of claim 1 , wherein extracting the one or more findings from the radiology report comprises:

chunking text in the radiology report into one or more sentences, and

finding anatomical, disease and pathological terms and their modifiers in the one or more sentences.

4 . The one or more non-transitory computer readable media of claim 1 , wherein at least one of the one or more tuples comprises an ordered list of elements including an anatomical region of interest, a disease or pathology, a morphology, a severity, an etiology, a location, a description modifier, or a combination thereof.

5 . A system comprising:

a non-transitory memory device for storing computer readable program code; and

a processor in communication with the memory device, the processor being operative with the computer readable program code to perform operations including

receiving a radiology report and corresponding image data,

extracting one or more findings from the radiology report,

detecting one or more anatomical landmarks in the image data,

correlating the one or more extracted findings to the one or more anatomical landmarks, and

overlaying the one or more extracted findings with the correlated one or more anatomical landmarks on the image data.

6 . The system of claim 5 wherein the findings comprise anatomical, disease and pathological terms associated with one or more anatomical regions.

7 . The system of claim 5 wherein the processor is operative with the computer readable program code to extract the one or more findings by performing a Natural Language Processing technique to analyze text in the radiology report.

8 . The system of claim 7 wherein the processor is operative with the computer readable program code to perform the Natural Language Processing technique by performing machine learning.

9 . The system of claim 5 wherein the processor is operative with the computer readable program code to extract the one or more findings by

chunking text in the radiology report into one or more sentences, and

finding anatomical, disease and pathological terms in the one or more sentences.

10 . The system of claim 9 wherein the processor is operative with the computer readable program code to find the anatomical, disease and pathological terms by matching the anatomical, disease and pathological terms with terms in predefined anatomy, disease and pathology dictionaries.

11 . The system of claim 5 wherein the processor is operative with the computer readable program code to represent at least one of the one or more extracted findings as a tuple.

12 . The system of claim 11 wherein the tuple comprises an ordered list of an anatomical term and one or more disease and pathological terms.

13 . The system of claim 12 wherein the one or more disease and pathological terms comprise a disease or pathology, a morphology, a severity, an etiology, a location, a description modifier, or a combination thereof.

14 . The system of claim 5 wherein the processor is operative with the computer readable program code to further assign one or more weights to the one or more extracted findings in accordance with importance or severity.

15 . The system of claim 14 wherein the processor is operative with the computer readable program code to assign zero weight to at least one of the one or more extracted findings in response to detecting a negation of existence of disease in the extracted finding.

16 . The system of claim 14 wherein the processor is operative with the computer readable program code to overlay the one or more extracted findings that are weighted above a predetermined threshold with the correlated one or more anatomical landmarks on the image data.

17 . The system of claim 5 wherein the processor is operative with the computer readable program code to correlate the one or more extracted findings to the one or more anatomical landmarks using one or more predefined rules.

18 . The system of claim 5 , wherein the processor is operative with the computer readable program code to correlate the one or more extracted findings to the one or more anatomical landmarks by

performing a word clustering technique to partition sets of words into clusters of semantically similar words, and

correlating a first term in the one or more extracted findings with a second term describing the one or more anatomical landmarks in response to the first and second terms being grouped into a same word cluster.

19 . A method, comprising:

receiving a radiology report and corresponding image data;

extracting one or more findings from the radiology report;

detecting one or more anatomical landmarks in the image data;

correlating the one or more extracted findings to the one or more anatomical landmarks; and

overlaying the one or more extracted findings with the correlated one or more anatomical landmarks on the image data.

20 . The method of claim 19 wherein extracting the one or more findings from the radiology report comprises performing a Natural Language Processing technique.