AI Platform System and Method

1 . A computer-implemented method, executed on a computing device, comprising:

processing a test truth set using a plurality of automated analysis processes to generate a plurality of automated result sets;

determining a process efficacy for each of the plurality of automated analysis processes based, at least in part, upon the test truth set and each of the plurality of automated result sets, thus defining a plurality of process efficacies; and

comparatively rendering the plurality of process efficacies.

2 . The computer-implemented method of claim 1 further comprising:

defining the test truth set from a master truth set.

3 . The computer-implemented method of claim 2 wherein defining the test truth set from a master truth set includes:

enabling a user to define narrowing criteria for the master truth set; and

applying the narrowing criteria to the master truth set to generate the test truth set, wherein the test truth set is a subset of the master truth set.

4 . The computer-implemented method of claim 3 wherein the narrowing criteria concerns one or more of:

content type;

patient type; and

anomaly type.

5 . The computer-implemented method of claim 1 wherein the test truth set includes a plurality of medical images and a plurality of related human-generated reports.

6 . The computer-implemented method of claim 5 wherein the plurality of automated result sets each include a plurality of machine-generated reports.

7 . The computer-implemented method of claim 6 wherein processing a test truth set using a plurality of automated analysis processes to generate a plurality of automated result sets includes:

processing the plurality of medical images using each of the plurality of automated analysis processes to generate the plurality of machine-generated reports included in the plurality of automated result sets, based upon the plurality of medical images.

8 . The computer-implemented method of claim 6 wherein determining a process efficacy for each of the plurality of automated analysis processes based, at least in part, upon the test truth set and each of the plurality of automated result sets, thus defining a plurality of process efficacies includes:

comparing the plurality of related human-generated reports to each of the plurality of machine-generated reports.

9 . The computer-implemented method of claim 1 wherein comparatively rendering the plurality of process efficacies includes:

textually comparatively rendering the plurality of process efficacies.

10 . The computer-implemented method of claim 1 wherein comparatively rendering the plurality of process efficacies includes:

graphically comparatively rendering the plurality of process efficacies.

11 . A computer program product, executed on a computing device, comprising:

processing a test truth set using a plurality of automated analysis processes to generate a plurality of automated result sets;

determining a process efficacy for each of the plurality of automated analysis processes based, at least in part, upon the test truth set and each of the plurality of automated result sets, thus defining a plurality of process efficacies; and

comparatively rendering the plurality of process efficacies.

12 . The computer program product of claim 11 further comprising:

defining the test truth set from a master truth set.

13 . The computer program product of claim 12 wherein defining the test truth set from a master truth set includes:

enabling a user to define narrowing criteria for the master truth set; and

applying the narrowing criteria to the master truth set to generate the test truth set, wherein the test truth set is a subset of the master truth set.

14 . The computer program product of claim 13 wherein the narrowing criteria concerns one or more of:

content type;

patient type; and

anomaly type.

15 . The computer program product of claim 11 wherein the test truth set includes a plurality of medical images and a plurality of related human-generated reports.

16 . The computer program product of claim 15 wherein the plurality of automated result sets each include a plurality of machine-generated reports.

17 . The computer program product of claim 16 wherein processing a test truth set using a plurality of automated analysis processes to generate a plurality of automated result sets includes:

processing the plurality of medical images using each of the plurality of automated analysis processes to generate the plurality of machine-generated reports included in the plurality of automated result sets, based upon the plurality of medical images.

18 . The computer program product of claim 16 wherein determining a process efficacy for each of the plurality of automated analysis processes based, at least in part, upon the test truth set and each of the plurality of automated result sets, thus defining a plurality of process efficacies includes:

comparing the plurality of related human-generated reports to each of the plurality of machine-generated reports.

19 . The computer program product of claim 11 wherein comparatively rendering the plurality of process efficacies includes:

textually comparatively rendering the plurality of process efficacies.

20 . The computer program product of claim 11 wherein comparatively rendering the plurality of process efficacies includes:

graphically comparatively rendering the plurality of process efficacies.

21 . A computing system, executed on a computing device, comprising:

processing a test truth set using a plurality of automated analysis processes to generate a plurality of automated result sets;

determining a process efficacy for each of the plurality of automated analysis processes based, at least in part, upon the test truth set and each of the plurality of automated result sets, thus defining a plurality of process efficacies; and

comparatively rendering the plurality of process efficacies.

22 . The computing system of claim 21 further comprising:

defining the test truth set from a master truth set.

23 . The computing system of claim 22 wherein defining the test truth set from a master truth set includes:

enabling a user to define narrowing criteria for the master truth set; and

applying the narrowing criteria to the master truth set to generate the test truth set, wherein the test truth set is a subset of the master truth set.

24 . The computing system of claim 23 wherein the narrowing criteria concerns one or more of:

content type;

patient type; and

anomaly type.

25 . The computing system of claim 21 wherein the test truth set includes a plurality of medical images and a plurality of related human-generated reports.

26 . The computing system of claim 25 wherein the plurality of automated result sets each include a plurality of machine-generated reports.

27 . The computing system of claim 26 wherein processing a test truth set using a plurality of automated analysis processes to generate a plurality of automated result sets includes:

processing the plurality of medical images using each of the plurality of automated analysis processes to generate the plurality of machine-generated reports included in the plurality of automated result sets, based upon the plurality of medical images.

28 . The computing system of claim 26 wherein determining a process efficacy for each of the plurality of automated analysis processes based, at least in part, upon the test truth set and each of the plurality of automated result sets, thus defining a plurality of process efficacies includes:

comparing the plurality of related human-generated reports to each of the plurality of machine-generated reports.

29 . The computing system of claim 21 wherein comparatively rendering the plurality of process efficacies includes:

textually comparatively rendering the plurality of process efficacies.

30 . The computer-implemented method of claim 21 wherein comparatively rendering the plurality of process efficacies includes:

graphically comparatively rendering the plurality of process efficacies.