Augmented Intelligence System Robustness Assessment Engine
A method, system and computer-readable storage medium for performing a cognitive information processing operation. The cognitive information processing operation includes: receiving data from a plurality of data sources; processing the data from the plurality of data sources to provide cognitively processed insights via an augmented intelligence system, the augmented intelligence system executing on a hardware processor of an information processing system, the augmented intelligence system and the information processing system providing a cognitive computing function; performing a robustness assessment operation via a robustness assessment engine, the robustness assessment operation assessing robustness of the cognitive computing function; and, providing the cognitively processed insights to a destination, the destination comprising a cognitive application, the cognitive application enabling a user to interact with the cognitive insights.
1 . A computer-implementable method for cognitive information processing, comprising:
receiving data from a plurality of data sources;
processing the data from the plurality of data sources to provide cognitively processed insights via an augmented intelligence system, the augmented intelligence system executing on a hardware processor of an information processing system, the augmented intelligence system and the information processing system providing a cognitive computing function;
performing a robustness assessment operation via a robustness assessment engine, the robustness assessment operation assessing robustness of the cognitive computing function; and,
providing the cognitively processed insights to a destination, the destination comprising a cognitive application, the cognitive application enabling a user to interact with the cognitive insights.
2 . The method of claim 1 , wherein:
the robustness assessment engine is implemented within augmented intelligence system, the augmented intelligence system comprising a cognitive process foundation.
3 . The method of claim 2 , wherein:
the cognitive process foundation performs an augmented intelligence assurance operation.
4 . The method of claim 1 , wherein:
the robustness assessment operation includes generating a robustness score for the cognitive computing function.
5 . The method of claim 1 , wherein:
the robustness assessment engine receives a plurality of counterfactuals; and,
the robustness assessment operation determines a distance between a subject data point and the plurality of counterfactuals.
6 . The method of claim 1 , wherein:
the cognitive computing function is performed using an opaque model.
7 . A system comprising:
a hardware processor;
a data bus coupled to the hardware processor; and
a non-transitory, computer-readable storage medium embodying computer program code, the non-transitory, computer-readable storage medium being coupled to the data bus, the computer program code interacting with a plurality of computer operations and comprising instructions executable by the hardware processor and configured for:
receiving data from a plurality of data sources;
processing the data from the plurality of data sources to provide cognitively processed insights via an augmented intelligence system, the augmented intelligence system executing on a hardware processor of an information processing system, the augmented intelligence system and the information processing system providing a cognitive computing function;
performing a robustness assessment operation via a robustness assessment engine, the robustness assessment operation assessing robustness of the cognitive computing function; and,
providing the cognitively processed insights to a destination, the destination comprising a cognitive application, the cognitive application enabling a user to interact with the cognitive insights.
8 . The system of claim 7 , wherein:
the robustness assessment engine is implemented within augmented intelligence system, the augmented intelligence system comprising a cognitive process foundation.
9 . The system of claim 8 , wherein:
the cognitive process foundation performs an augmented intelligence assurance operation.
10 . The system of claim 7 , wherein:
the robustness assessment operation includes generating a robustness score for the cognitive computing function.
11 . The system of claim 10 , wherein:
the robustness assessment engine receives a plurality of counterfactuals; and,
the robustness assessment operation determines a distance between a subject data point and the plurality of counterfactuals.
12 . The system of claim 7 , wherein:
the cognitive computing function is performed using an opaque model.
13 . A non-transitory, computer-readable storage medium embodying computer program code, the computer program code comprising computer executable instructions configured for:
receiving data from a plurality of data sources;
processing the data from the plurality of data sources to provide cognitively processed insights via an augmented intelligence system, the augmented intelligence system executing on a hardware processor of an information processing system, the augmented intelligence system and the information processing system providing a cognitive computing function;
performing a robustness assessment operation via a robustness assessment engine, the robustness assessment operation assessing robustness of the cognitive computing function; and,
providing the cognitively processed insights to a destination, the destination comprising a cognitive application, the cognitive application enabling a user to interact with the cognitive insights.
14 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the robustness assessment engine is implemented within augmented intelligence system, the augmented intelligence system comprising a cognitive process foundation.
15 . The non-transitory, computer-readable storage medium of claim 14 , wherein:
the cognitive process foundation performs an augmented intelligence assurance operation.
16 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the robustness assessment operation includes generating a robustness score for the cognitive computing function.
17 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the robustness assessment engine receives a plurality of counterfactuals; and,
the robustness assessment operation determines a distance between a subject data point and the plurality of counterfactuals.
18 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the cognitive computing function is performed using an opaque model.
19 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the computer executable instructions are deployable to a client system from a server system at a remote location.
20 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the computer executable instructions are provided by a service provider to a user on an on-demand basis.