Method for Providing an Explanation Dataset for an AI Module, Computer-Readable Storage Medium, Device and System
Explaining the decisions of AI modules to a user is difficult. The invention relates to methods for providing an explanation dataset ( 2 ) for an AI module ( 31 ), the methods comprising: receiving a user dataset ( 20 ) which specifies at least one input dataset ( 21 ) of an AI module ( 31 ), wherein the AI module ( 31 ) is adapted to compute an output dataset ( 3 ) for the input dataset ( 21 ), wherein the user dataset ( 20 ) comprises at least one target specification ( 25 ) which specifies a value of a data item ( 26 ) in an output dataset ( 3 ) of the AI module ( 31 ); loading at least one optimization task ( 16 ) which specifies a specific metric ( 14 ) and/or a similarity metric ( 15 ); computing at least one solution of the at least one optimization task ( 16 ) as an explanation dataset ( 2 ) taking the user dataset ( 20 ) and the AI module ( 31 ) into consideration and applying at least one optimization method ( 17 ), wherein the AI module ( 31 ) is adapted to compute for the explanation dataset ( 2 ) an output dataset ( 3 ) which comprises the data item ( 26 ) specified by the target specification ( 25 ); providing the explanation dataset ( 2 ) for the AI module ( 31 ).
1 . A method for providing an explanation dataset for an AI module, the method comprising:
receiving a user dataset specifying at least one input dataset of an AI module, wherein the AI module is adapted to compute an output dataset for the input dataset using at least one of a regression and a classification, wherein the user dataset comprises at least one target specification specifying a value of a data item in an output dataset of the AI module;
loading at least one optimization task specifying a specific metric and/or a similarity metric;
computing at least one solution of the at least one optimization task as an explanation dataset, based on the user dataset and the AI module, by at least applying at least one optimization method, wherein the AI module is adapted to compute for the explanation dataset an output dataset comprising the data item specified by the target specification; and
providing the explanation dataset for the AI module.
2 . The method of claim 1 , wherein the user dataset comprises at least one constraint for the at least one optimization task, wherein the optimization method computes the at least one optimization task based on the at least one constraint of the user dataset.
3 . The method of claim 2 , wherein the at least one constraint comprises an allowance specification, wherein the allowance specification specifies in which feature categories defined by the input dataset the explanation dataset differs from the input dataset.
4 . The method of claim 2 , wherein the at least one constraint comprises at least one weight, wherein a weight specifies a preference for a change of a feature category of the input dataset in the explanation dataset.
5 . The method of claim 2 , wherein the at least one constraint comprises at least one range specification, wherein the at least one range specification specifies a permitted value range of a feature category of the explanation dataset, wherein the permitted value range includes a maximum and/or minimum permitted deviation from a value in the input dataset.
6 . The method of claim 2 , wherein the explanation dataset comprises a plurality of variations of the input dataset, each satisfying the at least one constraint.
7 . The method of claim 1 , further comprising receiving at least one provider dataset, wherein the provider dataset comprises at least one constraint for the at least one optimization task, and wherein the optimization method computes the at least one optimization task based on the at least one constraint of the provider dataset.
8 . The method of claim 7 , wherein the at least one constraint of the provider dataset specifies an output count, and wherein the output count specifies how many variations of the input dataset are computed and comprised by the explanation dataset.
9 . The method of claim 1 , wherein the at least one optimization method comprises a gradient method and/or a Newton method.
10 . The method of claim 1 , wherein the specific metric is minimal if the target specification matches the data item of the output dataset of the AI module, and wherein the specific metric is formed as cross entropy and/or as mean square deviation.
11 . The method of claim 1 , wherein the similarity metric is adapted as an Lpnorm including an L0, L1 and/or L2 metric.
12 . The method of claim 2 , wherein the optimization task is given by the formula
min
δ
M
sp
(
δ
)
+
λ
M
i
m
(
δ
)
,
wherein M sp specifies the specific metric and M im specifies the similarity metric, and δ is selected from a set of the allowable changes of the input dataset.
13 . The method of claim 1 , further comprising-computing an output dataset using the AI module, wherein the explanation dataset is used as an input dataset of the AI module.
14 . A computer-readable storage medium containing instructions, which when executed by at least one processor, result in operations comprising:
receiving a user dataset specifying at least one input dataset of an AI module, wherein the AI module is adapted to compute an output dataset for the input dataset using at least one of a regression and a classification, wherein the user dataset comprises at least one target specification specifying a value of a data item in an output dataset of the AI module;
loading at least one optimization task specifying a specific metric and/or a similarity metric;
computing at least one solution of the at least one optimization task as an explanation dataset, based on the user dataset and the AI module, by at least applying at least one optimization method, wherein the AI module is adapted to compute for the explanation dataset an output dataset comprising the data item specified by the target specification; and
providing the explanation dataset for the AI module.
15 . A device for providing an explanation dataset, comprising:
a receiving unit adapted to receive a user dataset specifying at least one input dataset of an AI module, wherein the AI module is adapted to compute an output dataset for the input dataset using at least one of a regression and a classification, wherein the user dataset comprises at least one target specification specifying a value of a data item in an output dataset of the AI module;
an optimization unit adapted to load an optimization task specifying a specific metric and/or a similarity metric and further adapted to compute at least one solution of the at least one optimization task as an explanation dataset, based on the user dataset and the AI module, using at least one optimization method, wherein the AI module is adapted to compute for the explanation dataset an output dataset comprising the data item specified by the target specification; and
a providing unit adapted to provide the explanation dataset.
16 . The device of claim 14 , further comprising: an AI unit adapted to compute an output dataset, wherein the explanation dataset is used as an input dataset of the AI module.
17 . A system, comprising:
at least one server unit, comprising the device of claim 15 and a server communication interface; and
at least one client unit having a client communication interface, adapted to send a request to the server communication interface, via a communication network;
wherein the server communication interface is adapted to provide an application programmable interface adapted to receive a user dataset and transmit an explanation dataset.