SECURE GLOBAL MODEL CALCULATION APPARATUS, LOCAL MODEL REGISTERING METHOD, AND PROGRAM
A technique for efficiently registering local models in a local model management table used when a global model is computed from local models in federated learning is provided. A secure global model computation device in a federated learning system including M local model training devices for training local models using training data and a secure global model computation system composed of N secure global model computation devices for secure computation of a global model from M local models includes a parameter share registration unit that receives shares of parameters of an m-th local model trained by an m-th local model training device (where m satisfies 1≤m≤M)) as an input and register the shares of the parameters of the m-th local model in a local model management table using K records having a set (m, k) of identifiers and shares of parameters of a k-th layer (1≤k≤K) of the m-th local model as one record.
1 . A secure global model computation device in a federated learning system including M local model training devices for training local models using training data and a secure global model computation system composed of N secure global model computation devices for secure computation of a global model from M local models,
wherein M and K are integers of 2 or more and N is an integer of 3 or more, a local model is defined as a neural network composed of K layers, and a local model management table is defined as a table including an attribute having a set (m, k) (1≤m≤M, 1≤k≤K) of an identifier m for identifying a local model and an identifier k for identifying a layer as an attribute value and an attribute having shares of parameters of the local model as an attribute value, the secure global model computation device comprising:
a transmission/reception circuitry configured to receive shares of parameters of a local model (hereinafter referred to as an m-th local model) trained by one local model training device (hereinafter referred to as an m-th local model training device (where m satisfies 1≤m≤M)) among the M local model training devices; and
a parameter share registration circuitry configured to register the shares of the parameters of the m-th local model in a local model management table using K records having a set (m, k) of identifiers and shares of parameters of a k-th layer (1≤k≤K) of the m-th local model as one record.
2 . A secure global model computation device in a federated learning system including M local model training devices for training local models using training data and a secure global model computation system composed of N secure global model computation devices for secure computation of a global model from M local models,
wherein M and K are integers of 2 or more and N is an integer of 3 or more, a local model is defined as a model represented using K vectors, and a local model management table is defined as a table including an attribute having a set (m, k) (1≤m≤M, 1≤k≤K) of an identifier m for identifying a local model and an identifier k for identifying a vector constituting the local model as an attribute value and an attribute having shares of parameters of the local model as an attribute value, the secure global model computation device comprising:
a transmission/reception circuitry configured to receive shares of parameters of a local model (hereinafter referred to as an m-th local model) trained by one local model training device (hereinafter referred to as an m-th local model training device (where m satisfies 1≤m≤M)) among the M local model training devices; and
a parameter share registration circuitry configured to register the shares of the parameters of the m-th local model in a local model management table using K records having a set (m, k) of identifiers and shares of parameters included in a k-th vector (1≤k≤K) of the m-th local model as one record.
3 . A local model registration method,
wherein M and K are integers of 2 or more and N is an integer of 3 or more, a local model is defined as a neural network composed of K layers, and a local model management table is defined as a table including an attribute having a set (m, k) (1≤m≤M, 1≤k≤K) of an identifier m for identifying a local model and an identifier k for identifying a layer as an attribute value and an attribute having shares of parameters of the local model as an attribute value,
the local model registration method comprising:
a transmission/reception step in which a secure global model computation device in a federated learning system including M local model training devices for training local models using training data and a secure global model computation system composed of N secure global model computation devices for secure computation of a global model from M local models receives shares of parameters of a local model (hereinafter referred to as an m-th local model) trained by one local model training device (hereinafter referred to as an m-th local model training device (where m satisfies 1≤m≤M)) among the M local model training devices; and
a parameter share registration step in which the secure global model computation device registers the shares of the parameters of the m-th local model in a local model management table using K records having a set (m, k) of identifiers and shares of parameters of a k-th layer (1≤k≤K) of the m-th local model as one record.
4 . A local model registration method,
wherein M and K are integers of 2 or more and Nis an integer of 3 or more, a local model is defined as a model represented using K vectors, and a local model management table is defined as a table including an attribute having a set (m, k) (1≤m≤M, 1≤k≤K) of an identifier m for identifying a local model and an identifier k for identifying a vector constituting the local model as an attribute value and an attribute having shares of parameters of the local model as an attribute value,
the local model registration method comprising:
a transmission/reception step in which a secure global model computation device in a federated learning system including M local model training devices for training local models using training data and a secure global model computation system composed of N secure global model computation devices for secure computation of a global model from M local models receives shares of parameters of a local model (hereinafter referred to as an m-th local model) trained by one local model training device (hereinafter referred to as an m-th local model training device (where m satisfies 1≤m≤M)) among the M local model training devices; and
a parameter share registration step in which the secure global model computation device registers the shares of the parameters of the m-th local model in a local model management table using K records having a set (m, k) of identifiers and shares of parameters included in a k-th vector (1<k≤K) of the m-th local model as one record.
5 . A non-transitory computer-readable storage medium which stores a program for causing a computer to function as the secure global model computation device according to claim 1 .
6 . A non-transitory computer-readable storage medium which stores a program for causing a computer to function as the secure global model computation device according to claim 2 .