Production system that sets determination value of variable relating to abnormality of product

1. A production system comprising:

a manufacturing machine that manufactures a product made of a plurality of components;

a machine state detector that detects a state of the manufacturing machine;

an environment state detector that detects an environment state around the manufacturing machine;

an inspection device that inspects the product manufactured by the manufacturing machine; and

a manufacturing management apparatus that is connected to a control apparatus of the manufacturing machine and a control apparatus of the inspection device, wherein

the manufacturing management apparatus includes:

a memory that stores data on the state of the manufacturing machine, data on the environment state, and data on an inspection result of the product;

a processor configured to access the memory to:

select a variable relating to an occurrence of an abnormality, wherein the selected variable is based on a correlation between the inspection result of the product, and the data on the state of the manufacturing machine and the data on the environment state when the abnormality occurs in the inspection result, wherein the variable is among a plurality of variables relating to the state of the manufacturing machine and to the environment state;

set an initial determination value of the selected variable relating to the abnormality;

update the initial determination value by reinforcement learning;

obtain the data on the state of the manufacturing machine, the data on the environment state, and the inspection results of the product corresponding to the abnormality;

set a reward for calculating an action value when the initial determination value is set based on the obtained data on the state of the manufacturing machine, data on the environment state, and the inspection result of the product;

update an action evaluation function of an action value table based on the obtained data and the set reward; and

set a new determination value of the selected variable based on the updated action evaluation function.

2. The production system according to claim 1 , further comprising:

an external memory that is connected to the processor of the manufacturing management apparatus via a network, wherein

the external memory is configured so as to be capable of storing another data different from the data on the state of the manufacturing machine, the data on the environment state, and the data on the inspection result of the product, and

the processor is further configured to set the initial determination value of the variable based on the another data.