Machine learning device, laminated core manufacturing apparatus, laminated core manufacturing system, and machine learning method for learning operation for stacking core sheets
A machine learning device which learns an operation of a laminated core manufacturing apparatus for stacking a plurality of core sheets to manufacture a laminated core, wherein the machine learning device includes a state observation unit which observes states of the core sheets and the laminated core manufacturing apparatus; and a learning unit which updates a manipulated variable for stacking the core sheets, on the basis of a state variable observed by the state observation unit.
1. A laminated core manufacturing apparatus, comprising:
a robot having a hand portion configured to stack core sheets having a predetermined shape one by one or in groups of at least two core sheets to manufacture a laminated core; and
a robot vision system attached to the hand portion, wherein
the laminated core manufacturing apparatus is configured to manufacture the laminated core by stacking the core sheets based on
(1) shape data of the core sheets detected by the robot vision system,
(2) operation data of the laminated core manufacturing apparatus, and
(3) time data for stacking the core sheets.
2. The laminated core manufacturing apparatus according to claim 1 , further comprising:
a machine learning device configured to learn an operation of the laminated core manufacturing apparatus,
the machine learning device comprising:
a state observation unit configured to observe states of the core sheets and the laminated core manufacturing apparatus; and
a learning unit configured to update a manipulated variable for stacking the core sheets, on the basis of a state variable observed by the state observation unit, the state variable representing (1) the shape data of the core sheets, (2) the operation data of the laminated core manufacturing apparatus, and (3) the time data for stacking the core sheets.
3. A laminated core manufacturing system comprising a plurality of laminated core manufacturing apparatuses according to claim 2 , wherein
the machine learning device is mounted in each of the laminated core manufacturing apparatuses, and
the plurality of machine learning devices mounted in the plurality of laminated core manufacturing apparatuses, respectively, are configured to share or exchange data with one another via a communication medium.
4. A laminated core manufacturing system comprising a plurality of laminated core manufacturing apparatuses according to claim 2 , wherein
the machine learning device of at least one of the plurality of laminated core manufacturing apparatuses is located on a cloud server.
5. A machine learning method of learning an operation of a laminated core manufacturing apparatus for stacking a plurality of core sheets to manufacture a laminated core, the method comprising:
observing states of the core sheets and the laminated core manufacturing apparatus; and
updating a manipulated variable for stacking the core sheets, on the basis of a state variable obtained in the observing, the state variable representing
(1) shape data of the core sheets,
(2) operation data of the laminated core manufacturing apparatus, and
(3) time data for stacking the core sheets,
wherein
the laminated core manufacturing apparatus comprises a robot comprising a robot vision system attached to one of a hand portion and an area which provides a broad view of a workspace, and
in said observing, the shape data of the core sheets are received from the robot vision system.
6. A machine learning device for learning an operation of a laminated core manufacturing apparatus for stacking a plurality of core sheets to manufacture a laminated core, wherein the machine learning device comprises:
a state observation unit configured to observe states of the core sheets and the laminated core manufacturing apparatus; and
a learning unit configured to update a manipulated variable for stacking the core sheets, on the basis of a state variable observed by the state observation unit, the state variable representing
(1) shape data of the core sheets,
(2) operation data of the laminated core manufacturing apparatus, and
(3) time data for stacking the core sheets,
wherein
the laminated core manufacturing apparatus comprises a robot comprising a robot vision system attached to one of a hand portion and an area which provides a broad view of a workspace, and
the state observation unit is configured to receive the shape data of the core sheets from the robot vision system.
7. The machine learning device according to claim 6 , wherein
the laminated core manufacturing apparatus further comprises a robot control unit configured to issue a command of one of a displacement and an angle of the hand portion to control an operation of the robot, and
the state observation unit is configured to receive from the robot control unit, the operation data of the laminated core manufacturing apparatus, and the time data for stacking the core sheets.
8. The machine learning device according to claim 7 , wherein the state observation unit is configured to obtain a velocity gain and a position gain of the hand portion output from the robot control unit and the time data for stacking the core sheets.
9. The machine learning device according to claim 6 , further comprising:
a decision unit configured to decide an operation of the laminated core manufacturing apparatus by referring to the manipulated variable learned by the learning unit.
10. The machine learning device according to claim 6 , wherein the learning unit comprises:
a reward computation unit configured to compute a reward on the basis of output from the state observation unit; and
a value function update unit configured to update a value function for determining a value of the operation for stacking the core sheets to manufacture a laminated core, in accordance with the reward on the basis of outputs from the state observation unit and the reward computation unit.
11. The machine learning device according to claim 6 , wherein the learning unit comprises:
an error computation unit configured to compute an error on the basis of output from the state observation unit and input teacher data; and
an error model update unit configured to update an error model for determining an error of the operation for stacking the core sheets to manufacture a laminated core, on the basis of outputs from the state observation unit and the error computation unit.
12. The machine learning device according to claim 6 , wherein the machine learning device further comprises a neural network.