IP Library › Granted Patent US 12,243,211
Granted Patent B2
US 12,243,211 · App. 17/460,155 · Granted Mar 4, 2025

Method to train a neural network to detect a tool status from images, method of machining and/or manufacturing, and installation

Inventors: Benjamin Samuel Lutz (Munich, DE); Daniel Regulin (Munich, DE)
Assignee: Siemens Aktiengesellschaft
G06T7/0004G05B19/4065G06N3/08G06T2207/10056G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,211
App. No.
17/460,155
Granted
Mar 4, 2025
Kind
B2
Abstract

In a method for training a neural network to recognize a tool condition based on image data, the neural network is trained to recognize the tool condition of a first tool type, and image data of a second tool type is applied. The image data is subjected to image processing. Via this, the image data of the second tool type is converted into image data of the first tool type. The neural network is trained based on the converted image data. In a method for machining and/or production via the first tool type, the tool condition of the first tool type is recognized via a neural network that is trained in accordance with such a method.

Claims (24)

1. A method for training a neural network to recognize a machining tool condition based on image data, the method comprising:

training the neural network to recognize the machining tool condition of a first tool type; and

applying image data of a second tool type, the applied image data being subjected to image processing, via which the image data of the second tool type is converted into image data of the first tool type,

wherein the neural network is trained based on the converted image data,

wherein the image data of the second tool type is converted such that a shape of the second tool type is converted into a shape of the first tool type, and

wherein the image data of the second tool type is assigned a respective machining tool condition that is applied in each case jointly with the image data of the second tool type to train the neural network.

2. The method of claim 1 , wherein the image data of the second tool type is converted such that a color of the second tool type is converted into a color of the first tool type.

3. The method of claim 1 , wherein the first tool type, the second tool type, or the first tool type and the second tool type are configured for subtractive machining of a workpiece.

4. The method of claim 3 , wherein the first tool type, the second tool type, or the first tool type and the second tool type form a cutting tool, a milling tool, or a cutting and milling tool.

5. The method of claim 1 , wherein the image data of the second tool type arises from optical imaging.

6. The method of claim 5 , wherein the optical imaging comprises optical imaging using a camera.

7. The method of claim 6 , wherein the optical imaging comprises optical imaging using a microscope camera.

8. The method of claim 1 , wherein the machining tool condition is a wear condition.

9. The method of claim 1 , wherein the image data of the second tool type is converted by modifying color channels, compressing, stretching image data, splitting image data and putting the image data back together differently, or any combination thereof.

10. The method of claim 9 , wherein the image data of the second tool type is converted by splitting image data and putting the image data back together with a different position, orientation, compression, stretching, or any combination thereof.

11. A machining, production, or machining and production method that is performed via a first tool type, the machining, production, or machining and production method comprising:

recognizing a machining tool condition of the first tool type by a neural network that is trained to recognize the machining tool condition of the first tool type, the training of the neural network comprising applying image data of a second tool type, the applied image data being subjected to image processing, via which the image data of the second tool type is converted into image data of the first tool type, the neural network being trained based on the converted image data,

wherein the image data of the second tool type is converted such that a shape of the second tool type is converted into a shape of the first tool type, and

wherein the image data of the second tool type is assigned a respective machining tool condition that is applied in each case jointly with the image data of the second tool type to train the neural network.

12. A system for machining, production, or machining and production via a first tool type, the system comprising:

a processor configured to use a neural network that is trained to recognize a machining tool condition based on image data, the neural network being trained to recognize the machining tool condition of the first tool type, the training of the neural network further including application of image data of a second tool type, the applied image data being subjected to image processing, via which the image data of the second tool type is converted into image data of the first tool type,

wherein the neural network is trained based on the converted image data,

wherein the image data of the second tool type is converted such that a shape of the second tool type is converted into a shape of the first tool type, and

wherein the image data of the second tool type is assigned a respective machining tool condition that is applied in each case jointly with the image data of the second tool type to train the neural network.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2022
From: LUTZ, BENJAMIN SAMUEL; REGULIN, DANIEL
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 060037/0073 →
Priority Claims (1)
EP 20193430 · Aug 28, 2020 · regional
Continuity (1)
Related Publication 20220067913A1 · Mar 3, 2022
References Cited (16)
US 8781982B1 · Das · 2014 [cited by examiner]
US 20060067573A1 · Parr · 2006 [cited by examiner]
US 20170344860A1 · Sachs · 2017 [cited by examiner]
US 20180073303A1 · Bilen · 2018 [cited by examiner]
US 20190147320A1 · Mattyus · 2019 [cited by examiner]
US 20210183027A1 · Duan · 2021 [cited by examiner]
US 20230129992A1 · Inagaki · 2023 [cited by examiner]
US 20230360192A1 · Lutz · 2023 [cited by examiner]
CA 3002198A · 2018 [cited by applicant]
EP 3399466A1 · 2018 [cited by applicant]
GB 2578771A · 2020 [cited by applicant]
JP H11267649A · 1999 [cited by applicant]
JP H11267949A · 1999 [cited by applicant]
European Search Report for European Application No. 20193430.4-1216 dated Feb. 18, 2021. [cited by applicant]
“Research on Techniques of cutting tool wear condition monitoring Based on Geometrical Shape and Texture Analysis of Tool Wear Images” Feb. 2, 2012, pp. 1-79, with English abstract. [cited by applicant]
D'Addona, Doriana M., Amm Sharif Ullah, and Davide Matarazzo. “Tool-wear prediction and pattern-recognition using artificial neural network and DNA-based computing.” Journal of Intelligent Manufacturing 28 (2017): 1285-… [cited by applicant]