IP Library Granted Patent US 10,922,510
Granted Patent B2
US 10,922,510 · App. 16/388,503 · Granted Feb 16, 2021

Method, automation system and computer system for detecting optical codes

Inventors: Marko Tscherepanow (Verl, DE); Robin Vogt (Verl, DE); Benjamin Jurke (Gütersloh, DE)
Assignee: Beckhoff Automation GmbH
G06K7/1443G06K7/1417G06K7/1456G06N3/08G06T7/73
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,922,510
App. No.
16/388,503
Granted
Feb 16, 2021
Kind
B2
Abstract

A method for detecting optical codes comprises an input image being provided. Optical codes in the input image are detected by generating an output image on the basis of the input image. Within generating the output image, pixels of an area of the input image comprising a part of an optical code are assigned a first intensity in the output image. Within generating the output image, pixels of an area of the input image e.g. comprising no part of an optical code are assigned a second intensity in the output image. Regions of the output image with the first intensity are provided for determining properties of the detected optical codes.

Claims (14)

1. A method for detecting optical codes, the method comprising the following: providing an input image; detecting one or more optical codes in the input image by generating an output image on the basis of the input image; wherein within a framework of generating the output image, pixels of an area of the input image comprising a part of an optical code are assigned a first intensity in the output image; wherein within the framework of generating the output image, pixels of an area of the input image comprising no part of the optical code are assigned a second intensity in the output image; and providing regions of the output image with the first intensity for determining properties of the detected optical codes.

2. The method according to claim 1 , wherein generating the output image is carried out by a first neural network, or a deep, trained, convolutional first neural network.

3. The method according to claim 2 , wherein providing the input image comprises adjusting the input image; and wherein adjusting the input image is carried out in such way that the adjusted input image comprises a size compatible with a size of a first input layer of the first neural network or the deep, trained, convolutional first neural network.

4. The method according to claim 1 , wherein for determining the properties of the detected optical codes, a determination of positions of detected optical codes is carried out; and wherein determining the positions of the detected optical codes is carried out by assigning enclosing rectangles, outer contours and/or geometrical centers to the regions of the output image assigned with the first intensity.

5. The method according to claim 4 , wherein assigning the enclosing rectangles, outer contours and/or geometrical centers is carried out by blob detection, morphological operators and/or a binarization of the output image in combination with contour tracking.

6. The method according to claim 4 , wherein determining the positions of the detected optical codes comprises transforming the enclosing rectangles, the outer contours and/or the geometrical centers to correspond to the input image.

7. The method according to claim 4 , wherein for determining the properties of detected optical codes an extraction of code images is carried out on the basis of the determined positions of the detected optical codes and determining orientations and/or categories of the detected optical codes is carried out on the basis of code images.

8. The method according to claim 7 , wherein determining orientations and/or categories of the detected optical codes is carried out by a second neural network, or a deep, trained, convolutional second neural network.

9. The method according to claim 8 , wherein the extraction of the code images comprises adjusting the code images; and wherein adjusting the code images is carried out in such a way that the adjusted code images each comprise a size compatible with a size of a second input layer of the second neural network or the deep, trained, convolutional second neural network.

10. The method according to claim 7 , wherein determining orientations and/or categories of the detected optical codes comprises extracting general features by a third neural network, or by an auto-encoder, and a regression and/or classification.

11. The method according to claim 10 , wherein a characteristic of the extracted general features is examined for novelty by a novelty detector.

12. The method according to claim 1 , wherein for determining the properties of the detected optical codes information stored in the detected optical codes is read out.

13. The method according to claim 1 , wherein determining a property of one single optical code of the detected optical codes, determining a plurality of properties of one single optical code of the detected optical codes, determining a property of a plurality of the detected optical codes, and/or determining a plurality of properties of a plurality of the detected optical codes is carried out in parallel.

14. A non-transitory, computer readable data storage medium having computer program code stored thereon, the computer program code comprising commands that, when executing the computer program code on a computer, cause said computer to carry out a method for detecting optical codes, the method comprising: providing an input image; detecting one or more optical codes in the input image by generating an output image on the basis of the input image; wherein within a framework of generating the output image pixels of an area of the input image comprising a part of an optical code are assigned a first intensity in the output image; wherein within the framework of generating the output image pixels of an area of the input image comprising no part of the optical code are assigned a second intensity in the output image; and providing regions of the output image with the first intensity for determining properties of the detected optical codes.

Assignments (2)
CHANGE OF ASSIGNEE ADDRESS Recorded Nov 19, 2019
From: BECKHOFF AUTOMATION GMBH
To: BECKHOFF AUTOMATION GMBH
Reel/Frame 051057/0632 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2019
From: TSCHEREPANOW, MARKO; JURKE, BENJAMIN; VOGT, ROBIN
To: BECKHOFF AUTOMATION GMBH
Reel/Frame 049263/0944 →
Priority Claims (1)
DE 10 2018 109 392 · Apr 19, 2018 · national
Continuity (1)
Related Publication 20190325183A1 · Oct 24, 2019
Cited By (4)
US 12,367,393 US 12,380,599 US 12,412,072 US 12,476,787