IP Library Granted Patent US 11,908,122
Granted Patent B2
US 11,908,122 · App. 16/939,939 · Granted Feb 20, 2024

System and method for performing production line product identification

Inventor: David J. Kotula (Maple Plain, MN)
Assignee: Sensors Incorporated
G06T7/0004G06F18/22G06K7/10445G06K7/10722G06K7/10861G06K7/1413G06T7/0002G06V10/75G06V20/52G06V20/64G06V30/242G06T2207/10024G06T2207/30128G06T2207/30164G06T2207/30168G06V20/68
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,908,122
App. No.
16/939,939
Granted
Feb 20, 2024
Kind
B2
Abstract

In an illustrative embodiment, a system for identifying products on a production line includes image capturing devices that acquire images of containers moving along a production line at an inspection location. The system also includes a rejection device and a controller that configures the image capturing devices for image acquisition based on properties of the containers, identifies a product associated with each of the containers based on a portion of a product identification code and a portion of additional features detected in the images, and determines whether the identified product matches predetermined properties or characteristics, resulting in a pass result, otherwise a non-pass result occurs. When a non-pass result occurs, the controller outputs a signal to actuate the rejection device that removes the container from the production line.

Claims (40)

1. A system for processing containers on a production line, the system comprising:

a plurality of image acquisition devices positioned proximate to an inspection location on a production line, each of the plurality of image acquisition devices adapted to capture a plurality of images of a plurality of containers transiting across the production line; and

a control device electronically coupled to the plurality of image acquisition devices, the control device including

a data storage region for storing packaging pattern data associated with a plurality of products processed on the production line,

wherein a portion of the packaging pattern data includes one or more groupings of product pattern data, wherein each of the one or more groupings of product pattern data includes a plurality of product patterns associated with a respective product of the plurality of products, and

one or more processors configured to, for each respective container of the plurality of containers transiting across the production line,

identify, from the plurality of images captured by the plurality of image acquisition devices, one or more images of the plurality of images containing features of a product of the plurality of products portrayed on the respective container,

extract, from the one or more images, the features of the product portrayed on the respective container,

determine, from the extracted features in each respective image of the one or more images, a quality score of the respective image, wherein the quality score indicates a suitability of the respective image for positively identifying the product,

identify, based on analysis of respective extracted features of an image of the one or more images having a highest quality score of the determined quality scores, a respective product grouping of the one or more groupings of product pattern data for the respective container based on a correspondence between the extracted features of the image having the highest quality score and respective pattern data from the respective product grouping,

determine, based on the respective product grouping associated with the respective container, whether a match condition exists between the product associated with the respective container and a predetermined product of the plurality of products, and

cause actuation, responsive to failing to identify the match condition, of a rejection device to remove the respective container from the production line.

2. The system of claim 1 , wherein each of the one or more groupings of product pattern data is associated with an identification code for one of the plurality of products.

3. The system of claim 1 , wherein each of the one or more groupings of product pattern data is associated with a recipe for one of the plurality of products.

4. The system of claim 1 , wherein the quality score for the respective image provides an indication of a quantity of the extracted features of the product detected in the respective image.

5. The system of claim 1 , wherein the extracted features include at least one an identification code, brand logos, product logos, ingredient lists, nutrition information, or container quantity information.

6. The system of claim 1 , wherein a product pattern of the plurality of product patterns associated with a respective pattern grouping of the one or more groupings of product pattern data includes at least one of a brand logo, a product logo, a product picture, nutrition information, an ingredient list, or a background color scheme.

7. The system of claim 6 , wherein a portion of the plurality of product patterns in a respective pattern grouping of the one or more groupings of product pattern data is associated with a holiday pattern scheme.

8. The system of claim 1 , wherein a portion of the plurality of product patterns in a respective pattern grouping of the one or more groupings of product pattern data is associated with one or more differing package shapes.

9. The system of claim 8 , wherein a first product pattern of the plurality of product patterns in the respective pattern grouping is associated with a cylindrical package shape.

10. The system of claim 9 , wherein a second product pattern of the plurality of product patterns in the respective pattern grouping is associated with a rectangular box package shape.

11. A method comprising:

capturing, with a plurality of image acquisition devices, a plurality of images of a plurality of containers transiting past an inspection location on a production line;

for each respective container of the plurality of containers transiting past the inspection location on the production line,

identifying, by a controller communicatively coupled to the plurality of image acquisition devices from the plurality of images, one or more images of the plurality of images containing features of a product of a plurality of products portrayed on the respective container;

extracting, by the controller from the one or more images, the features of the product portrayed on the respective container;

determining, by the controller from the extracted features in each of the one or more images, a quality score of the respective image, wherein the quality score indicates a suitability of the respective image for positively identifying the product;

identifying, by the controller based on analysis of respective extracted features of an image of the one or more images having a highest quality score of the determined quality scores, a respective product grouping of one or more groupings of pattern data for the respective container based on a correspondence between the extracted features of the image having the highest quality score and respective pattern data from the respective product grouping,

wherein packaging pattern data for the one or more groupings of pattern data associated with the plurality of products processed on the production line are stored in a data storage region of the controller;

determining, by the controller based on the respective product grouping associated with the respective container, whether a match condition exists between the product associated with the respective container and a predetermined product of the plurality of products, and

causing actuation, by the controller responsive to failing to identify the match condition, of a rejection device to remove the respective container from the production line.

12. The method of claim 11 , wherein each of the one or more groupings of pattern data is associated with an identification code for one of the plurality of products.

13. The method of claim 11 , wherein each of the one or more groupings of pattern data is associated with a recipe for one of the plurality of products.

14. The method of claim 11 , wherein the quality score for the respective image provides an indication of a quantity of the extracted features of the product detected in the respective image.

15. The method of claim 11 , wherein the extracted features include at least one an identification code, brand logos, product logos, ingredient lists, nutrition information, or container quantity information.

16. The method of claim 11 , wherein a product pattern of a plurality of product patterns associated with a respective grouping of the one or more groupings of pattern data includes at least one of a brand logo, a product logo, a product picture, nutrition information, an ingredient list, or a background color scheme.

17. The method of claim 16 , wherein a portion of the plurality of product patterns in a respective grouping of the one or more groupings of pattern data is associated with a holiday pattern scheme.

18. The method of claim 11 , wherein a portion of a plurality of product patterns in a respective pattern grouping of the one or more groupings of pattern data is associated with differing package shapes.

19. The method of claim 18 , wherein a first product pattern of the plurality of product patterns in the respective pattern grouping is associated with a cylindrical package shape.

20. The method of claim 19 , wherein a second product pattern of the plurality of product patterns in the respective pattern grouping is associated with a rectangular box package shape.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Jan 27, 2025
From: APOGEM CAPITAL LLC (SUCCESSOR TO MADISON CAPITAL FUNDING LLC)
To: SENSORS INC.; SENSORS INTEGRATION CORP.
Reel/Frame 070015/0931 →
SECURITY INTEREST Recorded Jan 22, 2025
From: DEVLINKS, LTD.; SENSORS INC.; SENSORS INTEGRATION CORP.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 069971/0982 →
ASSIGNMENT OF INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 21, 2022
From: MADISON CAPITAL FUNDING LLC, AS RETIRING AGENT
To: APOGEM CAPITAL LLC, AS SUCCESSOR AGENT
Reel/Frame 059750/0620 →
SECURITY INTEREST Recorded Dec 3, 2021
From: SENSORS INC.; SENSORS INTEGRATION CORP.
To: MADISON CAPITAL FUNDING LLC, AS AGENT
Reel/Frame 058277/0909 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2020
From: KOTULA, DAVID J.
To: SENSORS INCORPORATED
Reel/Frame 053773/0199 →
Continuity (4)
Continuation In Part 16395387 · Apr 26, 2019
Continuation 15956813 · Apr 19, 2018
Continuation 15498267 · Apr 26, 2017
Related Publication 20200356798A1 · Nov 12, 2020