IP Library Granted Patent US 12,246,354
Granted Patent B2
US 12,246,354 · App. 18/404,694 · Granted Mar 11, 2025

Methods, apparatuses, and systems for automatically performing sorting operations

Inventors: Matthew Wicks (Charlotte, NC); David Pepley (Charlotte, NC)
Assignee: Intelligrated Headquarters, LLC
B07C5/3422B07C5/08B07C5/28B07C5/362B65G65/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,246,354
App. No.
18/404,694
Granted
Mar 11, 2025
Kind
B2
Abstract

Apparatuses, method and computer program products for automatically performing sorting operations are disclosed herein. An example apparatus may comprise: an array of gripping elements, and at least one processing component configured to: obtain image data corresponding with the plurality of items; identify, from the image data, one or more characteristics of the plurality of items; determine, based at least in part on the one or more characteristics, an ordered sequence corresponding with the plurality of items; and generate a control indication to cause at least one of the gripping elements to perform the sorting operations based at least in part on the ordered sequence.

Claims (45)

1. An apparatus for automatically performing sorting operations with respect to a plurality of items, the apparatus comprising:

one or more gripping elements; and

at least one processing component configured to:

obtain image data corresponding with the plurality of items;

identify, from the image data, one or more characteristics of the plurality of items;

determine, based at least in part on the one or more characteristics, an ordered sequence corresponding with the plurality of items; and

generate a control indication to cause the one or more gripping elements to perform the sorting operations based at least in part on the ordered sequence, wherein the ordered sequence comprises a set of instructions to pause a deposit of at least one item of the plurality of items for at least a predetermined time duration based on the one or more characteristics of the plurality of items.

2. The apparatus of claim 1 , wherein the ordered sequence defines a sequence, target parameters and a timing for one or more of singulation operations and depalletizing operations with respect to the plurality of items.

3. The apparatus of claim 1 , wherein the one or more characteristics comprise one or more of a type, a material, an estimated weight, a location and dimensions.

4. The apparatus of claim 1 , wherein the apparatus further comprises at least one image sensing component, wherein the at least one processing component is further configured to:

generate the control indication to cause the at least one image sensing component to capture the image data.

5. The apparatus of claim 1 , wherein the at least one processing component is configured to:

cause the one or more gripping elements to collect and sequentially deposit at least two or more items of the plurality of items, comprising causing the one or more gripping elements to:

transfer the plurality of items from a first location to a second location; and

deposit each of the plurality of items at the second location based at least in part on the ordered sequence.

6. The apparatus of claim 1 , wherein the at least one processing component is configured to determine the ordered sequence based at least in part on a machine learning model.

7. The apparatus of claim 1 , wherein the at least one processing component is configured to identify the one or more characteristics pursuant to an image segmentation and/or object pose estimation techniques.

8. A method for automatically performing sorting operations with respect to a plurality of items, the method comprising:

obtaining, by at least one processing component, image data corresponding with the plurality of items;

identifying, from the image data, one or more characteristics of the plurality of items;

determining, based at least in part on the one or more characteristics, an ordered sequence corresponding with the plurality of items; and

generating a control indication to cause one or more gripping elements to perform the sorting operations based at least in part on the ordered sequence, wherein the ordered sequence comprises a set of instructions to pause a deposit of at least one item of the plurality of items for at least a predetermined time duration based on the one or more characteristics of the plurality of items.

9. The method of claim 8 , wherein the ordered sequence defines a sequence, target parameters and a timing for one or more of singulation operations and depalletizing operations with respect to the plurality of items.

10. The method of claim 8 , wherein the one or more characteristics comprise one or more of a type, a material, an estimated weight, a location and dimensions.

11. The method of claim 8 , further comprising:

generating a second control indication to cause at least one image sensing component to capture the image data.

12. The method of claim 8 , further comprising:

generating the control indication to cause the one or more gripping elements to collect and sequentially deposit the plurality of items, comprising causing the one or more gripping elements to:

transfer the plurality of items from a first location to a second location; and

deposit each of the plurality of items at the second location based at least in part on the ordered sequence.

13. The method of claim 8 , further comprising determining the ordered sequence based at least in part on a machine learning model.

14. The method of claim 8 , further comprising identifying the one or more characteristics pursuant to an image segmentation and/or object pose estimation techniques.

15. A computer program product configured to automatically perform sorting operations with respect to a plurality of items, the computer program product comprising at least one non-transitory computer-readable storage medium having computer executable program code instructions therein, the computer executable program code instructions comprising program code instructions configured, upon execution, to:

obtain image data corresponding with the plurality of items;

identify, from the image data, one or more characteristics of the plurality of items;

determine, based at least in part on the one or more characteristics, an ordered sequence corresponding with the plurality of items; and

generate a control indication to cause one or more gripping elements to perform the sorting operations based at least in part on the ordered sequence, wherein the ordered sequence comprises a set of instructions to pause a deposit of at least one item of the plurality of items for at least a predetermined time duration based on the one or more characteristics of the plurality of items.

16. The computer program product of claim 15 , wherein the ordered sequence defines a sequence, target parameters and a timing for one or more of singulation operations and depalletizing operations with respect to the plurality of items.

17. The computer program product of claim 15 , wherein the one or more characteristics comprise one or more of a type, a material, an estimated weight, a location and dimensions.

18. The computer program product of claim 15 , wherein the computer executable program code instructions further comprise the program code instructions configured to, upon execution, to:

generate a second control indication to cause at least one image sensing component to capture the image data.

19. The computer program product of claim 15 , wherein generating the control indication to cause the one or more gripping elements to collect and sequentially deposit at least two or more items of the plurality of items comprises causing the one or more gripping elements to:

transfer the plurality of items from a first location to a second location; and

deposit each of the plurality of items at the second location based at least in part on the ordered sequence.

20. The computer program product of claim 15 , wherein the ordered sequence is determined based at least in part on a machine learning model.

Assignments (2)
SECURITY AGREEMENT Recorded Jul 29, 2026
From: INTELLIGRATED HEADQUARTERS, LLC; TRANSNORM SYSTEM INC.; HILMOT, LLC; TREW, LLC; UNITED SORTATION SOLUTIONS LLC; TECH KING OPERATIONS, LLC
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 076077/0385 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2024
From: WICKS, MATTHEW; PEPLEY, DAVID
To: INTELLIGRATED HEADQUARTERS, LLC
Reel/Frame 066025/0029 →
Continuity (3)
Continuation 17451572 · Oct 20, 2021
Provisional Application 63124482 · Dec 11, 2020
Related Publication 20240139778A1 · May 2, 2024
References Cited (57)
US 9205558B1 · Zevenbergen · 2015 [cited by examiner]
US 9487361B2 · Girtman · 2016 [cited by examiner]
US 10814489B1 · Kalouche et al. · 2020 [cited by applicant]
US 10857673B2 · Atohira · 2020 [cited by examiner]
US 11911801B2 · Wicks · 2024 [cited by examiner]
US 20100092272A1 · Echelmeyer et al. · 2010 [cited by applicant]
US 20120181804A1 · Schmidt et al. · 2012 [cited by applicant]
US 20130175206A1 · Li · 2013 [cited by examiner]
US 20150057793A1 · Kawano · 2015 [cited by applicant]
US 20170136632A1 · Wagner et al. · 2017 [cited by applicant]
US 20180273296A1 · Wagner et al. · 2018 [cited by applicant]
US 20180333749A1 · Wagner et al. · 2018 [cited by applicant]
US 20180345324A1 · Hillerich, Jr. · 2018 [cited by examiner]
US 20180354121A1 · Sezaki · 2018 [cited by examiner]
US 20190061151A1 · Namiki · 2019 [cited by applicant]
US 20190070734A1 · Wertenberger · 2019 [cited by examiner]
US 20190344448A1 · Wicks · 2019 [cited by examiner]
US 20190344974A1 · Wicks et al. · 2019 [cited by applicant]
US 20200002107A1 · Morency et al. · 2020 [cited by applicant]
US 20200017317A1 · Yap et al. · 2020 [cited by applicant]
US 20200055091A1 · Ma et al. · 2020 [cited by applicant]
US 20200143127A1 · Wagner et al. · 2020 [cited by applicant]
US 20200238519A1 · Diankov et al. · 2020 [cited by applicant]
US 20200269283A1 · Ulrich et al. · 2020 [cited by applicant]
US 20200306964A1 · Neville et al. · 2020 [cited by applicant]
US 20200316787A1 · Fujihara et al. · 2020 [cited by applicant]
US 20200353510A1 · Chandler · 2020 [cited by applicant]
CA 2228594A1 · 1997 [cited by applicant]
CN 105798914A · 2016 [cited by applicant]
CN 106458479A · 2017 [cited by applicant]
CN 206811992U · 2017 [cited by applicant]
CN 108273761A · 2018 [cited by applicant]
CN 108349083A · 2018 [cited by applicant]
CN 109436820A · 2019 [cited by applicant]
CN 109926342A · 2019 [cited by applicant]
CN 110420888A · 2019 [cited by applicant]
CN 111977385A · 2020 [cited by applicant]
CN 111993448A · 2020 [cited by applicant]
EP 3617936A1 · 2020 [cited by applicant]
WO 2020146472A9 · 2020 [cited by applicant]
EP Office Action Mailed on Jun. 26, 2024 for EP Application No. 21211978, 4 page(s). [cited by applicant]
Advisory Action (PTOL-303) Mailed on Jul. 13, 2023 for U.S. Appl. No. 17/451,572, 12 page(s). [cited by applicant]
CN Office Action Mailed on Oct. 12, 2023 for CN Application No. 202111515551, 6 page(s). [cited by applicant]
CN Office Action, including Search Report Mailed on Mar. 29, 2023 for CN Application No. 202111515551, 10 page(s). [cited by applicant]
English Translation of CN Office Action dated Oct. 12, 2023 for CN Application No. 202111515551, 14 page(s). [cited by applicant]
English Translation of CN Office Action, including Search Report dated Mar. 29, 2023 for CN Application No. 202111515551, 14 page(s). [cited by applicant]
European search report Mailed on Jul. 21, 2022 for EP Application No. 21211978, 10 page(s). [cited by applicant]
Examiner Interview Summary Record (PTOL-413) Mailed on Jul. 11, 2023 for U.S. Appl. No. 17/451,572, 2 page(s). [cited by applicant]
Examiner Interview Summary Record (PTOL-413) Mailed on Sep. 6, 2023 for U.S. Appl. No. 177/451,572, 2 page(s). [cited by applicant]
Final Rejection Mailed on Apr. 25, 2023 for U.S. Appl. No. 17/451,572, 12 page(s). [cited by applicant]
Non-Final Rejection Mailed on Aug. 8, 2023 for U.S. Appl. No. 17/451,572, 21 page(s). [cited by applicant]
Non-Final Rejection Mailed on Jan. 5, 2023 for U.S. Appl. No. 17/451,572. [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Jan. 22, 2024 for U.S. Appl. No. 17/451,572, 2 page(s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Oct. 4, 2023 for U.S. Appl. No. 17/451,572, 7 page(s). [cited by applicant]
CN Office Action Mailed on Mar. 1, 2024 for CN Application No. 202111515551, 5 page(s). [cited by applicant]
English Translation of CN Office Action dated Mar. 1, 2024 for CN Application No. 202111515551, 12 page(s). [cited by applicant]
U.S. Appl. No. 17/451,572, filed Oct. 20, 2021, 2022/0184666, Allowed. [cited by applicant]