IP Library › Granted Patent US 12,704,831
Granted Patent B2
US 12,704,831 · App. 17/776,355 · Granted Aug 11, 2026

Method for computer-implemented configuration of a controlled drive application of a logistics system

Inventors: Michel Tokic (Tettnang, DE); David Grossenbacher (Prague, CZ); Daniel Hein (Munich, DE); Michael Leipold (Nuremberg, DE); Volkmar Sterzing (Neubiberg, DE); Steffen Udluft (Eichenau, DE)
Assignee: SIEMENS AKTIENGESELLSCHAFT
G05B19/4182G05B19/4189
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,704,831
App. No.
17/776,355
Filed
May 12, 2022
Granted
Aug 11, 2026
Kind
B2
Art Unit
3655
USPC
700/230
Abstract

A method for configuration of a controlled drive application of a logistics system. The logistics system includes parallel conveying paths for piece goods. Each conveying path includes sub-conveying paths which are each accelerated or delayed to merge the piece goods on a single output conveying path with defined spacing. A system model of the logistics system is firstly determined by operating data of the logistics system which include sensor values of the logistics system and changes to control variables. A control function is determined, which includes configuration data for the drives, with at least one control action being performed on the precondition of one or more performance features that are to be achieved in the system model, during which control action the operating data is simulated for a plurality of time steps.

Claims (26)

1 . A method for computer-implemented configuration of a controlled drive application of a logistics system, wherein the logistics system comprises a plurality of parallel- running conveyor sections for piece goods that each lead to a combining unit in the conveying direction, each of the conveyor sections including a plurality of conveyor subsections that are accelerated or decelerated by a respective associated drive under a control of a computing unit to render the combining unit able to combine the piece goods onto a single output conveyor section at defined intervals, the method comprising:

determining a system model of the logistics system on a basis of operating data of the logistics system, the operating data being available for a multiplicity of times in the operation of the logistics system and comprising, for each time, measured values from sensors of the logistics system and manipulated variable changes; and

determining a control function of the logistics system, the control function comprising at least configuration data for the drives, on a basis of the system model by specifying one or more performance features to be attained to perform at least one control operation in the system model, involving simulating the operating data for a multiplicity of time steps, wherein a reward quantity is ascertained for each time step, and the control operation is used as the control function, involving a predefined fitness function that aggregates the reward quantities for a multiplicity of time steps satisfying a predetermined criterion.

2 . The method as claimed in claim 1 , wherein the system model is determined using supervised learning methods by way of a neural network or a recurrent neural network.

3 . The method as claimed in claim 1 , wherein the control function is determined by way of reinforcement learning.

4 . The method as claimed in claim 1 , wherein a sum of the performance feature(s) for the simulated time steps is processed as the fitness function.

5 . The method as claimed in claim 1 , wherein one or more of the following parameters are processed as a performance feature:

a mean throughput of piece goods at the output of the combining unit;

an interval between two piece goods conveyed in direct succession;

a detection of a collision in the combining unit at the output thereof;

an interval uniformity measure that characterizes a deviation of the intervals from an equidistance between each pair of piece goods conveyed in direct succession; and

a running speed of the conveyor subsections of a respective conveyor section or of all of the conveyor sections.

6 . The method as claimed in claim 1 , wherein the control function is determined by varying one or more input variables of the system model.

7 . The method as claimed in claim 6 , wherein one or more of the following parameters are processed as input variables of the system model:

a respective speed of the conveyor subsections;

a position of a respective piece good;

a size of a respective piece good;

a throughput of piece goods at the output of the combining unit; and

a collision in the combining unit at the output thereof.

8 . The method as claimed in claim 7 , wherein the input variables are operating parameters of the system model.

9 . An apparatus for computer-implemented configuration of a controlled application of a logistics system, wherein the logistics system comprises a plurality of parallel-drive running conveyor sections for piece goods that each lead to a combining unit in the conveying direction, each of the conveyor sections including a plurality of conveyor subsections that are accelerated or decelerated by a respective associated drive under a control of a computing unit of the apparatus to render the combining unit able to combine the piece goods onto a single output conveyor section at defined intervals, the computing unit being designed to carry out the following steps:

determining a system model of the logistics system on a basis of operating data of the logistics system, the operating data being available for a multiplicity of times in the operation of the logistics system and comprising, for each time, measured values from sensors of the logistics system and manipulated variable changes; and

determining a control function of the logistics system, the control function comprising at least configuration data for the drives, on a basis of the system model by specifying one or more performance features to be attained to perform at least one control operation in the system model, involving simulating the operating data for a multiplicity of time steps, wherein a reward quantity is ascertained for each time step, and the control operation is used as the control function, involving a predefined fitness function that aggregates the reward quantities for a multiplicity of time steps satisfying a predetermined criterion.

10 . The apparatus as claimed in claim 9 , the apparatus being designed to carry out a method for computer-implemented configuration of the controlled drive application of the logistics system.

11 . A logistics system having one or more parallel-running conveyor sections for piece goods that each lead to a combining unit in the conveying direction, each of the conveyor sections including a plurality of conveyor subsections that are accelerated or decelerated by a respective associated drive under a control of a computing unit to render the combining unit able to combine the piece goods onto a single output conveyor section at defined intervals, wherein the logistics system comprises the apparatus as claimed in claim 9 .

12 . A computer program product, comprising a computer readable hardware storage device having computer readable program code stored therein, said program code executable by a processor of a computer system to implement a method as claimed in claim 1 when the program code is executed on a computer.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: SIEMENS, S.R.O.
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 063293/0254 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: TOKIC, MICHEL; HEIN, DANIEL; LEIPOLD, MICHAEL; STERZING, VOLKMAR; UDLUFT, STEFFEN
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 063293/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2023
From: GROSSENBACHER, DAVID
To: SIEMENS, S.R.O.
Reel/Frame 063293/0211 →
Priority Claims (1)
EP 19210263 · Nov 20, 2019 · regional
Continuity (1)
Related Publication 20220397887A1 · Dec 15, 2022
References Cited (35)
US 11498764B2 · Gorman · 2022 [cited by examiner]
US 20020112938A1 · Shiohara · 2002 [cited by examiner]
US 20030015396A1 · Mennie · 2003 [cited by applicant]
US 20100036522A1 · Stich · 2010 [cited by applicant]
US 20140050087A1 · Pasotti et al. · 2014 [cited by applicant]
US 20140202829A1 · Eberhardt et al. · 2014 [cited by applicant]
US 20180057271A1 · Vitalini · 2018 [cited by examiner]
US 20180127217A1 · Henze · 2018 [cited by applicant]
US 20180356793A1 · Kanemaru · 2018 [cited by examiner]
US 20190056718A1 · Satou · 2019 [cited by examiner]
CN 1369419A · 2002 [cited by applicant]
CN 101198975A · 2008 [cited by applicant]
CN 103518137A · 2014 [cited by applicant]
CN 107750229A · 2018 [cited by applicant]
CN 107777275A · 2018 [cited by applicant]
CN 108792586A · 2018 [cited by examiner]
CN 109649910A · 2019 [cited by applicant]
CN 117332834A · 2024 [cited by examiner]
DE 102005027687A1 · 2006 [cited by examiner]
DE 102015106034A1 · 2016 [cited by examiner]
DE 102018006551A1 · 2019 [cited by examiner]
EP 1228986A1 · 2002 [cited by examiner]
EP 3287396B1 · 2023 [cited by examiner]
EP 4299478A1 · 2024 [cited by examiner]
JP 4048029B2 · 2008 [cited by examiner]
Gary Gang Jing et al. “Modeling a controlled conveyor network with merging configuration” (Year: 1998). [cited by examiner]
Michael Johnstone et al. “Simulation-based baggage handling system merge analysis” (Year: 2015). [cited by examiner]
Daniel Szego “Combining conveyor belt with artificial intelligence” (Year: 2018). [cited by examiner]
DE 102018006551 EN translation (Year: 2019). [cited by examiner]
PCT/EP2020/080635 EN translation (Year: 2022). [cited by examiner]
Jing et al. Modeling CNMC (Year: 1998). [cited by examiner]
Johnstone Michael et al: “Simulation-based baggage handling system merge analysis”, Simulation Modelling Practice and Theory, vol. 53, pp. 45-59, XP055691968, Amsterdam, NL; ISSN: 1569-190X, DOI: 10.1016/j.simpat.2015.0… [cited by applicant]
Szego Daniel: “Combining conveyor belt with artificial intelligence”, pp. 1-6, XP055691970, Gefunden im Internet: URL:http://danielszego.blogspot.com/2018/04/combining-conveyor-belt-with-artificial.html; [gefunden am Ma… [cited by applicant]
Gang Gary Jing et al: “Modeling a controlled conveyor network with merging configuration”, Simulation Conference Proceedings, 1998. Winter Washington, DC, USA Dec. 13-16, 1998, Piscataway, NJ, USA, IEEE, US, vol. 2, pp.… [cited by applicant]
PCT International Search Report and Written Opinion of International Searching Authority mailed Sep. 2, 2021 corresponding to PCT International Application No. PCT/EP2020/080635 filed Nov. 2, 2020. [cited by applicant]