IP Library Granted Patent US 12,254,439
Granted Patent B2
US 12,254,439 · App. 18/748,961 · Granted Mar 18, 2025

Control system for container terminal and related methods

Inventors: Mark D. Mills (Odessa, FL); Artem Igorevich Davtyan (New Port Richey, FL); Matthew Michael McDermott (Weeki Wachee, FL); Jorge A. Perez Rincon (Odessa, FL); Christopher Alexander (Tarpon Springs, FL)
Assignee: All Terminal Services, LLC
G06Q10/083
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,439
App. No.
18/748,961
Granted
Mar 18, 2025
Kind
B2
Abstract

A control system is for a container terminal with containers. The control system includes a server, and a terminal tractor operable within the container terminal. The terminal tractor comprises onboard tractor sensors configured to generate sensor data of at least some of the containers, a geolocation device configured to generate a geolocation value for the terminal tractor, a wireless transceiver, and a controller coupled to the onboard tractor sensors, the geolocation device, and the wireless transceiver. The controller is configured to transmit the sensor data and the geolocation value for the terminal tractor to the server. The server is in communication with the terminal tractor and is configured to generate a database associated with the sensor data, the database comprising, for each container, a container type value, a container logo image, and a vehicle classification value.

Claims (114)

1. A control system for an inventory management facility, the control system comprising:

one or more shipping assets in the inventory management facility;

one or more sensors configured to generate sensor data of the one or more shipping assets; and

a server in communication with the one or more sensors, the server including one or more processors and one or more non-transitory computer-readable storage mediums storing instructions comprising one or more algorithms that when executed by the one or more processors cause the one or more processors to perform steps to:

generate a database associated with the one or more shipping assets based upon the sensor data; and

track at least one of a location or a movement, or a combination thereof, of a shipping asset of the one or more shipping assets within the inventory management facility,

wherein the one or more sensors comprises one or more image sensors configured to generate image data, and

wherein the server is configured to identify a shipping asset of the one or more shipping assets based upon the image data,

wherein the server is configured to perform optical character recognition (OCR) on the image data including at least one of:

generating a text string for the shipping asset,

determining a color of the shipping asset, or

generating logo image data associated with a logo carried by the shipping asset, or

a combination of two or more thereof; and

wherein the server is configured to perform machine learning on the image data including executing at least one of:

a first machine learning model comprising a neural network trained to predict a location of text sequences in the image data; or

a second machine learning model comprising a neural network for scanning the text sequences and predicting a sequence of missing characters; or

a combination thereof,

wherein the server is configured to track the at least one of the location or the movement, or the combination thereof, of the shipping asset within the inventory management facility based on the at least one of the generated text string for the shipping asset, the determined color of for the shipping asset, or the generated logo image data for the shipping asset, or the combination of two or more thereof; and

one or more vehicles in the inventory management facility,

wherein the server is in communication with a vehicle of the one or more vehicles and is configured to transmit one or more operational values to the vehicle to position the shipping asset at a predetermined location within the inventory management facility based upon the sensor data, and

wherein the vehicle comprises:

a geolocation device configured to generate a geolocation value for the vehicle;

a wireless transceiver configured to communicate with the server; and

a controller coupled to the wireless transceiver and the geolocation device,

wherein the controller is configured to transmit the geolocation value for the vehicle to the server.

2. The control system of claim 1 , wherein the inventory management facility includes at least one of:

a railyard, a railroad classification yard, a terminal, a container terminal, an intermodal yard, a warehouse, a container warehouse, a distribution facility, or a docked container ship, or a combination of two or more thereof.

3. The control system of claim 1 , wherein the one or more shipping assets includes at least one of:

a container, a railcar container, a railcar, freight, a truck, a hostler, a bobtail, a trailer, an intermodal carrier, a boxcar, a cargobeamer car, a coil car, a combine car, a flatcar, a container flatcar, a schnable car, a gondola car, a Presflo car, a Prestwin car, a bulk cement wagon car, a roll-block car, a slate wagon car, a stock car, a tank car, a tank wagon car, a tanker, a milk car, a “Whale Belly” car, a transporter wagon car, a well car, a watercraft, or a container ship, or a combination of two or more thereof.

4. The control system of claim 1 , further comprising one or more vehicles in the inventory management facility,

wherein the server is in communication with a vehicle of the one or more vehicles and is configured to transmit one or more operational values to the vehicle to position the shipping asset at a predetermined location within the inventory management facility based upon the sensor data, and

wherein the one or more vehicles includes one of:

a terminal tractor;

a remote control terminal tractor;

a locomotive; or

a remote control locomotive, or

a combination of two or more thereof.

5. The control system of claim 4 , wherein the terminal tractor includes one of:

a hostler, a truck, a bobtail, or a Rubber Tired Gantry Crane (RTG), or a combination of two or more thereof.

6. The control system of claim 1 , wherein the one or more image sensors is one of:

mounted in a fixed location in the inventory management facility;

mounted onboard one or more vehicles in the inventory management facility;

mounted onboard one or more remote control vehicles in the inventory management facility;

mounted at an entry point of the inventory management facility;

mounted at an exit point of the inventory management facility; or

mounted onboard a Rubber Tired Gantry Crane (RTG) in the inventory management facility; or

a combination of two or more thereof.

7. The control system of claim 1 , wherein the database comprises, for the shipping asset of the one or more shipping assets, at least one of:

a shipping asset type value, a shipping asset logo image, a vehicle classification value of a vehicle loaded with the shipping asset, a supplier, a supplier ID, a seal status, or a road ability metric, or a combination of two or more thereof.

8. The control system of claim 1 ,

wherein the first machine learning model comprises a convolutional neural network (CNN) trained to predict the location of text sequences in the image data; or

wherein the second machine learning model comprises a recurrent neural network (RNN) for scanning the text sequences and predicting the sequence of missing characters; or

a combination thereof.

9. The control system of claim 1 , wherein the server is configured to monitor one or more vehicles in the inventory management facility for traffic violations.

10. The control system of claim 1 , wherein the one or more sensors further comprises one or more proximity sensors configured to detect a presence of one or more vehicles in the inventory management facility.

11. The control system of claim 10 , wherein the one or more proximity sensors includes one of a range finder sensor or a pressure sensor, or a combination thereof.

12. A server for controlling an inventory management facility including one or more shipping assets, wherein the server is in communication with one or more sensors configured to generate sensor data of the one or more shipping assets in the inventory management facility, the server comprising:

one or more processors and one or more non-transitory computer-readable storage mediums storing instructions comprising one or more algorithms that when executed by the one or more processors cause the one or more processors to perform steps to:

generate a database associated with the one or more shipping assets based upon the sensor data; and

track at least one of a location or a movement, or a combination thereof, of a shipping asset of the one or more shipping assets within the inventory management facility,

wherein the one or more sensors comprises one or more image sensors configured to generate image data,

wherein the server is configured to identify a shipping asset of the one or more shipping assets based upon the image data,

wherein the server is configured to perform optical character recognition (OCR) on the image data including at least one of:

generating a text string for the shipping asset,

determining a color of the shipping asset, or

generating logo image data associated with a logo carried by the shipping asset, or

a combination of two or more thereof; and

wherein the server is configured to perform machine learning on the image data including executing at least one of:

a first machine learning model comprising a neural network trained to predict a location of text sequences in the image data; or

a second machine learning model comprising a neural network for scanning the text sequences and predicting a sequence of missing characters; or

a combination thereof,

wherein the server is configured to track the at least one of the location or the movement, or the combination thereof, of the shipping asset within the inventory management facility based on the at least one of the generated text string for the shipping asset, the determined color of for the shipping asset, or the generated logo image data for the shipping asset, or the combination of two or more thereof; and

one or more vehicles in the inventory management facility,

wherein the server is in communication with a vehicle of the one or more vehicles and is configured to transmit one or more operational values to the vehicle to position the shipping asset at a predetermined location within the inventory management facility based upon the sensor data, and

wherein the vehicle comprises:

a geolocation device configured to generate a geolocation value for the vehicle;

a wireless transceiver configured to communicate with the server; and

a controller coupled to the wireless transceiver and the geolocation device,

wherein the controller is configured to transmit the geolocation value for the vehicle to the server.

13. The server of claim 12 , wherein the inventory management facility includes at least one of a railyard, a railroad classification yard, a terminal, a container terminal, an intermodal yard, a warehouse, a container warehouse, a distribution facility, or a docked container ship, or a combination of two or more thereof,

wherein the one or more shipping assets includes at least one of a container, a railcar container, a railcar, freight, a truck, a hostler, a bobtail, a trailer, an intermodal carrier, a boxcar, a cargobeamer car, a coil car, a combine car, a flatcar, a container flatcar, a schnable car, a gondola car, a Presflo car, a Prestwin car, a bulk cement wagon car, a roll-block car, a slate wagon car, a stock car, a tank car, a tank wagon car, a tanker, a milk car, a “Whale Belly” car, a transporter wagon car, a well car, a watercraft, or a container ship, or a combination of two or more thereof, and

wherein the server is in communication with a vehicle of the one or more vehicles in the inventory management facility and is configured to transmit one or more operational values to the vehicle to position the shipping asset at a predetermined location within the inventory management facility based upon the sensor data, and

wherein the one or more vehicles includes at least one of a terminal tractor, a remote control terminal tractor, a locomotive, or a remote control locomotive, or a combination of two or more thereof.

14. The server of claim 12 , wherein the database comprises, for the shipping asset of the one or more shipping assets, at least one of:

a shipping asset type value, a shipping asset logo image, a vehicle classification value of a vehicle loaded with the shipping asset, a supplier, a supplier ID, a seal status, or a road ability metric, or a combination of two or more thereof.

15. The server of claim 12 ,

wherein the first machine learning model comprises a convolutional neural network (CNN) trained to predict the location of text sequences in the image data; or

wherein the second machine learning model comprises a recurrent neural network (RNN) for scanning the text sequences and predicting the sequence of missing characters; or

a combination thereof.

16. A method for operating a control system for an inventory management facility including one or more shipping assets, and one or more sensors configured to generate sensor data of the one or more shipping assets in the inventory management facility, the method comprising:

operating a server in communication with the one or more sensors to generate a database associated with the one or more shipping assets based upon the sensor data;

tracking at least one of a location or a movement, or a combination thereof, of a shipping asset of the one or more shipping assets within the inventory management facility, wherein the one or more sensors comprises one or more image sensors configured to generate image data,

wherein the server is configured to identify a shipping asset of the one or more shipping assets based upon the image data,

wherein the step of operating the server to generate the database comprises performing optical character recognition (OCR) on the container image data including at least one of:

generating a text string for the shipping asset,

determining a color of the shipping asset, or

generating logo image data associated with a logo carried by the shipping asset, or

a combination of two or more thereof;

wherein the step of operating the server to generate the database comprises performing machine learning on the image data including at least one of:

executing a first machine learning model comprising a neural network trained to predict a location of text sequences in the image data; or

executing a second machine learning model comprising a neural network for scanning the text sequences and predicting a sequence of missing characters, or

a combination thereof;

wherein the server is configured to track the at least one of the location or the movement, or the combination thereof, of the shipping asset within the inventory management facility based on the at least one of the generated text string for the shipping asset, the determined color of for the shipping asset, or the generated logo image data for the shipping asset, or the combination of two or more thereof; and

wherein the server is in communication with one or more vehicles in the inventory management facility; and

operating the server to transmit one or more operational values to the vehicle to position the shipping asset at a predetermined location within the inventory management facility based upon the sensor data.

17. The method of claim 16 , wherein the inventory management facility includes at least one of a railyard, a railroad classification yard, a terminal, a container terminal, an intermodal yard, a warehouse, a container warehouse, a distribution facility, or a docked container ship, or a combination of two or more thereof,

wherein the one or more shipping assets includes at least one of a container, a railcar container, a railcar, freight, a truck, a hostler, a bobtail, a trailer, an intermodal carrier, a boxcar, a cargobeamer car, a coil car, a combine car, a flatcar, a container flatcar, a schnable car, a gondola car, a Presflo car, a Prestwin car, a bulk cement wagon car, a roll-block car, a slate wagon car, a stock car, a tank car, a tank wagon car, a tanker, a milk car, a “Whale Belly” car, a transporter wagon car, a well car, a watercraft, or a container ship, or a combination of two or more thereof; and

wherein the one or more vehicles includes at least one of a terminal tractor, a remote control terminal tractor, a locomotive, or a remote control locomotive, or a combination of two or more thereof.

18. The method of claim 16 , wherein the step of operating the server to generate the database comprises generating, for the shipping asset, at least one of:

a shipping asset type value, a shipping asset logo image, a vehicle classification value of a vehicle loaded with the shipping asset, a supplier, a supplier ID, a seal status, or a road ability metric, or a combination of two or more thereof.

19. The method of claim 16 ,

wherein the first machine learning model comprising the neural network includes a convolutional neural network (CNN) trained to predict the location of text sequences in the image data; or

wherein the second machine learning model comprising the neural network includes a recurrent neural network (RNN) for scanning the text sequences and predicting the sequence of missing characters, or

a combination thereof.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2024
From: DAVTYAN, ARTEM; MILLS, MARK D.; MCDERMOTT, MATTHEW MICHAEL; RINCON, JORGE PEREZ; ALEXANDER, CHRISTOPHER
To: COMMUNICATION CONCEPTS INTEGRATION INC.
Reel/Frame 069018/0198 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2024
From: COMMUNICATION CONCEPTS INTEGRATION INC.
To: ITS TECHNOLOGIES & LOGISTICS, LLC
Reel/Frame 069018/0652 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 25, 2024
From: ITS TECHNOLOGIES & LOGISTICS, LLC (D/B/A CONGLOBAL)
To: ALL TERMINAL SERVICES, LLC (D/B/A CONGLOBAL TECHNOLOGIES)
Reel/Frame 069018/0702 →
Continuity (5)
Continuation 18060162 · Nov 30, 2022
Continuation In Part 16951015 · Nov 18, 2020
Provisional Application 63284071 · Nov 30, 2021
Provisional Application 62936715 · Nov 18, 2019
Related Publication 20240354690A1 · Oct 24, 2024
References Cited (44)
US 2853968A · McLean · 1958 [cited by applicant]
US 7813846B2 · Wills et al. · 2010 [cited by applicant]
US 8180590B2 · Szwilski et al. · 2012 [cited by applicant]
US 8280567B2 · Brand et al. · 2012 [cited by applicant]
US 8532842B2 · Smith et al. · 2013 [cited by applicant]
US 8942426B2 · Bar-Am · 2015 [cited by applicant]
US 10029708B2 · Viviani · 2018 [cited by applicant]
US 10597053B2 · Mian et al. · 2020 [cited by applicant]
US 12020148B1 · Mills et al. · 2024 [cited by applicant]
US 20020188593A1 · Moser et al. · 2002 [cited by applicant]
US 20050125113A1 · Wheeler et al. · 2005 [cited by applicant]
US 20080086393A1 · Naghshiineh et al. · 2008 [cited by applicant]
US 20090015400A1 · Breed · 2009 [cited by applicant]
US 20100063734A1 · Kumar · 2010 [cited by applicant]
US 20120130562A1 · Brand · 2012 [cited by examiner]
US 20150201165A1 · Bocionek et al. · 2015 [cited by applicant]
US 20170001653A1 · Ferencz, Jr. · 2017 [cited by examiner]
US 20170032316A1 · Benedict · 2017 [cited by applicant]
US 20170154347A1 · Bateman · 2017 [cited by applicant]
US 20190311625A1 · Anvari · 2019 [cited by applicant]
US 20200125877A1 · Phan et al. · 2020 [cited by applicant]
US 20200265377A1 · Al Dhaheri et al. · 2020 [cited by applicant]
US 20240029092A1 · Simpson · 2024 [cited by applicant]
US 20240354687A1 · Mills et al. · 2024 [cited by applicant]
US 20240386269A1 · Mills et al. · 2024 [cited by applicant]
US 20240386270A1 · Mills et al. · 2024 [cited by applicant]
CN 107364434 · 2017 [cited by applicant]
CN 110457420 · 2019 [cited by applicant]
CN 110457420A · 2019 [cited by examiner]
EP 3275764 · 2018 [cited by applicant]
EP 3275764A1 · 2018 [cited by examiner]
RU 2630859 · 2017 [cited by applicant]
WO WO2016191711 · 2016 [cited by applicant]
Jung, Seungwon; Kim, Yongsung; Hwang, Eenjun. Real-time car tracking system based on surveillance videos. EURASIP Journal on Image and Video Processing; New York vol. 2018, Iss. 1, (Nov. 2018): 1-13. (Year: 2018). [cited by examiner]
U.S. Appl. No. 16/951,015, filed Nov. 18, 2020, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 18/060,162, filed Nov. 30, 2022, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 18/731,207, filed May 31, 2024, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 18/744,198, filed Jun. 14, 2024, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 62/936,715, filed Nov. 18, 2019, Mark D. Mills. [cited by applicant]
U.S. Appl. No. 16/951,015, dated Dec. 5, 2023, Office Action issued by the U.S. Patent and Trademark Office. [cited by applicant]
U.S. Appl. No. 16/951,015, dated Apr. 29, 2024, Notice of Allowance issued by the U.S. Patent and Trademark Office. [cited by applicant]
U.S. Appl. No. 18/731,207, dated Sep. 20, 2024, Office Action issued by the U.S. Patent and Trademark Office. [cited by applicant]
U.S. Appl. No. 18/731,207, dated Nov. 18, 2024, Notice of Allowance issued by the U.S. Patent and Trademark Office. [cited by applicant]
U.S. Appl. No. 18/744,198, dated Oct. 18, 2024, Office Action issued by the U.S. Patent and Trademark Office. [cited by applicant]