IP Library Granted Patent US 12,217,183
Granted Patent B2
US 12,217,183 · App. 18/731,207 · Granted Feb 4, 2025

Control system for railway yard and related methods

Inventors: Mark D. Mills (Odessa, FL); Matthew Michael McDermott (Weeki Wachee, FL); Jorge A. Perez Rincon (Odessa, FL); Carson Rentz (Odessa, FL); Edwin Victor Gendron (Odessa, FL); Dakoda Jarrard Sanders (Odessa, FL)
Assignee: All Terminal Services, LLC
G06N3/08B61L23/00B61L23/005B61L23/12B61L23/14B61L25/00B61L25/02B61L25/04G06F16/21G06F16/29G06V20/176H04L67/12B61L27/00G06V30/19
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,183
App. No.
18/731,207
Granted
Feb 4, 2025
Kind
B2
Abstract

A control system is for a railway yard with railroad tracks. The control system may include RCLs and sets of railcars on the railroad tracks. The control system may include railyard sensors configured to generate railyard sensor data of the railroad tracks, and a server in communication with the RCLs and the railyard sensors. The server may be configured to generate a database associated with the sets of railcars based upon the railyard sensor data. The database may have, for each railcar, a railcar type value, a railcar logo image, and a vehicle classification value. The server may be configured to selectively control the RCLs to position the sets of railcars within the railroad tracks based upon the railyard sensor data.

Claims (61)

1. A control system for a railway yard with a plurality of railroad tracks, the control system comprising:

one or more remote control locomotives (RCLs) and one or more railcars respectively associated therewith on one or more railroad tracks;

one or more railyard sensors configured to generate railyard sensor data of the one or more railroad tracks; and

a server in communication with the one or more RCLs and the one or more railyard sensors, the server including one or more processors and one or more non-transitory computer-readable storage mediums storing instructions comprising one or more algorithms that when executed by the one or more processors cause the one or more processors to perform steps to:

generate a database associated with the one or more railcars based upon the railyard sensor data; and

selectively control the one or more RCLs to position the one or more railcars within the one or more railroad tracks based upon the railyard sensor data,

wherein the one or more railyard sensors comprises an image sensor configured to generate railyard image data, and

wherein the server is configured to identify each railcar of the one or more railcars based upon the railyard image data.

2. The control system of claim 1 , wherein the database comprises, for each railcar, at least one of a railcar type value, a railcar logo image, or a vehicle classification value, or a combination of two or more thereof.

3. The control system of claim 1 , wherein the database comprises, for each railcar, a railcar type value, a railcar logo image, and a vehicle classification value.

4. The control system of claim 1 , wherein the step of generating the database associated with the one or more railcars based upon the railyard sensor data includes classifying each railcar with a vehicle type and a container type.

5. The control system of claim 1 , wherein the server is configured to perform optical character recognition (OCR) on the railyard image data.

6. The control system of claim 5 , wherein the step of performing the optical character recognition (OCR) further comprises:

generating a text string for each railcar,

determining a color of each railcar, and

generating logo image data associated with a logo carried by each railcar.

7. The control system of claim 6 , wherein the server is configured to track at least one of a location or a movement, or a combination thereof, of each railcar within the railway yard based on the generated text string for each railcar, the determined color of for each railcar, or the generated logo image data for each railcar, or a combination thereof.

8. The control system of claim 1 , wherein the server is configured to perform machine learning on the railyard image data.

9. The control system of claim 8 , wherein the server is configured to execute a first machine learning model comprising a convolutional neural network (CNN) trained to predict a location of text sequences in the railyard image data.

10. The control system of claim 9 wherein the server is configured to execute a second machine learning model comprising a recurrent neural network (RNN) for scanning the text sequences and predicting a sequence of missing characters.

11. The control system of claim 1 , wherein each RCL comprises:

a geolocation device configured to generate a geolocation value for a respective RCL;

a wireless transceiver configured to communicate with the server; and

a controller coupled to the wireless transceiver and the geolocation device,

wherein the controller is configured to transmit the geolocation value for the respective RCL to the server.

12. The control system of claim 1 , wherein the server is configured to monitor the one or more RCLs for railyard traffic violations.

13. The control system of claim 1 , wherein the one or more railyard sensors further comprises one or more proximity sensors configured to detect a presence of the one or more RCLs.

14. The control system of claim 13 , wherein the one or more proximity sensors includes one of a range finder sensor or a pressure sensor, or a combination thereof.

15. The control system of claim 1 , wherein each railcar comprises one of a container, a railcar container, a trailer, a chassis, a boxcar, a cargobeamer car, a coil car, a combine car, a flatcar, a schnable car, a gondola car, a Presflo and Prestwin car, a bulk cement wagon car, a roll-block car, a slate wagon car, a stock car, a tank car, a milk car, a transporter wagon car, or a well car.

16. A server for controlling a railway yard with one or more railroad tracks, one or more remote control locomotives (RCLs) and one or more railcars respectively associated therewith on the one or more railroad tracks, the plurality of RCLs being communication with the server, one or more railyard sensors in communication with the server and configured to generate railyard sensor data of the one or more railroad tracks, the server comprising:

one or more processors and one or more non-transitory computer-readable storage mediums storing instructions comprising one or more algorithms that when executed by the one or more processors cause the one or more processors to perform steps to:

generate a database associated with the one or more railcars based upon the railyard sensor data, and

selectively control the one or more RCLs to position the one or more railcars within the one or more railroad tracks based upon the railyard sensor data,

wherein the one or more railyard sensors comprises one or more image sensors configured to generate railyard image data, and

wherein the one or more processors is configured to identify each railcar based upon the railyard image data.

17. The server of claim 16 , wherein the database comprises, for each railcar, a railcar type value, a railcar logo image, and a vehicle classification value.

18. The server of claim 16 , wherein the database comprises, for each railcar, a railcar type value, a railcar logo image, or a vehicle classification value, or a combination of two or more thereof.

19. The server of claim 16 , wherein the step of generating the database associated with the one or more railcars based upon the railyard sensor data includes classifying each railcar with a vehicle type or a container type, or a combination thereof.

20. The server of claim 16 , wherein the server is configured to perform optical character recognition (OCR) on the railyard image data.

21. The server of claim 20 , wherein the step of performing the optical character recognition (OCR) further comprises:

generating a text string for each railcar,

determining a color of each railcar, and

generating logo image data associated with a logo carried by each railcar.

22. The server of claim 21 , wherein the server is configured to track at least one of a location or a movement, or a combination thereof, of each railcar within the railway yard based on the generated text string for each railcar, the determined color of for each railcar, or the generated logo image data for each railcar, or a combination of two or more thereof.

23. The server of claim 16 , wherein the one or more processors is configured to perform machine learning on the railyard image data.

24. The server of claim 23 , wherein the one or more processors is configured to at least one of:

execute a first machine learning model comprising a convolutional neural network (CNN) trained to predict a location of text sequences in the railyard image data; or

wherein the one or more processors is configured to execute a second machine learning model comprising a recurrent neural network (RNN) for scanning the text sequences and predicting a sequence of missing characters, or

a combination thereof.

25. The server of claim 16 , wherein the one or more railyard sensors further comprises one or more proximity sensors configured to detect a presence of the one or more RCLs.

26. The server of claim 16 , wherein each RCL comprises a geolocation device configured to generate a geolocation value for a respective RCL, a wireless transceiver configured to communicate with the server, and a controller coupled to the wireless transceiver and the geolocation device; and

wherein the controller is configured to transmit the geolocation value for the respective RCL to the server.

27. The server of claim 16 , wherein the one or more processors is configured to monitor the one or more RCLs for railyard traffic violations.

28. The server of claim 16 , wherein each railcar comprises one of a container, a railcar container, a trailer, a chassis, a boxcar, a cargobeamer car, a coil car, a combine car, a flatcar, a schnable car, a gondola car, a Presflo and Prestwin car, a bulk cement wagon car, a roll-block car, a slate wagon car, a stock car, a tank car, a milk car, a transporter wagon car, or a well car.

29. A method for operating a control system for a railway yard with one or more railroad tracks, the control system comprising one or more remote control locomotives (RCLs) and one or more railcars respectively associated therewith on the one or more railroad tracks, and one or more railyard sensors configured to generate railyard sensor data of the one or more railroad tracks, the method comprising:

operating a server in communication with the one or more RCLs and the one or more railyard sensors to generate a database associated with the one or more railcars based upon the railyard sensor data; and

operating the server to selectively control the one or more RCLs to position the one or more railcars within the one or more railroad tracks based upon the railyard sensor data,

wherein the one or more railyard sensors comprises one or more image sensors configured to generate railyard image data, and

wherein the server is configured to identify each railcar of the one or more railcars based upon the railyard image data.

30. The method of claim 29 , wherein the database comprises, for each railcar, at least one of a railcar type value, a railcar logo image, or a vehicle classification value, or a combination of two or more thereof, and

wherein each railcar comprises one of a container, a railcar container, a trailer, a chassis, a boxcar, a cargobeamer car, a coil car, a combine car, a flatcar, a schnable car, a gondola car, a Presflo and Prestwin car, a bulk cement wagon car, a roll-block car, a slate wagon car, a stock car, a tank car, a milk car, a transporter wagon car, or a well car.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2024
From: MILLS, MARK D.; MCDERMOTT, MATTHEW MICHAEL; RINCON, JORGE PEREZ; RENTZ, CARSON; GENDRON, EDWIN VICTOR; SANDERS, DAKODA JARRARD
To: COMMUNICATION CONCEPTS INTEGRATION INC.
Reel/Frame 069010/0444 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2024
From: COMMUNICATION CONCEPTS INTEGRATION INC.
To: ITS TECHNOLOGIES & LOGISTICS, LLC
Reel/Frame 069010/0754 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2024
From: ITS TECHNOLOGIES & LOGISTICS, LLC (D/B/A CONGLOBAL)
To: ALL TERMINAL SERVICES, LLC (D/B/A CONGLOBAL TECHNOLOGIES)
Reel/Frame 069010/0862 →
Continuity (3)
Continuation 16951015 · Nov 18, 2020
Provisional Application 62936715 · Nov 18, 2019
Related Publication 20240386269A1 · Nov 21, 2024
References Cited (42)
US 2853968A · McLean · 1958 [cited by applicant]
US 7813846B2 · Wills et al. · 2010 [cited by applicant]
US 8180590B2 · Szwilski et al. · 2012 [cited by applicant]
US 8280567B2 · Brand et al. · 2012 [cited by applicant]
US 8532842B2 · Smith et al. · 2013 [cited by applicant]
US 8942426B2 · Bar-Am · 2015 [cited by applicant]
US 10029708B2 · Viviani · 2018 [cited by applicant]
US 10597053B2 · Mian et al. · 2020 [cited by applicant]
US 12020148B1 · Mills et al. · 2024 [cited by applicant]
US 20020188593A1 · Moser et al. · 2002 [cited by applicant]
US 20050125113A1 · Wheeler et al. · 2005 [cited by applicant]
US 20080086393A1 · Naghshiineh et al. · 2008 [cited by applicant]
US 20090015400A1 · Breed · 2009 [cited by applicant]
US 20100063734A1 · Kumar · 2010 [cited by applicant]
US 20120130562A1 · Brand et al. · 2012 [cited by applicant]
US 20150201165A1 · Bocionek et al. · 2015 [cited by applicant]
US 20170001653A1 · Ferencz, Jr. et al. · 2017 [cited by applicant]
US 20170032316A1 · Benedict · 2017 [cited by applicant]
US 20170154347A1 · Bateman · 2017 [cited by applicant]
US 20190311625A1 · Anvari · 2019 [cited by examiner]
US 20200125877A1 · Phan et al. · 2020 [cited by applicant]
US 20200265377A1 · Al Dhaheri et al. · 2020 [cited by applicant]
US 20240029092A1 · Simpson · 2024 [cited by applicant]
US 20240354687A1 · Mills et al. · 2024 [cited by applicant]
US 20240354690A1 · Mills et al. · 2024 [cited by applicant]
CN 107364434 · 2017 [cited by applicant]
CN 110457420 · 2019 [cited by applicant]
EP 3275764 · 2018 [cited by applicant]
RU 2630859 · 2017 [cited by applicant]
WO WO2016191711 · 2016 [cited by applicant]
U.S. Appl. No. 16/951,015, filed Nov. 18, 2020, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 18/060,162, filed Nov. 30, 2022, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 62/936,715, filed Nov. 18, 2019, Mark D. Mills. [cited by applicant]
U.S. Appl. No. 16/951,015, dated Dec. 5, 2023, Office Action issued by the U.S. Patent and Trademark Office. [cited by applicant]
U.S. Appl. No. 16/951,015, dated Apr. 29, 2024, Notice of Allowance issued by the U.S. Patent and Trademark Office. [cited by applicant]
U.S. Appl. No. 18/744,198, filed Jun. 14, 2024, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 18/748,961, filed Jun. 20, 2024, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 63/284,071, filed Nov. 30, 2021, Mark D. Mills et al. [cited by applicant]
U.S. Appl. No. 18/744,198, filed Jun. 14, 2024, Mills et al. [cited by applicant]
Jung et al., “Real-time car tracking system based on surveillance videos,” EURASIP Journal on Image and Video Processing, 2018; 2018(1): pp. 1-13. [cited by applicant]
U.S. Appl. No. 18/744,198, dated Oct. 18, 2024, Office Action issued by the U.S. Patent and Trademark Office. [cited by applicant]
U.S. Appl. No. 18/748,961, dated Oct. 8, 2024, Office Action issued by the U.S. Patent and Trademark Office. [cited by applicant]